Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9242 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30045 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37198 originally caused by: Started by upstream project "master-osmo-iuh" build number 12852 originally caused by: Started by upstream project "master-libasn1c" build number 1806 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37199 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29268 originally caused by: Started by upstream project "master-osmo-msc" build number 34215 originally caused by: Started by upstream project "master-osmo-iuh" build number 12852 originally caused by: Started by upstream project "master-libasn1c" build number 1806 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17658 originally caused by: Started by upstream project "master-osmo-bsc" build number 20113 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12971 originally caused by: Started by upstream project "master-openbsc" build number 13167 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29269 originally caused by: Started by upstream project "master-osmo-msc" build number 34216 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34217 originally caused by: Started by upstream project "master-osmo-iuh" build number 12853 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30046 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37200 originally caused by: Started by upstream project "master-osmo-iuh" build number 12853 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9112 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17659 originally caused by: Started by upstream project "master-osmo-bsc" build number 20114 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17659 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2955 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29269 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5151 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12971 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9242 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5190 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3908 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins9490231211391664701.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 08:20:25 + trial_dir_prefix=trial- + rm -rf trial-2371 trial-2371-bin.tgz trial-2371-run.tgz + trial_dir=trial-2372 + mkdir -p trial-2372 + mv open5gs.build-8.tgz osmo-bsc.build-17659.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2955.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29269.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30046.tgz osmo-stp.build-9242.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2372 + cat open5gs.build-8.md5 osmo-bsc.build-17659.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2955.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29269.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30046.md5 osmo-stp.build-9242.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17659.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2955.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29269.md5 osmo-nitb.build-12971.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30046.md5 osmo-stp.build-9242.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2372 combinations: None trial: 'trial-2372' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2372 -------------------------------------------------------------------------------------------- 08:20:36.561297 tst trial-2372: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/log --------------------------------------------------------------------- trial-2372 nitb_sms:sysmo --------------------------------------------------------------------- 08:22:43.603649 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:22:43.607166 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 08:22:43.628336 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 08:22:43.635468 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 08:22:43.691689 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 08:22:43.712492 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 08:22:43.719422 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 08:22:44.258690 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:22:44.263523 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 08:22:44.274791 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 08:22:44.648834 tst mo_mt_sms.py: using LAC 27096 08:22:44.886607 tst mo_mt_sms.py: using RAC 66 08:22:45.005398 tst mo_mt_sms.py: using CellId 27096 08:22:45.123148 tst mo_mt_sms.py: using BVCI 27097 08:22:45.231994 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:22:45.413942 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 08:22:45.531695 tst mo_mt_sms.py:9: start nitb and bts... 08:22:45.738668 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:22:48.077031 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16396): Launched 08:22:48.388458 run osmo-nitb_10.42.42.2(pid=16397): Launched 08:22:48.556472 run osmo-nitb_10.42.42.2(pid=16397): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16397)] 08:22:48.683369 run osmo-nitb_10.42.42.2(pid=16397): stdout: | (launched: 2022-12-10_08:22:48.329878) 08:22:48.811318 run osmo-nitb_10.42.42.2(pid=16397): stderr: | (launched: 2022-12-10_08:22:48.375946) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:22:48.939878 run osmo-nitb_10.42.42.2(pid=16397): stdout: | (launched: 2022-12-10_08:22:48.329878) 08:22:49.061768 run osmo-nitb_10.42.42.2(pid=16397): stderr: | (launched: 2022-12-10_08:22:48.375946) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:22:49.208050 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16397) [trial-2372↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16397)] [trial-2372↪nitb_sms:sysmo↪mo_mt_sms.py:11] 08:22:49.216308 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 08:22:49.222879 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16396): Terminating (SIGTERM) 08:22:49.432356 --- ParallelTerminationStrategy: PID 16396 died... 08:22:49.453618 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16396): Terminated: ok {rc=0} 08:22:49.540423 bus /sierra_3: Setting Powered False 08:22:50.641810 bus /sierra_3: Setting Powered False 08:22:51.760412 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:sysmo --------------------------------------------------------------------- 08:22:52.939735 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:22:52.943644 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 08:22:52.964473 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 08:22:52.991961 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 08:22:53.046386 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 08:22:53.067183 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 08:22:53.093962 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 08:22:53.643867 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:sysmo mo_mt_sms.py ---------------------------------------------- 08:22:53.649379 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:53.660753 tst sms:sysmo: Using 1 x bts (candidates: 1) 08:22:53.696025 tst mo_mt_sms.py: using LAC 27097 08:22:53.829117 tst mo_mt_sms.py: using RAC 67 08:22:53.956058 tst mo_mt_sms.py: using CellId 27097 08:22:54.082359 tst mo_mt_sms.py: using BVCI 27098 08:22:54.201044 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:54.212127 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:54.223134 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:54.234103 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:54.245147 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 08:22:54.256245 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:22:54.377373 tst sms:sysmo: Using 1 x modem (candidates: 2) 08:22:54.498616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:22:56.207442 run create_hlr_db(pid=16402): Launched 08:22:56.329154 bus /sierra_2: Setting Powered False 08:22:57.390588 run create_hlr_db(pid=16402): Terminated: ok {rc=0} 08:22:57.843762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16404): Launched 08:22:58.174924 run osmo-hlr_10.42.42.2(pid=16405): Launched 08:22:58.300670 run osmo-stp_10.42.42.5: Starting osmo-stp 08:23:00.872398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16407): Launched 08:23:01.213632 run osmo-stp_10.42.42.5(pid=16408): Launched 08:23:01.439979 run osmo-msc_10.42.42.6: Starting osmo-msc 08:23:06.812820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16410): Launched 08:23:07.122227 run osmo-msc_10.42.42.6(pid=16411): Launched 08:23:07.294733 run osmo-stp_10.42.42.5(pid=16408): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16408)] 08:23:07.426029 run osmo-stp_10.42.42.5(pid=16408): stdout: | (launched: 2022-12-10_08:23:01.148470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:07.556667 run osmo-stp_10.42.42.5(pid=16408): stderr: | 20221210082301486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082301486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082301486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082301487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082301487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082301487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082301487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:07.685423 run osmo-stp_10.42.42.5(pid=16408): stdout: | (launched: 2022-12-10_08:23:01.148470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:07.807746 run osmo-stp_10.42.42.5(pid=16408): stderr: | 20221210082301486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082301486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082301486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082301487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082301487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082301487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082301487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:07.954258 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16408): Process ended prematurely: osmo-stp_10.42.42.5(pid=16408) [trial-2372↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16408)] [trial-2372↪sms:sysmo↪mo_mt_sms.py:16] 08:23:07.962538 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 08:23:07.988515 run osmo-hlr_10.42.42.2(pid=16405): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16405)] 08:23:08.036527 run osmo-hlr_10.42.42.2(pid=16405): stdout: | (launched: 2022-12-10_08:22:58.112829) 08:23:08.086313 run osmo-hlr_10.42.42.2(pid=16405): stderr: | 20221210082258318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082258318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082258318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082258318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082258318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082258318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082258331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082258339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082258340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082258340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:23:08.155377 run osmo-msc_10.42.42.6(pid=16411): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16411)] 08:23:08.203348 run osmo-msc_10.42.42.6(pid=16411): stdout: | (launched: 2022-12-10_08:23:07.063832) 08:23:08.253340 run osmo-msc_10.42.42.6(pid=16411): stderr: | 20221210082307338 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082307338 DLGLOBAL DEBUG validating counter group 0x7ff52bde7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082307338 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082307338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082307338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082307338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082307340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082307341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082307341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082307341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:23:08.303375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16404): Terminating (SIGTERM) 08:23:08.343451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16407): Terminating (SIGTERM) 08:23:08.383991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16410): Terminating (SIGTERM) 08:23:08.424032 --- ParallelTerminationStrategy: PID 16404 died... 08:23:08.443497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16404): Terminated: ok {rc=0} 08:23:08.488196 --- ParallelTerminationStrategy: PID 16407 died... 08:23:08.506795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16407): Terminated: ok {rc=0} 08:23:08.551689 --- ParallelTerminationStrategy: PID 16410 died... 08:23:08.570351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16410): Terminated: ok {rc=0} 08:23:08.656379 bus /sierra_3: Setting Powered False 08:23:09.757208 bus /sierra_3: Setting Powered False 08:23:10.873841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:sysmo --------------------------------------------------------------------- 08:23:12.089099 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:23:12.092666 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:23:12.114854 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 08:23:12.122033 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:23:12.157706 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:23:12.178798 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 08:23:12.186051 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:23:12.708600 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 08:23:12.715195 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 08:23:12.726524 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 08:23:12.760894 tst assert_extension.py: using LAC 27098 08:23:12.883420 tst assert_extension.py: using RAC 68 08:23:13.004418 tst assert_extension.py: using CellId 27098 08:23:13.126809 tst assert_extension.py: using BVCI 27099 08:23:13.241154 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 08:23:13.361089 tst assert_extension.py:10: start nitb and bts... 08:23:13.584025 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:23:14.255929 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16416): Launched 08:23:14.586987 run osmo-nitb_10.42.42.2(pid=16417): Launched 08:23:14.774996 run osmo-nitb_10.42.42.2(pid=16417): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16417)] 08:23:14.932920 run osmo-nitb_10.42.42.2(pid=16417): stdout: | (launched: 2022-12-10_08:23:14.524610) 08:23:15.080748 run osmo-nitb_10.42.42.2(pid=16417): stderr: | (launched: 2022-12-10_08:23:14.573922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:23:15.228763 run osmo-nitb_10.42.42.2(pid=16417): stdout: | (launched: 2022-12-10_08:23:14.524610) 08:23:15.371272 run osmo-nitb_10.42.42.2(pid=16417): stderr: | (launched: 2022-12-10_08:23:14.573922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16417): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16417) [trial-2372↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16417)] 08:23:15.710413 tst osmo-nitb_10.42.42.2(pid=16417): stdout: | (launched: 2022-12-10_08:23:14.524610) 08:23:15.854340 tst osmo-nitb_10.42.42.2(pid=16417): stderr: | (launched: 2022-12-10_08:23:14.573922) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:23:16.009608 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16417): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16417) [trial-2372↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16417)] [trial-2372↪nitb_ussd:sysmo↪assert_extension.py:12] 08:23:16.018869 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:23:16.026751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16416): Terminating (SIGTERM) 08:23:16.240805 --- ParallelTerminationStrategy: PID 16416 died... 08:23:16.260677 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16416): Terminated: ok {rc=0} 08:23:16.381205 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:sysmo --------------------------------------------------------------------- 08:23:17.606617 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:23:17.611185 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 08:23:17.643925 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 08:23:17.686757 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 08:23:17.730290 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 08:23:17.763644 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 08:23:17.807740 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 08:23:18.340875 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:sysmo assert_extension.py ---------------------------------------------- 08:23:18.347883 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:18.364293 tst ussd:sysmo: Using 1 x bts (candidates: 1) 08:23:18.411917 tst assert_extension.py: using LAC 27099 08:23:18.574494 tst assert_extension.py: using RAC 69 08:23:18.728546 tst assert_extension.py: using CellId 27099 08:23:18.883213 tst assert_extension.py: using BVCI 27100 08:23:19.031477 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:19.046632 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:19.062550 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:19.075458 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:19.087560 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 08:23:19.099987 tst ussd:sysmo: Using 1 x modem (candidates: 1) 08:23:19.221252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:23:19.724070 run create_hlr_db(pid=16691): Launched 08:23:19.949457 bus /sierra_2: Setting Powered False 08:23:21.010166 run create_hlr_db(pid=16691): Terminated: ok {rc=0} 08:23:21.651555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16695): Launched 08:23:21.986717 run osmo-hlr_10.42.42.2(pid=16696): Launched 08:23:22.234075 run osmo-stp_10.42.42.5: Starting osmo-stp 08:23:22.977761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16698): Launched 08:23:23.312238 run osmo-stp_10.42.42.5(pid=16699): Launched 08:23:23.559649 run osmo-msc_10.42.42.6: Starting osmo-msc 08:23:24.301336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16701): Launched 08:23:24.650675 run osmo-msc_10.42.42.6(pid=16702): Launched 08:23:25.018257 run osmo-stp_10.42.42.5(pid=16699): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16699)] 08:23:25.306497 run osmo-stp_10.42.42.5(pid=16699): stdout: | (launched: 2022-12-10_08:23:23.248590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:25.475820 run osmo-stp_10.42.42.5(pid=16699): stderr: | 20221210082323588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082323588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082323588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082323588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082323597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082323597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082323597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:25.617110 run osmo-stp_10.42.42.5(pid=16699): stdout: | (launched: 2022-12-10_08:23:23.248590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:25.751867 run osmo-stp_10.42.42.5(pid=16699): stderr: | 20221210082323588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082323588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082323588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082323588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082323597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082323597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082323597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:25.912709 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16699): Process ended prematurely: osmo-stp_10.42.42.5(pid=16699) [trial-2372↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16699)] [trial-2372↪ussd:sysmo↪assert_extension.py:17] 08:23:25.922692 tst assert_extension.py:17: Test FAILED (7.6 sec) 08:23:25.951851 run osmo-hlr_10.42.42.2(pid=16696): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16696)] 08:23:26.005197 run osmo-hlr_10.42.42.2(pid=16696): stdout: | (launched: 2022-12-10_08:23:21.924515) 08:23:26.059603 run osmo-hlr_10.42.42.2(pid=16696): stderr: | 20221210082322277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082322277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082322277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082322277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082322277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082322277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082322356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082322372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082322372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082322372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:23:26.135148 run osmo-msc_10.42.42.6(pid=16702): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16702)] 08:23:26.188363 run osmo-msc_10.42.42.6(pid=16702): stdout: | (launched: 2022-12-10_08:23:24.586081) 08:23:26.243095 run osmo-msc_10.42.42.6(pid=16702): stderr: | 20221210082325091 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082325091 DLGLOBAL DEBUG validating counter group 0x7ff2c5b88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082325091 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082325091 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082325091 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082325091 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082325097 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082325098 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082325098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082325098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:23:26.297422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16695): Terminating (SIGTERM) 08:23:26.341486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16698): Terminating (SIGTERM) 08:23:26.386126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16701): Terminating (SIGTERM) 08:23:26.432259 --- ParallelTerminationStrategy: PID 16695 died... 08:23:26.453535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16695): Terminated: ok {rc=0} 08:23:26.502929 --- ParallelTerminationStrategy: PID 16698 died... 08:23:26.524161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16698): Terminated: ok {rc=0} 08:23:26.571761 --- ParallelTerminationStrategy: PID 16701 died... 08:23:26.592190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16701): Terminated: ok {rc=0} 08:23:26.682652 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:23:27.880358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:23:27.887628 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:23:27.913187 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:23:27.943824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:23:27.996839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:23:28.018799 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:23:28.048888 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:23:28.598749 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:23:28.655678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:28.668359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:23:28.729439 tst mo_mt_call.py: using LAC 27100 08:23:28.861778 tst mo_mt_call.py: using RAC 70 08:23:28.991035 tst mo_mt_call.py: using CellId 27100 08:23:29.120512 tst mo_mt_call.py: using BVCI 27101 08:23:29.241665 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:29.254507 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:29.266601 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:29.279311 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:29.292210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:29.306308 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:23:29.433358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:23:29.558127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:23:30.070693 run create_hlr_db(pid=16707): Launched 08:23:30.237535 bus /sierra_2: Setting Powered False 08:23:31.336878 run create_hlr_db(pid=16707): Terminated: ok {rc=0} 08:23:31.845020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Launched 08:23:32.214028 run osmo-hlr_10.42.42.2(pid=16710): Launched 08:23:32.523795 run osmo-stp_10.42.42.5: Starting osmo-stp 08:23:33.300861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Launched 08:23:33.653732 run osmo-stp_10.42.42.5(pid=16713): Launched 08:23:33.906787 run osmo-msc_10.42.42.6: Starting osmo-msc 08:23:34.609156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16715): Launched 08:23:34.962157 run osmo-msc_10.42.42.6(pid=16716): Launched 08:23:35.338193 run osmo-stp_10.42.42.5(pid=16713): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] 08:23:35.624012 run osmo-stp_10.42.42.5(pid=16713): stdout: | (launched: 2022-12-10_08:23:33.588420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:35.793101 run osmo-stp_10.42.42.5(pid=16713): stderr: | 20221210082333885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082333886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082333886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082333886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082333887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082333887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082333887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:35.934812 run osmo-stp_10.42.42.5(pid=16713): stdout: | (launched: 2022-12-10_08:23:33.588420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:36.072433 run osmo-stp_10.42.42.5(pid=16713): stderr: | 20221210082333885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082333886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082333886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082333886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082333887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082333887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082333887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:36.235649 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16713): Process ended prematurely: osmo-stp_10.42.42.5(pid=16713) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:23:36.246133 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 08:23:36.275025 run osmo-hlr_10.42.42.2(pid=16710): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16710)] 08:23:36.326636 run osmo-hlr_10.42.42.2(pid=16710): stdout: | (launched: 2022-12-10_08:23:32.149935) 08:23:36.380249 run osmo-hlr_10.42.42.2(pid=16710): stderr: | 20221210082332476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082332476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082332476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082332476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082332476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082332476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082332504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082332521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082332521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082332529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:23:36.454618 run osmo-msc_10.42.42.6(pid=16716): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16716)] 08:23:36.506761 run osmo-msc_10.42.42.6(pid=16716): stdout: | (launched: 2022-12-10_08:23:34.897536) 08:23:36.560344 run osmo-msc_10.42.42.6(pid=16716): stderr: | 20221210082335403 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082335403 DLGLOBAL DEBUG validating counter group 0x7f9555655c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082335403 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082335403 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082335403 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082335404 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082335410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082335410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082335410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082335410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:23:36.615024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Terminating (SIGTERM) 08:23:36.658364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Terminating (SIGTERM) 08:23:36.702435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16715): Terminating (SIGTERM) 08:23:36.748116 --- ParallelTerminationStrategy: PID 16709 died... 08:23:36.769116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16709): Terminated: ok {rc=0} 08:23:36.817993 --- ParallelTerminationStrategy: PID 16712 died... 08:23:36.838577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16712): Terminated: ok {rc=0} 08:23:36.886393 --- ParallelTerminationStrategy: PID 16715 died... 08:23:36.907013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16715): Terminated: ok {rc=0} 08:23:36.998240 bus /sierra_3: Setting Powered False 08:23:38.101270 bus /sierra_3: Setting Powered False 08:23:39.218770 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:23:40.369236 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.381257 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:23:40.438619 tst mo_mt_call_osmux.py: using LAC 27101 08:23:40.564908 tst mo_mt_call_osmux.py: using RAC 71 08:23:40.690768 tst mo_mt_call_osmux.py: using CellId 27101 08:23:40.817098 tst mo_mt_call_osmux.py: using BVCI 27102 08:23:40.933989 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.945212 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.956156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.967414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.978660 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:23:40.989884 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:23:41.108693 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:23:41.232080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:23:41.755150 run create_hlr_db(pid=16719): Launched 08:23:41.891339 bus /sierra_2: Setting Powered False 08:23:42.956838 run create_hlr_db(pid=16719): Terminated: ok {rc=0} 08:23:43.423093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16721): Launched 08:23:43.760433 run osmo-hlr_10.42.42.2(pid=16722): Launched 08:23:43.888587 run osmo-stp_10.42.42.5: Starting osmo-stp 08:23:44.469382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16724): Launched 08:23:44.806582 run osmo-stp_10.42.42.5(pid=16725): Launched 08:23:44.933743 run osmo-msc_10.42.42.6: Starting osmo-msc 08:23:45.540850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16727): Launched 08:23:45.901613 run osmo-msc_10.42.42.6(pid=16728): Launched 08:23:46.286109 run osmo-stp_10.42.42.5(pid=16725): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16725)] 08:23:46.691301 run osmo-stp_10.42.42.5(pid=16725): stdout: | (launched: 2022-12-10_08:23:44.743715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:46.935743 run osmo-stp_10.42.42.5(pid=16725): stderr: | 20221210082344940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082344941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082344941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082344941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082344943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082344944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082344944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:47.078220 run osmo-stp_10.42.42.5(pid=16725): stdout: | (launched: 2022-12-10_08:23:44.743715) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:47.214750 run osmo-stp_10.42.42.5(pid=16725): stderr: | 20221210082344940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082344941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082344941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082344941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082344943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082344944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082344944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:47.376609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16725): Process ended prematurely: osmo-stp_10.42.42.5(pid=16725) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16725)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:23:47.386154 tst mo_mt_call_osmux.py:8: Test FAILED (7.1 sec) 08:23:47.414091 run osmo-hlr_10.42.42.2(pid=16722): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16722)] 08:23:47.465170 run osmo-hlr_10.42.42.2(pid=16722): stdout: | (launched: 2022-12-10_08:23:43.697542) 08:23:47.518301 run osmo-hlr_10.42.42.2(pid=16722): stderr: | 20221210082343898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082343898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082343898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082343898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082343898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082343898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082343910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082343919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082343919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082343919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:23:47.591880 run osmo-msc_10.42.42.6(pid=16728): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16728)] 08:23:47.643094 run osmo-msc_10.42.42.6(pid=16728): stdout: | (launched: 2022-12-10_08:23:45.815973) 08:23:47.695835 run osmo-msc_10.42.42.6(pid=16728): stderr: | 20221210082346521 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082346522 DLGLOBAL DEBUG validating counter group 0x7f8e9bc17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082346522 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082346522 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082346523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082346523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082346528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082346530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082346530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082346530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:23:47.748563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16721): Terminating (SIGTERM) 08:23:47.790537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16724): Terminating (SIGTERM) 08:23:47.832672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16727): Terminating (SIGTERM) 08:23:47.874998 --- ParallelTerminationStrategy: PID 16721 died... 08:23:47.895175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16721): Terminated: ok {rc=0} 08:23:47.941798 --- ParallelTerminationStrategy: PID 16724 died... 08:23:47.961497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16724): Terminated: ok {rc=0} 08:23:48.008128 --- ParallelTerminationStrategy: PID 16727 died... 08:23:48.027804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16727): Terminated: ok {rc=0} 08:23:48.116744 bus /sierra_3: Setting Powered False 08:23:49.217794 bus /sierra_3: Setting Powered False 08:23:50.335746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:23:51.570885 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:23:51.577268 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:23:51.598742 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:23:51.625728 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:23:51.678836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:23:51.700028 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:23:51.727237 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:23:52.280491 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:23:52.331610 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.342904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:23:52.402643 tst mo_mt_call.py: using LAC 27102 08:23:52.525248 tst mo_mt_call.py: using RAC 72 08:23:52.647397 tst mo_mt_call.py: using CellId 27102 08:23:52.771249 tst mo_mt_call.py: using BVCI 27103 08:23:52.887609 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.898843 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.909786 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.921212 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.932576 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:23:52.943980 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:23:53.063564 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:23:53.184112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:23:53.707291 run create_hlr_db(pid=16733): Launched 08:23:53.843557 bus /sierra_2: Setting Powered False 08:23:54.907412 run create_hlr_db(pid=16733): Terminated: ok {rc=0} 08:23:55.357089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Launched 08:23:55.673590 run osmo-hlr_10.42.42.2(pid=16736): Launched 08:23:55.793804 run osmo-stp_10.42.42.5: Starting osmo-stp 08:23:56.352258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Launched 08:23:56.668883 run osmo-stp_10.42.42.5(pid=16739): Launched 08:23:56.790199 run osmo-msc_10.42.42.6: Starting osmo-msc 08:23:57.360331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16741): Launched 08:23:57.677819 run osmo-msc_10.42.42.6(pid=16742): Launched 08:23:57.853170 run osmo-stp_10.42.42.5(pid=16739): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16739)] 08:23:57.986355 run osmo-stp_10.42.42.5(pid=16739): stdout: | (launched: 2022-12-10_08:23:56.609485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:58.119392 run osmo-stp_10.42.42.5(pid=16739): stderr: | 20221210082356786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082356786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082356786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082356787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082356787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082356787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082356787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:58.250423 run osmo-stp_10.42.42.5(pid=16739): stdout: | (launched: 2022-12-10_08:23:56.609485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:23:58.375604 run osmo-stp_10.42.42.5(pid=16739): stderr: | 20221210082356786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082356786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082356786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082356787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082356787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082356787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082356787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:23:58.525790 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16739): Process ended prematurely: osmo-stp_10.42.42.5(pid=16739) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16739)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:23:58.534796 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:23:58.561537 run osmo-hlr_10.42.42.2(pid=16736): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16736)] 08:23:58.609409 run osmo-hlr_10.42.42.2(pid=16736): stdout: | (launched: 2022-12-10_08:23:55.614413) 08:23:58.659000 run osmo-hlr_10.42.42.2(pid=16736): stderr: | 20221210082355794 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082355794 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082355794 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082355794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082355794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082355794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082355807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082355815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082355815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082355815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:23:58.727482 run osmo-msc_10.42.42.6(pid=16742): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16742)] 08:23:58.775179 run osmo-msc_10.42.42.6(pid=16742): stdout: | (launched: 2022-12-10_08:23:57.618048) 08:23:58.825200 run osmo-msc_10.42.42.6(pid=16742): stderr: | 20221210082357895 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082357895 DLGLOBAL DEBUG validating counter group 0x7f9890e2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082357895 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082357895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082357895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082357895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082357897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082357898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082357898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082357898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:23:58.875025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Terminating (SIGTERM) 08:23:58.914959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Terminating (SIGTERM) 08:23:58.954649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16741): Terminating (SIGTERM) 08:23:58.994473 --- ParallelTerminationStrategy: PID 16735 died... 08:23:59.013445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16735): Terminated: ok {rc=0} 08:23:59.057949 --- ParallelTerminationStrategy: PID 16738 died... 08:23:59.076336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16738): Terminated: ok {rc=0} 08:23:59.120902 --- ParallelTerminationStrategy: PID 16741 died... 08:23:59.139821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16741): Terminated: ok {rc=0} 08:23:59.227274 bus /sierra_3: Setting Powered False 08:24:00.327096 bus /sierra_3: Setting Powered False 08:24:01.450770 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:24:02.618850 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:02.631079 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:24:02.689707 tst mo_mt_call_osmux.py: using LAC 27103 08:24:02.822843 tst mo_mt_call_osmux.py: using RAC 73 08:24:02.956660 tst mo_mt_call_osmux.py: using CellId 27103 08:24:03.089374 tst mo_mt_call_osmux.py: using BVCI 27104 08:24:03.211802 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:03.223459 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:03.234864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:03.246281 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:03.257640 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:24:03.269142 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:24:03.388336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:24:03.509421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:04.003764 run create_hlr_db(pid=16744): Launched 08:24:04.125488 bus /sierra_2: Setting Powered False 08:24:05.187883 run create_hlr_db(pid=16744): Terminated: ok {rc=0} 08:24:05.649112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Launched 08:24:05.986478 run osmo-hlr_10.42.42.2(pid=16747): Launched 08:24:06.115663 run osmo-stp_10.42.42.5: Starting osmo-stp 08:24:06.696942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Launched 08:24:07.037102 run osmo-stp_10.42.42.5(pid=16750): Launched 08:24:07.165144 run osmo-msc_10.42.42.6: Starting osmo-msc 08:24:07.774388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16752): Launched 08:24:08.110588 run osmo-msc_10.42.42.6(pid=16753): Launched 08:24:08.297531 run osmo-stp_10.42.42.5(pid=16750): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16750)] 08:24:08.437283 run osmo-stp_10.42.42.5(pid=16750): stdout: | (launched: 2022-12-10_08:24:06.974543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:08.578847 run osmo-stp_10.42.42.5(pid=16750): stderr: | 20221210082407170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082407170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082407170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082407171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082407171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082407171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082407171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:08.718837 run osmo-stp_10.42.42.5(pid=16750): stdout: | (launched: 2022-12-10_08:24:06.974543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:08.852147 run osmo-stp_10.42.42.5(pid=16750): stderr: | 20221210082407170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082407170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082407170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082407171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082407171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082407171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082407171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:09.011776 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16750): Process ended prematurely: osmo-stp_10.42.42.5(pid=16750) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16750)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:24:09.021145 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:24:09.048758 run osmo-hlr_10.42.42.2(pid=16747): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16747)] 08:24:09.098616 run osmo-hlr_10.42.42.2(pid=16747): stdout: | (launched: 2022-12-10_08:24:05.923566) 08:24:09.150131 run osmo-hlr_10.42.42.2(pid=16747): stderr: | 20221210082406127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082406127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082406127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082406127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082406127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082406128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082406140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082406150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082406151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082406151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:24:09.221774 run osmo-msc_10.42.42.6(pid=16753): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16753)] 08:24:09.271669 run osmo-msc_10.42.42.6(pid=16753): stdout: | (launched: 2022-12-10_08:24:08.047586) 08:24:09.323518 run osmo-msc_10.42.42.6(pid=16753): stderr: | 20221210082408376 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082408376 DLGLOBAL DEBUG validating counter group 0x7f72c98e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082408377 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082408377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082408377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082408377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082408379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082408379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082408379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082408379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:24:09.375412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Terminating (SIGTERM) 08:24:09.417000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Terminating (SIGTERM) 08:24:09.458592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16752): Terminating (SIGTERM) 08:24:09.500372 --- ParallelTerminationStrategy: PID 16746 died... 08:24:09.520505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16746): Terminated: ok {rc=0} 08:24:09.567136 --- ParallelTerminationStrategy: PID 16749 died... 08:24:09.586705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16749): Terminated: ok {rc=0} 08:24:09.632504 --- ParallelTerminationStrategy: PID 16752 died... 08:24:09.651930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16752): Terminated: ok {rc=0} 08:24:09.739376 bus /sierra_3: Setting Powered False 08:24:10.838689 bus /sierra_3: Setting Powered False 08:24:11.954650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:24:13.198433 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:24:13.205336 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:24:13.226880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:24:13.254381 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:24:13.307521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:24:13.329686 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:24:13.357298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:24:13.906968 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:24:13.958198 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:13.969344 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:24:14.023633 tst mo_mt_call.py: using LAC 27104 08:24:14.146038 tst mo_mt_call.py: using RAC 74 08:24:14.271262 tst mo_mt_call.py: using CellId 27104 08:24:14.399713 tst mo_mt_call.py: using BVCI 27105 08:24:14.524119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:14.536893 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:14.548495 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:14.560061 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:14.571822 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:14.583318 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:24:14.702195 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:24:14.822841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:15.348274 run create_hlr_db(pid=16759): Launched 08:24:15.483543 bus /sierra_2: Setting Powered False 08:24:16.548574 run create_hlr_db(pid=16759): Terminated: ok {rc=0} 08:24:17.027876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16761): Launched 08:24:17.376549 run osmo-hlr_10.42.42.2(pid=16762): Launched 08:24:17.505481 run osmo-stp_10.42.42.5: Starting osmo-stp 08:24:18.086150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16764): Launched 08:24:18.422379 run osmo-stp_10.42.42.5(pid=16765): Launched 08:24:18.550573 run osmo-msc_10.42.42.6: Starting osmo-msc 08:24:19.161177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16767): Launched 08:24:19.498876 run osmo-msc_10.42.42.6(pid=16768): Launched 08:24:19.686925 run osmo-stp_10.42.42.5(pid=16765): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16765)] 08:24:19.828221 run osmo-stp_10.42.42.5(pid=16765): stdout: | (launched: 2022-12-10_08:24:18.359312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:19.970047 run osmo-stp_10.42.42.5(pid=16765): stderr: | 20221210082418556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082418556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082418557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082418557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082418560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082418560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082418560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:20.110251 run osmo-stp_10.42.42.5(pid=16765): stdout: | (launched: 2022-12-10_08:24:18.359312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:20.243552 run osmo-stp_10.42.42.5(pid=16765): stderr: | 20221210082418556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082418556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082418557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082418557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082418560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082418560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082418560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:20.403391 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16765): Process ended prematurely: osmo-stp_10.42.42.5(pid=16765) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16765)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:24:20.412624 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:24:20.440510 run osmo-hlr_10.42.42.2(pid=16762): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16762)] 08:24:20.491356 run osmo-hlr_10.42.42.2(pid=16762): stdout: | (launched: 2022-12-10_08:24:17.313957) 08:24:20.543828 run osmo-hlr_10.42.42.2(pid=16762): stderr: | 20221210082417514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082417514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082417514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082417514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082417514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082417514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082417527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082417535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082417536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082417536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:24:20.616260 run osmo-msc_10.42.42.6(pid=16768): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16768)] 08:24:20.666701 run osmo-msc_10.42.42.6(pid=16768): stdout: | (launched: 2022-12-10_08:24:19.435721) 08:24:20.718826 run osmo-msc_10.42.42.6(pid=16768): stderr: | 20221210082419765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082419765 DLGLOBAL DEBUG validating counter group 0x7f8d7f1a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082419765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082419765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082419766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082419766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082419767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082419768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082419768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082419768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:24:20.771213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16761): Terminating (SIGTERM) 08:24:20.812758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16764): Terminating (SIGTERM) 08:24:20.854688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16767): Terminating (SIGTERM) 08:24:20.896658 --- ParallelTerminationStrategy: PID 16761 died... 08:24:20.916615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16761): Terminated: ok {rc=0} 08:24:20.963463 --- ParallelTerminationStrategy: PID 16764 died... 08:24:20.983058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16764): Terminated: ok {rc=0} 08:24:21.029088 --- ParallelTerminationStrategy: PID 16767 died... 08:24:21.048550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16767): Terminated: ok {rc=0} 08:24:21.136323 bus /sierra_3: Setting Powered False 08:24:22.236135 bus /sierra_3: Setting Powered False 08:24:23.351913 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:24:24.504508 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:24.516832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:24:24.576730 tst mo_mt_call_osmux.py: using LAC 27105 08:24:24.719053 tst mo_mt_call_osmux.py: using RAC 75 08:24:24.862700 tst mo_mt_call_osmux.py: using CellId 27105 08:24:24.991121 tst mo_mt_call_osmux.py: using BVCI 27106 08:24:25.108356 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:25.119757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:25.130788 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:25.142262 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:25.153679 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:24:25.164920 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:24:25.283442 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:24:25.402371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:25.897387 run create_hlr_db(pid=16770): Launched 08:24:26.017800 bus /sierra_2: Setting Powered False 08:24:27.080291 run create_hlr_db(pid=16770): Terminated: ok {rc=0} 08:24:27.539761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16772): Launched 08:24:27.878694 run osmo-hlr_10.42.42.2(pid=16773): Launched 08:24:28.007477 run osmo-stp_10.42.42.5: Starting osmo-stp 08:24:28.589569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16775): Launched 08:24:28.927394 run osmo-stp_10.42.42.5(pid=16776): Launched 08:24:29.055884 run osmo-msc_10.42.42.6: Starting osmo-msc 08:24:29.667008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16778): Launched 08:24:30.005091 run osmo-msc_10.42.42.6(pid=16779): Launched 08:24:30.192573 run osmo-stp_10.42.42.5(pid=16776): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16776)] 08:24:30.333993 run osmo-stp_10.42.42.5(pid=16776): stdout: | (launched: 2022-12-10_08:24:28.864150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:30.476792 run osmo-stp_10.42.42.5(pid=16776): stderr: | 20221210082429059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082429059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082429060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082429060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082429061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082429061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082429061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:30.617249 run osmo-stp_10.42.42.5(pid=16776): stdout: | (launched: 2022-12-10_08:24:28.864150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:30.750939 run osmo-stp_10.42.42.5(pid=16776): stderr: | 20221210082429059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082429059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082429060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082429060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082429061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082429061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082429061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:30.912775 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16776): Process ended prematurely: osmo-stp_10.42.42.5(pid=16776) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16776)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:24:30.923216 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:24:30.956245 run osmo-hlr_10.42.42.2(pid=16773): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16773)] 08:24:31.007147 run osmo-hlr_10.42.42.2(pid=16773): stdout: | (launched: 2022-12-10_08:24:27.815510) 08:24:31.060370 run osmo-hlr_10.42.42.2(pid=16773): stderr: | 20221210082428019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082428019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082428019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082428020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082428020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082428020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082428032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082428043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082428043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082428043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:24:31.133918 run osmo-msc_10.42.42.6(pid=16779): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16779)] 08:24:31.185277 run osmo-msc_10.42.42.6(pid=16779): stdout: | (launched: 2022-12-10_08:24:29.941816) 08:24:31.238060 run osmo-msc_10.42.42.6(pid=16779): stderr: | 20221210082430267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082430267 DLGLOBAL DEBUG validating counter group 0x7f7cdb856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082430267 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082430268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082430268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082430268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082430270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082430270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082430270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082430270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:24:31.291153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16772): Terminating (SIGTERM) 08:24:31.334050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16775): Terminating (SIGTERM) 08:24:31.377543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16778): Terminating (SIGTERM) 08:24:31.422669 --- ParallelTerminationStrategy: PID 16772 died... 08:24:31.443133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16772): Terminated: ok {rc=0} 08:24:31.491497 --- ParallelTerminationStrategy: PID 16775 died... 08:24:31.511516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16775): Terminated: ok {rc=0} 08:24:31.558907 --- ParallelTerminationStrategy: PID 16778 died... 08:24:31.579133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16778): Terminated: ok {rc=0} 08:24:31.678893 bus /sierra_3: Setting Powered False 08:24:32.778005 bus /sierra_3: Setting Powered False 08:24:33.893322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:24:35.130348 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:24:35.136718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:24:35.158852 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:24:35.185887 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:24:35.238905 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:24:35.260300 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:24:35.287274 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:24:35.836263 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:24:35.887204 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:35.898457 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:24:35.959513 tst mo_mt_call.py: using LAC 27106 08:24:36.082836 tst mo_mt_call.py: using RAC 76 08:24:36.205266 tst mo_mt_call.py: using CellId 27106 08:24:36.327387 tst mo_mt_call.py: using BVCI 27107 08:24:36.443689 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:36.455025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:36.466062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:36.477365 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:36.488571 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:36.499727 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:24:36.621349 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:24:36.740012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:37.262940 run create_hlr_db(pid=16784): Launched 08:24:37.397900 bus /sierra_2: Setting Powered False 08:24:38.463347 run create_hlr_db(pid=16784): Terminated: ok {rc=0} 08:24:38.914952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16786): Launched 08:24:39.233578 run osmo-hlr_10.42.42.2(pid=16787): Launched 08:24:39.354760 run osmo-stp_10.42.42.5: Starting osmo-stp 08:24:39.911179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16789): Launched 08:24:40.229227 run osmo-stp_10.42.42.5(pid=16790): Launched 08:24:40.350480 run osmo-msc_10.42.42.6: Starting osmo-msc 08:24:40.922932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16792): Launched 08:24:41.241389 run osmo-msc_10.42.42.6(pid=16793): Launched 08:24:41.418559 run osmo-stp_10.42.42.5(pid=16790): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16790)] 08:24:41.553387 run osmo-stp_10.42.42.5(pid=16790): stdout: | (launched: 2022-12-10_08:24:40.169253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:41.687063 run osmo-stp_10.42.42.5(pid=16790): stderr: | 20221210082440344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082440344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082440345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082440345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082440347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082440347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082440347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:41.818566 run osmo-stp_10.42.42.5(pid=16790): stdout: | (launched: 2022-12-10_08:24:40.169253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:41.943947 run osmo-stp_10.42.42.5(pid=16790): stderr: | 20221210082440344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082440344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082440345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082440345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082440347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082440347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082440347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:42.094082 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16790): Process ended prematurely: osmo-stp_10.42.42.5(pid=16790) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16790)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:24:42.103069 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:24:42.130157 run osmo-hlr_10.42.42.2(pid=16787): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16787)] 08:24:42.178755 run osmo-hlr_10.42.42.2(pid=16787): stdout: | (launched: 2022-12-10_08:24:39.173778) 08:24:42.229484 run osmo-hlr_10.42.42.2(pid=16787): stderr: | 20221210082439355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082439355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082439355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082439355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082439355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082439355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082439367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082439376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082439376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082439376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:24:42.299122 run osmo-msc_10.42.42.6(pid=16793): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16793)] 08:24:42.347381 run osmo-msc_10.42.42.6(pid=16793): stdout: | (launched: 2022-12-10_08:24:41.181752) 08:24:42.397240 run osmo-msc_10.42.42.6(pid=16793): stderr: | 20221210082441458 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082441459 DLGLOBAL DEBUG validating counter group 0x7f77a8b85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082441459 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082441459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082441459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082441459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082441461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082441461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082441461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082441462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:24:42.447656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16786): Terminating (SIGTERM) 08:24:42.487603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16789): Terminating (SIGTERM) 08:24:42.527706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16792): Terminating (SIGTERM) 08:24:42.567858 --- ParallelTerminationStrategy: PID 16786 died... 08:24:42.586944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16786): Terminated: ok {rc=0} 08:24:42.631355 --- ParallelTerminationStrategy: PID 16789 died... 08:24:42.649939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16789): Terminated: ok {rc=0} 08:24:42.694077 --- ParallelTerminationStrategy: PID 16792 died... 08:24:42.712563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16792): Terminated: ok {rc=0} 08:24:42.796393 bus /sierra_3: Setting Powered False 08:24:43.894514 bus /sierra_3: Setting Powered False 08:24:45.010015 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:24:46.163354 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.176145 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:24:46.234372 tst mo_mt_call_osmux.py: using LAC 27107 08:24:46.364216 tst mo_mt_call_osmux.py: using RAC 77 08:24:46.499354 tst mo_mt_call_osmux.py: using CellId 27107 08:24:46.633571 tst mo_mt_call_osmux.py: using BVCI 27108 08:24:46.788911 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.804686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.821461 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.835714 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.848818 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:24:46.861341 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:24:46.987953 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:24:47.125544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:47.622745 run create_hlr_db(pid=16795): Launched 08:24:47.743218 bus /sierra_2: Setting Powered False 08:24:48.805463 run create_hlr_db(pid=16795): Terminated: ok {rc=0} 08:24:49.246139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Launched 08:24:49.563143 run osmo-hlr_10.42.42.2(pid=16798): Launched 08:24:49.683928 run osmo-stp_10.42.42.5: Starting osmo-stp 08:24:50.226693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Launched 08:24:50.543930 run osmo-stp_10.42.42.5(pid=16801): Launched 08:24:50.665738 run osmo-msc_10.42.42.6: Starting osmo-msc 08:24:51.237281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16803): Launched 08:24:51.554196 run osmo-msc_10.42.42.6(pid=16804): Launched 08:24:51.731407 run osmo-stp_10.42.42.5(pid=16801): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] 08:24:51.865339 run osmo-stp_10.42.42.5(pid=16801): stdout: | (launched: 2022-12-10_08:24:50.483879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:51.997828 run osmo-stp_10.42.42.5(pid=16801): stderr: | 20221210082450657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082450657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082450657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082450658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082450660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082450660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082450660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:52.129182 run osmo-stp_10.42.42.5(pid=16801): stdout: | (launched: 2022-12-10_08:24:50.483879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:24:52.254436 run osmo-stp_10.42.42.5(pid=16801): stderr: | 20221210082450657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082450657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082450657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082450658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082450660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082450660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082450660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:24:52.404644 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16801): Process ended prematurely: osmo-stp_10.42.42.5(pid=16801) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:24:52.413595 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:24:52.440389 run osmo-hlr_10.42.42.2(pid=16798): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16798)] 08:24:52.488427 run osmo-hlr_10.42.42.2(pid=16798): stdout: | (launched: 2022-12-10_08:24:49.503425) 08:24:52.538382 run osmo-hlr_10.42.42.2(pid=16798): stderr: | 20221210082449685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082449685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082449685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082449685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082449685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082449685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082449727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082449737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082449737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082449738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:24:52.607502 run osmo-msc_10.42.42.6(pid=16804): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16804)] 08:24:52.655698 run osmo-msc_10.42.42.6(pid=16804): stdout: | (launched: 2022-12-10_08:24:51.494639) 08:24:52.705497 run osmo-msc_10.42.42.6(pid=16804): stderr: | 20221210082451770 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082451770 DLGLOBAL DEBUG validating counter group 0x7fd5d7a9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082451771 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082451771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082451771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082451771 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082451774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082451775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082451775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082451775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:24:52.755541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Terminating (SIGTERM) 08:24:52.795200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Terminating (SIGTERM) 08:24:52.834919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16803): Terminating (SIGTERM) 08:24:52.874835 --- ParallelTerminationStrategy: PID 16797 died... 08:24:52.893791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16797): Terminated: ok {rc=0} 08:24:52.937906 --- ParallelTerminationStrategy: PID 16800 died... 08:24:52.956405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16800): Terminated: ok {rc=0} 08:24:53.001010 --- ParallelTerminationStrategy: PID 16803 died... 08:24:53.019953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16803): Terminated: ok {rc=0} 08:24:53.106892 bus /sierra_3: Setting Powered False 08:24:54.207684 bus /sierra_3: Setting Powered False 08:24:55.324199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:24:56.560201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:24:56.566401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:24:56.588334 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:24:56.615766 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:24:56.669211 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:24:56.690586 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:24:56.717832 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:24:57.271770 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:24:57.327386 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.339141 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:24:57.398623 tst mo_mt_call.py: using LAC 27108 08:24:57.531523 tst mo_mt_call.py: using RAC 78 08:24:57.665672 tst mo_mt_call.py: using CellId 27108 08:24:57.800513 tst mo_mt_call.py: using BVCI 27109 08:24:57.924507 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.936358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.947951 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.959358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.971000 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:24:57.982476 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:24:58.103351 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:24:58.222985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:24:58.718014 run create_hlr_db(pid=16810): Launched 08:24:58.838700 bus /sierra_2: Setting Powered False 08:24:59.901505 run create_hlr_db(pid=16810): Terminated: ok {rc=0} 08:25:00.362956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16812): Launched 08:25:00.702829 run osmo-hlr_10.42.42.2(pid=16813): Launched 08:25:00.843401 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:01.536181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16818): Launched 08:25:01.891855 run osmo-stp_10.42.42.5(pid=16819): Launched 08:25:02.073966 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:02.777021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16821): Launched 08:25:03.115021 run osmo-msc_10.42.42.6(pid=16822): Launched 08:25:03.302071 run osmo-stp_10.42.42.5(pid=16819): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16819)] 08:25:03.447349 run osmo-stp_10.42.42.5(pid=16819): stdout: | (launched: 2022-12-10_08:25:01.827098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:03.589765 run osmo-stp_10.42.42.5(pid=16819): stderr: | 20221210082502136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082502136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082502139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082502143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082502146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082502146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082502146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:03.729498 run osmo-stp_10.42.42.5(pid=16819): stdout: | (launched: 2022-12-10_08:25:01.827098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:03.863132 run osmo-stp_10.42.42.5(pid=16819): stderr: | 20221210082502136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082502136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082502139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082502143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082502146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082502146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082502146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:04.023534 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16819): Process ended prematurely: osmo-stp_10.42.42.5(pid=16819) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16819)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:25:04.033089 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 08:25:04.060829 run osmo-hlr_10.42.42.2(pid=16813): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16813)] 08:25:04.111017 run osmo-hlr_10.42.42.2(pid=16813): stdout: | (launched: 2022-12-10_08:25:00.639819) 08:25:04.163181 run osmo-hlr_10.42.42.2(pid=16813): stderr: | 20221210082500843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082500843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082500843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082500844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082500844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082500844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082500859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082500875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082500884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082500884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:04.235342 run osmo-msc_10.42.42.6(pid=16822): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16822)] 08:25:04.285510 run osmo-msc_10.42.42.6(pid=16822): stdout: | (launched: 2022-12-10_08:25:03.051714) 08:25:04.337516 run osmo-msc_10.42.42.6(pid=16822): stderr: | 20221210082503382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082503382 DLGLOBAL DEBUG validating counter group 0x7f00e8e9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082503382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082503382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082503382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082503383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082503384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082503385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082503385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082503385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:04.389750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16812): Terminating (SIGTERM) 08:25:04.431532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16818): Terminating (SIGTERM) 08:25:04.474006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16821): Terminating (SIGTERM) 08:25:04.516270 --- ParallelTerminationStrategy: PID 16812 died... 08:25:04.536250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16812): Terminated: ok {rc=0} 08:25:04.582955 --- ParallelTerminationStrategy: PID 16818 died... 08:25:04.602739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16818): Terminated: ok {rc=0} 08:25:04.648903 --- ParallelTerminationStrategy: PID 16821 died... 08:25:04.668796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16821): Terminated: ok {rc=0} 08:25:04.757293 bus /sierra_3: Setting Powered False 08:25:05.856519 bus /sierra_3: Setting Powered False 08:25:06.973037 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:25:08.124276 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.136856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:25:08.195375 tst mo_mt_call_osmux.py: using LAC 27109 08:25:08.328916 tst mo_mt_call_osmux.py: using RAC 79 08:25:08.454913 tst mo_mt_call_osmux.py: using CellId 27109 08:25:08.580721 tst mo_mt_call_osmux.py: using BVCI 27110 08:25:08.697899 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.709104 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.719920 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.731040 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.742164 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:25:08.753380 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:25:08.875378 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:25:09.002047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:09.524484 run create_hlr_db(pid=16824): Launched 08:25:09.661388 bus /sierra_2: Setting Powered False 08:25:10.726489 run create_hlr_db(pid=16824): Terminated: ok {rc=0} 08:25:11.176228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16826): Launched 08:25:11.493425 run osmo-hlr_10.42.42.2(pid=16827): Launched 08:25:11.614559 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:12.160409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16829): Launched 08:25:12.477350 run osmo-stp_10.42.42.5(pid=16830): Launched 08:25:12.598866 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:13.172845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16832): Launched 08:25:13.491637 run osmo-msc_10.42.42.6(pid=16833): Launched 08:25:13.669220 run osmo-stp_10.42.42.5(pid=16830): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16830)] 08:25:13.803497 run osmo-stp_10.42.42.5(pid=16830): stdout: | (launched: 2022-12-10_08:25:12.417838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:13.936690 run osmo-stp_10.42.42.5(pid=16830): stderr: | 20221210082512595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082512596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082512596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082512596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082512597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082512597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082512597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:14.068118 run osmo-stp_10.42.42.5(pid=16830): stdout: | (launched: 2022-12-10_08:25:12.417838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:14.193692 run osmo-stp_10.42.42.5(pid=16830): stderr: | 20221210082512595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082512596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082512596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082512596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082512597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082512597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082512597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:14.344230 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16830): Process ended prematurely: osmo-stp_10.42.42.5(pid=16830) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16830)] [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:25:14.353342 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:25:14.379962 run osmo-hlr_10.42.42.2(pid=16827): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16827)] 08:25:14.428383 run osmo-hlr_10.42.42.2(pid=16827): stdout: | (launched: 2022-12-10_08:25:11.434121) 08:25:14.478611 run osmo-hlr_10.42.42.2(pid=16827): stderr: | 20221210082511614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082511614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082511614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082511614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082511614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082511614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082511639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082511649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082511649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082511649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:14.547800 run osmo-msc_10.42.42.6(pid=16833): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16833)] 08:25:14.596081 run osmo-msc_10.42.42.6(pid=16833): stdout: | (launched: 2022-12-10_08:25:13.431676) 08:25:14.646060 run osmo-msc_10.42.42.6(pid=16833): stderr: | 20221210082513709 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082513709 DLGLOBAL DEBUG validating counter group 0x7f69a26f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082513709 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082513709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082513709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082513710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082513711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082513712 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082513712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082513712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:14.696409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16826): Terminating (SIGTERM) 08:25:14.736889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16829): Terminating (SIGTERM) 08:25:14.777307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16832): Terminating (SIGTERM) 08:25:14.817515 --- ParallelTerminationStrategy: PID 16826 died... 08:25:14.836513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16826): Terminated: ok {rc=0} 08:25:14.881027 --- ParallelTerminationStrategy: PID 16829 died... 08:25:14.900016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16829): Terminated: ok {rc=0} 08:25:14.944479 --- ParallelTerminationStrategy: PID 16832 died... 08:25:14.962884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16832): Terminated: ok {rc=0} 08:25:15.047193 bus /sierra_3: Setting Powered False 08:25:16.153879 bus /sierra_3: Setting Powered False 08:25:17.278764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:25:18.519911 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:18.527317 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:25:18.548602 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:25:18.575786 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:25:18.628105 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:25:18.649128 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:25:18.676423 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:25:19.227742 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:25:19.283294 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.295116 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:25:19.353552 tst mo_mt_call.py: using LAC 27110 08:25:19.488285 tst mo_mt_call.py: using RAC 80 08:25:19.621156 tst mo_mt_call.py: using CellId 27110 08:25:19.751576 tst mo_mt_call.py: using BVCI 27111 08:25:19.874528 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.886244 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.897742 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.909174 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.920554 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:19.932136 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:25:20.052905 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:25:20.175209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:20.700329 run create_hlr_db(pid=16838): Launched 08:25:20.837917 bus /sierra_2: Setting Powered False 08:25:21.903735 run create_hlr_db(pid=16838): Terminated: ok {rc=0} 08:25:22.356882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16840): Launched 08:25:22.675792 run osmo-hlr_10.42.42.2(pid=16841): Launched 08:25:22.796902 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:23.359363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16843): Launched 08:25:23.677267 run osmo-stp_10.42.42.5(pid=16844): Launched 08:25:23.797889 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:24.376162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16846): Launched 08:25:24.694740 run osmo-msc_10.42.42.6(pid=16847): Launched 08:25:24.871662 run osmo-stp_10.42.42.5(pid=16844): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16844)] 08:25:25.005603 run osmo-stp_10.42.42.5(pid=16844): stdout: | (launched: 2022-12-10_08:25:23.617750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:25.139126 run osmo-stp_10.42.42.5(pid=16844): stderr: | 20221210082523793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082523794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082523794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082523794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082523795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082523795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082523795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:25.270392 run osmo-stp_10.42.42.5(pid=16844): stdout: | (launched: 2022-12-10_08:25:23.617750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:25.396352 run osmo-stp_10.42.42.5(pid=16844): stderr: | 20221210082523793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082523794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082523794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082523794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082523795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082523795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082523795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:25.547199 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16844): Process ended prematurely: osmo-stp_10.42.42.5(pid=16844) [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16844)] [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:25:25.556034 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:25:25.582383 run osmo-hlr_10.42.42.2(pid=16841): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16841)] 08:25:25.630530 run osmo-hlr_10.42.42.2(pid=16841): stdout: | (launched: 2022-12-10_08:25:22.615665) 08:25:25.680219 run osmo-hlr_10.42.42.2(pid=16841): stderr: | 20221210082522797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082522797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082522797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082522797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082522797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082522797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082522808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082522817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082522817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082522817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:25.749319 run osmo-msc_10.42.42.6(pid=16847): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16847)] 08:25:25.797253 run osmo-msc_10.42.42.6(pid=16847): stdout: | (launched: 2022-12-10_08:25:24.634813) 08:25:25.847070 run osmo-msc_10.42.42.6(pid=16847): stderr: | 20221210082524913 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082524913 DLGLOBAL DEBUG validating counter group 0x7f78ed4ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082524913 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082524913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082524914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082524914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082524915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082524916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082524916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082524916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:25.896902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16840): Terminating (SIGTERM) 08:25:25.936777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16843): Terminating (SIGTERM) 08:25:25.976528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16846): Terminating (SIGTERM) 08:25:26.016488 --- ParallelTerminationStrategy: PID 16840 died... 08:25:26.035434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16840): Terminated: ok {rc=0} 08:25:26.079881 --- ParallelTerminationStrategy: PID 16843 died... 08:25:26.098515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16843): Terminated: ok {rc=0} 08:25:26.142470 --- ParallelTerminationStrategy: PID 16846 died... 08:25:26.160871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16846): Terminated: ok {rc=0} 08:25:26.247106 bus /sierra_3: Setting Powered False 08:25:27.346591 bus /sierra_3: Setting Powered False 08:25:28.460506 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:25:29.611671 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:29.624121 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:25:29.684552 tst mo_mt_call_osmux.py: using LAC 27111 08:25:29.818494 tst mo_mt_call_osmux.py: using RAC 81 08:25:29.953574 tst mo_mt_call_osmux.py: using CellId 27111 08:25:30.085403 tst mo_mt_call_osmux.py: using BVCI 27112 08:25:30.208497 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:30.220272 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:30.232038 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:30.244223 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:30.256399 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:25:30.268590 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:25:30.393763 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:25:30.516330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:31.054326 run create_hlr_db(pid=16849): Launched 08:25:31.219963 bus /sierra_2: Setting Powered False 08:25:32.281030 run create_hlr_db(pid=16849): Terminated: ok {rc=0} 08:25:32.723095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16851): Launched 08:25:33.040468 run osmo-hlr_10.42.42.2(pid=16852): Launched 08:25:33.161432 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:33.710596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16854): Launched 08:25:34.027690 run osmo-stp_10.42.42.5(pid=16855): Launched 08:25:34.149244 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:34.734296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16857): Launched 08:25:35.052015 run osmo-msc_10.42.42.6(pid=16858): Launched 08:25:35.228773 run osmo-stp_10.42.42.5(pid=16855): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16855)] 08:25:35.362727 run osmo-stp_10.42.42.5(pid=16855): stdout: | (launched: 2022-12-10_08:25:33.968168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:35.496227 run osmo-stp_10.42.42.5(pid=16855): stderr: | 20221210082534144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082534144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082534144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082534144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082534145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082534145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082534145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:35.628159 run osmo-stp_10.42.42.5(pid=16855): stdout: | (launched: 2022-12-10_08:25:33.968168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:35.753360 run osmo-stp_10.42.42.5(pid=16855): stderr: | 20221210082534144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082534144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082534144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082534144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082534145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082534145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082534145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:35.903168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16855): Process ended prematurely: osmo-stp_10.42.42.5(pid=16855) [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16855)] [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:25:35.912206 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:25:35.939290 run osmo-hlr_10.42.42.2(pid=16852): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16852)] 08:25:35.987452 run osmo-hlr_10.42.42.2(pid=16852): stdout: | (launched: 2022-12-10_08:25:32.980892) 08:25:36.037433 run osmo-hlr_10.42.42.2(pid=16852): stderr: | 20221210082533159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082533159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082533159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082533159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082533159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082533159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082533171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082533181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082533182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082533182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:36.106698 run osmo-msc_10.42.42.6(pid=16858): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16858)] 08:25:36.155175 run osmo-msc_10.42.42.6(pid=16858): stdout: | (launched: 2022-12-10_08:25:34.992079) 08:25:36.204940 run osmo-msc_10.42.42.6(pid=16858): stderr: | 20221210082535270 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082535270 DLGLOBAL DEBUG validating counter group 0x7f51e3420c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082535270 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082535270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082535270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082535270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082535272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082535272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082535273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082535273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:36.255053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16851): Terminating (SIGTERM) 08:25:36.295120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16854): Terminating (SIGTERM) 08:25:36.335796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16857): Terminating (SIGTERM) 08:25:36.376321 --- ParallelTerminationStrategy: PID 16851 died... 08:25:36.395335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16851): Terminated: ok {rc=0} 08:25:36.439721 --- ParallelTerminationStrategy: PID 16854 died... 08:25:36.458306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16854): Terminated: ok {rc=0} 08:25:36.502494 --- ParallelTerminationStrategy: PID 16857 died... 08:25:36.520911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16857): Terminated: ok {rc=0} 08:25:36.606363 bus /sierra_3: Setting Powered False 08:25:37.705483 bus /sierra_3: Setting Powered False 08:25:38.821662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:25:40.056286 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:25:40.061887 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:25:40.083565 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:25:40.110574 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:25:40.162157 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:25:40.183843 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:25:40.211588 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:25:40.762916 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:25:40.816311 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:40.827804 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:25:40.885761 tst mo_mt_call.py: using LAC 27112 08:25:41.017440 tst mo_mt_call.py: using RAC 82 08:25:41.149722 tst mo_mt_call.py: using CellId 27112 08:25:41.279437 tst mo_mt_call.py: using BVCI 27113 08:25:41.401950 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:41.413668 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:41.424939 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:41.436319 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:41.447712 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:41.459131 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:25:41.576572 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:25:41.700628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:42.226142 run create_hlr_db(pid=16863): Launched 08:25:42.363699 bus /sierra_2: Setting Powered False 08:25:43.428907 run create_hlr_db(pid=16863): Terminated: ok {rc=0} 08:25:43.881611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16865): Launched 08:25:44.200467 run osmo-hlr_10.42.42.2(pid=16866): Launched 08:25:44.321659 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:44.885333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16868): Launched 08:25:45.203206 run osmo-stp_10.42.42.5(pid=16869): Launched 08:25:45.325636 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:45.908916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16871): Launched 08:25:46.262482 run osmo-msc_10.42.42.6(pid=16872): Launched 08:25:46.578511 run osmo-stp_10.42.42.5(pid=16869): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16869)] 08:25:46.739439 run osmo-stp_10.42.42.5(pid=16869): stdout: | (launched: 2022-12-10_08:25:45.143401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:47.040384 run osmo-stp_10.42.42.5(pid=16869): stderr: | 20221210082545317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082545317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082545317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082545318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082545318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082545318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082545318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:47.258663 run osmo-stp_10.42.42.5(pid=16869): stdout: | (launched: 2022-12-10_08:25:45.143401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:47.388377 run osmo-stp_10.42.42.5(pid=16869): stderr: | 20221210082545317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082545317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082545317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082545318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082545318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082545318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082545318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:47.539727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16869): Process ended prematurely: osmo-stp_10.42.42.5(pid=16869) [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16869)] [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:25:47.548897 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 08:25:47.576383 run osmo-hlr_10.42.42.2(pid=16866): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16866)] 08:25:47.625791 run osmo-hlr_10.42.42.2(pid=16866): stdout: | (launched: 2022-12-10_08:25:44.140936) 08:25:47.676842 run osmo-hlr_10.42.42.2(pid=16866): stderr: | 20221210082544323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082544323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082544323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082544323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082544323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082544323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082544335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082544344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082544344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082544344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:47.747426 run osmo-msc_10.42.42.6(pid=16872): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16872)] 08:25:47.796617 run osmo-msc_10.42.42.6(pid=16872): stdout: | (launched: 2022-12-10_08:25:46.198043) 08:25:47.847446 run osmo-msc_10.42.42.6(pid=16872): stderr: | 20221210082546819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082546819 DLGLOBAL DEBUG validating counter group 0x7f15e6e74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082546820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082546820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082546820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082546820 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082546822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082546822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082546822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082546822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:47.898365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16865): Terminating (SIGTERM) 08:25:47.939243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16868): Terminating (SIGTERM) 08:25:47.980035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16871): Terminating (SIGTERM) 08:25:48.021568 --- ParallelTerminationStrategy: PID 16865 died... 08:25:48.041168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16865): Terminated: ok {rc=0} 08:25:48.086828 --- ParallelTerminationStrategy: PID 16868 died... 08:25:48.105851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16868): Terminated: ok {rc=0} 08:25:48.151307 --- ParallelTerminationStrategy: PID 16871 died... 08:25:48.170206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16871): Terminated: ok {rc=0} 08:25:48.257766 bus /sierra_3: Setting Powered False 08:25:49.356940 bus /sierra_3: Setting Powered False 08:25:50.471465 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:25:51.622891 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:51.635017 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:25:51.697625 tst mo_mt_call_osmux.py: using LAC 27113 08:25:51.828888 tst mo_mt_call_osmux.py: using RAC 83 08:25:51.958560 tst mo_mt_call_osmux.py: using CellId 27113 08:25:52.087903 tst mo_mt_call_osmux.py: using BVCI 27114 08:25:52.211647 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:52.223113 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:52.234421 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:52.245763 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:52.257028 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:25:52.268375 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:25:52.389916 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:25:52.511879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:25:53.035721 run create_hlr_db(pid=16874): Launched 08:25:53.173078 bus /sierra_2: Setting Powered False 08:25:54.239602 run create_hlr_db(pid=16874): Terminated: ok {rc=0} 08:25:54.691685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16876): Launched 08:25:55.011020 run osmo-hlr_10.42.42.2(pid=16877): Launched 08:25:55.133462 run osmo-stp_10.42.42.5: Starting osmo-stp 08:25:55.695043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16879): Launched 08:25:56.013924 run osmo-stp_10.42.42.5(pid=16880): Launched 08:25:56.135600 run osmo-msc_10.42.42.6: Starting osmo-msc 08:25:56.708533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16882): Launched 08:25:57.026324 run osmo-msc_10.42.42.6(pid=16883): Launched 08:25:57.203268 run osmo-stp_10.42.42.5(pid=16880): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16880)] 08:25:57.337136 run osmo-stp_10.42.42.5(pid=16880): stdout: | (launched: 2022-12-10_08:25:55.953788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:57.470337 run osmo-stp_10.42.42.5(pid=16880): stderr: | 20221210082556128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082556128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082556128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082556129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082556131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082556131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082556131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:57.602237 run osmo-stp_10.42.42.5(pid=16880): stdout: | (launched: 2022-12-10_08:25:55.953788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:25:57.728051 run osmo-stp_10.42.42.5(pid=16880): stderr: | 20221210082556128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082556128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082556128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082556129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082556131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082556131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082556131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:25:57.878672 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16880): Process ended prematurely: osmo-stp_10.42.42.5(pid=16880) [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16880)] [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:25:57.887558 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:25:57.914082 run osmo-hlr_10.42.42.2(pid=16877): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16877)] 08:25:57.962979 run osmo-hlr_10.42.42.2(pid=16877): stdout: | (launched: 2022-12-10_08:25:54.951280) 08:25:58.013233 run osmo-hlr_10.42.42.2(pid=16877): stderr: | 20221210082555132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082555132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082555132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082555132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082555132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082555133 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082555146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082555154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082555154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082555155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:25:58.082681 run osmo-msc_10.42.42.6(pid=16883): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16883)] 08:25:58.130966 run osmo-msc_10.42.42.6(pid=16883): stdout: | (launched: 2022-12-10_08:25:56.966610) 08:25:58.180941 run osmo-msc_10.42.42.6(pid=16883): stderr: | 20221210082557243 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082557243 DLGLOBAL DEBUG validating counter group 0x7fe14b755c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082557243 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082557243 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082557244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082557244 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082557246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082557246 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082557246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082557246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:25:58.231291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16876): Terminating (SIGTERM) 08:25:58.271549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16879): Terminating (SIGTERM) 08:25:58.311736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16882): Terminating (SIGTERM) 08:25:58.352326 --- ParallelTerminationStrategy: PID 16876 died... 08:25:58.371433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16876): Terminated: ok {rc=0} 08:25:58.416477 --- ParallelTerminationStrategy: PID 16879 died... 08:25:58.435227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16879): Terminated: ok {rc=0} 08:25:58.479721 --- ParallelTerminationStrategy: PID 16882 died... 08:25:58.498480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16882): Terminated: ok {rc=0} 08:25:58.582629 bus /sierra_3: Setting Powered False 08:25:59.681109 bus /sierra_3: Setting Powered False 08:26:00.799891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:sysmo --------------------------------------------------------------------- 08:26:02.054704 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:26:02.059213 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 08:26:02.081940 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 08:26:02.112542 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 08:26:02.203115 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 08:26:02.225383 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 08:26:02.254603 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 08:26:02.837810 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 08:26:02.842910 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:02.854078 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:26:02.890806 tst emergency_mo_mt_call.py: using LAC 27114 08:26:03.020559 tst emergency_mo_mt_call.py: using RAC 84 08:26:03.149708 tst emergency_mo_mt_call.py: using CellId 27114 08:26:03.280740 tst emergency_mo_mt_call.py: using BVCI 27115 08:26:03.400776 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:03.411941 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:03.423033 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:03.434072 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:03.445044 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:03.456055 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:03.573290 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:03.690756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:04.178186 run create_hlr_db(pid=16888): Launched 08:26:04.298113 bus /sierra_2: Setting Powered False 08:26:05.359675 run create_hlr_db(pid=16888): Terminated: ok {rc=0} 08:26:05.796755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16890): Launched 08:26:06.111054 run osmo-hlr_10.42.42.2(pid=16891): Launched 08:26:06.230789 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:06.768444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16893): Launched 08:26:07.082115 run osmo-stp_10.42.42.5(pid=16894): Launched 08:26:07.215575 tst emergency_mo_mt_call.py: using MSISDN 7642 08:26:07.374821 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:07.935915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16896): Launched 08:26:08.249257 run osmo-msc_10.42.42.6(pid=16897): Launched 08:26:08.422992 run osmo-stp_10.42.42.5(pid=16894): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16894)] 08:26:08.555083 run osmo-stp_10.42.42.5(pid=16894): stdout: | (launched: 2022-12-10_08:26:07.022794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:08.686915 run osmo-stp_10.42.42.5(pid=16894): stderr: | 20221210082607198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082607198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082607198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082607199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082607199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082607199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082607199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:08.816457 run osmo-stp_10.42.42.5(pid=16894): stdout: | (launched: 2022-12-10_08:26:07.022794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:08.939704 run osmo-stp_10.42.42.5(pid=16894): stderr: | 20221210082607198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082607198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082607198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082607199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082607199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082607199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082607199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:09.087587 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16894): Process ended prematurely: osmo-stp_10.42.42.5(pid=16894) [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16894)] [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py:19] 08:26:09.095977 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 08:26:09.123257 run osmo-hlr_10.42.42.2(pid=16891): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16891)] 08:26:09.171956 run osmo-hlr_10.42.42.2(pid=16891): stdout: | (launched: 2022-12-10_08:26:06.051935) 08:26:09.222433 run osmo-hlr_10.42.42.2(pid=16891): stderr: | 20221210082606231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082606231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082606231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082606231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082606231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082606231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082606244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082606254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082606254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082606254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:09.292658 run osmo-msc_10.42.42.6(pid=16897): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16897)] 08:26:09.341435 run osmo-msc_10.42.42.6(pid=16897): stdout: | (launched: 2022-12-10_08:26:08.190090) 08:26:09.391730 run osmo-msc_10.42.42.6(pid=16897): stderr: | 20221210082608468 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082608468 DLGLOBAL DEBUG validating counter group 0x7fca4308cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082608468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082608468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082608468 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082608468 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082608472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082608472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082608473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082608473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:09.442440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16890): Terminating (SIGTERM) 08:26:09.482914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16893): Terminating (SIGTERM) 08:26:09.523463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16896): Terminating (SIGTERM) 08:26:09.564249 --- ParallelTerminationStrategy: PID 16890 died... 08:26:09.583667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16890): Terminated: ok {rc=0} 08:26:09.628758 --- ParallelTerminationStrategy: PID 16893 died... 08:26:09.647574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16893): Terminated: ok {rc=0} 08:26:09.692553 --- ParallelTerminationStrategy: PID 16896 died... 08:26:09.711517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16896): Terminated: ok {rc=0} 08:26:09.799142 bus /sierra_3: Setting Powered False 08:26:10.899755 bus /sierra_3: Setting Powered False 08:26:12.017174 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 08:26:13.104764 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.116645 tst emergency:sysmo: Using 1 x bts (candidates: 1) 08:26:13.156084 tst emergency_preemptive_call.py: using LAC 27115 08:26:13.281397 tst emergency_preemptive_call.py: using RAC 85 08:26:13.404753 tst emergency_preemptive_call.py: using CellId 27115 08:26:13.528831 tst emergency_preemptive_call.py: using BVCI 27116 08:26:13.651135 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.662383 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.673979 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.684940 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.695989 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 08:26:13.706961 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:13.827278 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:13.950920 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:14.073496 tst emergency:sysmo: Using 1 x modem (candidates: 4) 08:26:14.195872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:14.711334 run create_hlr_db(pid=16899): Launched 08:26:14.844673 bus /sierra_2: Setting Powered False 08:26:15.922812 run create_hlr_db(pid=16899): Terminated: ok {rc=0} 08:26:16.432829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16901): Launched 08:26:16.852883 run osmo-hlr_10.42.42.2(pid=16902): Launched 08:26:17.132577 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:17.753211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16904): Launched 08:26:18.068139 run osmo-stp_10.42.42.5(pid=16905): Launched 08:26:18.203530 tst emergency_preemptive_call.py: using MSISDN 7643 08:26:18.372774 run osmo-msc_10.42.42.6: Starting osmo-msc 08:26:18.931570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16907): Launched 08:26:19.244558 run osmo-msc_10.42.42.6(pid=16908): Launched 08:26:19.426665 run osmo-stp_10.42.42.5(pid=16905): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16905)] 08:26:19.559021 run osmo-stp_10.42.42.5(pid=16905): stdout: | (launched: 2022-12-10_08:26:18.008691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:19.691358 run osmo-stp_10.42.42.5(pid=16905): stderr: | 20221210082618183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082618183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082618184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082618184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082618184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082618185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082618185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:19.821278 run osmo-stp_10.42.42.5(pid=16905): stdout: | (launched: 2022-12-10_08:26:18.008691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:19.945494 run osmo-stp_10.42.42.5(pid=16905): stderr: | 20221210082618183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082618183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082618184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082618184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082618184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082618185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082618185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:20.092834 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16905): Process ended prematurely: osmo-stp_10.42.42.5(pid=16905) [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16905)] [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py:32] 08:26:20.101372 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 08:26:20.127874 run osmo-hlr_10.42.42.2(pid=16902): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16902)] 08:26:20.176041 run osmo-hlr_10.42.42.2(pid=16902): stdout: | (launched: 2022-12-10_08:26:16.769656) 08:26:20.225824 run osmo-hlr_10.42.42.2(pid=16902): stderr: | 20221210082617059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082617059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082617059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082617059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082617059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082617059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082617073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082617088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082617089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082617091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:20.295041 run osmo-msc_10.42.42.6(pid=16908): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16908)] 08:26:20.342988 run osmo-msc_10.42.42.6(pid=16908): stdout: | (launched: 2022-12-10_08:26:19.185320) 08:26:20.392829 run osmo-msc_10.42.42.6(pid=16908): stderr: | 20221210082619463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210082619464 DLGLOBAL DEBUG validating counter group 0x7feaae713c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210082619464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210082619464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210082619464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210082619464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210082619466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210082619467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210082619467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210082619467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:26:20.442863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16901): Terminating (SIGTERM) 08:26:20.482699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16904): Terminating (SIGTERM) 08:26:20.522581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16907): Terminating (SIGTERM) 08:26:20.562700 --- ParallelTerminationStrategy: PID 16901 died... 08:26:20.581593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16901): Terminated: ok {rc=0} 08:26:20.625965 --- ParallelTerminationStrategy: PID 16904 died... 08:26:20.644591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16904): Terminated: ok {rc=0} 08:26:20.689103 --- ParallelTerminationStrategy: PID 16907 died... 08:26:20.707716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16907): Terminated: ok {rc=0} 08:26:20.791852 bus /sierra_9: Setting Powered False 08:26:21.889419 bus /sierra_9: Setting Powered False 08:26:23.005105 bus /sierra_8: Setting Powered False 08:26:24.104418 bus /sierra_8: Setting Powered False 08:26:25.220659 bus /sierra_3: Setting Powered False 08:26:26.317056 bus /sierra_3: Setting Powered False 08:26:27.433391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:sysmo --------------------------------------------------------------------- 08:26:28.691598 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:26:28.695818 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 08:26:28.716681 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 08:26:28.756325 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 08:26:28.844254 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 08:26:28.865050 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 08:26:28.903892 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 08:26:29.494152 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 08:26:29.547844 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:29.558509 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:26:29.595050 tst cs_paging_gprs_active.py: using LAC 27116 08:26:29.720436 tst cs_paging_gprs_active.py: using RAC 86 08:26:29.851184 tst cs_paging_gprs_active.py: using CellId 27116 08:26:29.974431 tst cs_paging_gprs_active.py: using BVCI 27117 08:26:30.091287 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.102016 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.112542 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.123285 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.133649 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.144457 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.155277 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.165998 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:30.176768 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:30.294902 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:30.412635 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:26:30.627528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:30.961844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16913): Launched 08:26:31.294843 run iperf3-srv_10.42.42.10(pid=16914): Launched 08:26:31.440064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:26:31.677262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:32.027889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16915): Launched 08:26:32.339939 run iperf3-srv_10.42.42.10(pid=16916): Launched 08:26:32.466587 tst cs_paging_gprs_active.py:38: start network... 08:26:32.694977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:33.219529 run create_hlr_db(pid=16917): Launched 08:26:33.356546 bus /sierra_2: Setting Powered False 08:26:34.422908 run create_hlr_db(pid=16917): Terminated: ok {rc=0} 08:26:34.874760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Launched 08:26:35.193996 run osmo-hlr_10.42.42.2(pid=16920): Launched 08:26:35.314939 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:35.874310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Launched 08:26:36.191752 run osmo-stp_10.42.42.5(pid=16923): Launched 08:26:36.312497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:26:37.826921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16925): Launched 08:26:37.948165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:26:38.219731 run patchelf(pid=16926): Launched 08:26:38.395897 run osmo-stp_10.42.42.5(pid=16923): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] 08:26:38.529544 run osmo-stp_10.42.42.5(pid=16923): stdout: | (launched: 2022-12-10_08:26:36.132299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:38.665209 run osmo-stp_10.42.42.5(pid=16923): stderr: | 20221210082636305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082636305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082636305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082636306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082636306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082636306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082636306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:38.800786 run osmo-stp_10.42.42.5(pid=16923): stdout: | (launched: 2022-12-10_08:26:36.132299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:38.930693 run osmo-stp_10.42.42.5(pid=16923): stderr: | 20221210082636305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082636305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082636305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082636306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082636306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082636306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082636306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:39.084183 run patchelf(pid=16926): Terminating (SIGINT) 08:26:39.261584 run patchelf(pid=16926): Terminated: ok {rc=0} 08:26:39.389393 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16923): Process ended prematurely: osmo-stp_10.42.42.5(pid=16923) [trial-2372↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] [trial-2372↪gprs:sysmo↪cs_paging_gprs_active.py:38] 08:26:39.398847 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 08:26:39.426496 run osmo-hlr_10.42.42.2(pid=16920): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16920)] 08:26:39.474988 run osmo-hlr_10.42.42.2(pid=16920): stdout: | (launched: 2022-12-10_08:26:35.133672) 08:26:39.525081 run osmo-hlr_10.42.42.2(pid=16920): stderr: | 20221210082635315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082635315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082635315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082635315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082635315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082635315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082635327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082635338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082635339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082635339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:39.575788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16913): Terminating (SIGTERM) 08:26:39.616076 run iperf3-srv_10.42.42.10(pid=16914): Terminating (SIGTERM) 08:26:39.656444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16915): Terminating (SIGTERM) 08:26:39.696790 run iperf3-srv_10.42.42.10(pid=16916): Terminating (SIGTERM) 08:26:39.736908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Terminating (SIGTERM) 08:26:39.777309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Terminating (SIGTERM) 08:26:39.817906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16925): Terminating (SIGTERM) 08:26:39.858091 --- ParallelTerminationStrategy: PID 16913 died... 08:26:39.877038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16913): Terminated: ok {rc=0} 08:26:39.921629 --- ParallelTerminationStrategy: PID 16914 died... 08:26:39.940079 run iperf3-srv_10.42.42.10(pid=16914): Terminated {rc=256} 08:26:39.985059 --- ParallelTerminationStrategy: PID 16915 died... 08:26:40.003841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16915): Terminated: ok {rc=0} 08:26:40.048779 --- ParallelTerminationStrategy: PID 16916 died... 08:26:40.067593 run iperf3-srv_10.42.42.10(pid=16916): Terminated {rc=256} 08:26:40.112297 --- ParallelTerminationStrategy: PID 16919 died... 08:26:40.130759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16919): Terminated: ok {rc=0} 08:26:40.174904 --- ParallelTerminationStrategy: PID 16922 died... 08:26:40.193477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16922): Terminated: ok {rc=0} 08:26:40.238065 --- ParallelTerminationStrategy: PID 16925 died... 08:26:40.256713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16925): Terminated: ok {rc=0} 08:26:40.343253 bus /gobi_0: Setting Powered False 08:26:41.444323 bus /gobi_0: Setting Powered False 08:26:42.560797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo iperf3.py ---------------------------------------------- 08:26:43.715692 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:43.727460 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:26:43.764472 tst iperf3.py: using LAC 27117 08:26:43.898405 tst iperf3.py: using RAC 87 08:26:44.030405 tst iperf3.py: using CellId 27117 08:26:44.162837 tst iperf3.py: using BVCI 27118 08:26:44.287823 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.298992 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.310047 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.321044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.331901 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.342992 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.354109 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.365068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:44.376130 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:44.496193 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:26:44.725211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:45.065084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Launched 08:26:45.359759 run iperf3-srv_10.42.42.10(pid=16928): Launched 08:26:45.486873 tst iperf3.py:8: start network... 08:26:45.714392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:46.254120 run create_hlr_db(pid=16929): Launched 08:26:46.391716 bus /gobi_6: Setting Powered False 08:26:47.453912 run create_hlr_db(pid=16929): Terminated: ok {rc=0} 08:26:47.918454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Launched 08:26:48.256311 run osmo-hlr_10.42.42.2(pid=16932): Launched 08:26:48.384429 run osmo-stp_10.42.42.5: Starting osmo-stp 08:26:48.969516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Launched 08:26:49.298473 run osmo-stp_10.42.42.5(pid=16935): Launched 08:26:49.423526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:26:49.992760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Launched 08:26:50.118105 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:26:50.398162 run patchelf(pid=16938): Launched 08:26:50.580515 run osmo-stp_10.42.42.5(pid=16935): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] 08:26:50.719331 run osmo-stp_10.42.42.5(pid=16935): stdout: | (launched: 2022-12-10_08:26:49.236891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:50.859693 run osmo-stp_10.42.42.5(pid=16935): stderr: | 20221210082649433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082649433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082649434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082649434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082649435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082649435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082649435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:51.000110 run osmo-stp_10.42.42.5(pid=16935): stdout: | (launched: 2022-12-10_08:26:49.236891) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:26:51.134998 run osmo-stp_10.42.42.5(pid=16935): stderr: | 20221210082649433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082649433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082649434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082649434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082649435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082649435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082649435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:26:51.294789 run patchelf(pid=16938): Terminating (SIGINT) 08:26:51.477781 run patchelf(pid=16938): Terminated: ok {rc=0} 08:26:51.610211 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16935): Process ended prematurely: osmo-stp_10.42.42.5(pid=16935) [trial-2372↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] [trial-2372↪gprs:sysmo↪iperf3.py:8] 08:26:51.620186 tst iperf3.py:8: Test FAILED (7.9 sec) 08:26:51.648264 run osmo-hlr_10.42.42.2(pid=16932): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16932)] 08:26:51.697699 run osmo-hlr_10.42.42.2(pid=16932): stdout: | (launched: 2022-12-10_08:26:48.193257) 08:26:51.748836 run osmo-hlr_10.42.42.2(pid=16932): stderr: | 20221210082648396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082648396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082648396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082648396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082648396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082648396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082648409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082648418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082648418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082648418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:26:51.800390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Terminating (SIGTERM) 08:26:51.841546 run iperf3-srv_10.42.42.10(pid=16928): Terminating (SIGTERM) 08:26:51.882772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Terminating (SIGTERM) 08:26:51.924343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Terminating (SIGTERM) 08:26:51.965771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Terminating (SIGTERM) 08:26:52.007466 --- ParallelTerminationStrategy: PID 16927 died... 08:26:52.027227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Terminated: ok {rc=0} 08:26:52.073169 --- ParallelTerminationStrategy: PID 16928 died... 08:26:52.092577 run iperf3-srv_10.42.42.10(pid=16928): Terminated {rc=256} 08:26:52.138433 --- ParallelTerminationStrategy: PID 16931 died... 08:26:52.158111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Terminated: ok {rc=0} 08:26:52.203831 --- ParallelTerminationStrategy: PID 16934 died... 08:26:52.223285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Terminated: ok {rc=0} 08:26:52.269107 --- ParallelTerminationStrategy: PID 16937 died... 08:26:52.288387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Terminated: ok {rc=0} 08:26:52.375475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo iperf3m4.py ---------------------------------------------- 08:26:53.526733 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:53.538571 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:26:53.575374 tst iperf3m4.py: using LAC 27118 08:26:53.710315 tst iperf3m4.py: using RAC 88 08:26:53.839499 tst iperf3m4.py: using CellId 27118 08:26:53.970967 tst iperf3m4.py: using BVCI 27119 08:26:54.091770 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.103017 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.114093 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.125606 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.136398 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.147292 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.158650 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.169607 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:26:54.181718 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:54.303545 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:54.423810 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:54.544157 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:26:54.662519 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:26:54.871875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:55.184702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16939): Launched 08:26:55.456143 run iperf3-srv_10.42.42.10(pid=16940): Launched 08:26:55.572251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:26:55.780598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:56.092915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16941): Launched 08:26:56.365177 run iperf3-srv_10.42.42.10(pid=16942): Launched 08:26:56.481628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:26:56.689558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:57.001801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16943): Launched 08:26:57.272391 run iperf3-srv_10.42.42.10(pid=16944): Launched 08:26:57.388209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:26:57.594750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:26:57.906066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16945): Launched 08:26:58.194899 run iperf3-srv_10.42.42.10(pid=16946): Launched 08:26:58.319385 tst iperf3m4.py:8: start network... 08:26:58.541819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:26:59.056172 run create_hlr_db(pid=16947): Launched 08:26:59.189990 bus /gobi_6: Setting Powered False 08:27:00.254956 run create_hlr_db(pid=16947): Terminated: ok {rc=0} 08:27:00.697970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16949): Launched 08:27:01.057375 run osmo-hlr_10.42.42.2(pid=16950): Launched 08:27:01.233327 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:02.010634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16952): Launched 08:27:02.396211 run osmo-stp_10.42.42.5(pid=16953): Launched 08:27:02.527640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:27:03.065418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16955): Launched 08:27:03.184404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:27:03.448020 run patchelf(pid=16956): Launched 08:27:03.620209 run osmo-stp_10.42.42.5(pid=16953): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16953)] 08:27:03.751234 run osmo-stp_10.42.42.5(pid=16953): stdout: | (launched: 2022-12-10_08:27:02.329459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:03.883844 run osmo-stp_10.42.42.5(pid=16953): stderr: | 20221210082702529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082702529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082702529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082702530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082702530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082702530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082702530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:04.016122 run osmo-stp_10.42.42.5(pid=16953): stdout: | (launched: 2022-12-10_08:27:02.329459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:04.143135 run osmo-stp_10.42.42.5(pid=16953): stderr: | 20221210082702529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082702529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082702529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082702530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082702530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082702530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082702530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:04.294285 run patchelf(pid=16956): Terminating (SIGINT) 08:27:04.467762 run patchelf(pid=16956): Terminated: ok {rc=0} 08:27:04.592916 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16953): Process ended prematurely: osmo-stp_10.42.42.5(pid=16953) [trial-2372↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16953)] [trial-2372↪gprs:sysmo↪iperf3m4.py:8] 08:27:04.602395 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:27:04.630293 run osmo-hlr_10.42.42.2(pid=16950): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16950)] 08:27:04.678724 run osmo-hlr_10.42.42.2(pid=16950): stdout: | (launched: 2022-12-10_08:27:00.992186) 08:27:04.728510 run osmo-hlr_10.42.42.2(pid=16950): stderr: | 20221210082701343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082701343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082701343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082701343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082701343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082701343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082701360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082701368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082701369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082701369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:04.779021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16939): Terminating (SIGTERM) 08:27:04.819118 run iperf3-srv_10.42.42.10(pid=16940): Terminating (SIGTERM) 08:27:04.859296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16941): Terminating (SIGTERM) 08:27:04.899423 run iperf3-srv_10.42.42.10(pid=16942): Terminating (SIGTERM) 08:27:04.939414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16943): Terminating (SIGTERM) 08:27:04.979579 run iperf3-srv_10.42.42.10(pid=16944): Terminating (SIGTERM) 08:27:05.019957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16945): Terminating (SIGTERM) 08:27:05.060097 run iperf3-srv_10.42.42.10(pid=16946): Terminating (SIGTERM) 08:27:05.100138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16949): Terminating (SIGTERM) 08:27:05.140314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16952): Terminating (SIGTERM) 08:27:05.180343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16955): Terminating (SIGTERM) 08:27:05.220683 --- ParallelTerminationStrategy: PID 16939 died... 08:27:05.239794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16939): Terminated: ok {rc=0} 08:27:05.285033 --- ParallelTerminationStrategy: PID 16940 died... 08:27:05.303625 run iperf3-srv_10.42.42.10(pid=16940): Terminated {rc=256} 08:27:05.348427 --- ParallelTerminationStrategy: PID 16941 died... 08:27:05.366986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16941): Terminated: ok {rc=0} 08:27:05.411301 --- ParallelTerminationStrategy: PID 16942 died... 08:27:05.429926 run iperf3-srv_10.42.42.10(pid=16942): Terminated {rc=256} 08:27:05.474694 --- ParallelTerminationStrategy: PID 16943 died... 08:27:05.493193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16943): Terminated: ok {rc=0} 08:27:05.537551 --- ParallelTerminationStrategy: PID 16944 died... 08:27:05.556002 run iperf3-srv_10.42.42.10(pid=16944): Terminated {rc=256} 08:27:05.599550 --- ParallelTerminationStrategy: PID 16945 died... 08:27:05.617936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16945): Terminated: ok {rc=0} 08:27:05.661765 --- ParallelTerminationStrategy: PID 16946 died... 08:27:05.679964 run iperf3-srv_10.42.42.10(pid=16946): Terminated {rc=256} 08:27:05.724369 --- ParallelTerminationStrategy: PID 16949 died... 08:27:05.742869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16949): Terminated: ok {rc=0} 08:27:05.786892 --- ParallelTerminationStrategy: PID 16952 died... 08:27:05.805394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16952): Terminated: ok {rc=0} 08:27:05.849415 --- ParallelTerminationStrategy: PID 16955 died... 08:27:05.867747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16955): Terminated: ok {rc=0} 08:27:05.951150 bus /gobi_4: Setting Powered False 08:27:07.049300 bus /gobi_4: Setting Powered False 08:27:08.166368 bus /gobi_1: Setting Powered False 08:27:09.263983 bus /gobi_1: Setting Powered False 08:27:10.376471 bus /gobi_0: Setting Powered False 08:27:11.474013 bus /gobi_0: Setting Powered False 08:27:12.590035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo ping.py ---------------------------------------------- 08:27:13.692654 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:13.704316 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:27:13.741283 tst ping.py: using LAC 27119 08:27:13.870320 tst ping.py: using RAC 89 08:27:13.999600 tst ping.py: using CellId 27119 08:27:14.128485 tst ping.py: using BVCI 27120 08:27:14.246455 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.257450 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.268389 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.279254 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.290028 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.300718 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.311642 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:14.322840 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:27:14.442172 tst ping.py:19: start network... 08:27:14.660796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:15.163905 run create_hlr_db(pid=16958): Launched 08:27:15.297663 bus /gobi_6: Setting Powered False 08:27:16.367681 run create_hlr_db(pid=16958): Terminated: ok {rc=0} 08:27:16.831447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Launched 08:27:17.181697 run osmo-hlr_10.42.42.2(pid=16961): Launched 08:27:17.306039 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:17.870062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Launched 08:27:18.194004 run osmo-stp_10.42.42.5(pid=16964): Launched 08:27:18.316856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:27:18.878287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Launched 08:27:19.001930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:27:19.276462 run patchelf(pid=16967): Launched 08:27:19.456541 run osmo-stp_10.42.42.5(pid=16964): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] 08:27:19.602468 run osmo-stp_10.42.42.5(pid=16964): stdout: | (launched: 2022-12-10_08:27:18.133323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:19.739694 run osmo-stp_10.42.42.5(pid=16964): stderr: | 20221210082718326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082718327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082718327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082718327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082718328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082718328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082718328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:19.876594 run osmo-stp_10.42.42.5(pid=16964): stdout: | (launched: 2022-12-10_08:27:18.133323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:20.007460 run osmo-stp_10.42.42.5(pid=16964): stderr: | 20221210082718326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082718327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082718327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082718327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082718328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082718328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082718328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:20.162727 run patchelf(pid=16967): Terminating (SIGINT) 08:27:20.342098 run patchelf(pid=16967): Terminated: ok {rc=0} 08:27:20.471278 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16964): Process ended prematurely: osmo-stp_10.42.42.5(pid=16964) [trial-2372↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] [trial-2372↪gprs:sysmo↪ping.py:22] 08:27:20.480387 tst ping.py:22: Test FAILED (6.8 sec) 08:27:20.508231 run osmo-hlr_10.42.42.2(pid=16961): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16961)] 08:27:20.558305 run osmo-hlr_10.42.42.2(pid=16961): stdout: | (launched: 2022-12-10_08:27:17.111123) 08:27:20.610006 run osmo-hlr_10.42.42.2(pid=16961): stderr: | 20221210082717335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082717335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082717335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082717335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082717335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082717335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082717348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082717357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082717358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082717358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:20.662488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Terminating (SIGTERM) 08:27:20.704389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Terminating (SIGTERM) 08:27:20.746302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Terminating (SIGTERM) 08:27:20.788330 --- ParallelTerminationStrategy: PID 16960 died... 08:27:20.808440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16960): Terminated: ok {rc=0} 08:27:20.855047 --- ParallelTerminationStrategy: PID 16963 died... 08:27:20.874717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16963): Terminated: ok {rc=0} 08:27:20.920897 --- ParallelTerminationStrategy: PID 16966 died... 08:27:20.940848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16966): Terminated: ok {rc=0} 08:27:21.028418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 08:27:22.115560 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.126661 tst gprs:sysmo: Using 1 x bts (candidates: 1) 08:27:22.163595 tst ping_idle_ping.py: using LAC 27120 08:27:22.284298 tst ping_idle_ping.py: using RAC 90 08:27:22.402631 tst ping_idle_ping.py: using CellId 27120 08:27:22.522334 tst ping_idle_ping.py: using BVCI 27121 08:27:22.640487 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.651611 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.662534 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.674187 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.685093 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.695905 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.706957 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 08:27:22.718106 tst gprs:sysmo: Using 1 x modem (candidates: 4) 08:27:22.841404 tst ping_idle_ping.py:24: start network... 08:27:23.042647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:23.510861 run create_hlr_db(pid=16968): Launched 08:27:23.624871 bus /gobi_6: Setting Powered False 08:27:24.684796 run create_hlr_db(pid=16968): Terminated: ok {rc=0} 08:27:25.129615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Launched 08:27:25.452420 run osmo-hlr_10.42.42.2(pid=16971): Launched 08:27:25.573850 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:26.133083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Launched 08:27:26.458774 run osmo-stp_10.42.42.5(pid=16974): Launched 08:27:26.580427 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:27:27.139058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Launched 08:27:27.260888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:27:27.537938 run patchelf(pid=16977): Launched 08:27:27.715738 run osmo-stp_10.42.42.5(pid=16974): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] 08:27:27.850714 run osmo-stp_10.42.42.5(pid=16974): stdout: | (launched: 2022-12-10_08:27:26.393238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:27.987474 run osmo-stp_10.42.42.5(pid=16974): stderr: | 20221210082726596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082726596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082726597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082726597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082726597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082726598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082726598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:28.124248 run osmo-stp_10.42.42.5(pid=16974): stdout: | (launched: 2022-12-10_08:27:26.393238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:28.255460 run osmo-stp_10.42.42.5(pid=16974): stderr: | 20221210082726596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082726596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082726597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082726597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082726597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082726598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082726598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:28.410973 run patchelf(pid=16977): Terminating (SIGINT) 08:27:28.590375 run patchelf(pid=16977): Terminated: ok {rc=0} 08:27:28.719644 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16974): Process ended prematurely: osmo-stp_10.42.42.5(pid=16974) [trial-2372↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] [trial-2372↪gprs:sysmo↪ping_idle_ping.py:27] 08:27:28.728743 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:27:28.756153 run osmo-hlr_10.42.42.2(pid=16971): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16971)] 08:27:28.805344 run osmo-hlr_10.42.42.2(pid=16971): stdout: | (launched: 2022-12-10_08:27:25.389468) 08:27:28.856347 run osmo-hlr_10.42.42.2(pid=16971): stderr: | 20221210082725593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082725593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082725593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082725593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082725593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082725593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082725605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082725613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082725613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082725613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:28.907616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Terminating (SIGTERM) 08:27:28.948551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Terminating (SIGTERM) 08:27:28.989488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Terminating (SIGTERM) 08:27:29.030679 --- ParallelTerminationStrategy: PID 16970 died... 08:27:29.050218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16970): Terminated: ok {rc=0} 08:27:29.095447 --- ParallelTerminationStrategy: PID 16973 died... 08:27:29.114657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16973): Terminated: ok {rc=0} 08:27:29.159712 --- ParallelTerminationStrategy: PID 16976 died... 08:27:29.178820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16976): Terminated: ok {rc=0} 08:27:29.264325 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 08:27:30.551296 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:27:30.556692 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:27:30.577721 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:27:30.616713 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:27:30.705115 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:27:30.726237 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:27:30.765292 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:27:31.356512 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:27:31.410815 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:31.422222 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:27:31.459088 tst cs_paging_gprs_active.py: using LAC 27121 08:27:31.582501 tst cs_paging_gprs_active.py: using RAC 91 08:27:31.733627 tst cs_paging_gprs_active.py: using CellId 27121 08:27:31.891767 tst cs_paging_gprs_active.py: using BVCI 27122 08:27:32.024140 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.035971 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.047568 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.060104 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.072729 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.086367 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.099253 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.110751 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:32.123236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:32.244938 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:32.364832 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:27:32.570541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:32.874430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Launched 08:27:33.137684 run iperf3-srv_10.42.42.10(pid=16983): Launched 08:27:33.251474 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:27:33.455574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:33.760030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Launched 08:27:34.024480 run iperf3-srv_10.42.42.10(pid=16985): Launched 08:27:34.138683 tst cs_paging_gprs_active.py:38: start network... 08:27:34.343033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:34.813258 run create_hlr_db(pid=16986): Launched 08:27:34.929234 bus /gobi_6: Setting Powered False 08:27:35.995490 run create_hlr_db(pid=16986): Terminated: ok {rc=0} 08:27:36.417022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16989): Launched 08:27:36.719921 run osmo-hlr_10.42.42.2(pid=16990): Launched 08:27:36.836368 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:37.368769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16992): Launched 08:27:37.671444 run osmo-stp_10.42.42.5(pid=16993): Launched 08:27:37.787451 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:27:38.308339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16995): Launched 08:27:38.424156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:27:38.679886 run patchelf(pid=16996): Launched 08:27:38.847742 run osmo-stp_10.42.42.5(pid=16993): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16993)] 08:27:38.975789 run osmo-stp_10.42.42.5(pid=16993): stdout: | (launched: 2022-12-10_08:27:37.616438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:39.105509 run osmo-stp_10.42.42.5(pid=16993): stderr: | 20221210082737787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082737787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082737788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082737788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082737788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082737789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082737789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:39.235448 run osmo-stp_10.42.42.5(pid=16993): stdout: | (launched: 2022-12-10_08:27:37.616438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:39.359335 run osmo-stp_10.42.42.5(pid=16993): stderr: | 20221210082737787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082737787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082737788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082737788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082737788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082737789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082737789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:39.506352 run patchelf(pid=16996): Terminating (SIGINT) 08:27:39.676130 run patchelf(pid=16996): Terminated: ok {rc=0} 08:27:39.798716 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16993): Process ended prematurely: osmo-stp_10.42.42.5(pid=16993) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16993)] [trial-2372↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:27:39.807976 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 08:27:39.835268 run osmo-hlr_10.42.42.2(pid=16990): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16990)] 08:27:39.882560 run osmo-hlr_10.42.42.2(pid=16990): stdout: | (launched: 2022-12-10_08:27:36.665098) 08:27:39.931583 run osmo-hlr_10.42.42.2(pid=16990): stderr: | 20221210082736841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082736841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082736841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082736841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082736841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082736841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082736853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082736862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082736862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082736862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:39.981260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Terminating (SIGTERM) 08:27:40.021028 run iperf3-srv_10.42.42.10(pid=16983): Terminating (SIGTERM) 08:27:40.060543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Terminating (SIGTERM) 08:27:40.100209 run iperf3-srv_10.42.42.10(pid=16985): Terminating (SIGTERM) 08:27:40.139613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16989): Terminating (SIGTERM) 08:27:40.179270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16992): Terminating (SIGTERM) 08:27:40.218730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16995): Terminating (SIGTERM) 08:27:40.258472 --- ParallelTerminationStrategy: PID 16982 died... 08:27:40.277396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16982): Terminated: ok {rc=0} 08:27:40.321171 --- ParallelTerminationStrategy: PID 16983 died... 08:27:40.339237 run iperf3-srv_10.42.42.10(pid=16983): Terminated {rc=256} 08:27:40.382593 --- ParallelTerminationStrategy: PID 16984 died... 08:27:40.400739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16984): Terminated: ok {rc=0} 08:27:40.444196 --- ParallelTerminationStrategy: PID 16985 died... 08:27:40.462364 run iperf3-srv_10.42.42.10(pid=16985): Terminated {rc=256} 08:27:40.506302 --- ParallelTerminationStrategy: PID 16989 died... 08:27:40.524737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16989): Terminated: ok {rc=0} 08:27:40.568351 --- ParallelTerminationStrategy: PID 16992 died... 08:27:40.586607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16992): Terminated: ok {rc=0} 08:27:40.630152 --- ParallelTerminationStrategy: PID 16995 died... 08:27:40.648371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16995): Terminated: ok {rc=0} 08:27:40.730585 bus /gobi_0: Setting Powered False 08:27:41.828262 bus /gobi_0: Setting Powered False 08:27:42.947091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:27:44.091713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.102950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:27:44.139970 tst iperf3.py: using LAC 27122 08:27:44.258952 tst iperf3.py: using RAC 92 08:27:44.384663 tst iperf3.py: using CellId 27122 08:27:44.503974 tst iperf3.py: using BVCI 27123 08:27:44.614701 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.625400 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.635942 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.646795 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.657578 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.668227 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.679080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.689854 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:44.700598 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:44.822188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:27:45.040836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:45.364156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16997): Launched 08:27:45.643266 run iperf3-srv_10.42.42.10(pid=16998): Launched 08:27:45.764544 tst iperf3.py:8: start network... 08:27:45.995835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:46.486585 run create_hlr_db(pid=16999): Launched 08:27:46.669684 bus /gobi_6: Setting Powered False 08:27:47.732885 run create_hlr_db(pid=16999): Terminated: ok {rc=0} 08:27:48.172022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17001): Launched 08:27:48.473340 run osmo-hlr_10.42.42.2(pid=17002): Launched 08:27:48.591059 run osmo-stp_10.42.42.5: Starting osmo-stp 08:27:49.112614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17004): Launched 08:27:49.414105 run osmo-stp_10.42.42.5(pid=17005): Launched 08:27:49.530716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:27:50.052048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17007): Launched 08:27:50.167883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:27:50.422864 run patchelf(pid=17008): Launched 08:27:50.590450 run osmo-stp_10.42.42.5(pid=17005): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17005)] 08:27:50.718934 run osmo-stp_10.42.42.5(pid=17005): stdout: | (launched: 2022-12-10_08:27:49.359559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:50.848633 run osmo-stp_10.42.42.5(pid=17005): stderr: | 20221210082749529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082749529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082749529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082749529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082749530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082749530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082749530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:50.978688 run osmo-stp_10.42.42.5(pid=17005): stdout: | (launched: 2022-12-10_08:27:49.359559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:27:51.102941 run osmo-stp_10.42.42.5(pid=17005): stderr: | 20221210082749529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082749529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082749529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082749529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082749530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082749530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082749530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:27:51.250048 run patchelf(pid=17008): Terminating (SIGINT) 08:27:51.419313 run patchelf(pid=17008): Terminated: ok {rc=0} 08:27:51.541869 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17005): Process ended prematurely: osmo-stp_10.42.42.5(pid=17005) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17005)] [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 08:27:51.551128 tst iperf3.py:8: Test FAILED (7.5 sec) 08:27:51.578282 run osmo-hlr_10.42.42.2(pid=17002): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17002)] 08:27:51.625815 run osmo-hlr_10.42.42.2(pid=17002): stdout: | (launched: 2022-12-10_08:27:48.418639) 08:27:51.674846 run osmo-hlr_10.42.42.2(pid=17002): stderr: | 20221210082748598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082748598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082748598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082748598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082748598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082748598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082748610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082748620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082748621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082748621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:27:51.724247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16997): Terminating (SIGTERM) 08:27:51.763710 run iperf3-srv_10.42.42.10(pid=16998): Terminating (SIGTERM) 08:27:51.803032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17001): Terminating (SIGTERM) 08:27:51.842504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17004): Terminating (SIGTERM) 08:27:51.881731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17007): Terminating (SIGTERM) 08:27:51.922206 --- ParallelTerminationStrategy: PID 16997 died... 08:27:51.941381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16997): Terminated: ok {rc=0} 08:27:51.985349 --- ParallelTerminationStrategy: PID 16998 died... 08:27:52.003675 run iperf3-srv_10.42.42.10(pid=16998): Terminated {rc=256} 08:27:52.047730 --- ParallelTerminationStrategy: PID 17001 died... 08:27:52.066221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17001): Terminated: ok {rc=0} 08:27:52.110445 --- ParallelTerminationStrategy: PID 17004 died... 08:27:52.129027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17004): Terminated: ok {rc=0} 08:27:52.173221 --- ParallelTerminationStrategy: PID 17007 died... 08:27:52.191572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17007): Terminated: ok {rc=0} 08:27:52.275435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:27:53.418121 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.429466 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:27:53.467430 tst iperf3m4.py: using LAC 27123 08:27:53.587105 tst iperf3m4.py: using RAC 93 08:27:53.705976 tst iperf3m4.py: using CellId 27123 08:27:53.824712 tst iperf3m4.py: using BVCI 27124 08:27:53.934720 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.945515 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.956175 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.966957 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.977470 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.988307 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:53.999205 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:54.009663 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:27:54.020688 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:54.136527 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:54.257756 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:54.376156 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:27:54.490640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:27:54.695706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:55.001936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17009): Launched 08:27:55.265119 run iperf3-srv_10.42.42.10(pid=17010): Launched 08:27:55.378640 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:27:55.581363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:55.885015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17011): Launched 08:27:56.148139 run iperf3-srv_10.42.42.10(pid=17012): Launched 08:27:56.261879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:27:56.464656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:56.769295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17013): Launched 08:27:57.032299 run iperf3-srv_10.42.42.10(pid=17014): Launched 08:27:57.146144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:27:57.349204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:27:57.653465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17015): Launched 08:27:57.916552 run iperf3-srv_10.42.42.10(pid=17016): Launched 08:27:58.030524 tst iperf3m4.py:8: start network... 08:27:58.234134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:27:58.703314 run create_hlr_db(pid=17017): Launched 08:27:58.818321 bus /gobi_6: Setting Powered False 08:27:59.877745 run create_hlr_db(pid=17017): Terminated: ok {rc=0} 08:28:00.299016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Launched 08:28:00.600417 run osmo-hlr_10.42.42.2(pid=17020): Launched 08:28:00.717204 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:01.323802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Launched 08:28:01.668889 run osmo-stp_10.42.42.5(pid=17023): Launched 08:28:01.900978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:02.665239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Launched 08:28:02.787658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:03.058783 run patchelf(pid=17026): Launched 08:28:03.237083 run osmo-stp_10.42.42.5(pid=17023): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] 08:28:03.372627 run osmo-stp_10.42.42.5(pid=17023): stdout: | (launched: 2022-12-10_08:28:01.602871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:03.509399 run osmo-stp_10.42.42.5(pid=17023): stderr: | 20221210082801988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082801988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082801988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082801989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082801989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082801989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082801989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:03.646837 run osmo-stp_10.42.42.5(pid=17023): stdout: | (launched: 2022-12-10_08:28:01.602871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:03.778420 run osmo-stp_10.42.42.5(pid=17023): stderr: | 20221210082801988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082801988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082801988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082801989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082801989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082801989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082801989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:03.933947 run patchelf(pid=17026): Terminating (SIGINT) 08:28:04.112781 run patchelf(pid=17026): Terminated: ok {rc=0} 08:28:04.241782 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17023): Process ended prematurely: osmo-stp_10.42.42.5(pid=17023) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 08:28:04.251552 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:28:04.279753 run osmo-hlr_10.42.42.2(pid=17020): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17020)] 08:28:04.329225 run osmo-hlr_10.42.42.2(pid=17020): stdout: | (launched: 2022-12-10_08:28:00.545664) 08:28:04.380212 run osmo-hlr_10.42.42.2(pid=17020): stderr: | 20221210082800723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082800723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082800723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082800723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082800723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082800724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082800739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082800749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082800749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082800749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:04.431728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17009): Terminating (SIGTERM) 08:28:04.472898 run iperf3-srv_10.42.42.10(pid=17010): Terminating (SIGTERM) 08:28:04.514189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17011): Terminating (SIGTERM) 08:28:04.555412 run iperf3-srv_10.42.42.10(pid=17012): Terminating (SIGTERM) 08:28:04.596340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17013): Terminating (SIGTERM) 08:28:04.637552 run iperf3-srv_10.42.42.10(pid=17014): Terminating (SIGTERM) 08:28:04.678957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17015): Terminating (SIGTERM) 08:28:04.720455 run iperf3-srv_10.42.42.10(pid=17016): Terminating (SIGTERM) 08:28:04.761770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminating (SIGTERM) 08:28:04.803047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Terminating (SIGTERM) 08:28:04.844117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Terminating (SIGTERM) 08:28:04.885467 --- ParallelTerminationStrategy: PID 17009 died... 08:28:04.904663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17009): Terminated: ok {rc=0} 08:28:04.950626 --- ParallelTerminationStrategy: PID 17010 died... 08:28:04.969979 run iperf3-srv_10.42.42.10(pid=17010): Terminated {rc=256} 08:28:05.015451 --- ParallelTerminationStrategy: PID 17011 died... 08:28:05.034748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17011): Terminated: ok {rc=0} 08:28:05.080326 --- ParallelTerminationStrategy: PID 17012 died... 08:28:05.099744 run iperf3-srv_10.42.42.10(pid=17012): Terminated {rc=256} 08:28:05.145125 --- ParallelTerminationStrategy: PID 17013 died... 08:28:05.164253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17013): Terminated: ok {rc=0} 08:28:05.209974 --- ParallelTerminationStrategy: PID 17014 died... 08:28:05.229359 run iperf3-srv_10.42.42.10(pid=17014): Terminated {rc=256} 08:28:05.274778 --- ParallelTerminationStrategy: PID 17015 died... 08:28:05.294011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17015): Terminated: ok {rc=0} 08:28:05.339670 --- ParallelTerminationStrategy: PID 17016 died... 08:28:05.359158 run iperf3-srv_10.42.42.10(pid=17016): Terminated {rc=256} 08:28:05.404519 --- ParallelTerminationStrategy: PID 17019 died... 08:28:05.423646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminated: ok {rc=0} 08:28:05.468741 --- ParallelTerminationStrategy: PID 17022 died... 08:28:05.488030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Terminated: ok {rc=0} 08:28:05.533440 --- ParallelTerminationStrategy: PID 17025 died... 08:28:05.552575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Terminated: ok {rc=0} 08:28:05.640043 bus /gobi_4: Setting Powered False 08:28:06.739120 bus /gobi_4: Setting Powered False 08:28:07.854233 bus /gobi_1: Setting Powered False 08:28:08.953752 bus /gobi_1: Setting Powered False 08:28:10.069686 bus /gobi_0: Setting Powered False 08:28:11.167473 bus /gobi_0: Setting Powered False 08:28:12.284029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 08:28:13.385920 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.397523 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:28:13.437792 tst ping.py: using LAC 27124 08:28:13.562862 tst ping.py: using RAC 94 08:28:13.688891 tst ping.py: using CellId 27124 08:28:13.814545 tst ping.py: using BVCI 27125 08:28:13.930682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.941859 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.953054 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.964080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.975006 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.985929 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:13.997135 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:14.008210 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:28:14.130016 tst ping.py:19: start network... 08:28:14.343125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:14.834765 run create_hlr_db(pid=17027): Launched 08:28:14.963263 bus /gobi_6: Setting Powered False 08:28:16.025467 run create_hlr_db(pid=17027): Terminated: ok {rc=0} 08:28:16.473609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17029): Launched 08:28:16.802689 run osmo-hlr_10.42.42.2(pid=17030): Launched 08:28:16.947780 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:17.586886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17032): Launched 08:28:17.902126 run osmo-stp_10.42.42.5(pid=17033): Launched 08:28:18.021691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:18.566186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17035): Launched 08:28:18.686571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:18.953952 run patchelf(pid=17036): Launched 08:28:19.129170 run osmo-stp_10.42.42.5(pid=17033): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17033)] 08:28:19.262754 run osmo-stp_10.42.42.5(pid=17033): stdout: | (launched: 2022-12-10_08:28:17.844615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:19.397746 run osmo-stp_10.42.42.5(pid=17033): stderr: | 20221210082818035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082818036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082818036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082818036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082818037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082818037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082818037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:19.532686 run osmo-stp_10.42.42.5(pid=17033): stdout: | (launched: 2022-12-10_08:28:17.844615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:19.662826 run osmo-stp_10.42.42.5(pid=17033): stderr: | 20221210082818035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082818036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082818036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082818036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082818037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082818037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082818037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:19.816655 run patchelf(pid=17036): Terminating (SIGINT) 08:28:19.993668 run patchelf(pid=17036): Terminated: ok {rc=0} 08:28:20.120845 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17033): Process ended prematurely: osmo-stp_10.42.42.5(pid=17033) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17033)] [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 08:28:20.130175 tst ping.py:22: Test FAILED (6.7 sec) 08:28:20.157795 run osmo-hlr_10.42.42.2(pid=17030): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17030)] 08:28:20.207223 run osmo-hlr_10.42.42.2(pid=17030): stdout: | (launched: 2022-12-10_08:28:16.739569) 08:28:20.258216 run osmo-hlr_10.42.42.2(pid=17030): stderr: | 20221210082817088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082817088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082817088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082817088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082817088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082817088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082817116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082817141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082817141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082817141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:20.309654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17029): Terminating (SIGTERM) 08:28:20.350934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17032): Terminating (SIGTERM) 08:28:20.392080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17035): Terminating (SIGTERM) 08:28:20.433500 --- ParallelTerminationStrategy: PID 17029 died... 08:28:20.453323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17029): Terminated: ok {rc=0} 08:28:20.499022 --- ParallelTerminationStrategy: PID 17032 died... 08:28:20.518292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17032): Terminated: ok {rc=0} 08:28:20.564238 --- ParallelTerminationStrategy: PID 17035 died... 08:28:20.583657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17035): Terminated: ok {rc=0} 08:28:20.669590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:28:21.756251 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:21.767975 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:28:21.813493 tst ping_idle_ping.py: using LAC 27125 08:28:21.932060 tst ping_idle_ping.py: using RAC 95 08:28:22.048304 tst ping_idle_ping.py: using CellId 27125 08:28:22.164656 tst ping_idle_ping.py: using BVCI 27126 08:28:22.273513 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.284297 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.295094 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.306307 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.317246 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.328070 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.339039 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:28:22.350385 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:28:22.475683 tst ping_idle_ping.py:24: start network... 08:28:22.689703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:23.179426 run create_hlr_db(pid=17037): Launched 08:28:23.307848 bus /gobi_6: Setting Powered False 08:28:24.371382 run create_hlr_db(pid=17037): Terminated: ok {rc=0} 08:28:24.794739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17039): Launched 08:28:25.092403 run osmo-hlr_10.42.42.2(pid=17040): Launched 08:28:25.206579 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:25.732247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17042): Launched 08:28:26.028863 run osmo-stp_10.42.42.5(pid=17043): Launched 08:28:26.142939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:26.656838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17045): Launched 08:28:26.770315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:27.021471 run patchelf(pid=17046): Launched 08:28:27.187150 run osmo-stp_10.42.42.5(pid=17043): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17043)] 08:28:27.313224 run osmo-stp_10.42.42.5(pid=17043): stdout: | (launched: 2022-12-10_08:28:25.975077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:27.440237 run osmo-stp_10.42.42.5(pid=17043): stderr: | 20221210082826143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082826144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082826144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082826144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082826145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082826145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082826145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:27.568072 run osmo-stp_10.42.42.5(pid=17043): stdout: | (launched: 2022-12-10_08:28:25.975077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:27.690205 run osmo-stp_10.42.42.5(pid=17043): stderr: | 20221210082826143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082826144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082826144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082826144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082826145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082826145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082826145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:27.834930 run patchelf(pid=17046): Terminating (SIGINT) 08:28:28.002366 run patchelf(pid=17046): Terminated: ok {rc=0} 08:28:28.122919 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17043): Process ended prematurely: osmo-stp_10.42.42.5(pid=17043) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17043)] [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 08:28:28.131873 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:28:28.158617 run osmo-hlr_10.42.42.2(pid=17040): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17040)] 08:28:28.206088 run osmo-hlr_10.42.42.2(pid=17040): stdout: | (launched: 2022-12-10_08:28:25.038516) 08:28:28.255133 run osmo-hlr_10.42.42.2(pid=17040): stderr: | 20221210082825214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082825214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082825214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082825214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082825214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082825214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082825227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082825236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082825236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082825236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:28.304550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17039): Terminating (SIGTERM) 08:28:28.343961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17042): Terminating (SIGTERM) 08:28:28.383227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17045): Terminating (SIGTERM) 08:28:28.422888 --- ParallelTerminationStrategy: PID 17039 died... 08:28:28.441739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17039): Terminated: ok {rc=0} 08:28:28.485706 --- ParallelTerminationStrategy: PID 17042 died... 08:28:28.503987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17042): Terminated: ok {rc=0} 08:28:28.547922 --- ParallelTerminationStrategy: PID 17045 died... 08:28:28.566267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17045): Terminated: ok {rc=0} 08:28:28.648643 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:28:29.937788 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:28:29.944250 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:28:29.965384 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:28:30.004469 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:28:30.091526 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:28:30.112760 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:28:30.152189 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:28:30.749360 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:28:30.800838 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:30.812066 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:28:30.872818 tst cs_paging_gprs_active.py: using LAC 27126 08:28:31.008796 tst cs_paging_gprs_active.py: using RAC 96 08:28:31.136026 tst cs_paging_gprs_active.py: using CellId 27126 08:28:31.257659 tst cs_paging_gprs_active.py: using BVCI 27127 08:28:31.374389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.386446 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.399025 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.412664 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.425337 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.437275 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.449587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.462135 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:31.474419 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:31.616537 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:31.761055 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:28:32.029537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:32.358472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Launched 08:28:32.625457 run iperf3-srv_10.42.42.10(pid=17051): Launched 08:28:32.738854 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:28:32.942109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:33.249134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17052): Launched 08:28:33.515177 run iperf3-srv_10.42.42.10(pid=17053): Launched 08:28:33.628361 tst cs_paging_gprs_active.py:38: start network... 08:28:33.831105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:34.301900 run create_hlr_db(pid=17054): Launched 08:28:34.417794 bus /gobi_6: Setting Powered False 08:28:35.477963 run create_hlr_db(pid=17054): Terminated: ok {rc=0} 08:28:35.923831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17057): Launched 08:28:36.248417 run osmo-hlr_10.42.42.2(pid=17058): Launched 08:28:36.371742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:36.930255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17060): Launched 08:28:37.255833 run osmo-stp_10.42.42.5(pid=17061): Launched 08:28:37.378117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:37.942087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17063): Launched 08:28:38.065053 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:38.343109 run patchelf(pid=17064): Launched 08:28:38.522206 run osmo-stp_10.42.42.5(pid=17061): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17061)] 08:28:38.658199 run osmo-stp_10.42.42.5(pid=17061): stdout: | (launched: 2022-12-10_08:28:37.193012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:38.796336 run osmo-stp_10.42.42.5(pid=17061): stderr: | 20221210082837388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082837389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082837389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082837389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082837390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082837390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082837390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:38.934204 run osmo-stp_10.42.42.5(pid=17061): stdout: | (launched: 2022-12-10_08:28:37.193012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:39.066544 run osmo-stp_10.42.42.5(pid=17061): stderr: | 20221210082837388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082837389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082837389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082837389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082837390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082837390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082837390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:39.222710 run patchelf(pid=17064): Terminating (SIGINT) 08:28:39.403242 run patchelf(pid=17064): Terminated: ok {rc=0} 08:28:39.533347 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17061): Process ended prematurely: osmo-stp_10.42.42.5(pid=17061) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17061)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:28:39.543132 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:28:39.571332 run osmo-hlr_10.42.42.2(pid=17058): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17058)] 08:28:39.620885 run osmo-hlr_10.42.42.2(pid=17058): stdout: | (launched: 2022-12-10_08:28:36.186765) 08:28:39.672661 run osmo-hlr_10.42.42.2(pid=17058): stderr: | 20221210082836389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082836389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082836389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082836389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082836389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082836389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082836401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082836409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082836409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082836409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:39.724332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Terminating (SIGTERM) 08:28:39.765594 run iperf3-srv_10.42.42.10(pid=17051): Terminating (SIGTERM) 08:28:39.806734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17052): Terminating (SIGTERM) 08:28:39.847957 run iperf3-srv_10.42.42.10(pid=17053): Terminating (SIGTERM) 08:28:39.889230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17057): Terminating (SIGTERM) 08:28:39.930416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17060): Terminating (SIGTERM) 08:28:39.971544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17063): Terminating (SIGTERM) 08:28:40.012826 --- ParallelTerminationStrategy: PID 17050 died... 08:28:40.032594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17050): Terminated: ok {rc=0} 08:28:40.078782 --- ParallelTerminationStrategy: PID 17051 died... 08:28:40.098009 run iperf3-srv_10.42.42.10(pid=17051): Terminated {rc=256} 08:28:40.143419 --- ParallelTerminationStrategy: PID 17052 died... 08:28:40.162614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17052): Terminated: ok {rc=0} 08:28:40.208344 --- ParallelTerminationStrategy: PID 17053 died... 08:28:40.227491 run iperf3-srv_10.42.42.10(pid=17053): Terminated {rc=256} 08:28:40.272809 --- ParallelTerminationStrategy: PID 17057 died... 08:28:40.292556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17057): Terminated: ok {rc=0} 08:28:40.338234 --- ParallelTerminationStrategy: PID 17060 died... 08:28:40.357676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17060): Terminated: ok {rc=0} 08:28:40.403301 --- ParallelTerminationStrategy: PID 17063 died... 08:28:40.422584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17063): Terminated: ok {rc=0} 08:28:40.508718 bus /gobi_0: Setting Powered False 08:28:41.605509 bus /gobi_0: Setting Powered False 08:28:42.721492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:28:43.863529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:43.874920 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:28:43.933410 tst iperf3.py: using LAC 27127 08:28:44.054531 tst iperf3.py: using RAC 97 08:28:44.174817 tst iperf3.py: using CellId 27127 08:28:44.294189 tst iperf3.py: using BVCI 27128 08:28:44.404169 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.414966 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.425598 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.436425 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.447212 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.457942 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.468827 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.479718 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:44.490904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:44.603850 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:28:44.807391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:45.115300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17066): Launched 08:28:45.382904 run iperf3-srv_10.42.42.10(pid=17067): Launched 08:28:45.496576 tst iperf3.py:8: start network... 08:28:45.700344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:46.231375 run create_hlr_db(pid=17068): Launched 08:28:46.349647 bus /gobi_6: Setting Powered False 08:28:47.417865 run create_hlr_db(pid=17068): Terminated: ok {rc=0} 08:28:47.871212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Launched 08:28:48.196582 run osmo-hlr_10.42.42.2(pid=17071): Launched 08:28:48.320578 run osmo-stp_10.42.42.5: Starting osmo-stp 08:28:48.882670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Launched 08:28:49.208638 run osmo-stp_10.42.42.5(pid=17074): Launched 08:28:49.332314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:28:49.896395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17076): Launched 08:28:50.018730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:28:50.295045 run patchelf(pid=17077): Launched 08:28:50.473204 run osmo-stp_10.42.42.5(pid=17074): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] 08:28:50.609161 run osmo-stp_10.42.42.5(pid=17074): stdout: | (launched: 2022-12-10_08:28:49.145391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:50.747120 run osmo-stp_10.42.42.5(pid=17074): stderr: | 20221210082849340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082849340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082849340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082849342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082849344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082849344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082849345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:50.884521 run osmo-stp_10.42.42.5(pid=17074): stdout: | (launched: 2022-12-10_08:28:49.145391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:28:51.016748 run osmo-stp_10.42.42.5(pid=17074): stderr: | 20221210082849340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082849340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082849340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082849342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082849344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082849344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082849345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:28:51.173672 run patchelf(pid=17077): Terminating (SIGINT) 08:28:51.353592 run patchelf(pid=17077): Terminated: ok {rc=0} 08:28:51.483238 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17074): Process ended prematurely: osmo-stp_10.42.42.5(pid=17074) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 08:28:51.493058 tst iperf3.py:8: Test FAILED (7.7 sec) 08:28:51.521070 run osmo-hlr_10.42.42.2(pid=17071): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17071)] 08:28:51.570381 run osmo-hlr_10.42.42.2(pid=17071): stdout: | (launched: 2022-12-10_08:28:48.134687) 08:28:51.621253 run osmo-hlr_10.42.42.2(pid=17071): stderr: | 20221210082848336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082848336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082848336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082848336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082848336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082848336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082848347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082848355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082848355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082848355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:28:51.673090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17066): Terminating (SIGTERM) 08:28:51.714535 run iperf3-srv_10.42.42.10(pid=17067): Terminating (SIGTERM) 08:28:51.756048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Terminating (SIGTERM) 08:28:51.797751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Terminating (SIGTERM) 08:28:51.839271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17076): Terminating (SIGTERM) 08:28:51.881223 --- ParallelTerminationStrategy: PID 17066 died... 08:28:51.901414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17066): Terminated: ok {rc=0} 08:28:51.947485 --- ParallelTerminationStrategy: PID 17067 died... 08:28:51.967003 run iperf3-srv_10.42.42.10(pid=17067): Terminated {rc=256} 08:28:52.012655 --- ParallelTerminationStrategy: PID 17070 died... 08:28:52.032111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17070): Terminated: ok {rc=0} 08:28:52.078025 --- ParallelTerminationStrategy: PID 17073 died... 08:28:52.097481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17073): Terminated: ok {rc=0} 08:28:52.143497 --- ParallelTerminationStrategy: PID 17076 died... 08:28:52.165776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17076): Terminated: ok {rc=0} 08:28:52.252132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:28:53.398153 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:53.409662 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:28:53.465225 tst iperf3m4.py: using LAC 27128 08:28:53.585339 tst iperf3m4.py: using RAC 98 08:28:53.707556 tst iperf3m4.py: using CellId 27128 08:28:53.836886 tst iperf3m4.py: using BVCI 27129 08:28:53.954584 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:53.966033 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:53.977064 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:53.988142 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:53.999097 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:54.010177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:54.021342 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:54.032237 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:28:54.043452 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:54.164287 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:54.282722 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:54.401186 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:28:54.519147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:28:54.737556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:55.066639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17087): Launched 08:28:55.350826 run iperf3-srv_10.42.42.10(pid=17088): Launched 08:28:55.471209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:28:55.688419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:56.014522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17089): Launched 08:28:56.297513 run iperf3-srv_10.42.42.10(pid=17090): Launched 08:28:56.418192 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:28:56.635445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:56.963335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17091): Launched 08:28:57.247545 run iperf3-srv_10.42.42.10(pid=17092): Launched 08:28:57.368360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:28:57.586261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:28:57.914638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17093): Launched 08:28:58.198486 run iperf3-srv_10.42.42.10(pid=17094): Launched 08:28:58.319055 tst iperf3m4.py:8: start network... 08:28:58.536888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:28:59.044768 run create_hlr_db(pid=17095): Launched 08:28:59.175821 bus /gobi_6: Setting Powered False 08:29:00.239450 run create_hlr_db(pid=17095): Terminated: ok {rc=0} 08:29:00.676296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17097): Launched 08:29:01.017663 run osmo-hlr_10.42.42.2(pid=17098): Launched 08:29:01.179883 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:01.924792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17100): Launched 08:29:02.253957 run osmo-stp_10.42.42.5(pid=17101): Launched 08:29:02.523348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:03.085133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17103): Launched 08:29:03.207879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:03.483682 run patchelf(pid=17104): Launched 08:29:03.662171 run osmo-stp_10.42.42.5(pid=17101): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17101)] 08:29:03.798249 run osmo-stp_10.42.42.5(pid=17101): stdout: | (launched: 2022-12-10_08:29:02.191913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:03.935585 run osmo-stp_10.42.42.5(pid=17101): stderr: | 20221210082902412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082902412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082902412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082902413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082902413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082902413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082902413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:04.073263 run osmo-stp_10.42.42.5(pid=17101): stdout: | (launched: 2022-12-10_08:29:02.191913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:04.205415 run osmo-stp_10.42.42.5(pid=17101): stderr: | 20221210082902412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082902412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082902412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082902413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082902413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082902413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082902413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:04.361846 run patchelf(pid=17104): Terminating (SIGINT) 08:29:04.541734 run patchelf(pid=17104): Terminated: ok {rc=0} 08:29:04.671959 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17101): Process ended prematurely: osmo-stp_10.42.42.5(pid=17101) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17101)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:29:04.681866 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:29:04.710295 run osmo-hlr_10.42.42.2(pid=17098): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17098)] 08:29:04.760110 run osmo-hlr_10.42.42.2(pid=17098): stdout: | (launched: 2022-12-10_08:29:00.943245) 08:29:04.811371 run osmo-hlr_10.42.42.2(pid=17098): stderr: | 20221210082901337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082901337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082901337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082901337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082901337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082901338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082901356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082901380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082901380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082901380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:04.862840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17087): Terminating (SIGTERM) 08:29:04.904194 run iperf3-srv_10.42.42.10(pid=17088): Terminating (SIGTERM) 08:29:04.945500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17089): Terminating (SIGTERM) 08:29:04.987030 run iperf3-srv_10.42.42.10(pid=17090): Terminating (SIGTERM) 08:29:05.028270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17091): Terminating (SIGTERM) 08:29:05.069591 run iperf3-srv_10.42.42.10(pid=17092): Terminating (SIGTERM) 08:29:05.110747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17093): Terminating (SIGTERM) 08:29:05.151730 run iperf3-srv_10.42.42.10(pid=17094): Terminating (SIGTERM) 08:29:05.193335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17097): Terminating (SIGTERM) 08:29:05.235036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17100): Terminating (SIGTERM) 08:29:05.276213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17103): Terminating (SIGTERM) 08:29:05.317782 --- ParallelTerminationStrategy: PID 17087 died... 08:29:05.337525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17087): Terminated: ok {rc=0} 08:29:05.383025 --- ParallelTerminationStrategy: PID 17088 died... 08:29:05.402303 run iperf3-srv_10.42.42.10(pid=17088): Terminated {rc=256} 08:29:05.447678 --- ParallelTerminationStrategy: PID 17089 died... 08:29:05.467023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17089): Terminated: ok {rc=0} 08:29:05.512523 --- ParallelTerminationStrategy: PID 17090 died... 08:29:05.531823 run iperf3-srv_10.42.42.10(pid=17090): Terminated {rc=256} 08:29:05.577230 --- ParallelTerminationStrategy: PID 17091 died... 08:29:05.596272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17091): Terminated: ok {rc=0} 08:29:05.641983 --- ParallelTerminationStrategy: PID 17092 died... 08:29:05.661217 run iperf3-srv_10.42.42.10(pid=17092): Terminated {rc=256} 08:29:05.706807 --- ParallelTerminationStrategy: PID 17093 died... 08:29:05.726132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17093): Terminated: ok {rc=0} 08:29:05.771589 --- ParallelTerminationStrategy: PID 17094 died... 08:29:05.790896 run iperf3-srv_10.42.42.10(pid=17094): Terminated {rc=256} 08:29:05.836272 --- ParallelTerminationStrategy: PID 17097 died... 08:29:05.855721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17097): Terminated: ok {rc=0} 08:29:05.901308 --- ParallelTerminationStrategy: PID 17100 died... 08:29:05.920630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17100): Terminated: ok {rc=0} 08:29:05.966217 --- ParallelTerminationStrategy: PID 17103 died... 08:29:05.985515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17103): Terminated: ok {rc=0} 08:29:06.072677 bus /gobi_4: Setting Powered False 08:29:07.172713 bus /gobi_4: Setting Powered False 08:29:08.287913 bus /gobi_1: Setting Powered False 08:29:09.385937 bus /gobi_1: Setting Powered False 08:29:10.500806 bus /gobi_0: Setting Powered False 08:29:11.599195 bus /gobi_0: Setting Powered False 08:29:12.715511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:29:13.817563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:13.829777 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:29:13.887980 tst ping.py: using LAC 27129 08:29:14.009363 tst ping.py: using RAC 99 08:29:14.125632 tst ping.py: using CellId 27129 08:29:14.250785 tst ping.py: using BVCI 27130 08:29:14.366155 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.377489 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.388560 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.399728 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.410740 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.421760 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.432897 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:14.443992 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:29:14.558657 tst ping.py:19: start network... 08:29:14.758406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:15.222500 run create_hlr_db(pid=17105): Launched 08:29:15.337493 bus /gobi_6: Setting Powered False 08:29:16.396444 run create_hlr_db(pid=17105): Terminated: ok {rc=0} 08:29:16.837774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17107): Launched 08:29:17.163986 run osmo-hlr_10.42.42.2(pid=17108): Launched 08:29:17.291878 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:17.829571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17110): Launched 08:29:18.130733 run osmo-stp_10.42.42.5(pid=17111): Launched 08:29:18.244387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:18.760696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17113): Launched 08:29:18.874823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:19.128921 run patchelf(pid=17114): Launched 08:29:19.294108 run osmo-stp_10.42.42.5(pid=17111): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17111)] 08:29:19.420507 run osmo-stp_10.42.42.5(pid=17111): stdout: | (launched: 2022-12-10_08:29:18.072893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:19.547894 run osmo-stp_10.42.42.5(pid=17111): stderr: | 20221210082918248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082918248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082918248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082918249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082918249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082918249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082918250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:19.675933 run osmo-stp_10.42.42.5(pid=17111): stdout: | (launched: 2022-12-10_08:29:18.072893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:19.797801 run osmo-stp_10.42.42.5(pid=17111): stderr: | 20221210082918248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082918248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082918248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082918249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082918249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082918249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082918250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:19.942963 run patchelf(pid=17114): Terminating (SIGINT) 08:29:20.109940 run patchelf(pid=17114): Terminated: ok {rc=0} 08:29:20.230698 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17111): Process ended prematurely: osmo-stp_10.42.42.5(pid=17111) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17111)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 08:29:20.239363 tst ping.py:22: Test FAILED (6.4 sec) 08:29:20.265972 run osmo-hlr_10.42.42.2(pid=17108): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17108)] 08:29:20.313097 run osmo-hlr_10.42.42.2(pid=17108): stdout: | (launched: 2022-12-10_08:29:17.090663) 08:29:20.361647 run osmo-hlr_10.42.42.2(pid=17108): stderr: | 20221210082917297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082917297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082917297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082917298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082917298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082917298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082917309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082917317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082917317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082917317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:20.410573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17107): Terminating (SIGTERM) 08:29:20.450766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17110): Terminating (SIGTERM) 08:29:20.489832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17113): Terminating (SIGTERM) 08:29:20.529241 --- ParallelTerminationStrategy: PID 17107 died... 08:29:20.547773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17107): Terminated: ok {rc=0} 08:29:20.591569 --- ParallelTerminationStrategy: PID 17110 died... 08:29:20.609868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17110): Terminated: ok {rc=0} 08:29:20.653305 --- ParallelTerminationStrategy: PID 17113 died... 08:29:20.671655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17113): Terminated: ok {rc=0} 08:29:20.756197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:29:21.844206 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:21.855900 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:29:21.913412 tst ping_idle_ping.py: using LAC 27130 08:29:22.032123 tst ping_idle_ping.py: using RAC 100 08:29:22.149155 tst ping_idle_ping.py: using CellId 27130 08:29:22.265668 tst ping_idle_ping.py: using BVCI 27131 08:29:22.376048 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.386780 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.397389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.408124 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.418818 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.429539 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.440400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:29:22.451125 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:29:22.568602 tst ping_idle_ping.py:24: start network... 08:29:22.783107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:23.280237 run create_hlr_db(pid=17115): Launched 08:29:23.410510 bus /gobi_6: Setting Powered False 08:29:24.473446 run create_hlr_db(pid=17115): Terminated: ok {rc=0} 08:29:24.920926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17117): Launched 08:29:25.244449 run osmo-hlr_10.42.42.2(pid=17118): Launched 08:29:25.367005 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:25.919638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17120): Launched 08:29:26.239437 run osmo-stp_10.42.42.5(pid=17121): Launched 08:29:26.360304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:26.910893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17123): Launched 08:29:27.031282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:27.303818 run patchelf(pid=17124): Launched 08:29:27.480441 run osmo-stp_10.42.42.5(pid=17121): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17121)] 08:29:27.614355 run osmo-stp_10.42.42.5(pid=17121): stdout: | (launched: 2022-12-10_08:29:26.178216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:27.750207 run osmo-stp_10.42.42.5(pid=17121): stderr: | 20221210082926374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082926375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082926375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082926375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082926376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082926376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082926376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:27.885579 run osmo-stp_10.42.42.5(pid=17121): stdout: | (launched: 2022-12-10_08:29:26.178216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:28.015353 run osmo-stp_10.42.42.5(pid=17121): stderr: | 20221210082926374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082926375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082926375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082926375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082926376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082926376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082926376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:28.169160 run patchelf(pid=17124): Terminating (SIGINT) 08:29:28.346512 run patchelf(pid=17124): Terminated: ok {rc=0} 08:29:28.474345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17121): Process ended prematurely: osmo-stp_10.42.42.5(pid=17121) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17121)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:29:28.483651 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:29:28.510970 run osmo-hlr_10.42.42.2(pid=17118): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17118)] 08:29:28.560075 run osmo-hlr_10.42.42.2(pid=17118): stdout: | (launched: 2022-12-10_08:29:25.180835) 08:29:28.610858 run osmo-hlr_10.42.42.2(pid=17118): stderr: | 20221210082925383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082925383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082925383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082925383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082925383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082925383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082925395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082925403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082925403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082925403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:28.661987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17117): Terminating (SIGTERM) 08:29:28.703510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17120): Terminating (SIGTERM) 08:29:28.744718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17123): Terminating (SIGTERM) 08:29:28.786269 --- ParallelTerminationStrategy: PID 17117 died... 08:29:28.805883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17117): Terminated: ok {rc=0} 08:29:28.851159 --- ParallelTerminationStrategy: PID 17120 died... 08:29:28.870286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17120): Terminated: ok {rc=0} 08:29:28.915607 --- ParallelTerminationStrategy: PID 17123 died... 08:29:28.934781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17123): Terminated: ok {rc=0} 08:29:29.021311 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:29:30.312116 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:29:30.318812 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:29:30.339952 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:29:30.379134 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:29:30.467998 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:29:30.489223 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:29:30.528247 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:29:31.142654 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:29:31.195129 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.206460 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:29:31.264026 tst cs_paging_gprs_active.py: using LAC 27131 08:29:31.433313 tst cs_paging_gprs_active.py: using RAC 101 08:29:31.601143 tst cs_paging_gprs_active.py: using CellId 27131 08:29:31.730786 tst cs_paging_gprs_active.py: using BVCI 27132 08:29:31.853642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.865884 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.877897 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.890406 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.902042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.914484 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.926649 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.938241 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:31.949936 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:32.102915 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:32.242848 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:29:32.460555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:32.783433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17128): Launched 08:29:33.062077 run iperf3-srv_10.42.42.10(pid=17129): Launched 08:29:33.182519 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:29:33.399555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:33.722033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Launched 08:29:34.000434 run iperf3-srv_10.42.42.10(pid=17131): Launched 08:29:34.120583 tst cs_paging_gprs_active.py:38: start network... 08:29:34.337141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:34.835252 run create_hlr_db(pid=17132): Launched 08:29:34.965555 bus /gobi_6: Setting Powered False 08:29:36.028826 run create_hlr_db(pid=17132): Terminated: ok {rc=0} 08:29:36.459807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Launched 08:29:36.762899 run osmo-hlr_10.42.42.2(pid=17135): Launched 08:29:36.878059 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:37.413294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Launched 08:29:37.716882 run osmo-stp_10.42.42.5(pid=17138): Launched 08:29:37.832630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:38.355670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Launched 08:29:38.471291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:38.726943 run patchelf(pid=17141): Launched 08:29:38.894885 run osmo-stp_10.42.42.5(pid=17138): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] 08:29:39.023546 run osmo-stp_10.42.42.5(pid=17138): stdout: | (launched: 2022-12-10_08:29:37.661541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:39.153191 run osmo-stp_10.42.42.5(pid=17138): stderr: | 20221210082937833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082937834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082937834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082937834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082937835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082937835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082937835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:39.282896 run osmo-stp_10.42.42.5(pid=17138): stdout: | (launched: 2022-12-10_08:29:37.661541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:39.407055 run osmo-stp_10.42.42.5(pid=17138): stderr: | 20221210082937833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082937834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082937834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082937834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082937835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082937835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082937835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:39.554736 run patchelf(pid=17141): Terminating (SIGINT) 08:29:39.725078 run patchelf(pid=17141): Terminated: ok {rc=0} 08:29:39.847625 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17138): Process ended prematurely: osmo-stp_10.42.42.5(pid=17138) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:29:39.857004 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:29:39.884116 run osmo-hlr_10.42.42.2(pid=17135): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17135)] 08:29:39.931322 run osmo-hlr_10.42.42.2(pid=17135): stdout: | (launched: 2022-12-10_08:29:36.707697) 08:29:39.980260 run osmo-hlr_10.42.42.2(pid=17135): stderr: | 20221210082936881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082936881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082936881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082936881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082936881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082936881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082936893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082936902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082936903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082936903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:40.029367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17128): Terminating (SIGTERM) 08:29:40.068701 run iperf3-srv_10.42.42.10(pid=17129): Terminating (SIGTERM) 08:29:40.108082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Terminating (SIGTERM) 08:29:40.147323 run iperf3-srv_10.42.42.10(pid=17131): Terminating (SIGTERM) 08:29:40.186411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Terminating (SIGTERM) 08:29:40.225639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Terminating (SIGTERM) 08:29:40.264599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Terminating (SIGTERM) 08:29:40.303967 --- ParallelTerminationStrategy: PID 17128 died... 08:29:40.322693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17128): Terminated: ok {rc=0} 08:29:40.366312 --- ParallelTerminationStrategy: PID 17129 died... 08:29:40.384340 run iperf3-srv_10.42.42.10(pid=17129): Terminated {rc=256} 08:29:40.427778 --- ParallelTerminationStrategy: PID 17130 died... 08:29:40.445971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17130): Terminated: ok {rc=0} 08:29:40.489424 --- ParallelTerminationStrategy: PID 17131 died... 08:29:40.507530 run iperf3-srv_10.42.42.10(pid=17131): Terminated {rc=256} 08:29:40.550959 --- ParallelTerminationStrategy: PID 17134 died... 08:29:40.569305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17134): Terminated: ok {rc=0} 08:29:40.612668 --- ParallelTerminationStrategy: PID 17137 died... 08:29:40.630973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17137): Terminated: ok {rc=0} 08:29:40.674460 --- ParallelTerminationStrategy: PID 17140 died... 08:29:40.692511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17140): Terminated: ok {rc=0} 08:29:40.778152 bus /gobi_0: Setting Powered False 08:29:41.876612 bus /gobi_0: Setting Powered False 08:29:42.988793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:29:44.135606 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.147552 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:29:44.209171 tst iperf3.py: using LAC 27132 08:29:44.336863 tst iperf3.py: using RAC 102 08:29:44.468276 tst iperf3.py: using CellId 27132 08:29:44.593778 tst iperf3.py: using BVCI 27133 08:29:44.705443 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.716317 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.726928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.738347 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.749736 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.761258 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.774877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.785828 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:44.797082 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:44.911501 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:29:45.117112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:45.423041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17142): Launched 08:29:45.687902 run iperf3-srv_10.42.42.10(pid=17143): Launched 08:29:45.802452 tst iperf3.py:8: start network... 08:29:46.043712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:46.542987 run create_hlr_db(pid=17144): Launched 08:29:46.685081 bus /gobi_6: Setting Powered False 08:29:47.745581 run create_hlr_db(pid=17144): Terminated: ok {rc=0} 08:29:48.169187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17146): Launched 08:29:48.472318 run osmo-hlr_10.42.42.2(pid=17147): Launched 08:29:48.589140 run osmo-stp_10.42.42.5: Starting osmo-stp 08:29:49.127907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17149): Launched 08:29:49.430341 run osmo-stp_10.42.42.5(pid=17150): Launched 08:29:49.547204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:29:50.071403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17152): Launched 08:29:50.187083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:29:50.443413 run patchelf(pid=17153): Launched 08:29:50.611647 run osmo-stp_10.42.42.5(pid=17150): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17150)] 08:29:50.740133 run osmo-stp_10.42.42.5(pid=17150): stdout: | (launched: 2022-12-10_08:29:49.375465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:50.870587 run osmo-stp_10.42.42.5(pid=17150): stderr: | 20221210082949547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082949547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082949547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082949548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082949548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082949548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082949548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:51.000553 run osmo-stp_10.42.42.5(pid=17150): stdout: | (launched: 2022-12-10_08:29:49.375465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:29:51.125494 run osmo-stp_10.42.42.5(pid=17150): stderr: | 20221210082949547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210082949547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210082949547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210082949548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210082949548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210082949548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210082949548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:29:51.273448 run patchelf(pid=17153): Terminating (SIGINT) 08:29:51.443672 run patchelf(pid=17153): Terminated: ok {rc=0} 08:29:51.567336 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17150): Process ended prematurely: osmo-stp_10.42.42.5(pid=17150) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17150)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 08:29:51.576869 tst iperf3.py:8: Test FAILED (7.5 sec) 08:29:51.604274 run osmo-hlr_10.42.42.2(pid=17147): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17147)] 08:29:51.651876 run osmo-hlr_10.42.42.2(pid=17147): stdout: | (launched: 2022-12-10_08:29:48.417145) 08:29:51.701204 run osmo-hlr_10.42.42.2(pid=17147): stderr: | 20221210082948595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210082948595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210082948595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210082948595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210082948595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210082948595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210082948607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210082948617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210082948617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210082948617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:29:51.750777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17142): Terminating (SIGTERM) 08:29:51.790387 run iperf3-srv_10.42.42.10(pid=17143): Terminating (SIGTERM) 08:29:51.829818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17146): Terminating (SIGTERM) 08:29:51.869406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17149): Terminating (SIGTERM) 08:29:51.908832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17152): Terminating (SIGTERM) 08:29:51.948584 --- ParallelTerminationStrategy: PID 17142 died... 08:29:51.967510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17142): Terminated: ok {rc=0} 08:29:52.011795 --- ParallelTerminationStrategy: PID 17143 died... 08:29:52.030152 run iperf3-srv_10.42.42.10(pid=17143): Terminated {rc=256} 08:29:52.073974 --- ParallelTerminationStrategy: PID 17146 died... 08:29:52.092373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17146): Terminated: ok {rc=0} 08:29:52.136284 --- ParallelTerminationStrategy: PID 17149 died... 08:29:52.154759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17149): Terminated: ok {rc=0} 08:29:52.201400 --- ParallelTerminationStrategy: PID 17152 died... 08:29:52.219847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17152): Terminated: ok {rc=0} 08:29:52.302641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:29:53.451626 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:53.463378 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:29:53.527097 tst iperf3m4.py: using LAC 27133 08:29:53.653378 tst iperf3m4.py: using RAC 103 08:29:53.779242 tst iperf3m4.py: using CellId 27133 08:29:53.904353 tst iperf3m4.py: using BVCI 27134 08:29:54.021744 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.032875 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.043931 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.055061 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.066125 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.077236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.088299 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.099447 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:29:54.110766 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:54.229228 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:54.350701 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:54.467145 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:29:54.584643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:29:54.788274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:55.092332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17154): Launched 08:29:55.355758 run iperf3-srv_10.42.42.10(pid=17155): Launched 08:29:55.469154 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:29:55.672817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:55.976348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17156): Launched 08:29:56.239489 run iperf3-srv_10.42.42.10(pid=17157): Launched 08:29:56.353063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:29:56.556434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:56.859983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17158): Launched 08:29:57.122721 run iperf3-srv_10.42.42.10(pid=17159): Launched 08:29:57.236414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:29:57.439631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:29:57.744456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17160): Launched 08:29:58.007316 run iperf3-srv_10.42.42.10(pid=17161): Launched 08:29:58.120561 tst iperf3m4.py:8: start network... 08:29:58.324396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:29:58.794391 run create_hlr_db(pid=17162): Launched 08:29:58.910609 bus /gobi_6: Setting Powered False 08:29:59.970829 run create_hlr_db(pid=17162): Terminated: ok {rc=0} 08:30:00.392415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Launched 08:30:00.695741 run osmo-hlr_10.42.42.2(pid=17165): Launched 08:30:00.812622 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:01.492270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Launched 08:30:01.839373 run osmo-stp_10.42.42.5(pid=17171): Launched 08:30:02.059158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:02.723751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17173): Launched 08:30:02.846804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:03.118761 run patchelf(pid=17174): Launched 08:30:03.297869 run osmo-stp_10.42.42.5(pid=17171): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17171)] 08:30:03.434415 run osmo-stp_10.42.42.5(pid=17171): stdout: | (launched: 2022-12-10_08:30:01.770671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:03.572814 run osmo-stp_10.42.42.5(pid=17171): stderr: | 20221210083002108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083002109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083002110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083002111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083002121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083002121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083002121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:03.711796 run osmo-stp_10.42.42.5(pid=17171): stdout: | (launched: 2022-12-10_08:30:01.770671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:03.844613 run osmo-stp_10.42.42.5(pid=17171): stderr: | 20221210083002108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083002109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083002110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083002111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083002121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083002121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083002121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:04.002103 run patchelf(pid=17174): Terminating (SIGINT) 08:30:04.183369 run patchelf(pid=17174): Terminated: ok {rc=0} 08:30:04.313745 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17171): Process ended prematurely: osmo-stp_10.42.42.5(pid=17171) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17171)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:30:04.323675 tst iperf3m4.py:8: Test FAILED (10.9 sec) 08:30:04.352517 run osmo-hlr_10.42.42.2(pid=17165): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17165)] 08:30:04.402903 run osmo-hlr_10.42.42.2(pid=17165): stdout: | (launched: 2022-12-10_08:30:00.640491) 08:30:04.454279 run osmo-hlr_10.42.42.2(pid=17165): stderr: | 20221210083000815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083000815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083000815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083000815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083000815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083000815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083000827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083000850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083000850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083000850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:04.506081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17154): Terminating (SIGTERM) 08:30:04.547607 run iperf3-srv_10.42.42.10(pid=17155): Terminating (SIGTERM) 08:30:04.590588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17156): Terminating (SIGTERM) 08:30:04.632379 run iperf3-srv_10.42.42.10(pid=17157): Terminating (SIGTERM) 08:30:04.673814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17158): Terminating (SIGTERM) 08:30:04.715450 run iperf3-srv_10.42.42.10(pid=17159): Terminating (SIGTERM) 08:30:04.756620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17160): Terminating (SIGTERM) 08:30:04.798156 run iperf3-srv_10.42.42.10(pid=17161): Terminating (SIGTERM) 08:30:04.839189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Terminating (SIGTERM) 08:30:04.880406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Terminating (SIGTERM) 08:30:04.921582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17173): Terminating (SIGTERM) 08:30:04.963163 --- ParallelTerminationStrategy: PID 17154 died... 08:30:04.982987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17154): Terminated: ok {rc=0} 08:30:05.029295 --- ParallelTerminationStrategy: PID 17155 died... 08:30:05.048448 run iperf3-srv_10.42.42.10(pid=17155): Terminated {rc=256} 08:30:05.094161 --- ParallelTerminationStrategy: PID 17156 died... 08:30:05.113895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17156): Terminated: ok {rc=0} 08:30:05.159161 --- ParallelTerminationStrategy: PID 17157 died... 08:30:05.178363 run iperf3-srv_10.42.42.10(pid=17157): Terminated {rc=256} 08:30:05.223743 --- ParallelTerminationStrategy: PID 17158 died... 08:30:05.242996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17158): Terminated: ok {rc=0} 08:30:05.288434 --- ParallelTerminationStrategy: PID 17159 died... 08:30:05.307869 run iperf3-srv_10.42.42.10(pid=17159): Terminated {rc=256} 08:30:05.353474 --- ParallelTerminationStrategy: PID 17160 died... 08:30:05.372717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17160): Terminated: ok {rc=0} 08:30:05.418053 --- ParallelTerminationStrategy: PID 17161 died... 08:30:05.437238 run iperf3-srv_10.42.42.10(pid=17161): Terminated {rc=256} 08:30:05.482228 --- ParallelTerminationStrategy: PID 17164 died... 08:30:05.501530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Terminated: ok {rc=0} 08:30:05.546756 --- ParallelTerminationStrategy: PID 17167 died... 08:30:05.566063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Terminated: ok {rc=0} 08:30:05.611110 --- ParallelTerminationStrategy: PID 17173 died... 08:30:05.630241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17173): Terminated: ok {rc=0} 08:30:05.716797 bus /gobi_4: Setting Powered False 08:30:06.813609 bus /gobi_4: Setting Powered False 08:30:07.928294 bus /gobi_1: Setting Powered False 08:30:09.024905 bus /gobi_1: Setting Powered False 08:30:10.138666 bus /gobi_0: Setting Powered False 08:30:11.235850 bus /gobi_0: Setting Powered False 08:30:12.350079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:30:13.451731 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:13.463763 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:30:13.522326 tst ping.py: using LAC 27134 08:30:13.642249 tst ping.py: using RAC 104 08:30:13.762176 tst ping.py: using CellId 27134 08:30:13.881334 tst ping.py: using BVCI 27135 08:30:13.990521 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.001555 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.012178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.023042 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.033828 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.044540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.055294 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:14.066499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:30:14.184195 tst ping.py:19: start network... 08:30:14.383935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:14.845010 run create_hlr_db(pid=17175): Launched 08:30:14.958274 bus /gobi_6: Setting Powered False 08:30:16.021375 run create_hlr_db(pid=17175): Terminated: ok {rc=0} 08:30:16.481852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17177): Launched 08:30:16.825697 run osmo-hlr_10.42.42.2(pid=17178): Launched 08:30:17.071075 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:17.648843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17180): Launched 08:30:17.965917 run osmo-stp_10.42.42.5(pid=17181): Launched 08:30:18.086203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:18.632708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17183): Launched 08:30:18.753880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:19.021673 run patchelf(pid=17184): Launched 08:30:19.197895 run osmo-stp_10.42.42.5(pid=17181): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17181)] 08:30:19.332006 run osmo-stp_10.42.42.5(pid=17181): stdout: | (launched: 2022-12-10_08:30:17.908629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:19.467713 run osmo-stp_10.42.42.5(pid=17181): stderr: | 20221210083018101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083018101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083018101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083018102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083018102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083018102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083018102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:19.603399 run osmo-stp_10.42.42.5(pid=17181): stdout: | (launched: 2022-12-10_08:30:17.908629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:19.733876 run osmo-stp_10.42.42.5(pid=17181): stderr: | 20221210083018101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083018101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083018101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083018102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083018102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083018102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083018102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:19.888782 run patchelf(pid=17184): Terminating (SIGINT) 08:30:20.066705 run patchelf(pid=17184): Terminated: ok {rc=0} 08:30:20.194526 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17181): Process ended prematurely: osmo-stp_10.42.42.5(pid=17181) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17181)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 08:30:20.203858 tst ping.py:22: Test FAILED (6.7 sec) 08:30:20.231728 run osmo-hlr_10.42.42.2(pid=17178): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17178)] 08:30:20.281629 run osmo-hlr_10.42.42.2(pid=17178): stdout: | (launched: 2022-12-10_08:30:16.756292) 08:30:20.332871 run osmo-hlr_10.42.42.2(pid=17178): stderr: | 20221210083017099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083017099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083017099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083017099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083017099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083017100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083017119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083017127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083017127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083017127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:20.384505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17177): Terminating (SIGTERM) 08:30:20.425853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17180): Terminating (SIGTERM) 08:30:20.468337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17183): Terminating (SIGTERM) 08:30:20.509979 --- ParallelTerminationStrategy: PID 17177 died... 08:30:20.530104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17177): Terminated: ok {rc=0} 08:30:20.575900 --- ParallelTerminationStrategy: PID 17180 died... 08:30:20.595284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17180): Terminated: ok {rc=0} 08:30:20.640778 --- ParallelTerminationStrategy: PID 17183 died... 08:30:20.660087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17183): Terminated: ok {rc=0} 08:30:20.747044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:30:21.835145 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:21.847520 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:30:21.907596 tst ping_idle_ping.py: using LAC 27135 08:30:22.033118 tst ping_idle_ping.py: using RAC 105 08:30:22.157908 tst ping_idle_ping.py: using CellId 27135 08:30:22.277959 tst ping_idle_ping.py: using BVCI 27136 08:30:22.389525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.400515 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.411386 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.422949 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.434445 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.445953 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.457714 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:30:22.469442 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:30:22.588107 tst ping_idle_ping.py:24: start network... 08:30:22.803352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:23.298977 run create_hlr_db(pid=17185): Launched 08:30:23.429270 bus /gobi_6: Setting Powered False 08:30:24.492398 run create_hlr_db(pid=17185): Terminated: ok {rc=0} 08:30:24.922546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Launched 08:30:25.221769 run osmo-hlr_10.42.42.2(pid=17188): Launched 08:30:25.337097 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:25.865780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Launched 08:30:26.164504 run osmo-stp_10.42.42.5(pid=17191): Launched 08:30:26.279548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:26.796113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17193): Launched 08:30:26.910272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:27.162335 run patchelf(pid=17194): Launched 08:30:27.328046 run osmo-stp_10.42.42.5(pid=17191): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] 08:30:27.455558 run osmo-stp_10.42.42.5(pid=17191): stdout: | (launched: 2022-12-10_08:30:26.110140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:27.584926 run osmo-stp_10.42.42.5(pid=17191): stderr: | 20221210083026278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083026278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083026278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083026279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083026279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083026279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083026279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:27.713760 run osmo-stp_10.42.42.5(pid=17191): stdout: | (launched: 2022-12-10_08:30:26.110140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:27.836726 run osmo-stp_10.42.42.5(pid=17191): stderr: | 20221210083026278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083026278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083026278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083026279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083026279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083026279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083026279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:27.983121 run patchelf(pid=17194): Terminating (SIGINT) 08:30:28.151598 run patchelf(pid=17194): Terminated: ok {rc=0} 08:30:28.272933 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17191): Process ended prematurely: osmo-stp_10.42.42.5(pid=17191) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:30:28.281838 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:30:28.308741 run osmo-hlr_10.42.42.2(pid=17188): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17188)] 08:30:28.356319 run osmo-hlr_10.42.42.2(pid=17188): stdout: | (launched: 2022-12-10_08:30:25.167335) 08:30:28.405412 run osmo-hlr_10.42.42.2(pid=17188): stderr: | 20221210083025341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083025341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083025341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083025341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083025341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083025341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083025354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083025362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083025362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083025362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:28.455130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Terminating (SIGTERM) 08:30:28.494560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Terminating (SIGTERM) 08:30:28.534177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17193): Terminating (SIGTERM) 08:30:28.574226 --- ParallelTerminationStrategy: PID 17187 died... 08:30:28.593039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17187): Terminated: ok {rc=0} 08:30:28.637323 --- ParallelTerminationStrategy: PID 17190 died... 08:30:28.655900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17190): Terminated: ok {rc=0} 08:30:28.700134 --- ParallelTerminationStrategy: PID 17193 died... 08:30:28.718830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17193): Terminated: ok {rc=0} 08:30:28.805661 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:30:30.099307 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:30.106325 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:30:30.127856 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:30:30.163674 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:30:30.222649 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:30:30.244686 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:30:30.279634 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:30:30.830618 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:30:30.836067 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:30.847643 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:30:30.930076 tst switch_tch_pdch.py: using LAC 27136 08:30:31.055564 tst switch_tch_pdch.py: using RAC 106 08:30:31.183779 tst switch_tch_pdch.py: using CellId 27136 08:30:31.310624 tst switch_tch_pdch.py: using BVCI 27137 08:30:31.422033 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.433757 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.445290 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.456896 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.468639 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.480380 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.492189 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:30:31.504359 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:31.620541 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:30:31.736627 tst switch_tch_pdch.py:51: start network... 08:30:32.011265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:32.522621 run create_hlr_db(pid=17199): Launched 08:30:32.637973 bus /gobi_6: Setting Powered False 08:30:33.697442 run create_hlr_db(pid=17199): Terminated: ok {rc=0} 08:30:34.136489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Launched 08:30:34.456426 run osmo-hlr_10.42.42.2(pid=17202): Launched 08:30:34.577973 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:35.130700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Launched 08:30:35.451365 run osmo-stp_10.42.42.5(pid=17205): Launched 08:30:35.571961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:36.124254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17207): Launched 08:30:36.245108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:36.516259 run patchelf(pid=17208): Launched 08:30:36.691972 run osmo-stp_10.42.42.5(pid=17205): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] 08:30:36.826356 run osmo-stp_10.42.42.5(pid=17205): stdout: | (launched: 2022-12-10_08:30:35.389262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:36.961587 run osmo-stp_10.42.42.5(pid=17205): stderr: | 20221210083035585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083035585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083035585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083035586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083035586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083035586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083035587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:37.096931 run osmo-stp_10.42.42.5(pid=17205): stdout: | (launched: 2022-12-10_08:30:35.389262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:37.226748 run osmo-stp_10.42.42.5(pid=17205): stderr: | 20221210083035585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083035585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083035585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083035586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083035586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083035586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083035587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:37.380500 run patchelf(pid=17208): Terminating (SIGINT) 08:30:37.558900 run patchelf(pid=17208): Terminated: ok {rc=0} 08:30:37.687036 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17205): Process ended prematurely: osmo-stp_10.42.42.5(pid=17205) [trial-2372↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] [trial-2372↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:30:37.696183 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 08:30:37.724651 run osmo-hlr_10.42.42.2(pid=17202): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17202)] 08:30:37.774089 run osmo-hlr_10.42.42.2(pid=17202): stdout: | (launched: 2022-12-10_08:30:34.395128) 08:30:37.825259 run osmo-hlr_10.42.42.2(pid=17202): stderr: | 20221210083034597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083034597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083034597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083034597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083034597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083034598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083034610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083034620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083034620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083034620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:37.876677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Terminating (SIGTERM) 08:30:37.917724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Terminating (SIGTERM) 08:30:37.959366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17207): Terminating (SIGTERM) 08:30:38.000884 --- ParallelTerminationStrategy: PID 17201 died... 08:30:38.020670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17201): Terminated: ok {rc=0} 08:30:38.066334 --- ParallelTerminationStrategy: PID 17204 died... 08:30:38.085662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17204): Terminated: ok {rc=0} 08:30:38.130957 --- ParallelTerminationStrategy: PID 17207 died... 08:30:38.150145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17207): Terminated: ok {rc=0} 08:30:38.236224 bus /gobi_0: Setting Powered False 08:30:39.335845 bus /gobi_0: Setting Powered False 08:30:40.450586 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:30:41.689588 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:41.695757 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:30:41.717190 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:30:41.752671 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:30:41.807690 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:30:41.829537 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:30:41.864671 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:30:42.419487 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:30:42.424552 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:42.435814 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:30:42.496611 tst switch_tch_pdch.py: using LAC 27137 08:30:42.621200 tst switch_tch_pdch.py: using RAC 107 08:30:42.745147 tst switch_tch_pdch.py: using CellId 27137 08:30:42.868638 tst switch_tch_pdch.py: using BVCI 27138 08:30:42.983864 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:42.995197 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.006458 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.017580 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.028445 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.039583 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.050783 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:30:43.061962 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:30:43.177923 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:30:43.293105 tst switch_tch_pdch.py:51: start network... 08:30:43.493573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:30:43.929643 run create_hlr_db(pid=17212): Launched 08:30:44.044870 bus /gobi_6: Setting Powered False 08:30:45.104743 run create_hlr_db(pid=17212): Terminated: ok {rc=0} 08:30:45.512345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Launched 08:30:45.829192 run osmo-hlr_10.42.42.2(pid=17215): Launched 08:30:46.012756 run osmo-stp_10.42.42.5: Starting osmo-stp 08:30:46.698688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Launched 08:30:47.022719 run osmo-stp_10.42.42.5(pid=17218): Launched 08:30:47.329444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:30:47.868691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17220): Launched 08:30:47.989113 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:30:48.256701 run patchelf(pid=17221): Launched 08:30:48.432599 run osmo-stp_10.42.42.5(pid=17218): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] 08:30:48.566846 run osmo-stp_10.42.42.5(pid=17218): stdout: | (launched: 2022-12-10_08:30:46.954777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:48.702689 run osmo-stp_10.42.42.5(pid=17218): stderr: | 20221210083047201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083047201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083047202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083047203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083047205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083047205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083047205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:48.839122 run osmo-stp_10.42.42.5(pid=17218): stdout: | (launched: 2022-12-10_08:30:46.954777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:30:48.969068 run osmo-stp_10.42.42.5(pid=17218): stderr: | 20221210083047201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083047201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083047202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083047203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083047205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083047205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083047205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:30:49.123474 run patchelf(pid=17221): Terminating (SIGINT) 08:30:49.301499 run patchelf(pid=17221): Terminated: ok {rc=0} 08:30:49.429633 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17218): Process ended prematurely: osmo-stp_10.42.42.5(pid=17218) [trial-2372↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] [trial-2372↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:30:49.438970 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 08:30:49.466654 run osmo-hlr_10.42.42.2(pid=17215): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17215)] 08:30:49.516553 run osmo-hlr_10.42.42.2(pid=17215): stdout: | (launched: 2022-12-10_08:30:45.771939) 08:30:49.568086 run osmo-hlr_10.42.42.2(pid=17215): stderr: | 20221210083046083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083046083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083046083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083046083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083046083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083046083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083046103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083046115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083046115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083046115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:30:49.620055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Terminating (SIGTERM) 08:30:49.661781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Terminating (SIGTERM) 08:30:49.703906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17220): Terminating (SIGTERM) 08:30:49.746384 --- ParallelTerminationStrategy: PID 17214 died... 08:30:49.766387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Terminated: ok {rc=0} 08:30:49.812577 --- ParallelTerminationStrategy: PID 17217 died... 08:30:49.832101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Terminated: ok {rc=0} 08:30:49.877936 --- ParallelTerminationStrategy: PID 17220 died... 08:30:49.897449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17220): Terminated: ok {rc=0} 08:30:49.984608 bus /gobi_0: Setting Powered False 08:30:51.081580 bus /gobi_0: Setting Powered False 08:30:52.198045 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:oc2g --------------------------------------------------------------------- 08:30:53.439465 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:30:53.443392 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 08:30:53.464344 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 08:30:53.471189 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 08:30:53.524590 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 08:30:53.546356 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 08:30:53.553326 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 08:30:54.090794 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:30:54.095767 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 08:30:54.106780 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 08:30:54.141226 tst mo_mt_sms.py: using LAC 27138 08:30:54.268615 tst mo_mt_sms.py: using RAC 108 08:30:54.395718 tst mo_mt_sms.py: using CellId 27138 08:30:54.522572 tst mo_mt_sms.py: using BVCI 27139 08:30:54.639886 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:30:54.754812 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 08:30:54.869069 tst mo_mt_sms.py:9: start nitb and bts... 08:30:55.069128 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:30:55.681375 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17225): Launched 08:30:55.983256 run osmo-nitb_10.42.42.2(pid=17226): Launched 08:30:56.148873 run osmo-nitb_10.42.42.2(pid=17226): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17226)] 08:30:56.283841 run osmo-nitb_10.42.42.2(pid=17226): stdout: | (launched: 2022-12-10_08:30:55.925455) 08:30:56.419705 run osmo-nitb_10.42.42.2(pid=17226): stderr: | (launched: 2022-12-10_08:30:55.969906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:30:56.555902 run osmo-nitb_10.42.42.2(pid=17226): stdout: | (launched: 2022-12-10_08:30:55.925455) 08:30:56.686568 run osmo-nitb_10.42.42.2(pid=17226): stderr: | (launched: 2022-12-10_08:30:55.969906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17226) [trial-2372↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17226)] 08:30:57.096675 tst osmo-nitb_10.42.42.2(pid=17226): stdout: | (launched: 2022-12-10_08:30:55.925455) 08:30:57.217096 tst osmo-nitb_10.42.42.2(pid=17226): stderr: | (launched: 2022-12-10_08:30:55.969906) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:30:57.359081 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=17226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17226) [trial-2372↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17226)] [trial-2372↪nitb_sms:oc2g↪mo_mt_sms.py:11] 08:30:57.367346 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:30:57.373958 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17225): Terminating (SIGTERM) 08:30:57.582608 --- ParallelTerminationStrategy: PID 17225 died... 08:30:57.603193 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17225): Terminated: ok {rc=0} 08:30:57.688068 bus /sierra_3: Setting Powered False 08:30:58.787804 bus /sierra_3: Setting Powered False 08:30:59.904163 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:oc2g --------------------------------------------------------------------- 08:31:01.093424 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:01.099696 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 08:31:01.131157 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 08:31:01.164927 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 08:31:01.228370 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 08:31:01.254520 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 08:31:01.290902 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 08:31:01.843516 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:oc2g mo_mt_sms.py ---------------------------------------------- 08:31:01.850921 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:01.866948 tst sms:oc2g: Using 1 x bts (candidates: 1) 08:31:01.914708 tst mo_mt_sms.py: using LAC 27139 08:31:02.041411 tst mo_mt_sms.py: using RAC 109 08:31:02.167361 tst mo_mt_sms.py: using CellId 27139 08:31:02.298094 tst mo_mt_sms.py: using BVCI 27140 08:31:02.413723 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:02.424596 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:02.435570 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:02.446551 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:02.457442 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 08:31:02.468087 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:31:02.582299 tst sms:oc2g: Using 1 x modem (candidates: 2) 08:31:02.701493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:03.193181 run create_hlr_db(pid=17230): Launched 08:31:03.322210 bus /sierra_2: Setting Powered False 08:31:04.385226 run create_hlr_db(pid=17230): Terminated: ok {rc=0} 08:31:04.810473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17232): Launched 08:31:05.107561 run osmo-hlr_10.42.42.2(pid=17233): Launched 08:31:05.220565 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:05.731756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17235): Launched 08:31:06.028474 run osmo-stp_10.42.42.5(pid=17236): Launched 08:31:06.141410 run osmo-msc_10.42.42.6: Starting osmo-msc 08:31:06.679541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17238): Launched 08:31:06.976073 run osmo-msc_10.42.42.6(pid=17239): Launched 08:31:07.154587 run osmo-stp_10.42.42.5(pid=17236): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17236)] 08:31:07.290657 run osmo-stp_10.42.42.5(pid=17236): stdout: | (launched: 2022-12-10_08:31:05.974296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:07.427080 run osmo-stp_10.42.42.5(pid=17236): stderr: | 20221210083106143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083106143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083106143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083106144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083106144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083106144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083106144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:07.562012 run osmo-stp_10.42.42.5(pid=17236): stdout: | (launched: 2022-12-10_08:31:05.974296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:07.688497 run osmo-stp_10.42.42.5(pid=17236): stderr: | 20221210083106143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083106143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083106143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083106144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083106144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083106144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083106144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:07.839220 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17236): Process ended prematurely: osmo-stp_10.42.42.5(pid=17236) [trial-2372↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17236)] [trial-2372↪sms:oc2g↪mo_mt_sms.py:16] 08:31:07.848115 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 08:31:07.874760 run osmo-hlr_10.42.42.2(pid=17233): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17233)] 08:31:07.924208 run osmo-hlr_10.42.42.2(pid=17233): stdout: | (launched: 2022-12-10_08:31:05.053686) 08:31:07.975545 run osmo-hlr_10.42.42.2(pid=17233): stderr: | 20221210083105229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083105229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083105229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083105229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083105229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083105229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083105246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083105255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083105255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083105255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:08.046900 run osmo-msc_10.42.42.6(pid=17239): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17239)] 08:31:08.096463 run osmo-msc_10.42.42.6(pid=17239): stdout: | (launched: 2022-12-10_08:31:06.921475) 08:31:08.147255 run osmo-msc_10.42.42.6(pid=17239): stderr: | 20221210083107236 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083107236 DLGLOBAL DEBUG validating counter group 0x7f7053ecfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083107236 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083107236 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083107237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083107237 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083107238 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083107239 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083107239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083107239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:08.199120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17232): Terminating (SIGTERM) 08:31:08.240167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17235): Terminating (SIGTERM) 08:31:08.281345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17238): Terminating (SIGTERM) 08:31:08.322861 --- ParallelTerminationStrategy: PID 17232 died... 08:31:08.342826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17232): Terminated: ok {rc=0} 08:31:08.388925 --- ParallelTerminationStrategy: PID 17235 died... 08:31:08.408546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17235): Terminated: ok {rc=0} 08:31:08.455084 --- ParallelTerminationStrategy: PID 17238 died... 08:31:08.474668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17238): Terminated: ok {rc=0} 08:31:08.562029 bus /sierra_3: Setting Powered False 08:31:09.662767 bus /sierra_3: Setting Powered False 08:31:10.778527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:oc2g --------------------------------------------------------------------- 08:31:11.994390 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:11.998922 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:31:12.020918 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 08:31:12.027955 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:31:12.063986 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:31:12.085506 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 08:31:12.093072 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:31:12.611798 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 08:31:12.617786 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 08:31:12.628378 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 08:31:12.663680 tst assert_extension.py: using LAC 27140 08:31:12.781353 tst assert_extension.py: using RAC 110 08:31:12.900160 tst assert_extension.py: using CellId 27140 08:31:13.019504 tst assert_extension.py: using BVCI 27141 08:31:13.129430 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 08:31:13.245952 tst assert_extension.py:10: start nitb and bts... 08:31:13.460203 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:31:14.110178 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17244): Launched 08:31:14.431500 run osmo-nitb_10.42.42.2(pid=17245): Launched 08:31:14.607227 run osmo-nitb_10.42.42.2(pid=17245): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17245)] 08:31:14.749662 run osmo-nitb_10.42.42.2(pid=17245): stdout: | (launched: 2022-12-10_08:31:14.368367) 08:31:14.893358 run osmo-nitb_10.42.42.2(pid=17245): stderr: | (launched: 2022-12-10_08:31:14.415813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:31:15.037079 run osmo-nitb_10.42.42.2(pid=17245): stdout: | (launched: 2022-12-10_08:31:14.368367) 08:31:15.175138 run osmo-nitb_10.42.42.2(pid=17245): stderr: | (launched: 2022-12-10_08:31:14.415813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17245) [trial-2372↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17245)] 08:31:15.550816 tst osmo-nitb_10.42.42.2(pid=17245): stdout: | (launched: 2022-12-10_08:31:14.368367) 08:31:15.678851 tst osmo-nitb_10.42.42.2(pid=17245): stderr: | (launched: 2022-12-10_08:31:14.415813) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:31:15.829949 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17245) [trial-2372↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17245)] [trial-2372↪nitb_ussd:oc2g↪assert_extension.py:12] 08:31:15.839214 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:31:15.846798 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17244): Terminating (SIGTERM) 08:31:16.061568 --- ParallelTerminationStrategy: PID 17244 died... 08:31:16.089325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17244): Terminated: ok {rc=0} 08:31:16.199430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:oc2g --------------------------------------------------------------------- 08:31:17.362538 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:17.366228 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 08:31:17.386270 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 08:31:17.413300 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 08:31:17.448294 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 08:31:17.468755 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 08:31:17.496595 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 08:31:18.026497 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:oc2g assert_extension.py ---------------------------------------------- 08:31:18.032490 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.043823 tst ussd:oc2g: Using 1 x bts (candidates: 1) 08:31:18.079363 tst assert_extension.py: using LAC 27141 08:31:18.206252 tst assert_extension.py: using RAC 111 08:31:18.331444 tst assert_extension.py: using CellId 27141 08:31:18.457717 tst assert_extension.py: using BVCI 27142 08:31:18.572544 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.583873 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.594845 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.605794 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.616690 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 08:31:18.627632 tst ussd:oc2g: Using 1 x modem (candidates: 1) 08:31:18.742798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:19.205651 run create_hlr_db(pid=17250): Launched 08:31:19.320103 bus /sierra_2: Setting Powered False 08:31:20.379256 run create_hlr_db(pid=17250): Terminated: ok {rc=0} 08:31:20.816331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Launched 08:31:21.133248 run osmo-hlr_10.42.42.2(pid=17253): Launched 08:31:21.254366 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:21.810234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Launched 08:31:22.127071 run osmo-stp_10.42.42.5(pid=17256): Launched 08:31:22.247722 run osmo-msc_10.42.42.6: Starting osmo-msc 08:31:22.819964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17258): Launched 08:31:23.135801 run osmo-msc_10.42.42.6(pid=17259): Launched 08:31:23.312713 run osmo-stp_10.42.42.5(pid=17256): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] 08:31:23.447172 run osmo-stp_10.42.42.5(pid=17256): stdout: | (launched: 2022-12-10_08:31:22.069547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:23.581851 run osmo-stp_10.42.42.5(pid=17256): stderr: | 20221210083122262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083122262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083122262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083122262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083122263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083122263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083122263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:23.715499 run osmo-stp_10.42.42.5(pid=17256): stdout: | (launched: 2022-12-10_08:31:22.069547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:23.841871 run osmo-stp_10.42.42.5(pid=17256): stderr: | 20221210083122262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083122262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083122262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083122262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083122263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083122263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083122263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:23.992656 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17256): Process ended prematurely: osmo-stp_10.42.42.5(pid=17256) [trial-2372↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] [trial-2372↪ussd:oc2g↪assert_extension.py:17] 08:31:24.001372 tst assert_extension.py:17: Test FAILED (6.0 sec) 08:31:24.028402 run osmo-hlr_10.42.42.2(pid=17253): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17253)] 08:31:24.077939 run osmo-hlr_10.42.42.2(pid=17253): stdout: | (launched: 2022-12-10_08:31:21.074995) 08:31:24.129316 run osmo-hlr_10.42.42.2(pid=17253): stderr: | 20221210083121274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083121274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083121274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083121274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083121274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083121274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083121287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083121295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083121295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083121296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:24.200537 run osmo-msc_10.42.42.6(pid=17259): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17259)] 08:31:24.249791 run osmo-msc_10.42.42.6(pid=17259): stdout: | (launched: 2022-12-10_08:31:23.078382) 08:31:24.300731 run osmo-msc_10.42.42.6(pid=17259): stderr: | 20221210083123400 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083123400 DLGLOBAL DEBUG validating counter group 0x7fb180089c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083123401 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083123401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083123401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083123401 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083123403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083123403 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083123403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083123403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:24.352531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Terminating (SIGTERM) 08:31:24.393372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Terminating (SIGTERM) 08:31:24.434352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17258): Terminating (SIGTERM) 08:31:24.475576 --- ParallelTerminationStrategy: PID 17252 died... 08:31:24.494968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17252): Terminated: ok {rc=0} 08:31:24.540114 --- ParallelTerminationStrategy: PID 17255 died... 08:31:24.559466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17255): Terminated: ok {rc=0} 08:31:24.604607 --- ParallelTerminationStrategy: PID 17258 died... 08:31:24.623916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17258): Terminated: ok {rc=0} 08:31:24.710220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:31:25.907823 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:25.914879 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:31:25.936735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:31:25.963989 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:31:26.018300 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:31:26.040000 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:31:26.067209 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:31:26.617519 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:31:26.669846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:26.681383 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:31:26.738168 tst mo_mt_call.py: using LAC 27142 08:31:26.865750 tst mo_mt_call.py: using RAC 112 08:31:26.993102 tst mo_mt_call.py: using CellId 27142 08:31:27.121874 tst mo_mt_call.py: using BVCI 27143 08:31:27.241404 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:27.252755 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:27.263925 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:27.275123 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:27.286467 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:27.297732 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:31:27.413076 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:31:27.528886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:28.004505 run create_hlr_db(pid=17264): Launched 08:31:28.121023 bus /sierra_2: Setting Powered False 08:31:29.181581 run create_hlr_db(pid=17264): Terminated: ok {rc=0} 08:31:29.628419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17266): Launched 08:31:29.955641 run osmo-hlr_10.42.42.2(pid=17267): Launched 08:31:30.079006 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:30.647757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17269): Launched 08:31:30.994809 run osmo-stp_10.42.42.5(pid=17270): Launched 08:31:31.250458 run osmo-msc_10.42.42.6: Starting osmo-msc 08:31:31.946121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17272): Launched 08:31:32.291797 run osmo-msc_10.42.42.6(pid=17273): Launched 08:31:32.474959 run osmo-stp_10.42.42.5(pid=17270): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17270)] 08:31:32.608588 run osmo-stp_10.42.42.5(pid=17270): stdout: | (launched: 2022-12-10_08:31:30.927771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:32.740500 run osmo-stp_10.42.42.5(pid=17270): stderr: | 20221210083131272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083131272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083131272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083131274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083131274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083131277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083131277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:32.869642 run osmo-stp_10.42.42.5(pid=17270): stdout: | (launched: 2022-12-10_08:31:30.927771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:32.991789 run osmo-stp_10.42.42.5(pid=17270): stderr: | 20221210083131272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083131272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083131272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083131274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083131274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083131277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083131277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:33.137531 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17270): Process ended prematurely: osmo-stp_10.42.42.5(pid=17270) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17270)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:31:33.146474 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:31:33.173130 run osmo-hlr_10.42.42.2(pid=17267): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17267)] 08:31:33.220812 run osmo-hlr_10.42.42.2(pid=17267): stdout: | (launched: 2022-12-10_08:31:29.893397) 08:31:33.270300 run osmo-hlr_10.42.42.2(pid=17267): stderr: | 20221210083130095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083130095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083130095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083130095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083130095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083130095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083130107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083130116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083130116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083130116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:33.338733 run osmo-msc_10.42.42.6(pid=17273): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17273)] 08:31:33.386458 run osmo-msc_10.42.42.6(pid=17273): stdout: | (launched: 2022-12-10_08:31:32.216611) 08:31:33.435685 run osmo-msc_10.42.42.6(pid=17273): stderr: | 20221210083132545 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083132545 DLGLOBAL DEBUG validating counter group 0x7f6ea45c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083132545 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083132545 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083132546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083132546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083132547 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083132548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083132548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083132548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:33.485437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17266): Terminating (SIGTERM) 08:31:33.525028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17269): Terminating (SIGTERM) 08:31:33.565069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17272): Terminating (SIGTERM) 08:31:33.605238 --- ParallelTerminationStrategy: PID 17266 died... 08:31:33.624198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17266): Terminated: ok {rc=0} 08:31:33.668415 --- ParallelTerminationStrategy: PID 17269 died... 08:31:33.687012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17269): Terminated: ok {rc=0} 08:31:33.730978 --- ParallelTerminationStrategy: PID 17272 died... 08:31:33.749392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17272): Terminated: ok {rc=0} 08:31:33.834891 bus /sierra_3: Setting Powered False 08:31:34.934115 bus /sierra_3: Setting Powered False 08:31:36.049600 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:31:37.194798 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.206590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:31:37.262729 tst mo_mt_call_osmux.py: using LAC 27143 08:31:37.392624 tst mo_mt_call_osmux.py: using RAC 113 08:31:37.521224 tst mo_mt_call_osmux.py: using CellId 27143 08:31:37.647305 tst mo_mt_call_osmux.py: using BVCI 27144 08:31:37.759928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.771114 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.782245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.793795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.805397 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:31:37.817158 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:31:37.936904 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:31:38.055631 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:38.533206 run create_hlr_db(pid=17275): Launched 08:31:38.649527 bus /sierra_2: Setting Powered False 08:31:39.709559 run create_hlr_db(pid=17275): Terminated: ok {rc=0} 08:31:40.144816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17277): Launched 08:31:40.450987 run osmo-hlr_10.42.42.2(pid=17278): Launched 08:31:40.567414 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:41.093625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17280): Launched 08:31:41.399714 run osmo-stp_10.42.42.5(pid=17281): Launched 08:31:41.517068 run osmo-msc_10.42.42.6: Starting osmo-msc 08:31:42.069965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17283): Launched 08:31:42.374749 run osmo-msc_10.42.42.6(pid=17284): Launched 08:31:42.545695 run osmo-stp_10.42.42.5(pid=17281): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17281)] 08:31:42.675570 run osmo-stp_10.42.42.5(pid=17281): stdout: | (launched: 2022-12-10_08:31:41.340721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:42.804342 run osmo-stp_10.42.42.5(pid=17281): stderr: | 20221210083141515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083141515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083141515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083141516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083141516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083141516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083141516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:42.930422 run osmo-stp_10.42.42.5(pid=17281): stdout: | (launched: 2022-12-10_08:31:41.340721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:43.051006 run osmo-stp_10.42.42.5(pid=17281): stderr: | 20221210083141515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083141515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083141515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083141516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083141516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083141516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083141516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:43.195318 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17281): Process ended prematurely: osmo-stp_10.42.42.5(pid=17281) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17281)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:31:43.204131 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:31:43.230483 run osmo-hlr_10.42.42.2(pid=17278): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17278)] 08:31:43.278026 run osmo-hlr_10.42.42.2(pid=17278): stdout: | (launched: 2022-12-10_08:31:40.391976) 08:31:43.326851 run osmo-hlr_10.42.42.2(pid=17278): stderr: | 20221210083140571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083140571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083140572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083140572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083140572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083140572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083140584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083140593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083140593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083140593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:43.394403 run osmo-msc_10.42.42.6(pid=17284): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17284)] 08:31:43.441346 run osmo-msc_10.42.42.6(pid=17284): stdout: | (launched: 2022-12-10_08:31:42.316316) 08:31:43.489924 run osmo-msc_10.42.42.6(pid=17284): stderr: | 20221210083142589 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083142590 DLGLOBAL DEBUG validating counter group 0x7f19183f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083142590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083142590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083142590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083142590 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083142592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083142592 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083142592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083142593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:43.539113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17277): Terminating (SIGTERM) 08:31:43.578372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17280): Terminating (SIGTERM) 08:31:43.617560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17283): Terminating (SIGTERM) 08:31:43.656912 --- ParallelTerminationStrategy: PID 17277 died... 08:31:43.675669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17277): Terminated: ok {rc=0} 08:31:43.719206 --- ParallelTerminationStrategy: PID 17280 died... 08:31:43.737636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17280): Terminated: ok {rc=0} 08:31:43.781251 --- ParallelTerminationStrategy: PID 17283 died... 08:31:43.799460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17283): Terminated: ok {rc=0} 08:31:43.883121 bus /sierra_3: Setting Powered False 08:31:44.980561 bus /sierra_3: Setting Powered False 08:31:46.091042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:31:47.334170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:31:47.341625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:31:47.362496 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:31:47.389540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:31:47.440504 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:31:47.461108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:31:47.487994 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:31:48.038728 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:31:48.087870 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.099024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:31:48.153647 tst mo_mt_call.py: using LAC 27144 08:31:48.282846 tst mo_mt_call.py: using RAC 114 08:31:48.411652 tst mo_mt_call.py: using CellId 27144 08:31:48.538842 tst mo_mt_call.py: using BVCI 27145 08:31:48.657929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.669429 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.680702 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.691941 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.703207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:48.714523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:31:48.832451 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:31:48.949875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:49.421793 run create_hlr_db(pid=17289): Launched 08:31:49.538593 bus /sierra_2: Setting Powered False 08:31:50.599242 run create_hlr_db(pid=17289): Terminated: ok {rc=0} 08:31:51.041719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17291): Launched 08:31:51.363697 run osmo-hlr_10.42.42.2(pid=17292): Launched 08:31:51.486993 run osmo-stp_10.42.42.5: Starting osmo-stp 08:31:52.048298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17294): Launched 08:31:52.371277 run osmo-stp_10.42.42.5(pid=17295): Launched 08:31:52.490076 run osmo-msc_10.42.42.6: Starting osmo-msc 08:31:53.041897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17297): Launched 08:31:53.345267 run osmo-msc_10.42.42.6(pid=17298): Launched 08:31:53.515891 run osmo-stp_10.42.42.5(pid=17295): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17295)] 08:31:53.645644 run osmo-stp_10.42.42.5(pid=17295): stdout: | (launched: 2022-12-10_08:31:52.311944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:53.775492 run osmo-stp_10.42.42.5(pid=17295): stderr: | 20221210083152483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083152483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083152483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083152484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083152484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083152484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083152484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:53.901964 run osmo-stp_10.42.42.5(pid=17295): stdout: | (launched: 2022-12-10_08:31:52.311944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:31:54.023105 run osmo-stp_10.42.42.5(pid=17295): stderr: | 20221210083152483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083152483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083152483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083152484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083152484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083152484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083152484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:31:54.168027 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17295): Process ended prematurely: osmo-stp_10.42.42.5(pid=17295) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17295)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:31:54.176752 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:31:54.203526 run osmo-hlr_10.42.42.2(pid=17292): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17292)] 08:31:54.251140 run osmo-hlr_10.42.42.2(pid=17292): stdout: | (launched: 2022-12-10_08:31:51.305588) 08:31:54.300225 run osmo-hlr_10.42.42.2(pid=17292): stderr: | 20221210083151502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083151502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083151502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083151502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083151502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083151502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083151514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083151523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083151523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083151523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:31:54.368386 run osmo-msc_10.42.42.6(pid=17298): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17298)] 08:31:54.415498 run osmo-msc_10.42.42.6(pid=17298): stdout: | (launched: 2022-12-10_08:31:53.290083) 08:31:54.464510 run osmo-msc_10.42.42.6(pid=17298): stderr: | 20221210083153564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083153564 DLGLOBAL DEBUG validating counter group 0x7fbadbe8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083153564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083153564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083153564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083153565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083153566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083153567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083153567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083153567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:31:54.513833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17291): Terminating (SIGTERM) 08:31:54.553176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17294): Terminating (SIGTERM) 08:31:54.592409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17297): Terminating (SIGTERM) 08:31:54.631671 --- ParallelTerminationStrategy: PID 17291 died... 08:31:54.650340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17291): Terminated: ok {rc=0} 08:31:54.694465 --- ParallelTerminationStrategy: PID 17294 died... 08:31:54.712635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17294): Terminated: ok {rc=0} 08:31:54.756333 --- ParallelTerminationStrategy: PID 17297 died... 08:31:54.774755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17297): Terminated: ok {rc=0} 08:31:54.859929 bus /sierra_3: Setting Powered False 08:31:55.957109 bus /sierra_3: Setting Powered False 08:31:57.071320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:31:58.214030 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.225588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:31:58.279918 tst mo_mt_call_osmux.py: using LAC 27145 08:31:58.402661 tst mo_mt_call_osmux.py: using RAC 115 08:31:58.524439 tst mo_mt_call_osmux.py: using CellId 27145 08:31:58.642391 tst mo_mt_call_osmux.py: using BVCI 27146 08:31:58.754561 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.765543 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.776280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.787243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.798335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:31:58.809368 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:31:58.927964 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:31:59.046748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:31:59.517535 run create_hlr_db(pid=17300): Launched 08:31:59.633230 bus /sierra_2: Setting Powered False 08:32:00.693348 run create_hlr_db(pid=17300): Terminated: ok {rc=0} 08:32:01.149756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17302): Launched 08:32:01.543735 run osmo-hlr_10.42.42.2(pid=17303): Launched 08:32:01.815705 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:02.400404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17305): Launched 08:32:02.705589 run osmo-stp_10.42.42.5(pid=17306): Launched 08:32:02.823069 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:03.370490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17308): Launched 08:32:03.672643 run osmo-msc_10.42.42.6(pid=17309): Launched 08:32:03.843654 run osmo-stp_10.42.42.5(pid=17306): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17306)] 08:32:03.972629 run osmo-stp_10.42.42.5(pid=17306): stdout: | (launched: 2022-12-10_08:32:02.650008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:04.101579 run osmo-stp_10.42.42.5(pid=17306): stderr: | 20221210083202819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083202819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083202820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083202820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083202822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083202823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083202823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:04.227792 run osmo-stp_10.42.42.5(pid=17306): stdout: | (launched: 2022-12-10_08:32:02.650008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:04.347999 run osmo-stp_10.42.42.5(pid=17306): stderr: | 20221210083202819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083202819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083202820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083202820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083202822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083202823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083202823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:04.491737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17306): Process ended prematurely: osmo-stp_10.42.42.5(pid=17306) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17306)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:32:04.500426 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:32:04.526654 run osmo-hlr_10.42.42.2(pid=17303): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17303)] 08:32:04.574218 run osmo-hlr_10.42.42.2(pid=17303): stdout: | (launched: 2022-12-10_08:32:01.480238) 08:32:04.623306 run osmo-hlr_10.42.42.2(pid=17303): stderr: | 20221210083201690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083201690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083201690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083201690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083201690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083201690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083201704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083201723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083201723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083201723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:04.692216 run osmo-msc_10.42.42.6(pid=17309): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17309)] 08:32:04.739473 run osmo-msc_10.42.42.6(pid=17309): stdout: | (launched: 2022-12-10_08:32:03.617305) 08:32:04.788609 run osmo-msc_10.42.42.6(pid=17309): stderr: | 20221210083203888 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083203889 DLGLOBAL DEBUG validating counter group 0x7f5ca2a79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083203889 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083203889 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083203889 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083203889 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083203892 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083203893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083203893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083203893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:04.837707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17302): Terminating (SIGTERM) 08:32:04.876763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17305): Terminating (SIGTERM) 08:32:04.915838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17308): Terminating (SIGTERM) 08:32:04.955414 --- ParallelTerminationStrategy: PID 17302 died... 08:32:04.974148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17302): Terminated: ok {rc=0} 08:32:05.017576 --- ParallelTerminationStrategy: PID 17305 died... 08:32:05.035845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17305): Terminated: ok {rc=0} 08:32:05.079347 --- ParallelTerminationStrategy: PID 17308 died... 08:32:05.097570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17308): Terminated: ok {rc=0} 08:32:05.182129 bus /sierra_3: Setting Powered False 08:32:06.279973 bus /sierra_3: Setting Powered False 08:32:07.393056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:32:08.620056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:08.626540 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:32:08.647092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:32:08.674334 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:32:08.724274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:32:08.744601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:32:08.771243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:32:09.327156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:32:09.380790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:09.392267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:32:09.461588 tst mo_mt_call.py: using LAC 27146 08:32:09.596237 tst mo_mt_call.py: using RAC 116 08:32:09.723444 tst mo_mt_call.py: using CellId 27146 08:32:09.849618 tst mo_mt_call.py: using BVCI 27147 08:32:09.967356 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:09.978795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:09.990021 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:10.001239 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:10.012481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:10.023729 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:32:10.140548 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:32:10.255773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:10.731977 run create_hlr_db(pid=17314): Launched 08:32:10.849306 bus /sierra_2: Setting Powered False 08:32:11.909911 run create_hlr_db(pid=17314): Terminated: ok {rc=0} 08:32:12.357829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17316): Launched 08:32:12.686888 run osmo-hlr_10.42.42.2(pid=17317): Launched 08:32:12.811732 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:13.372050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17319): Launched 08:32:13.698960 run osmo-stp_10.42.42.5(pid=17320): Launched 08:32:13.822666 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:14.410731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17322): Launched 08:32:14.739002 run osmo-msc_10.42.42.6(pid=17323): Launched 08:32:14.920393 run osmo-stp_10.42.42.5(pid=17320): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17320)] 08:32:15.057239 run osmo-stp_10.42.42.5(pid=17320): stdout: | (launched: 2022-12-10_08:32:13.635151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:15.194598 run osmo-stp_10.42.42.5(pid=17320): stderr: | 20221210083213833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083213834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083213834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083213834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083213835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083213835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083213835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:15.330461 run osmo-stp_10.42.42.5(pid=17320): stdout: | (launched: 2022-12-10_08:32:13.635151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:15.458978 run osmo-stp_10.42.42.5(pid=17320): stderr: | 20221210083213833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083213834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083213834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083213834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083213835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083213835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083213835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:15.612721 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17320): Process ended prematurely: osmo-stp_10.42.42.5(pid=17320) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17320)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:32:15.622102 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:32:15.649651 run osmo-hlr_10.42.42.2(pid=17317): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17317)] 08:32:15.699078 run osmo-hlr_10.42.42.2(pid=17317): stdout: | (launched: 2022-12-10_08:32:12.622578) 08:32:15.750112 run osmo-hlr_10.42.42.2(pid=17317): stderr: | 20221210083212828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083212828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083212828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083212828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083212829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083212829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083212840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083212848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083212849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083212849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:15.821575 run osmo-msc_10.42.42.6(pid=17323): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17323)] 08:32:15.883846 run osmo-msc_10.42.42.6(pid=17323): stdout: | (launched: 2022-12-10_08:32:14.674350) 08:32:15.942507 run osmo-msc_10.42.42.6(pid=17323): stderr: | 20221210083215003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083215003 DLGLOBAL DEBUG validating counter group 0x7fbd9aee7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083215003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083215003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083215003 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083215004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083215005 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083215006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083215006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083215006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:15.995040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17316): Terminating (SIGTERM) 08:32:16.037589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17319): Terminating (SIGTERM) 08:32:16.081410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17322): Terminating (SIGTERM) 08:32:16.123888 --- ParallelTerminationStrategy: PID 17316 died... 08:32:16.143901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17316): Terminated: ok {rc=0} 08:32:16.190398 --- ParallelTerminationStrategy: PID 17319 died... 08:32:16.210466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17319): Terminated: ok {rc=0} 08:32:16.256905 --- ParallelTerminationStrategy: PID 17322 died... 08:32:16.276787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17322): Terminated: ok {rc=0} 08:32:16.365143 bus /sierra_3: Setting Powered False 08:32:17.464926 bus /sierra_3: Setting Powered False 08:32:18.580063 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:32:19.724456 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:19.736132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:32:19.795155 tst mo_mt_call_osmux.py: using LAC 27147 08:32:19.914421 tst mo_mt_call_osmux.py: using RAC 117 08:32:20.034331 tst mo_mt_call_osmux.py: using CellId 27147 08:32:20.154378 tst mo_mt_call_osmux.py: using BVCI 27148 08:32:20.266669 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:20.277736 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:20.288521 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:20.299608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:20.310706 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:32:20.321892 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:32:20.440908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:32:20.559770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:21.037389 run create_hlr_db(pid=17325): Launched 08:32:21.154245 bus /sierra_2: Setting Powered False 08:32:22.215255 run create_hlr_db(pid=17325): Terminated: ok {rc=0} 08:32:22.662956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17327): Launched 08:32:22.990272 run osmo-hlr_10.42.42.2(pid=17328): Launched 08:32:23.113531 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:23.673195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17330): Launched 08:32:23.999294 run osmo-stp_10.42.42.5(pid=17331): Launched 08:32:24.122306 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:24.709885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17333): Launched 08:32:25.037359 run osmo-msc_10.42.42.6(pid=17334): Launched 08:32:25.218420 run osmo-stp_10.42.42.5(pid=17331): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17331)] 08:32:25.355314 run osmo-stp_10.42.42.5(pid=17331): stdout: | (launched: 2022-12-10_08:32:23.936919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:25.492362 run osmo-stp_10.42.42.5(pid=17331): stderr: | 20221210083224133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083224133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083224133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083224133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083224134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083224134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083224134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:25.628651 run osmo-stp_10.42.42.5(pid=17331): stdout: | (launched: 2022-12-10_08:32:23.936919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:25.757353 run osmo-stp_10.42.42.5(pid=17331): stderr: | 20221210083224133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083224133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083224133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083224133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083224134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083224134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083224134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:25.912132 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17331): Process ended prematurely: osmo-stp_10.42.42.5(pid=17331) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17331)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:32:25.921465 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:32:25.949256 run osmo-hlr_10.42.42.2(pid=17328): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17328)] 08:32:25.999215 run osmo-hlr_10.42.42.2(pid=17328): stdout: | (launched: 2022-12-10_08:32:22.927264) 08:32:26.050773 run osmo-hlr_10.42.42.2(pid=17328): stderr: | 20221210083223128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083223128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083223128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083223128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083223128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083223128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083223143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083223152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083223153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083223153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:26.122977 run osmo-msc_10.42.42.6(pid=17334): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17334)] 08:32:26.173293 run osmo-msc_10.42.42.6(pid=17334): stdout: | (launched: 2022-12-10_08:32:24.974486) 08:32:26.224813 run osmo-msc_10.42.42.6(pid=17334): stderr: | 20221210083225299 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083225299 DLGLOBAL DEBUG validating counter group 0x7f2891c1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083225299 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083225299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083225300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083225300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083225302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083225302 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083225302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083225302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:26.276749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17327): Terminating (SIGTERM) 08:32:26.318157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17330): Terminating (SIGTERM) 08:32:26.359431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17333): Terminating (SIGTERM) 08:32:26.401149 --- ParallelTerminationStrategy: PID 17327 died... 08:32:26.420641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17327): Terminated: ok {rc=0} 08:32:26.466468 --- ParallelTerminationStrategy: PID 17330 died... 08:32:26.485902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17330): Terminated: ok {rc=0} 08:32:26.531659 --- ParallelTerminationStrategy: PID 17333 died... 08:32:26.551272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17333): Terminated: ok {rc=0} 08:32:26.638311 bus /sierra_3: Setting Powered False 08:32:27.735375 bus /sierra_3: Setting Powered False 08:32:28.848758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:32:30.082620 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:30.089665 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:32:30.110966 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:32:30.138395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:32:30.191240 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:32:30.212487 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:32:30.239558 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:32:30.789546 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:32:30.844157 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:30.856688 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:32:30.917536 tst mo_mt_call.py: using LAC 27148 08:32:31.049110 tst mo_mt_call.py: using RAC 118 08:32:31.173451 tst mo_mt_call.py: using CellId 27148 08:32:31.307409 tst mo_mt_call.py: using BVCI 27149 08:32:31.458260 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:31.470274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:31.482002 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:31.494044 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:31.505813 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:31.517631 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:32:31.662198 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:32:31.782152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:32.269516 run create_hlr_db(pid=17339): Launched 08:32:32.413645 bus /sierra_2: Setting Powered False 08:32:33.473992 run create_hlr_db(pid=17339): Terminated: ok {rc=0} 08:32:33.898143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17341): Launched 08:32:34.202451 run osmo-hlr_10.42.42.2(pid=17342): Launched 08:32:34.319481 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:34.859114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17344): Launched 08:32:35.161704 run osmo-stp_10.42.42.5(pid=17345): Launched 08:32:35.278527 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:35.827670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17347): Launched 08:32:36.132732 run osmo-msc_10.42.42.6(pid=17351): Launched 08:32:36.303462 run osmo-stp_10.42.42.5(pid=17345): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17345)] 08:32:36.433218 run osmo-stp_10.42.42.5(pid=17345): stdout: | (launched: 2022-12-10_08:32:35.106388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:36.562518 run osmo-stp_10.42.42.5(pid=17345): stderr: | 20221210083235275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083235275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083235276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083235276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083235276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083235277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083235277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:36.689259 run osmo-stp_10.42.42.5(pid=17345): stdout: | (launched: 2022-12-10_08:32:35.106388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:36.810311 run osmo-stp_10.42.42.5(pid=17345): stderr: | 20221210083235275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083235275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083235276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083235276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083235276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083235277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083235277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:36.955689 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17345): Process ended prematurely: osmo-stp_10.42.42.5(pid=17345) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17345)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:32:36.964549 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:32:36.991170 run osmo-hlr_10.42.42.2(pid=17342): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17342)] 08:32:37.039301 run osmo-hlr_10.42.42.2(pid=17342): stdout: | (launched: 2022-12-10_08:32:34.146960) 08:32:37.088536 run osmo-hlr_10.42.42.2(pid=17342): stderr: | 20221210083234323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083234323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083234323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083234323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083234323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083234323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083234336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083234344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083234345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083234345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:37.157125 run osmo-msc_10.42.42.6(pid=17351): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17351)] 08:32:37.204564 run osmo-msc_10.42.42.6(pid=17351): stdout: | (launched: 2022-12-10_08:32:36.077267) 08:32:37.253835 run osmo-msc_10.42.42.6(pid=17351): stderr: | 20221210083236349 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083236349 DLGLOBAL DEBUG validating counter group 0x7f82da880c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083236349 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083236349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083236349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083236350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083236353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083236354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083236354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083236354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:37.303509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17341): Terminating (SIGTERM) 08:32:37.342805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17344): Terminating (SIGTERM) 08:32:37.382233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17347): Terminating (SIGTERM) 08:32:37.421937 --- ParallelTerminationStrategy: PID 17341 died... 08:32:37.440843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17341): Terminated: ok {rc=0} 08:32:37.484885 --- ParallelTerminationStrategy: PID 17344 died... 08:32:37.503694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17344): Terminated: ok {rc=0} 08:32:37.547507 --- ParallelTerminationStrategy: PID 17347 died... 08:32:37.565807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17347): Terminated: ok {rc=0} 08:32:37.648492 bus /sierra_3: Setting Powered False 08:32:38.744801 bus /sierra_3: Setting Powered False 08:32:39.858930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:32:41.003269 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.014960 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:32:41.071029 tst mo_mt_call_osmux.py: using LAC 27149 08:32:41.191953 tst mo_mt_call_osmux.py: using RAC 119 08:32:41.311278 tst mo_mt_call_osmux.py: using CellId 27149 08:32:41.433351 tst mo_mt_call_osmux.py: using BVCI 27150 08:32:41.552152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.563807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.575313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.587132 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.598634 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:32:41.610084 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:32:41.726812 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:32:41.846386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:42.349229 run create_hlr_db(pid=17353): Launched 08:32:42.480050 bus /sierra_2: Setting Powered False 08:32:43.544238 run create_hlr_db(pid=17353): Terminated: ok {rc=0} 08:32:43.979125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17355): Launched 08:32:44.283125 run osmo-hlr_10.42.42.2(pid=17356): Launched 08:32:44.399874 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:44.933929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Launched 08:32:45.236125 run osmo-stp_10.42.42.5(pid=17359): Launched 08:32:45.351527 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:45.911569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17361): Launched 08:32:46.245704 run osmo-msc_10.42.42.6(pid=17362): Launched 08:32:46.593900 run osmo-stp_10.42.42.5(pid=17359): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17359)] 08:32:46.911283 run osmo-stp_10.42.42.5(pid=17359): stdout: | (launched: 2022-12-10_08:32:45.180783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:47.139976 run osmo-stp_10.42.42.5(pid=17359): stderr: | 20221210083245352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083245352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083245352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083245353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083245353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083245353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083245353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:47.270319 run osmo-stp_10.42.42.5(pid=17359): stdout: | (launched: 2022-12-10_08:32:45.180783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:47.391859 run osmo-stp_10.42.42.5(pid=17359): stderr: | 20221210083245352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083245352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083245352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083245353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083245353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083245353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083245353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:47.536809 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17359): Process ended prematurely: osmo-stp_10.42.42.5(pid=17359) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17359)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:32:47.546024 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:32:47.573122 run osmo-hlr_10.42.42.2(pid=17356): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17356)] 08:32:47.621456 run osmo-hlr_10.42.42.2(pid=17356): stdout: | (launched: 2022-12-10_08:32:44.227859) 08:32:47.670879 run osmo-hlr_10.42.42.2(pid=17356): stderr: | 20221210083244403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083244403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083244403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083244403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083244403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083244403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083244416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083244425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083244425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083244425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:47.739835 run osmo-msc_10.42.42.6(pid=17362): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17362)] 08:32:47.787511 run osmo-msc_10.42.42.6(pid=17362): stdout: | (launched: 2022-12-10_08:32:46.174678) 08:32:47.836662 run osmo-msc_10.42.42.6(pid=17362): stderr: | 20221210083246705 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083246705 DLGLOBAL DEBUG validating counter group 0x7fa2835b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083246705 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083246705 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083246705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083246705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083246707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083246707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083246708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083246708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:47.886465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17355): Terminating (SIGTERM) 08:32:47.926035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Terminating (SIGTERM) 08:32:47.965811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17361): Terminating (SIGTERM) 08:32:48.006066 --- ParallelTerminationStrategy: PID 17355 died... 08:32:48.024870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17355): Terminated: ok {rc=0} 08:32:48.069509 --- ParallelTerminationStrategy: PID 17358 died... 08:32:48.088037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Terminated: ok {rc=0} 08:32:48.132650 --- ParallelTerminationStrategy: PID 17361 died... 08:32:48.151300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17361): Terminated: ok {rc=0} 08:32:48.236803 bus /sierra_3: Setting Powered False 08:32:49.334332 bus /sierra_3: Setting Powered False 08:32:50.448362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:32:51.678122 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:32:51.686245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:32:51.707565 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:32:51.734870 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:32:51.787232 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:32:51.808727 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:32:51.836205 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:32:52.388254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:32:52.439599 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:52.451060 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:32:52.508518 tst mo_mt_call.py: using LAC 27150 08:32:52.637074 tst mo_mt_call.py: using RAC 120 08:32:52.765352 tst mo_mt_call.py: using CellId 27150 08:32:52.892351 tst mo_mt_call.py: using BVCI 27151 08:32:53.009989 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:53.021615 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:53.032863 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:53.044268 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:53.055477 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:32:53.066760 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:32:53.183845 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:32:53.303153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:32:53.810237 run create_hlr_db(pid=17367): Launched 08:32:53.941494 bus /sierra_2: Setting Powered False 08:32:55.005750 run create_hlr_db(pid=17367): Terminated: ok {rc=0} 08:32:55.460265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17369): Launched 08:32:55.787006 run osmo-hlr_10.42.42.2(pid=17370): Launched 08:32:55.910182 run osmo-stp_10.42.42.5: Starting osmo-stp 08:32:56.471248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17372): Launched 08:32:56.798548 run osmo-stp_10.42.42.5(pid=17373): Launched 08:32:56.922541 run osmo-msc_10.42.42.6: Starting osmo-msc 08:32:57.511416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17375): Launched 08:32:57.837703 run osmo-msc_10.42.42.6(pid=17376): Launched 08:32:58.018140 run osmo-stp_10.42.42.5(pid=17373): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17373)] 08:32:58.154036 run osmo-stp_10.42.42.5(pid=17373): stdout: | (launched: 2022-12-10_08:32:56.734868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:58.290547 run osmo-stp_10.42.42.5(pid=17373): stderr: | 20221210083256930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083256930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083256931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083256931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083256931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083256932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083256932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:58.426059 run osmo-stp_10.42.42.5(pid=17373): stdout: | (launched: 2022-12-10_08:32:56.734868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:32:58.554541 run osmo-stp_10.42.42.5(pid=17373): stderr: | 20221210083256930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083256930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083256931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083256931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083256931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083256932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083256932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:32:58.708206 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17373): Process ended prematurely: osmo-stp_10.42.42.5(pid=17373) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17373)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:32:58.717670 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:32:58.745075 run osmo-hlr_10.42.42.2(pid=17370): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17370)] 08:32:58.794941 run osmo-hlr_10.42.42.2(pid=17370): stdout: | (launched: 2022-12-10_08:32:55.723600) 08:32:58.846434 run osmo-hlr_10.42.42.2(pid=17370): stderr: | 20221210083255926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083255926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083255927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083255927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083255927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083255927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083255939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083255947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083255947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083255947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:32:58.917312 run osmo-msc_10.42.42.6(pid=17376): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17376)] 08:32:58.966786 run osmo-msc_10.42.42.6(pid=17376): stdout: | (launched: 2022-12-10_08:32:57.774562) 08:32:59.017863 run osmo-msc_10.42.42.6(pid=17376): stderr: | 20221210083258100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083258100 DLGLOBAL DEBUG validating counter group 0x7fc566e59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083258100 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083258100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083258101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083258101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083258102 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083258103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083258103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083258103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:32:59.069431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17369): Terminating (SIGTERM) 08:32:59.110460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17372): Terminating (SIGTERM) 08:32:59.151440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17375): Terminating (SIGTERM) 08:32:59.193097 --- ParallelTerminationStrategy: PID 17369 died... 08:32:59.212370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17369): Terminated: ok {rc=0} 08:32:59.257680 --- ParallelTerminationStrategy: PID 17372 died... 08:32:59.276880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17372): Terminated: ok {rc=0} 08:32:59.322003 --- ParallelTerminationStrategy: PID 17375 died... 08:32:59.341120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17375): Terminated: ok {rc=0} 08:32:59.426855 bus /sierra_3: Setting Powered False 08:33:00.524437 bus /sierra_3: Setting Powered False 08:33:01.637929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:33:02.781501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:02.792927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:33:02.848388 tst mo_mt_call_osmux.py: using LAC 27151 08:33:02.970884 tst mo_mt_call_osmux.py: using RAC 121 08:33:03.091040 tst mo_mt_call_osmux.py: using CellId 27151 08:33:03.208763 tst mo_mt_call_osmux.py: using BVCI 27152 08:33:03.319060 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:03.330174 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:03.340892 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:03.352186 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:03.363280 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:33:03.374395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:33:03.490162 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:33:03.610752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:04.118400 run create_hlr_db(pid=17379): Launched 08:33:04.249867 bus /sierra_2: Setting Powered False 08:33:05.314292 run create_hlr_db(pid=17379): Terminated: ok {rc=0} 08:33:05.767938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Launched 08:33:06.096331 run osmo-hlr_10.42.42.2(pid=17382): Launched 08:33:06.221618 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:06.787732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Launched 08:33:07.116765 run osmo-stp_10.42.42.5(pid=17385): Launched 08:33:07.240884 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:07.830726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Launched 08:33:08.157667 run osmo-msc_10.42.42.6(pid=17388): Launched 08:33:08.338276 run osmo-stp_10.42.42.5(pid=17385): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] 08:33:08.474369 run osmo-stp_10.42.42.5(pid=17385): stdout: | (launched: 2022-12-10_08:33:07.052101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:08.610714 run osmo-stp_10.42.42.5(pid=17385): stderr: | 20221210083307252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083307252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083307252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083307253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083307253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083307253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083307253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:08.746487 run osmo-stp_10.42.42.5(pid=17385): stdout: | (launched: 2022-12-10_08:33:07.052101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:08.875440 run osmo-stp_10.42.42.5(pid=17385): stderr: | 20221210083307252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083307252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083307252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083307253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083307253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083307253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083307253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:09.029445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17385): Process ended prematurely: osmo-stp_10.42.42.5(pid=17385) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:33:09.038824 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:33:09.066329 run osmo-hlr_10.42.42.2(pid=17382): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17382)] 08:33:09.115954 run osmo-hlr_10.42.42.2(pid=17382): stdout: | (launched: 2022-12-10_08:33:06.032184) 08:33:09.167676 run osmo-hlr_10.42.42.2(pid=17382): stderr: | 20221210083306244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083306244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083306244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083306244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083306244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083306244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083306257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083306265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083306265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083306265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:09.239555 run osmo-msc_10.42.42.6(pid=17388): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17388)] 08:33:09.289131 run osmo-msc_10.42.42.6(pid=17388): stdout: | (launched: 2022-12-10_08:33:08.094894) 08:33:09.340310 run osmo-msc_10.42.42.6(pid=17388): stderr: | 20221210083308421 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083308421 DLGLOBAL DEBUG validating counter group 0x7fb11645dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083308421 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083308421 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083308422 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083308422 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083308423 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083308424 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083308424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083308424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:09.392003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Terminating (SIGTERM) 08:33:09.433664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Terminating (SIGTERM) 08:33:09.474999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Terminating (SIGTERM) 08:33:09.516473 --- ParallelTerminationStrategy: PID 17381 died... 08:33:09.535947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17381): Terminated: ok {rc=0} 08:33:09.581678 --- ParallelTerminationStrategy: PID 17384 died... 08:33:09.600706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17384): Terminated: ok {rc=0} 08:33:09.646564 --- ParallelTerminationStrategy: PID 17387 died... 08:33:09.665901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17387): Terminated: ok {rc=0} 08:33:09.751974 bus /sierra_3: Setting Powered False 08:33:10.850023 bus /sierra_3: Setting Powered False 08:33:11.965203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:33:13.204546 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:13.211357 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:33:13.232411 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:33:13.259690 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:33:13.314081 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:33:13.335924 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:33:13.363165 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:33:13.913562 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:33:13.966525 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:13.978268 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:33:14.037084 tst mo_mt_call.py: using LAC 27152 08:33:14.165753 tst mo_mt_call.py: using RAC 122 08:33:14.297664 tst mo_mt_call.py: using CellId 27152 08:33:14.424726 tst mo_mt_call.py: using BVCI 27153 08:33:14.544005 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:14.555583 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:14.566967 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:14.578920 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:14.590844 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:14.602949 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:33:14.723035 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:33:14.843138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:15.345969 run create_hlr_db(pid=17393): Launched 08:33:15.475854 bus /sierra_2: Setting Powered False 08:33:16.538302 run create_hlr_db(pid=17393): Terminated: ok {rc=0} 08:33:17.001939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Launched 08:33:17.337657 run osmo-hlr_10.42.42.2(pid=17396): Launched 08:33:17.461119 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:18.021350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Launched 08:33:18.343785 run osmo-stp_10.42.42.5(pid=17399): Launched 08:33:18.466381 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:19.050073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17401): Launched 08:33:19.374253 run osmo-msc_10.42.42.6(pid=17402): Launched 08:33:19.554889 run osmo-stp_10.42.42.5(pid=17399): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] 08:33:19.691955 run osmo-stp_10.42.42.5(pid=17399): stdout: | (launched: 2022-12-10_08:33:18.284749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:19.829534 run osmo-stp_10.42.42.5(pid=17399): stderr: | 20221210083318478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083318478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083318478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083318478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083318481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083318481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083318481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:19.965397 run osmo-stp_10.42.42.5(pid=17399): stdout: | (launched: 2022-12-10_08:33:18.284749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:20.094853 run osmo-stp_10.42.42.5(pid=17399): stderr: | 20221210083318478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083318478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083318478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083318478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083318481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083318481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083318481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:20.249398 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17399): Process ended prematurely: osmo-stp_10.42.42.5(pid=17399) [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:33:20.258964 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:33:20.286541 run osmo-hlr_10.42.42.2(pid=17396): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17396)] 08:33:20.336617 run osmo-hlr_10.42.42.2(pid=17396): stdout: | (launched: 2022-12-10_08:33:17.279194) 08:33:20.388514 run osmo-hlr_10.42.42.2(pid=17396): stderr: | 20221210083317479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083317479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083317479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083317479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083317479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083317479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083317492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083317500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083317500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083317500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:20.460402 run osmo-msc_10.42.42.6(pid=17402): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17402)] 08:33:20.510336 run osmo-msc_10.42.42.6(pid=17402): stdout: | (launched: 2022-12-10_08:33:19.315535) 08:33:20.561848 run osmo-msc_10.42.42.6(pid=17402): stderr: | 20221210083319639 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083319639 DLGLOBAL DEBUG validating counter group 0x7f6f2ab64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083319640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083319640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083319640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083319640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083319642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083319642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083319642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083319642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:20.613803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Terminating (SIGTERM) 08:33:20.655221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Terminating (SIGTERM) 08:33:20.696657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17401): Terminating (SIGTERM) 08:33:20.738426 --- ParallelTerminationStrategy: PID 17395 died... 08:33:20.758427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17395): Terminated: ok {rc=0} 08:33:20.804831 --- ParallelTerminationStrategy: PID 17398 died... 08:33:20.824552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17398): Terminated: ok {rc=0} 08:33:20.870736 --- ParallelTerminationStrategy: PID 17401 died... 08:33:20.890509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17401): Terminated: ok {rc=0} 08:33:20.977317 bus /sierra_3: Setting Powered False 08:33:22.074338 bus /sierra_3: Setting Powered False 08:33:23.189838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:33:24.336033 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.347856 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:33:24.404750 tst mo_mt_call_osmux.py: using LAC 27153 08:33:24.526620 tst mo_mt_call_osmux.py: using RAC 123 08:33:24.648435 tst mo_mt_call_osmux.py: using CellId 27153 08:33:24.769328 tst mo_mt_call_osmux.py: using BVCI 27154 08:33:24.890906 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.902651 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.914080 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.926079 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.938115 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:33:24.950220 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:33:25.071644 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:33:25.189729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:25.664208 run create_hlr_db(pid=17404): Launched 08:33:25.781784 bus /sierra_2: Setting Powered False 08:33:26.842779 run create_hlr_db(pid=17404): Terminated: ok {rc=0} 08:33:27.286699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17406): Launched 08:33:27.611411 run osmo-hlr_10.42.42.2(pid=17407): Launched 08:33:27.735573 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:28.293792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17409): Launched 08:33:28.616628 run osmo-stp_10.42.42.5(pid=17410): Launched 08:33:28.740763 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:29.327888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17412): Launched 08:33:29.651632 run osmo-msc_10.42.42.6(pid=17413): Launched 08:33:29.833196 run osmo-stp_10.42.42.5(pid=17410): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17410)] 08:33:29.975045 run osmo-stp_10.42.42.5(pid=17410): stdout: | (launched: 2022-12-10_08:33:28.558011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:30.112193 run osmo-stp_10.42.42.5(pid=17410): stderr: | 20221210083328752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083328752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083328752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083328752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083328755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083328755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083328755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:30.247095 run osmo-stp_10.42.42.5(pid=17410): stdout: | (launched: 2022-12-10_08:33:28.558011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:30.376094 run osmo-stp_10.42.42.5(pid=17410): stderr: | 20221210083328752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083328752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083328752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083328752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083328755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083328755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083328755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:30.530047 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17410): Process ended prematurely: osmo-stp_10.42.42.5(pid=17410) [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17410)] [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:33:30.539599 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:33:30.567346 run osmo-hlr_10.42.42.2(pid=17407): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17407)] 08:33:30.617293 run osmo-hlr_10.42.42.2(pid=17407): stdout: | (launched: 2022-12-10_08:33:27.552364) 08:33:30.668746 run osmo-hlr_10.42.42.2(pid=17407): stderr: | 20221210083327751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083327751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083327751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083327751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083327751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083327751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083327763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083327771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083327771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083327771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:30.740422 run osmo-msc_10.42.42.6(pid=17413): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17413)] 08:33:30.790200 run osmo-msc_10.42.42.6(pid=17413): stdout: | (launched: 2022-12-10_08:33:29.592654) 08:33:30.842148 run osmo-msc_10.42.42.6(pid=17413): stderr: | 20221210083329919 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083329919 DLGLOBAL DEBUG validating counter group 0x7f0a72118c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083329919 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083329919 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083329919 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083329920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083329921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083329922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083329922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083329922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:30.899846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17406): Terminating (SIGTERM) 08:33:30.948422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17409): Terminating (SIGTERM) 08:33:30.995008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17412): Terminating (SIGTERM) 08:33:31.040120 --- ParallelTerminationStrategy: PID 17406 died... 08:33:31.060232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17406): Terminated: ok {rc=0} 08:33:31.109742 --- ParallelTerminationStrategy: PID 17409 died... 08:33:31.129514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17409): Terminated: ok {rc=0} 08:33:31.177524 --- ParallelTerminationStrategy: PID 17412 died... 08:33:31.198260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17412): Terminated: ok {rc=0} 08:33:31.286270 bus /sierra_3: Setting Powered False 08:33:32.385059 bus /sierra_3: Setting Powered False 08:33:33.498590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:33:34.734616 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:34.740517 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:33:34.761711 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:33:34.789462 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:33:34.842442 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:33:34.863666 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:33:34.890862 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:33:35.439678 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:33:35.490459 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:35.501516 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:33:35.560121 tst mo_mt_call.py: using LAC 27154 08:33:35.681343 tst mo_mt_call.py: using RAC 124 08:33:35.800129 tst mo_mt_call.py: using CellId 27154 08:33:35.922538 tst mo_mt_call.py: using BVCI 27155 08:33:36.035096 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:36.046249 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:36.056792 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:36.067707 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:36.078549 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:36.089484 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:33:36.207782 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:33:36.323035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:36.800748 run create_hlr_db(pid=17418): Launched 08:33:36.917354 bus /sierra_2: Setting Powered False 08:33:37.978367 run create_hlr_db(pid=17418): Terminated: ok {rc=0} 08:33:38.405709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17420): Launched 08:33:38.713608 run osmo-hlr_10.42.42.2(pid=17421): Launched 08:33:38.831774 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:39.372815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17423): Launched 08:33:39.683316 run osmo-stp_10.42.42.5(pid=17424): Launched 08:33:39.800571 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:40.356355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17426): Launched 08:33:40.666738 run osmo-msc_10.42.42.6(pid=17427): Launched 08:33:40.838508 run osmo-stp_10.42.42.5(pid=17424): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17424)] 08:33:40.968384 run osmo-stp_10.42.42.5(pid=17424): stdout: | (launched: 2022-12-10_08:33:39.623243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:41.098146 run osmo-stp_10.42.42.5(pid=17424): stderr: | 20221210083339797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083339797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083339798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083339798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083339800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083339800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083339800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:41.225639 run osmo-stp_10.42.42.5(pid=17424): stdout: | (launched: 2022-12-10_08:33:39.623243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:41.347378 run osmo-stp_10.42.42.5(pid=17424): stderr: | 20221210083339797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083339797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083339798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083339798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083339800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083339800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083339800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:41.493293 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17424): Process ended prematurely: osmo-stp_10.42.42.5(pid=17424) [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17424)] [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:33:41.501997 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:33:41.528553 run osmo-hlr_10.42.42.2(pid=17421): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17421)] 08:33:41.576671 run osmo-hlr_10.42.42.2(pid=17421): stdout: | (launched: 2022-12-10_08:33:38.654562) 08:33:41.626209 run osmo-hlr_10.42.42.2(pid=17421): stderr: | 20221210083338834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083338834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083338834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083338834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083338834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083338834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083338847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083338857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083338857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083338858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:41.695134 run osmo-msc_10.42.42.6(pid=17427): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17427)] 08:33:41.743120 run osmo-msc_10.42.42.6(pid=17427): stdout: | (launched: 2022-12-10_08:33:40.606535) 08:33:41.792336 run osmo-msc_10.42.42.6(pid=17427): stderr: | 20221210083340885 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083340885 DLGLOBAL DEBUG validating counter group 0x7f761ff39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083340885 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083340885 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083340885 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083340886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083340888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083340888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083340888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083340888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:41.842031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17420): Terminating (SIGTERM) 08:33:41.881478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17423): Terminating (SIGTERM) 08:33:41.921196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17426): Terminating (SIGTERM) 08:33:41.961351 --- ParallelTerminationStrategy: PID 17420 died... 08:33:41.980460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17420): Terminated: ok {rc=0} 08:33:42.024683 --- ParallelTerminationStrategy: PID 17423 died... 08:33:42.043316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17423): Terminated: ok {rc=0} 08:33:42.087425 --- ParallelTerminationStrategy: PID 17426 died... 08:33:42.105937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17426): Terminated: ok {rc=0} 08:33:42.191313 bus /sierra_3: Setting Powered False 08:33:43.290131 bus /sierra_3: Setting Powered False 08:33:44.406453 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:33:45.552232 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:45.563624 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:33:45.620841 tst mo_mt_call_osmux.py: using LAC 27155 08:33:45.744518 tst mo_mt_call_osmux.py: using RAC 125 08:33:45.878119 tst mo_mt_call_osmux.py: using CellId 27155 08:33:46.019054 tst mo_mt_call_osmux.py: using BVCI 27156 08:33:46.133705 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:46.145561 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:46.157100 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:46.169760 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:46.181974 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:33:46.194631 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:33:46.327980 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:33:46.471034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:47.037535 run create_hlr_db(pid=17429): Launched 08:33:47.198979 bus /sierra_2: Setting Powered False 08:33:48.263370 run create_hlr_db(pid=17429): Terminated: ok {rc=0} 08:33:48.702567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17431): Launched 08:33:49.011373 run osmo-hlr_10.42.42.2(pid=17432): Launched 08:33:49.127660 run osmo-stp_10.42.42.5: Starting osmo-stp 08:33:49.673082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17434): Launched 08:33:49.982010 run osmo-stp_10.42.42.5(pid=17435): Launched 08:33:50.106935 run osmo-msc_10.42.42.6: Starting osmo-msc 08:33:50.705917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17437): Launched 08:33:51.034909 run osmo-msc_10.42.42.6(pid=17438): Launched 08:33:51.215069 run osmo-stp_10.42.42.5(pid=17435): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17435)] 08:33:51.351304 run osmo-stp_10.42.42.5(pid=17435): stdout: | (launched: 2022-12-10_08:33:49.921929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:51.488241 run osmo-stp_10.42.42.5(pid=17435): stderr: | 20221210083350113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083350113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083350113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083350113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083350114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083350114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083350114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:51.624210 run osmo-stp_10.42.42.5(pid=17435): stdout: | (launched: 2022-12-10_08:33:49.921929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:33:51.753362 run osmo-stp_10.42.42.5(pid=17435): stderr: | 20221210083350113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083350113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083350113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083350113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083350114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083350114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083350114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:33:51.908599 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17435): Process ended prematurely: osmo-stp_10.42.42.5(pid=17435) [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17435)] [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:33:51.918281 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:33:51.946125 run osmo-hlr_10.42.42.2(pid=17432): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17432)] 08:33:51.995950 run osmo-hlr_10.42.42.2(pid=17432): stdout: | (launched: 2022-12-10_08:33:48.951896) 08:33:52.047254 run osmo-hlr_10.42.42.2(pid=17432): stderr: | 20221210083349132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083349132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083349132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083349132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083349132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083349132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083349143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083349153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083349153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083349153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:33:52.118944 run osmo-msc_10.42.42.6(pid=17438): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17438)] 08:33:52.168613 run osmo-msc_10.42.42.6(pid=17438): stdout: | (launched: 2022-12-10_08:33:50.971069) 08:33:52.220339 run osmo-msc_10.42.42.6(pid=17438): stderr: | 20221210083351298 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083351298 DLGLOBAL DEBUG validating counter group 0x7f4e48532c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083351298 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083351298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083351299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083351299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083351301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083351301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083351301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083351301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:33:52.272023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17431): Terminating (SIGTERM) 08:33:52.313439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17434): Terminating (SIGTERM) 08:33:52.355103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17437): Terminating (SIGTERM) 08:33:52.396778 --- ParallelTerminationStrategy: PID 17431 died... 08:33:52.416586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17431): Terminated: ok {rc=0} 08:33:52.462498 --- ParallelTerminationStrategy: PID 17434 died... 08:33:52.481865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17434): Terminated: ok {rc=0} 08:33:52.527644 --- ParallelTerminationStrategy: PID 17437 died... 08:33:52.547028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17437): Terminated: ok {rc=0} 08:33:52.634126 bus /sierra_3: Setting Powered False 08:33:53.732872 bus /sierra_3: Setting Powered False 08:33:54.848369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:oc2g --------------------------------------------------------------------- 08:33:56.081714 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:33:56.086400 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 08:33:56.108085 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 08:33:56.136766 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 08:33:56.223573 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 08:33:56.244806 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 08:33:56.273341 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 08:33:56.857889 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 08:33:56.864825 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:56.876646 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:33:56.913437 tst emergency_mo_mt_call.py: using LAC 27156 08:33:57.040548 tst emergency_mo_mt_call.py: using RAC 126 08:33:57.161097 tst emergency_mo_mt_call.py: using CellId 27156 08:33:57.291870 tst emergency_mo_mt_call.py: using BVCI 27157 08:33:57.409635 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:57.420746 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:57.431799 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:57.443299 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:57.454787 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:33:57.466348 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:33:57.584747 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:33:57.699282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:33:58.165646 run create_hlr_db(pid=17444): Launched 08:33:58.282087 bus /sierra_2: Setting Powered False 08:33:59.343329 run create_hlr_db(pid=17444): Terminated: ok {rc=0} 08:33:59.763409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17446): Launched 08:34:00.062830 run osmo-hlr_10.42.42.2(pid=17447): Launched 08:34:00.177568 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:00.707882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17449): Launched 08:34:01.062696 run osmo-stp_10.42.42.5(pid=17450): Launched 08:34:01.474803 tst emergency_mo_mt_call.py: using MSISDN 7644 08:34:01.748126 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:02.305394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17452): Launched 08:34:02.617298 run osmo-msc_10.42.42.6(pid=17453): Launched 08:34:02.786460 run osmo-stp_10.42.42.5(pid=17450): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17450)] 08:34:02.914838 run osmo-stp_10.42.42.5(pid=17450): stdout: | (launched: 2022-12-10_08:34:00.981302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:03.042995 run osmo-stp_10.42.42.5(pid=17450): stderr: | 20221210083401342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083401342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083401342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083401345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083401345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083401346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083401346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:03.168121 run osmo-stp_10.42.42.5(pid=17450): stdout: | (launched: 2022-12-10_08:34:00.981302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:03.287464 run osmo-stp_10.42.42.5(pid=17450): stderr: | 20221210083401342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083401342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083401342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083401345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083401345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083401346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083401346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:03.430597 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17450): Process ended prematurely: osmo-stp_10.42.42.5(pid=17450) [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17450)] [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py:19] 08:34:03.438942 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 08:34:03.465279 run osmo-hlr_10.42.42.2(pid=17447): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17447)] 08:34:03.513206 run osmo-hlr_10.42.42.2(pid=17447): stdout: | (launched: 2022-12-10_08:34:00.008199) 08:34:03.562775 run osmo-hlr_10.42.42.2(pid=17447): stderr: | 20221210083400185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083400185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083400185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083400185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083400185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083400185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083400198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083400207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083400207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083400207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:03.631916 run osmo-msc_10.42.42.6(pid=17453): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17453)] 08:34:03.680013 run osmo-msc_10.42.42.6(pid=17453): stdout: | (launched: 2022-12-10_08:34:02.562296) 08:34:03.729390 run osmo-msc_10.42.42.6(pid=17453): stderr: | 20221210083402835 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083402835 DLGLOBAL DEBUG validating counter group 0x7fedbcc05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083402835 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083402835 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083402835 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083402835 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083402837 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083402838 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083402838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083402838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:03.779267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17446): Terminating (SIGTERM) 08:34:03.818644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17449): Terminating (SIGTERM) 08:34:03.858394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17452): Terminating (SIGTERM) 08:34:03.898684 --- ParallelTerminationStrategy: PID 17446 died... 08:34:03.917427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17446): Terminated: ok {rc=0} 08:34:03.961877 --- ParallelTerminationStrategy: PID 17449 died... 08:34:03.980742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17449): Terminated: ok {rc=0} 08:34:04.025554 --- ParallelTerminationStrategy: PID 17452 died... 08:34:04.044294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17452): Terminated: ok {rc=0} 08:34:04.131873 bus /sierra_3: Setting Powered False 08:34:05.228791 bus /sierra_3: Setting Powered False 08:34:06.342968 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 08:34:07.429284 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.440604 tst emergency:oc2g: Using 1 x bts (candidates: 1) 08:34:07.478929 tst emergency_preemptive_call.py: using LAC 27157 08:34:07.599504 tst emergency_preemptive_call.py: using RAC 127 08:34:07.717792 tst emergency_preemptive_call.py: using CellId 27157 08:34:07.837163 tst emergency_preemptive_call.py: using BVCI 27158 08:34:07.946028 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.956522 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.967018 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.977728 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.988485 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 08:34:07.999068 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:34:08.117546 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:34:08.233736 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:34:08.350795 tst emergency:oc2g: Using 1 x modem (candidates: 4) 08:34:08.466876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:08.934618 run create_hlr_db(pid=17455): Launched 08:34:09.049088 bus /sierra_2: Setting Powered False 08:34:10.109262 run create_hlr_db(pid=17455): Terminated: ok {rc=0} 08:34:10.547548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Launched 08:34:10.853613 run osmo-hlr_10.42.42.2(pid=17458): Launched 08:34:10.968378 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:11.488394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Launched 08:34:11.788371 run osmo-stp_10.42.42.5(pid=17461): Launched 08:34:11.973343 tst emergency_preemptive_call.py: using MSISDN 7645 08:34:12.125601 run osmo-msc_10.42.42.6: Starting osmo-msc 08:34:12.663736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Launched 08:34:12.963508 run osmo-msc_10.42.42.6(pid=17464): Launched 08:34:13.131684 run osmo-stp_10.42.42.5(pid=17461): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] 08:34:13.259232 run osmo-stp_10.42.42.5(pid=17461): stdout: | (launched: 2022-12-10_08:34:11.733785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:13.387305 run osmo-stp_10.42.42.5(pid=17461): stderr: | 20221210083411901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083411901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083411902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083411902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083411904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083411904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083411905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:13.512856 run osmo-stp_10.42.42.5(pid=17461): stdout: | (launched: 2022-12-10_08:34:11.733785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:13.631916 run osmo-stp_10.42.42.5(pid=17461): stderr: | 20221210083411901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083411901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083411902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083411902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083411904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083411904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083411905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:13.775371 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17461): Process ended prematurely: osmo-stp_10.42.42.5(pid=17461) [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py:32] 08:34:13.783727 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 08:34:13.813097 run osmo-hlr_10.42.42.2(pid=17458): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17458)] 08:34:13.862669 run osmo-hlr_10.42.42.2(pid=17458): stdout: | (launched: 2022-12-10_08:34:10.798437) 08:34:13.913768 run osmo-hlr_10.42.42.2(pid=17458): stderr: | 20221210083410974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083410974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083410974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083410975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083410975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083410975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083410987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083410996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083410996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083410996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:13.984935 run osmo-msc_10.42.42.6(pid=17464): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17464)] 08:34:14.034219 run osmo-msc_10.42.42.6(pid=17464): stdout: | (launched: 2022-12-10_08:34:12.908635) 08:34:14.085401 run osmo-msc_10.42.42.6(pid=17464): stderr: | 20221210083413181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083413182 DLGLOBAL DEBUG validating counter group 0x7fa0c630fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083413182 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083413182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083413182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083413182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083413184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083413185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083413185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083413185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:34:14.136638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Terminating (SIGTERM) 08:34:14.177721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Terminating (SIGTERM) 08:34:14.218777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Terminating (SIGTERM) 08:34:14.260213 --- ParallelTerminationStrategy: PID 17457 died... 08:34:14.279861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17457): Terminated: ok {rc=0} 08:34:14.325419 --- ParallelTerminationStrategy: PID 17460 died... 08:34:14.344535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17460): Terminated: ok {rc=0} 08:34:14.390268 --- ParallelTerminationStrategy: PID 17463 died... 08:34:14.409791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17463): Terminated: ok {rc=0} 08:34:14.497727 bus /sierra_9: Setting Powered False 08:34:15.597202 bus /sierra_9: Setting Powered False 08:34:16.722090 bus /sierra_8: Setting Powered False 08:34:17.820552 bus /sierra_8: Setting Powered False 08:34:18.936935 bus /sierra_3: Setting Powered False 08:34:20.035170 bus /sierra_3: Setting Powered False 08:34:21.153943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:oc2g --------------------------------------------------------------------- 08:34:22.414012 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:34:22.418190 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 08:34:22.438480 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 08:34:22.478124 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 08:34:22.564739 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 08:34:22.585348 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 08:34:22.624474 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 08:34:23.212057 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 08:34:23.266577 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.277650 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:34:23.313345 tst cs_paging_gprs_active.py: using LAC 27158 08:34:23.440905 tst cs_paging_gprs_active.py: using RAC 128 08:34:23.570456 tst cs_paging_gprs_active.py: using CellId 27158 08:34:23.698615 tst cs_paging_gprs_active.py: using BVCI 27159 08:34:23.819470 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.830482 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.841628 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.852329 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.862983 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.873656 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.884365 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.895174 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:23.905984 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:24.021281 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:24.141163 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:34:24.362505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:24.693403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17469): Launched 08:34:24.981353 run iperf3-srv_10.42.42.10(pid=17470): Launched 08:34:25.103023 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:34:25.322897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:25.651832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17471): Launched 08:34:25.939638 run iperf3-srv_10.42.42.10(pid=17472): Launched 08:34:26.061752 tst cs_paging_gprs_active.py:38: start network... 08:34:26.281946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:26.789530 run create_hlr_db(pid=17473): Launched 08:34:26.920820 bus /sierra_2: Setting Powered False 08:34:27.984881 run create_hlr_db(pid=17473): Terminated: ok {rc=0} 08:34:28.439597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17475): Launched 08:34:28.767777 run osmo-hlr_10.42.42.2(pid=17476): Launched 08:34:28.891455 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:29.455448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17478): Launched 08:34:29.782896 run osmo-stp_10.42.42.5(pid=17479): Launched 08:34:29.907337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:30.471205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17481): Launched 08:34:30.594849 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:30.889030 run patchelf(pid=17482): Launched 08:34:31.095429 run osmo-stp_10.42.42.5(pid=17479): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17479)] 08:34:31.235460 run osmo-stp_10.42.42.5(pid=17479): stdout: | (launched: 2022-12-10_08:34:29.720091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:31.377769 run osmo-stp_10.42.42.5(pid=17479): stderr: | 20221210083429916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083429916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083429917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083429917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083429917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083429918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083429918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:31.519500 run osmo-stp_10.42.42.5(pid=17479): stdout: | (launched: 2022-12-10_08:34:29.720091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:31.655856 run osmo-stp_10.42.42.5(pid=17479): stderr: | 20221210083429916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083429916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083429917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083429917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083429917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083429918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083429918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:31.817784 run patchelf(pid=17482): Terminating (SIGINT) 08:34:32.004437 run patchelf(pid=17482): Terminated: ok {rc=0} 08:34:32.138971 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17479): Process ended prematurely: osmo-stp_10.42.42.5(pid=17479) [trial-2372↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17479)] [trial-2372↪gprs:oc2g↪cs_paging_gprs_active.py:38] 08:34:32.148885 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:34:32.177776 run osmo-hlr_10.42.42.2(pid=17476): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17476)] 08:34:32.227817 run osmo-hlr_10.42.42.2(pid=17476): stdout: | (launched: 2022-12-10_08:34:28.704583) 08:34:32.280133 run osmo-hlr_10.42.42.2(pid=17476): stderr: | 20221210083428908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083428909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083428909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083428909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083428909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083428909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083428921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083428929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083428929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083428930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:32.332434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17469): Terminating (SIGTERM) 08:34:32.373898 run iperf3-srv_10.42.42.10(pid=17470): Terminating (SIGTERM) 08:34:32.415408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17471): Terminating (SIGTERM) 08:34:32.457028 run iperf3-srv_10.42.42.10(pid=17472): Terminating (SIGTERM) 08:34:32.498339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17475): Terminating (SIGTERM) 08:34:32.540044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17478): Terminating (SIGTERM) 08:34:32.582196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17481): Terminating (SIGTERM) 08:34:32.624189 --- ParallelTerminationStrategy: PID 17469 died... 08:34:32.644260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17469): Terminated: ok {rc=0} 08:34:32.690745 --- ParallelTerminationStrategy: PID 17470 died... 08:34:32.710409 run iperf3-srv_10.42.42.10(pid=17470): Terminated {rc=256} 08:34:32.756232 --- ParallelTerminationStrategy: PID 17471 died... 08:34:32.775780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17471): Terminated: ok {rc=0} 08:34:32.822173 --- ParallelTerminationStrategy: PID 17472 died... 08:34:32.842357 run iperf3-srv_10.42.42.10(pid=17472): Terminated {rc=256} 08:34:32.888696 --- ParallelTerminationStrategy: PID 17475 died... 08:34:32.908256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17475): Terminated: ok {rc=0} 08:34:32.954304 --- ParallelTerminationStrategy: PID 17478 died... 08:34:32.973849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17478): Terminated: ok {rc=0} 08:34:33.020282 --- ParallelTerminationStrategy: PID 17481 died... 08:34:33.039953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17481): Terminated: ok {rc=0} 08:34:33.126746 bus /gobi_0: Setting Powered False 08:34:34.225264 bus /gobi_0: Setting Powered False 08:34:35.340645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g iperf3.py ---------------------------------------------- 08:34:36.489316 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:36.500849 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:34:36.537406 tst iperf3.py: using LAC 27159 08:34:36.665233 tst iperf3.py: using RAC 129 08:34:36.792937 tst iperf3.py: using CellId 27159 08:34:36.923397 tst iperf3.py: using BVCI 27160 08:34:37.043334 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.054470 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.065354 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.076252 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.087104 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.098106 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.109042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.119965 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:37.131049 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:37.251867 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:34:37.471712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:37.801700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17483): Launched 08:34:38.088706 run iperf3-srv_10.42.42.10(pid=17484): Launched 08:34:38.210450 tst iperf3.py:8: start network... 08:34:38.429141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:38.936099 run create_hlr_db(pid=17485): Launched 08:34:39.067620 bus /gobi_6: Setting Powered False 08:34:40.131564 run create_hlr_db(pid=17485): Terminated: ok {rc=0} 08:34:40.569505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17487): Launched 08:34:40.878660 run osmo-hlr_10.42.42.2(pid=17488): Launched 08:34:40.995193 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:41.537745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17490): Launched 08:34:41.845396 run osmo-stp_10.42.42.5(pid=17491): Launched 08:34:41.963044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:42.495351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17493): Launched 08:34:42.612005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:42.874115 run patchelf(pid=17494): Launched 08:34:43.043337 run osmo-stp_10.42.42.5(pid=17491): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17491)] 08:34:43.172136 run osmo-stp_10.42.42.5(pid=17491): stdout: | (launched: 2022-12-10_08:34:41.786200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:43.302775 run osmo-stp_10.42.42.5(pid=17491): stderr: | 20221210083441960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083441960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083441961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083441961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083441961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083441962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083441962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:43.433395 run osmo-stp_10.42.42.5(pid=17491): stdout: | (launched: 2022-12-10_08:34:41.786200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:43.558345 run osmo-stp_10.42.42.5(pid=17491): stderr: | 20221210083441960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083441960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083441961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083441961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083441961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083441962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083441962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:43.706335 run patchelf(pid=17494): Terminating (SIGINT) 08:34:43.877407 run patchelf(pid=17494): Terminated: ok {rc=0} 08:34:44.000843 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17491): Process ended prematurely: osmo-stp_10.42.42.5(pid=17491) [trial-2372↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17491)] [trial-2372↪gprs:oc2g↪iperf3.py:8] 08:34:44.010238 tst iperf3.py:8: Test FAILED (7.6 sec) 08:34:44.037410 run osmo-hlr_10.42.42.2(pid=17488): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17488)] 08:34:44.084851 run osmo-hlr_10.42.42.2(pid=17488): stdout: | (launched: 2022-12-10_08:34:40.819734) 08:34:44.134081 run osmo-hlr_10.42.42.2(pid=17488): stderr: | 20221210083440997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083440997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083440997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083440997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083440997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083440998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083441010 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083441019 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083441019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083441019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:44.183863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17483): Terminating (SIGTERM) 08:34:44.223146 run iperf3-srv_10.42.42.10(pid=17484): Terminating (SIGTERM) 08:34:44.262324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17487): Terminating (SIGTERM) 08:34:44.301628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17490): Terminating (SIGTERM) 08:34:44.340787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17493): Terminating (SIGTERM) 08:34:44.380529 --- ParallelTerminationStrategy: PID 17483 died... 08:34:44.399460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17483): Terminated: ok {rc=0} 08:34:44.443338 --- ParallelTerminationStrategy: PID 17484 died... 08:34:44.461696 run iperf3-srv_10.42.42.10(pid=17484): Terminated {rc=256} 08:34:44.505467 --- ParallelTerminationStrategy: PID 17487 died... 08:34:44.523956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17487): Terminated: ok {rc=0} 08:34:44.567626 --- ParallelTerminationStrategy: PID 17490 died... 08:34:44.586077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17490): Terminated: ok {rc=0} 08:34:44.629905 --- ParallelTerminationStrategy: PID 17493 died... 08:34:44.648318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17493): Terminated: ok {rc=0} 08:34:44.733607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g iperf3m4.py ---------------------------------------------- 08:34:45.894879 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:45.911719 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:34:45.955996 tst iperf3m4.py: using LAC 27160 08:34:46.093823 tst iperf3m4.py: using RAC 130 08:34:46.218674 tst iperf3m4.py: using CellId 27160 08:34:46.353583 tst iperf3m4.py: using BVCI 27161 08:34:46.474687 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.486372 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.498200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.510344 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.522189 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.533896 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.545480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.556802 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:34:46.568598 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:46.691776 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:46.844742 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:46.995768 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:34:47.112346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:34:47.323943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:47.638504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Launched 08:34:47.909242 run iperf3-srv_10.42.42.10(pid=17496): Launched 08:34:48.024852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:34:48.230307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:48.541610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Launched 08:34:48.811361 run iperf3-srv_10.42.42.10(pid=17498): Launched 08:34:48.925853 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:34:49.129353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:49.438353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17499): Launched 08:34:49.706145 run iperf3-srv_10.42.42.10(pid=17500): Launched 08:34:49.819830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:34:50.024125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:34:50.333590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17501): Launched 08:34:50.601297 run iperf3-srv_10.42.42.10(pid=17502): Launched 08:34:50.715383 tst iperf3m4.py:8: start network... 08:34:50.919056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:34:51.395317 run create_hlr_db(pid=17503): Launched 08:34:51.511036 bus /gobi_6: Setting Powered False 08:34:52.574830 run create_hlr_db(pid=17503): Terminated: ok {rc=0} 08:34:53.014256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17505): Launched 08:34:53.322406 run osmo-hlr_10.42.42.2(pid=17506): Launched 08:34:53.438905 run osmo-stp_10.42.42.5: Starting osmo-stp 08:34:53.980842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17508): Launched 08:34:54.289021 run osmo-stp_10.42.42.5(pid=17509): Launched 08:34:54.405618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:34:54.935876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17511): Launched 08:34:55.052350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:34:55.313586 run patchelf(pid=17512): Launched 08:34:55.483598 run osmo-stp_10.42.42.5(pid=17509): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17509)] 08:34:55.612709 run osmo-stp_10.42.42.5(pid=17509): stdout: | (launched: 2022-12-10_08:34:54.229943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:55.743584 run osmo-stp_10.42.42.5(pid=17509): stderr: | 20221210083454404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083454404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083454404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083454405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083454405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083454405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083454405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:55.874756 run osmo-stp_10.42.42.5(pid=17509): stdout: | (launched: 2022-12-10_08:34:54.229943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:34:56.000577 run osmo-stp_10.42.42.5(pid=17509): stderr: | 20221210083454404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083454404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083454404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083454405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083454405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083454405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083454405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:34:56.149322 run patchelf(pid=17512): Terminating (SIGINT) 08:34:56.320475 run patchelf(pid=17512): Terminated: ok {rc=0} 08:34:56.443942 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17509): Process ended prematurely: osmo-stp_10.42.42.5(pid=17509) [trial-2372↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17509)] [trial-2372↪gprs:oc2g↪iperf3m4.py:8] 08:34:56.453332 tst iperf3m4.py:8: Test FAILED (10.6 sec) 08:34:56.481029 run osmo-hlr_10.42.42.2(pid=17506): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17506)] 08:34:56.528635 run osmo-hlr_10.42.42.2(pid=17506): stdout: | (launched: 2022-12-10_08:34:53.262744) 08:34:56.577865 run osmo-hlr_10.42.42.2(pid=17506): stderr: | 20221210083453442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083453442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083453442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083453442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083453442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083453442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083453454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083453462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083453463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083453463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:34:56.627784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Terminating (SIGTERM) 08:34:56.667840 run iperf3-srv_10.42.42.10(pid=17496): Terminating (SIGTERM) 08:34:56.707446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Terminating (SIGTERM) 08:34:56.747283 run iperf3-srv_10.42.42.10(pid=17498): Terminating (SIGTERM) 08:34:56.786925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17499): Terminating (SIGTERM) 08:34:56.826662 run iperf3-srv_10.42.42.10(pid=17500): Terminating (SIGTERM) 08:34:56.866275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17501): Terminating (SIGTERM) 08:34:56.906039 run iperf3-srv_10.42.42.10(pid=17502): Terminating (SIGTERM) 08:34:56.945607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17505): Terminating (SIGTERM) 08:34:56.985270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17508): Terminating (SIGTERM) 08:34:57.025023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17511): Terminating (SIGTERM) 08:34:57.065193 --- ParallelTerminationStrategy: PID 17495 died... 08:34:57.084147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17495): Terminated: ok {rc=0} 08:34:57.128702 --- ParallelTerminationStrategy: PID 17496 died... 08:34:57.147381 run iperf3-srv_10.42.42.10(pid=17496): Terminated {rc=256} 08:34:57.191629 --- ParallelTerminationStrategy: PID 17497 died... 08:34:57.210297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17497): Terminated: ok {rc=0} 08:34:57.255313 --- ParallelTerminationStrategy: PID 17498 died... 08:34:57.273723 run iperf3-srv_10.42.42.10(pid=17498): Terminated {rc=256} 08:34:57.317772 --- ParallelTerminationStrategy: PID 17499 died... 08:34:57.336031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17499): Terminated: ok {rc=0} 08:34:57.380748 --- ParallelTerminationStrategy: PID 17500 died... 08:34:57.399257 run iperf3-srv_10.42.42.10(pid=17500): Terminated {rc=256} 08:34:57.443200 --- ParallelTerminationStrategy: PID 17501 died... 08:34:57.461663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17501): Terminated: ok {rc=0} 08:34:57.505391 --- ParallelTerminationStrategy: PID 17502 died... 08:34:57.523909 run iperf3-srv_10.42.42.10(pid=17502): Terminated {rc=256} 08:34:57.567534 --- ParallelTerminationStrategy: PID 17505 died... 08:34:57.586017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17505): Terminated: ok {rc=0} 08:34:57.629693 --- ParallelTerminationStrategy: PID 17508 died... 08:34:57.648060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17508): Terminated: ok {rc=0} 08:34:57.691871 --- ParallelTerminationStrategy: PID 17511 died... 08:34:57.710300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17511): Terminated: ok {rc=0} 08:34:57.795674 bus /gobi_4: Setting Powered False 08:34:58.893218 bus /gobi_4: Setting Powered False 08:35:00.005840 bus /gobi_1: Setting Powered False 08:35:01.106010 bus /gobi_1: Setting Powered False 08:35:02.234585 bus /gobi_0: Setting Powered False 08:35:03.334280 bus /gobi_0: Setting Powered False 08:35:04.449945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g ping.py ---------------------------------------------- 08:35:05.552462 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:05.563347 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:35:05.598842 tst ping.py: using LAC 27161 08:35:05.723068 tst ping.py: using RAC 131 08:35:05.842063 tst ping.py: using CellId 27161 08:35:05.961164 tst ping.py: using BVCI 27162 08:35:06.070889 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.081527 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.091884 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.102488 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.112867 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.123458 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.134105 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:06.144590 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:35:06.262951 tst ping.py:19: start network... 08:35:06.478569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:06.975787 run create_hlr_db(pid=17517): Launched 08:35:07.104435 bus /gobi_6: Setting Powered False 08:35:08.167877 run create_hlr_db(pid=17517): Terminated: ok {rc=0} 08:35:08.598420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17519): Launched 08:35:08.901209 run osmo-hlr_10.42.42.2(pid=17520): Launched 08:35:09.015850 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:09.552244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17522): Launched 08:35:09.855409 run osmo-stp_10.42.42.5(pid=17523): Launched 08:35:09.970191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:10.492762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17525): Launched 08:35:10.607734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:10.865549 run patchelf(pid=17526): Launched 08:35:11.032897 run osmo-stp_10.42.42.5(pid=17523): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17523)] 08:35:11.160056 run osmo-stp_10.42.42.5(pid=17523): stdout: | (launched: 2022-12-10_08:35:09.796456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:11.288669 run osmo-stp_10.42.42.5(pid=17523): stderr: | 20221210083509971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083509971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083509971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083509972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083509972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083509972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083509972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:11.416890 run osmo-stp_10.42.42.5(pid=17523): stdout: | (launched: 2022-12-10_08:35:09.796456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:11.539931 run osmo-stp_10.42.42.5(pid=17523): stderr: | 20221210083509971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083509971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083509971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083509972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083509972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083509972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083509972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:11.685814 run patchelf(pid=17526): Terminating (SIGINT) 08:35:11.854781 run patchelf(pid=17526): Terminated: ok {rc=0} 08:35:11.976059 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17523): Process ended prematurely: osmo-stp_10.42.42.5(pid=17523) [trial-2372↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17523)] [trial-2372↪gprs:oc2g↪ping.py:22] 08:35:11.984743 tst ping.py:22: Test FAILED (6.4 sec) 08:35:12.012085 run osmo-hlr_10.42.42.2(pid=17520): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17520)] 08:35:12.060080 run osmo-hlr_10.42.42.2(pid=17520): stdout: | (launched: 2022-12-10_08:35:08.843292) 08:35:12.110146 run osmo-hlr_10.42.42.2(pid=17520): stderr: | 20221210083509021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083509021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083509021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083509021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083509021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083509021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083509033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083509042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083509042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083509043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:12.160217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17519): Terminating (SIGTERM) 08:35:12.200345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17522): Terminating (SIGTERM) 08:35:12.240312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17525): Terminating (SIGTERM) 08:35:12.280536 --- ParallelTerminationStrategy: PID 17519 died... 08:35:12.299817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17519): Terminated: ok {rc=0} 08:35:12.345210 --- ParallelTerminationStrategy: PID 17522 died... 08:35:12.364213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17522): Terminated: ok {rc=0} 08:35:12.408736 --- ParallelTerminationStrategy: PID 17525 died... 08:35:12.427472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17525): Terminated: ok {rc=0} 08:35:12.513180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 08:35:13.602760 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:13.614386 tst gprs:oc2g: Using 1 x bts (candidates: 1) 08:35:13.651322 tst ping_idle_ping.py: using LAC 27162 08:35:13.771914 tst ping_idle_ping.py: using RAC 132 08:35:13.889961 tst ping_idle_ping.py: using CellId 27162 08:35:14.010867 tst ping_idle_ping.py: using BVCI 27163 08:35:14.122535 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.133132 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.143738 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.154355 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.164843 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.175432 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.186224 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 08:35:14.196713 tst gprs:oc2g: Using 1 x modem (candidates: 4) 08:35:14.313369 tst ping_idle_ping.py:24: start network... 08:35:14.529580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:15.031961 run create_hlr_db(pid=17527): Launched 08:35:15.161242 bus /gobi_6: Setting Powered False 08:35:16.224778 run create_hlr_db(pid=17527): Terminated: ok {rc=0} 08:35:16.697392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17529): Launched 08:35:17.041640 run osmo-hlr_10.42.42.2(pid=17530): Launched 08:35:17.200094 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:17.737889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17532): Launched 08:35:18.043674 run osmo-stp_10.42.42.5(pid=17533): Launched 08:35:18.158512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:18.680636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17535): Launched 08:35:18.795171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:19.052914 run patchelf(pid=17536): Launched 08:35:19.220597 run osmo-stp_10.42.42.5(pid=17533): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17533)] 08:35:19.348224 run osmo-stp_10.42.42.5(pid=17533): stdout: | (launched: 2022-12-10_08:35:17.984505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:19.477581 run osmo-stp_10.42.42.5(pid=17533): stderr: | 20221210083518157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083518158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083518158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083518158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083518159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083518159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083518159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:19.606728 run osmo-stp_10.42.42.5(pid=17533): stdout: | (launched: 2022-12-10_08:35:17.984505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:19.730444 run osmo-stp_10.42.42.5(pid=17533): stderr: | 20221210083518157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083518158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083518158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083518158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083518159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083518159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083518159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:19.877423 run patchelf(pid=17536): Terminating (SIGINT) 08:35:20.047295 run patchelf(pid=17536): Terminated: ok {rc=0} 08:35:20.168894 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17533): Process ended prematurely: osmo-stp_10.42.42.5(pid=17533) [trial-2372↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17533)] [trial-2372↪gprs:oc2g↪ping_idle_ping.py:27] 08:35:20.178028 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:35:20.205466 run osmo-hlr_10.42.42.2(pid=17530): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17530)] 08:35:20.253377 run osmo-hlr_10.42.42.2(pid=17530): stdout: | (launched: 2022-12-10_08:35:16.971735) 08:35:20.302926 run osmo-hlr_10.42.42.2(pid=17530): stderr: | 20221210083517205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083517205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083517205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083517205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083517205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083517205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083517217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083517225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083517226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083517226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:20.352924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17529): Terminating (SIGTERM) 08:35:20.393106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17532): Terminating (SIGTERM) 08:35:20.433329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17535): Terminating (SIGTERM) 08:35:20.473717 --- ParallelTerminationStrategy: PID 17529 died... 08:35:20.492743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17529): Terminated: ok {rc=0} 08:35:20.537213 --- ParallelTerminationStrategy: PID 17532 died... 08:35:20.555783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17532): Terminated: ok {rc=0} 08:35:20.600121 --- ParallelTerminationStrategy: PID 17535 died... 08:35:20.618690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17535): Terminated: ok {rc=0} 08:35:20.704032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 08:35:21.989714 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:35:21.994670 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:35:22.015095 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:35:22.053752 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:35:22.139868 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:35:22.160020 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:35:22.198297 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:35:22.789568 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:35:22.837973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:22.848455 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:35:22.883803 tst cs_paging_gprs_active.py: using LAC 27163 08:35:23.005728 tst cs_paging_gprs_active.py: using RAC 133 08:35:23.131153 tst cs_paging_gprs_active.py: using CellId 27163 08:35:23.259628 tst cs_paging_gprs_active.py: using BVCI 27164 08:35:23.376574 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.387827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.398701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.409523 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.420222 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.430967 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.441910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.452656 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:23.463610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:23.579293 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:23.697491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:35:23.914109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:24.233855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17541): Launched 08:35:24.510654 run iperf3-srv_10.42.42.10(pid=17542): Launched 08:35:24.630252 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:35:24.844771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:25.164359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17543): Launched 08:35:25.441127 run iperf3-srv_10.42.42.10(pid=17544): Launched 08:35:25.560821 tst cs_paging_gprs_active.py:38: start network... 08:35:25.775442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:26.272337 run create_hlr_db(pid=17545): Launched 08:35:26.401985 bus /gobi_6: Setting Powered False 08:35:27.464853 run create_hlr_db(pid=17545): Terminated: ok {rc=0} 08:35:27.909890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17547): Launched 08:35:28.228213 run osmo-hlr_10.42.42.2(pid=17548): Launched 08:35:28.350927 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:28.900700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17550): Launched 08:35:29.220029 run osmo-stp_10.42.42.5(pid=17551): Launched 08:35:29.342005 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:29.894446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17553): Launched 08:35:30.016785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:30.287776 run patchelf(pid=17554): Launched 08:35:30.465828 run osmo-stp_10.42.42.5(pid=17551): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17551)] 08:35:30.601382 run osmo-stp_10.42.42.5(pid=17551): stdout: | (launched: 2022-12-10_08:35:29.162193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:30.738568 run osmo-stp_10.42.42.5(pid=17551): stderr: | 20221210083529352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083529352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083529352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083529353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083529353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083529353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083529353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:30.877181 run osmo-stp_10.42.42.5(pid=17551): stdout: | (launched: 2022-12-10_08:35:29.162193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:31.011390 run osmo-stp_10.42.42.5(pid=17551): stderr: | 20221210083529352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083529352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083529352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083529353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083529353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083529353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083529353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:31.170299 run patchelf(pid=17554): Terminating (SIGINT) 08:35:31.353443 run patchelf(pid=17554): Terminated: ok {rc=0} 08:35:31.485679 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17551): Process ended prematurely: osmo-stp_10.42.42.5(pid=17551) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17551)] [trial-2372↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:35:31.496710 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:35:31.526299 run osmo-hlr_10.42.42.2(pid=17548): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17548)] 08:35:31.577698 run osmo-hlr_10.42.42.2(pid=17548): stdout: | (launched: 2022-12-10_08:35:28.170588) 08:35:31.631150 run osmo-hlr_10.42.42.2(pid=17548): stderr: | 20221210083528367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083528367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083528367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083528367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083528367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083528367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083528379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083528388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083528389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083528389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:31.686955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17541): Terminating (SIGTERM) 08:35:31.730568 run iperf3-srv_10.42.42.10(pid=17542): Terminating (SIGTERM) 08:35:31.776259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17543): Terminating (SIGTERM) 08:35:31.820374 run iperf3-srv_10.42.42.10(pid=17544): Terminating (SIGTERM) 08:35:31.866783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17547): Terminating (SIGTERM) 08:35:31.910522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17550): Terminating (SIGTERM) 08:35:31.955342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17553): Terminating (SIGTERM) 08:35:32.001314 --- ParallelTerminationStrategy: PID 17541 died... 08:35:32.021074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17541): Terminated: ok {rc=0} 08:35:32.070177 --- ParallelTerminationStrategy: PID 17542 died... 08:35:32.089806 run iperf3-srv_10.42.42.10(pid=17542): Terminated {rc=256} 08:35:32.137198 --- ParallelTerminationStrategy: PID 17543 died... 08:35:32.156595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17543): Terminated: ok {rc=0} 08:35:32.205295 --- ParallelTerminationStrategy: PID 17544 died... 08:35:32.224745 run iperf3-srv_10.42.42.10(pid=17544): Terminated {rc=256} 08:35:32.273133 --- ParallelTerminationStrategy: PID 17547 died... 08:35:32.292034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17547): Terminated: ok {rc=0} 08:35:32.337506 --- ParallelTerminationStrategy: PID 17550 died... 08:35:32.356066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17550): Terminated: ok {rc=0} 08:35:32.401341 --- ParallelTerminationStrategy: PID 17553 died... 08:35:32.420016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17553): Terminated: ok {rc=0} 08:35:32.506288 bus /gobi_0: Setting Powered False 08:35:33.605515 bus /gobi_0: Setting Powered False 08:35:34.719959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:35:35.864701 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:35.876180 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:35:35.912788 tst iperf3.py: using LAC 27164 08:35:36.031412 tst iperf3.py: using RAC 134 08:35:36.151264 tst iperf3.py: using CellId 27164 08:35:36.270326 tst iperf3.py: using BVCI 27165 08:35:36.382561 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.393238 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.403757 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.414969 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.426313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.437550 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.448874 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.460317 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:36.471971 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:36.592901 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:35:36.809606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:37.131450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17555): Launched 08:35:37.408070 run iperf3-srv_10.42.42.10(pid=17556): Launched 08:35:37.527137 tst iperf3.py:8: start network... 08:35:37.741920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:38.236550 run create_hlr_db(pid=17557): Launched 08:35:38.354055 bus /gobi_6: Setting Powered False 08:35:39.413457 run create_hlr_db(pid=17557): Terminated: ok {rc=0} 08:35:39.831221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17559): Launched 08:35:40.130188 run osmo-hlr_10.42.42.2(pid=17560): Launched 08:35:40.244775 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:40.763607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17562): Launched 08:35:41.064450 run osmo-stp_10.42.42.5(pid=17563): Launched 08:35:41.179780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:41.698760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17565): Launched 08:35:41.813826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:42.068074 run patchelf(pid=17566): Launched 08:35:42.235425 run osmo-stp_10.42.42.5(pid=17563): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17563)] 08:35:42.363382 run osmo-stp_10.42.42.5(pid=17563): stdout: | (launched: 2022-12-10_08:35:41.009613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:42.492444 run osmo-stp_10.42.42.5(pid=17563): stderr: | 20221210083541180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083541180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083541180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083541181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083541181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083541181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083541181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:42.621841 run osmo-stp_10.42.42.5(pid=17563): stdout: | (launched: 2022-12-10_08:35:41.009613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:42.745562 run osmo-stp_10.42.42.5(pid=17563): stderr: | 20221210083541180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083541180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083541180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083541181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083541181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083541181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083541181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:42.892118 run patchelf(pid=17566): Terminating (SIGINT) 08:35:43.061498 run patchelf(pid=17566): Terminated: ok {rc=0} 08:35:43.183854 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17563): Process ended prematurely: osmo-stp_10.42.42.5(pid=17563) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17563)] [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 08:35:43.193886 tst iperf3.py:8: Test FAILED (7.4 sec) 08:35:43.220936 run osmo-hlr_10.42.42.2(pid=17560): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17560)] 08:35:43.268739 run osmo-hlr_10.42.42.2(pid=17560): stdout: | (launched: 2022-12-10_08:35:40.075682) 08:35:43.317639 run osmo-hlr_10.42.42.2(pid=17560): stderr: | 20221210083540250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083540250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083540250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083540250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083540250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083540250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083540265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083540275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083540275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083540275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:43.367156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17555): Terminating (SIGTERM) 08:35:43.406770 run iperf3-srv_10.42.42.10(pid=17556): Terminating (SIGTERM) 08:35:43.446320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17559): Terminating (SIGTERM) 08:35:43.486081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17562): Terminating (SIGTERM) 08:35:43.525839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17565): Terminating (SIGTERM) 08:35:43.566153 --- ParallelTerminationStrategy: PID 17555 died... 08:35:43.585152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17555): Terminated: ok {rc=0} 08:35:43.629816 --- ParallelTerminationStrategy: PID 17556 died... 08:35:43.648298 run iperf3-srv_10.42.42.10(pid=17556): Terminated {rc=256} 08:35:43.692666 --- ParallelTerminationStrategy: PID 17559 died... 08:35:43.711306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17559): Terminated: ok {rc=0} 08:35:43.756206 --- ParallelTerminationStrategy: PID 17562 died... 08:35:43.774916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17562): Terminated: ok {rc=0} 08:35:43.819668 --- ParallelTerminationStrategy: PID 17565 died... 08:35:43.838394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17565): Terminated: ok {rc=0} 08:35:43.922769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:35:45.072382 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.084256 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:35:45.124385 tst iperf3m4.py: using LAC 27165 08:35:45.252076 tst iperf3m4.py: using RAC 135 08:35:45.378500 tst iperf3m4.py: using CellId 27165 08:35:45.505734 tst iperf3m4.py: using BVCI 27166 08:35:45.624694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.636146 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.647239 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.658819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.670307 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.681738 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.693460 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.704839 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:35:45.716434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:45.846471 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:45.987164 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:46.114052 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:35:46.247108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:35:46.470532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:46.809837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17567): Launched 08:35:47.135431 run iperf3-srv_10.42.42.10(pid=17568): Launched 08:35:47.270526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:35:47.486207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:47.807458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17569): Launched 08:35:48.084417 run iperf3-srv_10.42.42.10(pid=17570): Launched 08:35:48.204230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:35:48.420132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:48.741193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17571): Launched 08:35:49.018557 run iperf3-srv_10.42.42.10(pid=17572): Launched 08:35:49.138092 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:35:49.353561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:35:49.674531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Launched 08:35:49.952191 run iperf3-srv_10.42.42.10(pid=17574): Launched 08:35:50.071529 tst iperf3m4.py:8: start network... 08:35:50.287319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:35:50.786193 run create_hlr_db(pid=17575): Launched 08:35:50.915765 bus /gobi_6: Setting Powered False 08:35:51.979396 run create_hlr_db(pid=17575): Terminated: ok {rc=0} 08:35:52.426419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Launched 08:35:52.746153 run osmo-hlr_10.42.42.2(pid=17578): Launched 08:35:52.867418 run osmo-stp_10.42.42.5: Starting osmo-stp 08:35:53.419108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Launched 08:35:53.738673 run osmo-stp_10.42.42.5(pid=17581): Launched 08:35:53.861215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:35:54.413247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Launched 08:35:54.537171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:35:54.808548 run patchelf(pid=17584): Launched 08:35:54.986990 run osmo-stp_10.42.42.5(pid=17581): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] 08:35:55.122594 run osmo-stp_10.42.42.5(pid=17581): stdout: | (launched: 2022-12-10_08:35:53.680362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:55.259757 run osmo-stp_10.42.42.5(pid=17581): stderr: | 20221210083553873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083553873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083553873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083553874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083553874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083553874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083553874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:55.397087 run osmo-stp_10.42.42.5(pid=17581): stdout: | (launched: 2022-12-10_08:35:53.680362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:35:55.528727 run osmo-stp_10.42.42.5(pid=17581): stderr: | 20221210083553873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083553873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083553873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083553874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083553874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083553874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083553874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:35:55.684261 run patchelf(pid=17584): Terminating (SIGINT) 08:35:55.863675 run patchelf(pid=17584): Terminated: ok {rc=0} 08:35:55.993584 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17581): Process ended prematurely: osmo-stp_10.42.42.5(pid=17581) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 08:35:56.003554 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:35:56.031838 run osmo-hlr_10.42.42.2(pid=17578): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17578)] 08:35:56.081590 run osmo-hlr_10.42.42.2(pid=17578): stdout: | (launched: 2022-12-10_08:35:52.688180) 08:35:56.132634 run osmo-hlr_10.42.42.2(pid=17578): stderr: | 20221210083552892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083552892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083552892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083552892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083552892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083552892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083552904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083552912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083552913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083552913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:35:56.184026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17567): Terminating (SIGTERM) 08:35:56.225378 run iperf3-srv_10.42.42.10(pid=17568): Terminating (SIGTERM) 08:35:56.266623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17569): Terminating (SIGTERM) 08:35:56.307899 run iperf3-srv_10.42.42.10(pid=17570): Terminating (SIGTERM) 08:35:56.349081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17571): Terminating (SIGTERM) 08:35:56.390389 run iperf3-srv_10.42.42.10(pid=17572): Terminating (SIGTERM) 08:35:56.431434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Terminating (SIGTERM) 08:35:56.473073 run iperf3-srv_10.42.42.10(pid=17574): Terminating (SIGTERM) 08:35:56.514441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Terminating (SIGTERM) 08:35:56.555514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Terminating (SIGTERM) 08:35:56.596772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Terminating (SIGTERM) 08:35:56.638190 --- ParallelTerminationStrategy: PID 17567 died... 08:35:56.657813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17567): Terminated: ok {rc=0} 08:35:56.703468 --- ParallelTerminationStrategy: PID 17568 died... 08:35:56.722619 run iperf3-srv_10.42.42.10(pid=17568): Terminated {rc=256} 08:35:56.767904 --- ParallelTerminationStrategy: PID 17569 died... 08:35:56.787079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17569): Terminated: ok {rc=0} 08:35:56.832858 --- ParallelTerminationStrategy: PID 17570 died... 08:35:56.852519 run iperf3-srv_10.42.42.10(pid=17570): Terminated {rc=256} 08:35:56.898087 --- ParallelTerminationStrategy: PID 17571 died... 08:35:56.917253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17571): Terminated: ok {rc=0} 08:35:56.962723 --- ParallelTerminationStrategy: PID 17572 died... 08:35:56.981934 run iperf3-srv_10.42.42.10(pid=17572): Terminated {rc=256} 08:35:57.027112 --- ParallelTerminationStrategy: PID 17573 died... 08:35:57.046287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17573): Terminated: ok {rc=0} 08:35:57.091367 --- ParallelTerminationStrategy: PID 17574 died... 08:35:57.110575 run iperf3-srv_10.42.42.10(pid=17574): Terminated {rc=256} 08:35:57.155706 --- ParallelTerminationStrategy: PID 17577 died... 08:35:57.174890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17577): Terminated: ok {rc=0} 08:35:57.220173 --- ParallelTerminationStrategy: PID 17580 died... 08:35:57.239314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17580): Terminated: ok {rc=0} 08:35:57.284488 --- ParallelTerminationStrategy: PID 17583 died... 08:35:57.303757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17583): Terminated: ok {rc=0} 08:35:57.390514 bus /gobi_4: Setting Powered False 08:35:58.489510 bus /gobi_4: Setting Powered False 08:35:59.606622 bus /gobi_1: Setting Powered False 08:36:00.702117 bus /gobi_1: Setting Powered False 08:36:01.817145 bus /gobi_0: Setting Powered False 08:36:02.921100 bus /gobi_0: Setting Powered False 08:36:04.034847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 08:36:05.137935 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.149771 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:36:05.187944 tst ping.py: using LAC 27166 08:36:05.312308 tst ping.py: using RAC 136 08:36:05.429435 tst ping.py: using CellId 27166 08:36:05.553780 tst ping.py: using BVCI 27167 08:36:05.670350 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.682072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.693138 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.704123 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.715024 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.725947 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.737044 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:05.748036 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:36:05.864171 tst ping.py:19: start network... 08:36:06.061866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:06.517258 run create_hlr_db(pid=17585): Launched 08:36:06.631635 bus /gobi_6: Setting Powered False 08:36:07.690559 run create_hlr_db(pid=17585): Terminated: ok {rc=0} 08:36:08.122257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17587): Launched 08:36:08.435422 run osmo-hlr_10.42.42.2(pid=17588): Launched 08:36:08.555462 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:09.101933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17590): Launched 08:36:09.414913 run osmo-stp_10.42.42.5(pid=17591): Launched 08:36:09.534481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:10.079884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17593): Launched 08:36:10.199601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:10.465223 run patchelf(pid=17594): Launched 08:36:10.640107 run osmo-stp_10.42.42.5(pid=17591): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17591)] 08:36:10.773676 run osmo-stp_10.42.42.5(pid=17591): stdout: | (launched: 2022-12-10_08:36:09.357906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:10.908387 run osmo-stp_10.42.42.5(pid=17591): stderr: | 20221210083609547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083609547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083609547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083609548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083609550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083609550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083609550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:11.043502 run osmo-stp_10.42.42.5(pid=17591): stdout: | (launched: 2022-12-10_08:36:09.357906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:11.172691 run osmo-stp_10.42.42.5(pid=17591): stderr: | 20221210083609547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083609547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083609547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083609548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083609550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083609550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083609550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:11.326340 run patchelf(pid=17594): Terminating (SIGINT) 08:36:11.503548 run patchelf(pid=17594): Terminated: ok {rc=0} 08:36:11.630992 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17591): Process ended prematurely: osmo-stp_10.42.42.5(pid=17591) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17591)] [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 08:36:11.640222 tst ping.py:22: Test FAILED (6.5 sec) 08:36:11.667935 run osmo-hlr_10.42.42.2(pid=17588): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17588)] 08:36:11.717586 run osmo-hlr_10.42.42.2(pid=17588): stdout: | (launched: 2022-12-10_08:36:08.378265) 08:36:11.768799 run osmo-hlr_10.42.42.2(pid=17588): stderr: | 20221210083608575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083608575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083608576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083608576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083608576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083608576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083608589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083608597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083608597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083608597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:11.820364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17587): Terminating (SIGTERM) 08:36:11.861752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17590): Terminating (SIGTERM) 08:36:11.903613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17593): Terminating (SIGTERM) 08:36:11.945487 --- ParallelTerminationStrategy: PID 17587 died... 08:36:11.965224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17587): Terminated: ok {rc=0} 08:36:12.011070 --- ParallelTerminationStrategy: PID 17590 died... 08:36:12.030379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17590): Terminated: ok {rc=0} 08:36:12.075894 --- ParallelTerminationStrategy: PID 17593 died... 08:36:12.095227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17593): Terminated: ok {rc=0} 08:36:12.181581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:36:13.268909 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.281112 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:36:13.320287 tst ping_idle_ping.py: using LAC 27167 08:36:13.445727 tst ping_idle_ping.py: using RAC 137 08:36:13.570533 tst ping_idle_ping.py: using CellId 27167 08:36:13.695807 tst ping_idle_ping.py: using BVCI 27168 08:36:13.810938 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.822171 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.833261 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.844293 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.855192 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.866120 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.877197 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:36:13.888237 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:36:14.007640 tst ping_idle_ping.py:24: start network... 08:36:14.219863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:14.711353 run create_hlr_db(pid=17595): Launched 08:36:14.839063 bus /gobi_6: Setting Powered False 08:36:15.924060 run create_hlr_db(pid=17595): Terminated: ok {rc=0} 08:36:16.373713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17597): Launched 08:36:16.709694 run osmo-hlr_10.42.42.2(pid=17598): Launched 08:36:16.939948 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:17.556175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17600): Launched 08:36:17.854480 run osmo-stp_10.42.42.5(pid=17601): Launched 08:36:17.967812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:18.480834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17603): Launched 08:36:18.595020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:18.847710 run patchelf(pid=17604): Launched 08:36:19.015390 run osmo-stp_10.42.42.5(pid=17601): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17601)] 08:36:19.141952 run osmo-stp_10.42.42.5(pid=17601): stdout: | (launched: 2022-12-10_08:36:17.800065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:19.269839 run osmo-stp_10.42.42.5(pid=17601): stderr: | 20221210083617971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083617972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083617972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083617972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083617973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083617973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083617973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:19.397727 run osmo-stp_10.42.42.5(pid=17601): stdout: | (launched: 2022-12-10_08:36:17.800065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:19.520297 run osmo-stp_10.42.42.5(pid=17601): stderr: | 20221210083617971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083617972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083617972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083617972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083617973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083617973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083617973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:19.665944 run patchelf(pid=17604): Terminating (SIGINT) 08:36:19.834350 run patchelf(pid=17604): Terminated: ok {rc=0} 08:36:19.955156 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17601): Process ended prematurely: osmo-stp_10.42.42.5(pid=17601) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17601)] [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 08:36:19.963973 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:36:19.990612 run osmo-hlr_10.42.42.2(pid=17598): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17598)] 08:36:20.038575 run osmo-hlr_10.42.42.2(pid=17598): stdout: | (launched: 2022-12-10_08:36:16.636885) 08:36:20.087657 run osmo-hlr_10.42.42.2(pid=17598): stderr: | 20221210083616989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083616989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083616989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083616989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083616989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083616989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083617009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083617025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083617026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083617026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:20.137254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17597): Terminating (SIGTERM) 08:36:20.177058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17600): Terminating (SIGTERM) 08:36:20.216798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17603): Terminating (SIGTERM) 08:36:20.256748 --- ParallelTerminationStrategy: PID 17597 died... 08:36:20.275820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17597): Terminated: ok {rc=0} 08:36:20.320199 --- ParallelTerminationStrategy: PID 17600 died... 08:36:20.338733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17600): Terminated: ok {rc=0} 08:36:20.382609 --- ParallelTerminationStrategy: PID 17603 died... 08:36:20.401115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17603): Terminated: ok {rc=0} 08:36:20.483874 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:36:21.778012 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:36:21.784623 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:36:21.806731 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:36:21.847259 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:36:21.949331 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:36:21.970222 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:36:22.010181 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:36:22.599329 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:36:22.649525 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:22.660251 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:36:22.716789 tst cs_paging_gprs_active.py: using LAC 27168 08:36:22.836773 tst cs_paging_gprs_active.py: using RAC 138 08:36:22.955450 tst cs_paging_gprs_active.py: using CellId 27168 08:36:23.074227 tst cs_paging_gprs_active.py: using BVCI 27169 08:36:23.186558 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.197581 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.208209 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.219345 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.230427 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.241446 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.252583 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.263589 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:23.274825 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:23.392428 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:23.509849 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:36:23.713692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:24.020602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17609): Launched 08:36:24.287334 run iperf3-srv_10.42.42.10(pid=17610): Launched 08:36:24.401081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:36:24.604487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:24.912690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17611): Launched 08:36:25.179595 run iperf3-srv_10.42.42.10(pid=17612): Launched 08:36:25.293452 tst cs_paging_gprs_active.py:38: start network... 08:36:25.496608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:25.968940 run create_hlr_db(pid=17613): Launched 08:36:26.083929 bus /gobi_6: Setting Powered False 08:36:27.143558 run create_hlr_db(pid=17613): Terminated: ok {rc=0} 08:36:27.591381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Launched 08:36:27.916372 run osmo-hlr_10.42.42.2(pid=17616): Launched 08:36:28.039135 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:28.598413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Launched 08:36:28.924245 run osmo-stp_10.42.42.5(pid=17622): Launched 08:36:29.046844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:29.607097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Launched 08:36:29.728840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:30.005108 run patchelf(pid=17625): Launched 08:36:30.182250 run osmo-stp_10.42.42.5(pid=17622): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] 08:36:30.317520 run osmo-stp_10.42.42.5(pid=17622): stdout: | (launched: 2022-12-10_08:36:28.861606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:30.454364 run osmo-stp_10.42.42.5(pid=17622): stderr: | 20221210083629058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083629058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083629059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083629059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083629060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083629060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083629060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:30.591337 run osmo-stp_10.42.42.5(pid=17622): stdout: | (launched: 2022-12-10_08:36:28.861606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:30.722441 run osmo-stp_10.42.42.5(pid=17622): stderr: | 20221210083629058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083629058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083629059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083629059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083629060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083629060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083629060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:30.884659 run patchelf(pid=17625): Terminating (SIGINT) 08:36:31.065102 run patchelf(pid=17625): Terminated: ok {rc=0} 08:36:31.192738 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17622): Process ended prematurely: osmo-stp_10.42.42.5(pid=17622) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:36:31.203227 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:36:31.233869 run osmo-hlr_10.42.42.2(pid=17616): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17616)] 08:36:31.284379 run osmo-hlr_10.42.42.2(pid=17616): stdout: | (launched: 2022-12-10_08:36:27.854023) 08:36:31.335973 run osmo-hlr_10.42.42.2(pid=17616): stderr: | 20221210083628057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083628057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083628057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083628057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083628057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083628057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083628070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083628078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083628078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083628078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:31.389799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17609): Terminating (SIGTERM) 08:36:31.432258 run iperf3-srv_10.42.42.10(pid=17610): Terminating (SIGTERM) 08:36:31.474636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17611): Terminating (SIGTERM) 08:36:31.517706 run iperf3-srv_10.42.42.10(pid=17612): Terminating (SIGTERM) 08:36:31.559975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminating (SIGTERM) 08:36:31.603904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Terminating (SIGTERM) 08:36:31.647851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Terminating (SIGTERM) 08:36:31.693901 --- ParallelTerminationStrategy: PID 17609 died... 08:36:31.713296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17609): Terminated: ok {rc=0} 08:36:31.761900 --- ParallelTerminationStrategy: PID 17610 died... 08:36:31.781251 run iperf3-srv_10.42.42.10(pid=17610): Terminated {rc=256} 08:36:31.837130 --- ParallelTerminationStrategy: PID 17611 died... 08:36:31.861478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17611): Terminated: ok {rc=0} 08:36:31.918729 --- ParallelTerminationStrategy: PID 17612 died... 08:36:31.941997 run iperf3-srv_10.42.42.10(pid=17612): Terminated {rc=256} 08:36:31.993464 --- ParallelTerminationStrategy: PID 17615 died... 08:36:32.013266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17615): Terminated: ok {rc=0} 08:36:32.060251 --- ParallelTerminationStrategy: PID 17621 died... 08:36:32.079658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17621): Terminated: ok {rc=0} 08:36:32.126436 --- ParallelTerminationStrategy: PID 17624 died... 08:36:32.145616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17624): Terminated: ok {rc=0} 08:36:32.233613 bus /gobi_0: Setting Powered False 08:36:33.332759 bus /gobi_0: Setting Powered False 08:36:34.448358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:36:35.592406 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:35.603603 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:36:35.661973 tst iperf3.py: using LAC 27169 08:36:35.782279 tst iperf3.py: using RAC 139 08:36:35.902300 tst iperf3.py: using CellId 27169 08:36:36.022129 tst iperf3.py: using BVCI 27170 08:36:36.131805 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.142676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.153301 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.164008 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.174678 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.185535 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.196702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.207578 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:36.218544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:36.332217 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:36:36.534712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:36.840844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17626): Launched 08:36:37.106551 run iperf3-srv_10.42.42.10(pid=17627): Launched 08:36:37.218957 tst iperf3.py:8: start network... 08:36:37.420453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:37.889793 run create_hlr_db(pid=17628): Launched 08:36:38.020226 bus /gobi_6: Setting Powered False 08:36:39.083529 run create_hlr_db(pid=17628): Terminated: ok {rc=0} 08:36:39.531365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Launched 08:36:39.853486 run osmo-hlr_10.42.42.2(pid=17631): Launched 08:36:39.976286 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:40.535423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Launched 08:36:40.858109 run osmo-stp_10.42.42.5(pid=17634): Launched 08:36:40.981252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:41.536375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17636): Launched 08:36:41.658178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:41.931534 run patchelf(pid=17637): Launched 08:36:42.108414 run osmo-stp_10.42.42.5(pid=17634): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] 08:36:42.243304 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-10_08:36:40.795983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:42.380112 run osmo-stp_10.42.42.5(pid=17634): stderr: | 20221210083640993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083640993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083640993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083640993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083640994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083640994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083640994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:42.517244 run osmo-stp_10.42.42.5(pid=17634): stdout: | (launched: 2022-12-10_08:36:40.795983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:42.648190 run osmo-stp_10.42.42.5(pid=17634): stderr: | 20221210083640993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083640993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083640993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083640993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083640994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083640994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083640994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:42.804015 run patchelf(pid=17637): Terminating (SIGINT) 08:36:42.983886 run patchelf(pid=17637): Terminated: ok {rc=0} 08:36:43.113150 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 08:36:43.123090 tst iperf3.py:8: Test FAILED (7.6 sec) 08:36:43.150731 run osmo-hlr_10.42.42.2(pid=17631): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17631)] 08:36:43.199923 run osmo-hlr_10.42.42.2(pid=17631): stdout: | (launched: 2022-12-10_08:36:39.791853) 08:36:43.250820 run osmo-hlr_10.42.42.2(pid=17631): stderr: | 20221210083639996 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083639996 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083639996 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083639996 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083639997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083639997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083640008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083640017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083640017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083640017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:43.302075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17626): Terminating (SIGTERM) 08:36:43.343261 run iperf3-srv_10.42.42.10(pid=17627): Terminating (SIGTERM) 08:36:43.384359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminating (SIGTERM) 08:36:43.425667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminating (SIGTERM) 08:36:43.466637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17636): Terminating (SIGTERM) 08:36:43.507814 --- ParallelTerminationStrategy: PID 17626 died... 08:36:43.527459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17626): Terminated: ok {rc=0} 08:36:43.573386 --- ParallelTerminationStrategy: PID 17627 died... 08:36:43.592543 run iperf3-srv_10.42.42.10(pid=17627): Terminated {rc=256} 08:36:43.638335 --- ParallelTerminationStrategy: PID 17630 died... 08:36:43.657371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17630): Terminated: ok {rc=0} 08:36:43.702853 --- ParallelTerminationStrategy: PID 17633 died... 08:36:43.721879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17633): Terminated: ok {rc=0} 08:36:43.767342 --- ParallelTerminationStrategy: PID 17636 died... 08:36:43.786683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17636): Terminated: ok {rc=0} 08:36:43.873541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:36:45.026662 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.038542 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:36:45.094547 tst iperf3m4.py: using LAC 27170 08:36:45.216048 tst iperf3m4.py: using RAC 140 08:36:45.343267 tst iperf3m4.py: using CellId 27170 08:36:45.469768 tst iperf3m4.py: using BVCI 27171 08:36:45.587811 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.599129 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.610272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.621242 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.632149 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.643072 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.654305 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.665245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:36:45.676303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:45.792186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:45.940190 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:46.062769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:36:46.186474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:36:46.401579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:46.727269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17638): Launched 08:36:47.021707 run iperf3-srv_10.42.42.10(pid=17639): Launched 08:36:47.145895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:36:47.352176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:47.661423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17640): Launched 08:36:47.928631 run iperf3-srv_10.42.42.10(pid=17641): Launched 08:36:48.042847 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:36:48.246140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:48.554366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17642): Launched 08:36:48.819957 run iperf3-srv_10.42.42.10(pid=17643): Launched 08:36:48.933765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:36:49.136069 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:36:49.442817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Launched 08:36:49.708265 run iperf3-srv_10.42.42.10(pid=17645): Launched 08:36:49.821765 tst iperf3m4.py:8: start network... 08:36:50.024406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:36:50.496866 run create_hlr_db(pid=17646): Launched 08:36:50.613297 bus /gobi_6: Setting Powered False 08:36:51.673408 run create_hlr_db(pid=17646): Terminated: ok {rc=0} 08:36:52.115796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Launched 08:36:52.439301 run osmo-hlr_10.42.42.2(pid=17649): Launched 08:36:52.562768 run osmo-stp_10.42.42.5: Starting osmo-stp 08:36:53.121274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Launched 08:36:53.443525 run osmo-stp_10.42.42.5(pid=17652): Launched 08:36:53.565744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:36:54.122507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Launched 08:36:54.244297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:36:54.519148 run patchelf(pid=17655): Launched 08:36:54.697188 run osmo-stp_10.42.42.5(pid=17652): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] 08:36:54.832440 run osmo-stp_10.42.42.5(pid=17652): stdout: | (launched: 2022-12-10_08:36:53.381597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:54.970316 run osmo-stp_10.42.42.5(pid=17652): stderr: | 20221210083653578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083653578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083653578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083653578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083653579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083653579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083653579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:55.107327 run osmo-stp_10.42.42.5(pid=17652): stdout: | (launched: 2022-12-10_08:36:53.381597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:36:55.238738 run osmo-stp_10.42.42.5(pid=17652): stderr: | 20221210083653578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083653578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083653578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083653578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083653579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083653579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083653579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:36:55.394480 run patchelf(pid=17655): Terminating (SIGINT) 08:36:55.573582 run patchelf(pid=17655): Terminated: ok {rc=0} 08:36:55.702539 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17652): Process ended prematurely: osmo-stp_10.42.42.5(pid=17652) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:36:55.712382 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:36:55.740759 run osmo-hlr_10.42.42.2(pid=17649): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17649)] 08:36:55.790323 run osmo-hlr_10.42.42.2(pid=17649): stdout: | (launched: 2022-12-10_08:36:52.377201) 08:36:55.841635 run osmo-hlr_10.42.42.2(pid=17649): stderr: | 20221210083652579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083652579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083652579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083652579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083652579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083652579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083652591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083652599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083652600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083652600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:36:55.893208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17638): Terminating (SIGTERM) 08:36:55.935132 run iperf3-srv_10.42.42.10(pid=17639): Terminating (SIGTERM) 08:36:55.976718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17640): Terminating (SIGTERM) 08:36:56.018371 run iperf3-srv_10.42.42.10(pid=17641): Terminating (SIGTERM) 08:36:56.059619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17642): Terminating (SIGTERM) 08:36:56.101211 run iperf3-srv_10.42.42.10(pid=17643): Terminating (SIGTERM) 08:36:56.142550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Terminating (SIGTERM) 08:36:56.184009 run iperf3-srv_10.42.42.10(pid=17645): Terminating (SIGTERM) 08:36:56.225408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Terminating (SIGTERM) 08:36:56.266739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Terminating (SIGTERM) 08:36:56.307885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Terminating (SIGTERM) 08:36:56.349491 --- ParallelTerminationStrategy: PID 17638 died... 08:36:56.369185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17638): Terminated: ok {rc=0} 08:36:56.415007 --- ParallelTerminationStrategy: PID 17639 died... 08:36:56.434330 run iperf3-srv_10.42.42.10(pid=17639): Terminated {rc=256} 08:36:56.480062 --- ParallelTerminationStrategy: PID 17640 died... 08:36:56.499270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17640): Terminated: ok {rc=0} 08:36:56.544904 --- ParallelTerminationStrategy: PID 17641 died... 08:36:56.564714 run iperf3-srv_10.42.42.10(pid=17641): Terminated {rc=256} 08:36:56.610398 --- ParallelTerminationStrategy: PID 17642 died... 08:36:56.629631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17642): Terminated: ok {rc=0} 08:36:56.675162 --- ParallelTerminationStrategy: PID 17643 died... 08:36:56.694357 run iperf3-srv_10.42.42.10(pid=17643): Terminated {rc=256} 08:36:56.739912 --- ParallelTerminationStrategy: PID 17644 died... 08:36:56.759156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17644): Terminated: ok {rc=0} 08:36:56.804719 --- ParallelTerminationStrategy: PID 17645 died... 08:36:56.824055 run iperf3-srv_10.42.42.10(pid=17645): Terminated {rc=256} 08:36:56.870037 --- ParallelTerminationStrategy: PID 17648 died... 08:36:56.889352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17648): Terminated: ok {rc=0} 08:36:56.935291 --- ParallelTerminationStrategy: PID 17651 died... 08:36:56.955011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17651): Terminated: ok {rc=0} 08:36:57.000900 --- ParallelTerminationStrategy: PID 17654 died... 08:36:57.020656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17654): Terminated: ok {rc=0} 08:36:57.107538 bus /gobi_4: Setting Powered False 08:36:58.206910 bus /gobi_4: Setting Powered False 08:36:59.322126 bus /gobi_1: Setting Powered False 08:37:00.421113 bus /gobi_1: Setting Powered False 08:37:01.534860 bus /gobi_0: Setting Powered False 08:37:02.632901 bus /gobi_0: Setting Powered False 08:37:03.748328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:37:04.851098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:04.862380 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:37:04.919176 tst ping.py: using LAC 27171 08:37:05.042721 tst ping.py: using RAC 141 08:37:05.159534 tst ping.py: using CellId 27171 08:37:05.275183 tst ping.py: using BVCI 27172 08:37:05.382677 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.393531 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.404073 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.414926 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.425782 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.436476 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.447388 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:05.458214 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:37:05.572507 tst ping.py:19: start network... 08:37:05.785342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:06.279774 run create_hlr_db(pid=17656): Launched 08:37:06.407560 bus /gobi_6: Setting Powered False 08:37:07.469828 run create_hlr_db(pid=17656): Terminated: ok {rc=0} 08:37:07.898346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17658): Launched 08:37:08.198272 run osmo-hlr_10.42.42.2(pid=17659): Launched 08:37:08.311654 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:08.843128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17661): Launched 08:37:09.144115 run osmo-stp_10.42.42.5(pid=17662): Launched 08:37:09.257362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:09.774634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17664): Launched 08:37:09.888589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:10.144096 run patchelf(pid=17665): Launched 08:37:10.309960 run osmo-stp_10.42.42.5(pid=17662): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17662)] 08:37:10.436471 run osmo-stp_10.42.42.5(pid=17662): stdout: | (launched: 2022-12-10_08:37:09.086124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:10.564867 run osmo-stp_10.42.42.5(pid=17662): stderr: | 20221210083709259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083709259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083709259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083709259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083709260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083709260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083709260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:10.693489 run osmo-stp_10.42.42.5(pid=17662): stdout: | (launched: 2022-12-10_08:37:09.086124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:10.816303 run osmo-stp_10.42.42.5(pid=17662): stderr: | 20221210083709259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083709259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083709259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083709259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083709260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083709260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083709260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:10.961840 run patchelf(pid=17665): Terminating (SIGINT) 08:37:11.131348 run patchelf(pid=17665): Terminated: ok {rc=0} 08:37:11.252459 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17662): Process ended prematurely: osmo-stp_10.42.42.5(pid=17662) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17662)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 08:37:11.261615 tst ping.py:22: Test FAILED (6.4 sec) 08:37:11.288590 run osmo-hlr_10.42.42.2(pid=17659): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17659)] 08:37:11.337328 run osmo-hlr_10.42.42.2(pid=17659): stdout: | (launched: 2022-12-10_08:37:08.140815) 08:37:11.387514 run osmo-hlr_10.42.42.2(pid=17659): stderr: | 20221210083708317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083708317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083708317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083708317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083708317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083708317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083708330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083708341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083708341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083708341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:11.438042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17658): Terminating (SIGTERM) 08:37:11.478281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17661): Terminating (SIGTERM) 08:37:11.518677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17664): Terminating (SIGTERM) 08:37:11.559349 --- ParallelTerminationStrategy: PID 17658 died... 08:37:11.578486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17658): Terminated: ok {rc=0} 08:37:11.623226 --- ParallelTerminationStrategy: PID 17661 died... 08:37:11.641888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17661): Terminated: ok {rc=0} 08:37:11.686915 --- ParallelTerminationStrategy: PID 17664 died... 08:37:11.705526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17664): Terminated: ok {rc=0} 08:37:11.791467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:37:12.880632 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:12.892445 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:37:12.950380 tst ping_idle_ping.py: using LAC 27172 08:37:13.068921 tst ping_idle_ping.py: using RAC 142 08:37:13.194739 tst ping_idle_ping.py: using CellId 27172 08:37:13.320753 tst ping_idle_ping.py: using BVCI 27173 08:37:13.435420 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.446903 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.458193 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.469443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.480539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.491632 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.502916 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:37:13.514005 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:37:13.629108 tst ping_idle_ping.py:24: start network... 08:37:13.828838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:14.295790 run create_hlr_db(pid=17666): Launched 08:37:14.409847 bus /gobi_6: Setting Powered False 08:37:15.470434 run create_hlr_db(pid=17666): Terminated: ok {rc=0} 08:37:15.893404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Launched 08:37:16.239155 run osmo-hlr_10.42.42.2(pid=17669): Launched 08:37:16.474159 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:17.100164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Launched 08:37:17.433989 run osmo-stp_10.42.42.5(pid=17672): Launched 08:37:17.554568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:18.108389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17674): Launched 08:37:18.229646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:18.502195 run patchelf(pid=17675): Launched 08:37:18.677746 run osmo-stp_10.42.42.5(pid=17672): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] 08:37:18.811391 run osmo-stp_10.42.42.5(pid=17672): stdout: | (launched: 2022-12-10_08:37:17.372122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:18.947134 run osmo-stp_10.42.42.5(pid=17672): stderr: | 20221210083717566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083717566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083717566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083717566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083717567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083717567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083717567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:19.082543 run osmo-stp_10.42.42.5(pid=17672): stdout: | (launched: 2022-12-10_08:37:17.372122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:19.212507 run osmo-stp_10.42.42.5(pid=17672): stderr: | 20221210083717566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083717566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083717566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083717566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083717567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083717567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083717567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:19.366664 run patchelf(pid=17675): Terminating (SIGINT) 08:37:19.543877 run patchelf(pid=17675): Terminated: ok {rc=0} 08:37:19.671264 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17672): Process ended prematurely: osmo-stp_10.42.42.5(pid=17672) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:37:19.680423 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:37:19.708151 run osmo-hlr_10.42.42.2(pid=17669): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17669)] 08:37:19.757820 run osmo-hlr_10.42.42.2(pid=17669): stdout: | (launched: 2022-12-10_08:37:16.168836) 08:37:19.809174 run osmo-hlr_10.42.42.2(pid=17669): stderr: | 20221210083716407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083716407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083716407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083716407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083716407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083716407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083716419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083716431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083716432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083716432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:19.860818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Terminating (SIGTERM) 08:37:19.902461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Terminating (SIGTERM) 08:37:19.944395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17674): Terminating (SIGTERM) 08:37:19.986658 --- ParallelTerminationStrategy: PID 17668 died... 08:37:20.006635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17668): Terminated: ok {rc=0} 08:37:20.052806 --- ParallelTerminationStrategy: PID 17671 died... 08:37:20.072737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17671): Terminated: ok {rc=0} 08:37:20.118812 --- ParallelTerminationStrategy: PID 17674 died... 08:37:20.138338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17674): Terminated: ok {rc=0} 08:37:20.226933 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:37:21.513385 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:37:21.519273 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:37:21.540429 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:37:21.579219 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:37:21.665056 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:37:21.685455 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:37:21.724264 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:37:22.316253 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:37:22.365823 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.376710 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:37:22.433850 tst cs_paging_gprs_active.py: using LAC 27173 08:37:22.562020 tst cs_paging_gprs_active.py: using RAC 143 08:37:22.681569 tst cs_paging_gprs_active.py: using CellId 27173 08:37:22.806478 tst cs_paging_gprs_active.py: using BVCI 27174 08:37:22.922711 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.934323 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.945357 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.956289 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.967168 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.978696 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:22.989868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:23.000690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:23.011795 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:23.127048 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:23.242595 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:37:23.446258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:23.748834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17679): Launched 08:37:24.012542 run iperf3-srv_10.42.42.10(pid=17680): Launched 08:37:24.126225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:37:24.330058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:24.633140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17681): Launched 08:37:24.895602 run iperf3-srv_10.42.42.10(pid=17682): Launched 08:37:25.009222 tst cs_paging_gprs_active.py:38: start network... 08:37:25.213206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:25.682472 run create_hlr_db(pid=17683): Launched 08:37:25.799144 bus /gobi_6: Setting Powered False 08:37:26.859149 run create_hlr_db(pid=17683): Terminated: ok {rc=0} 08:37:27.301244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17685): Launched 08:37:27.622535 run osmo-hlr_10.42.42.2(pid=17686): Launched 08:37:27.745893 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:28.297887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17688): Launched 08:37:28.617221 run osmo-stp_10.42.42.5(pid=17689): Launched 08:37:28.739592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:29.293863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17691): Launched 08:37:29.415893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:29.686425 run patchelf(pid=17692): Launched 08:37:29.863898 run osmo-stp_10.42.42.5(pid=17689): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17689)] 08:37:30.000191 run osmo-stp_10.42.42.5(pid=17689): stdout: | (launched: 2022-12-10_08:37:28.559239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:30.138020 run osmo-stp_10.42.42.5(pid=17689): stderr: | 20221210083728750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083728751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083728751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083728751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083728752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083728752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083728752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:30.275706 run osmo-stp_10.42.42.5(pid=17689): stdout: | (launched: 2022-12-10_08:37:28.559239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:30.407362 run osmo-stp_10.42.42.5(pid=17689): stderr: | 20221210083728750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083728751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083728751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083728751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083728752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083728752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083728752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:30.563088 run patchelf(pid=17692): Terminating (SIGINT) 08:37:30.742547 run patchelf(pid=17692): Terminated: ok {rc=0} 08:37:30.873247 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17689): Process ended prematurely: osmo-stp_10.42.42.5(pid=17689) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17689)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:37:30.887416 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:37:30.926308 run osmo-hlr_10.42.42.2(pid=17686): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17686)] 08:37:30.977292 run osmo-hlr_10.42.42.2(pid=17686): stdout: | (launched: 2022-12-10_08:37:27.564274) 08:37:31.034787 run osmo-hlr_10.42.42.2(pid=17686): stderr: | 20221210083727762 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083727762 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083727762 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083727762 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083727762 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083727762 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083727774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083727783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083727783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083727783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:31.106629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17679): Terminating (SIGTERM) 08:37:31.149411 run iperf3-srv_10.42.42.10(pid=17680): Terminating (SIGTERM) 08:37:31.193928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17681): Terminating (SIGTERM) 08:37:31.237070 run iperf3-srv_10.42.42.10(pid=17682): Terminating (SIGTERM) 08:37:31.281838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17685): Terminating (SIGTERM) 08:37:31.323879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17688): Terminating (SIGTERM) 08:37:31.365737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17691): Terminating (SIGTERM) 08:37:31.407603 --- ParallelTerminationStrategy: PID 17679 died... 08:37:31.427327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17679): Terminated: ok {rc=0} 08:37:31.473473 --- ParallelTerminationStrategy: PID 17680 died... 08:37:31.492933 run iperf3-srv_10.42.42.10(pid=17680): Terminated {rc=256} 08:37:31.538985 --- ParallelTerminationStrategy: PID 17681 died... 08:37:31.558603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17681): Terminated: ok {rc=0} 08:37:31.604631 --- ParallelTerminationStrategy: PID 17682 died... 08:37:31.624089 run iperf3-srv_10.42.42.10(pid=17682): Terminated {rc=256} 08:37:31.669941 --- ParallelTerminationStrategy: PID 17685 died... 08:37:31.689400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17685): Terminated: ok {rc=0} 08:37:31.735292 --- ParallelTerminationStrategy: PID 17688 died... 08:37:31.754944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17688): Terminated: ok {rc=0} 08:37:31.800919 --- ParallelTerminationStrategy: PID 17691 died... 08:37:31.820723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17691): Terminated: ok {rc=0} 08:37:31.912869 bus /gobi_0: Setting Powered False 08:37:33.010708 bus /gobi_0: Setting Powered False 08:37:34.126996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:37:35.271808 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.283277 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:37:35.345582 tst iperf3.py: using LAC 27174 08:37:35.467086 tst iperf3.py: using RAC 144 08:37:35.590522 tst iperf3.py: using CellId 27174 08:37:35.709999 tst iperf3.py: using BVCI 27175 08:37:35.821998 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.832694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.843233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.854055 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.864757 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.875574 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.886525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.897203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:35.908345 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:36.029336 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:37:36.233489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:36.536545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17695): Launched 08:37:36.798481 run iperf3-srv_10.42.42.10(pid=17696): Launched 08:37:36.911223 tst iperf3.py:8: start network... 08:37:37.112835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:37.582410 run create_hlr_db(pid=17697): Launched 08:37:37.697358 bus /gobi_6: Setting Powered False 08:37:38.757973 run create_hlr_db(pid=17697): Terminated: ok {rc=0} 08:37:39.180446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17699): Launched 08:37:39.483317 run osmo-hlr_10.42.42.2(pid=17700): Launched 08:37:39.599583 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:40.133910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17702): Launched 08:37:40.434523 run osmo-stp_10.42.42.5(pid=17703): Launched 08:37:40.550337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:41.071685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17705): Launched 08:37:41.186794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:41.442022 run patchelf(pid=17706): Launched 08:37:41.609636 run osmo-stp_10.42.42.5(pid=17703): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17703)] 08:37:41.737348 run osmo-stp_10.42.42.5(pid=17703): stdout: | (launched: 2022-12-10_08:37:40.379904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:41.866572 run osmo-stp_10.42.42.5(pid=17703): stderr: | 20221210083740548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083740548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083740548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083740549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083740549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083740549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083740549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:41.996431 run osmo-stp_10.42.42.5(pid=17703): stdout: | (launched: 2022-12-10_08:37:40.379904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:42.120367 run osmo-stp_10.42.42.5(pid=17703): stderr: | 20221210083740548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083740548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083740548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083740549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083740549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083740549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083740549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:42.267366 run patchelf(pid=17706): Terminating (SIGINT) 08:37:42.436256 run patchelf(pid=17706): Terminated: ok {rc=0} 08:37:42.558950 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17703): Process ended prematurely: osmo-stp_10.42.42.5(pid=17703) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17703)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 08:37:42.568269 tst iperf3.py:8: Test FAILED (7.3 sec) 08:37:42.595558 run osmo-hlr_10.42.42.2(pid=17700): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17700)] 08:37:42.642746 run osmo-hlr_10.42.42.2(pid=17700): stdout: | (launched: 2022-12-10_08:37:39.428061) 08:37:42.691802 run osmo-hlr_10.42.42.2(pid=17700): stderr: | 20221210083739603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083739603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083739603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083739603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083739603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083739603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083739615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083739625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083739625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083739625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:42.741338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17695): Terminating (SIGTERM) 08:37:42.780430 run iperf3-srv_10.42.42.10(pid=17696): Terminating (SIGTERM) 08:37:42.819423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17699): Terminating (SIGTERM) 08:37:42.858480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17702): Terminating (SIGTERM) 08:37:42.897744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17705): Terminating (SIGTERM) 08:37:42.937590 --- ParallelTerminationStrategy: PID 17695 died... 08:37:42.955990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17695): Terminated: ok {rc=0} 08:37:43.000067 --- ParallelTerminationStrategy: PID 17696 died... 08:37:43.018414 run iperf3-srv_10.42.42.10(pid=17696): Terminated {rc=256} 08:37:43.061741 --- ParallelTerminationStrategy: PID 17699 died... 08:37:43.079866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17699): Terminated: ok {rc=0} 08:37:43.123084 --- ParallelTerminationStrategy: PID 17702 died... 08:37:43.141245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17702): Terminated: ok {rc=0} 08:37:43.184625 --- ParallelTerminationStrategy: PID 17705 died... 08:37:43.202989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17705): Terminated: ok {rc=0} 08:37:43.287995 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:37:44.435029 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:44.446525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:37:44.503299 tst iperf3m4.py: using LAC 27175 08:37:44.627851 tst iperf3m4.py: using RAC 145 08:37:44.747214 tst iperf3m4.py: using CellId 27175 08:37:44.874285 tst iperf3m4.py: using BVCI 27176 08:37:44.992146 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.003692 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.014918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.026395 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.037925 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.049401 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.061207 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.072438 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:37:45.084021 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:45.200807 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:45.320516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:45.440498 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:37:45.560003 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:37:45.765376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:46.108490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17707): Launched 08:37:46.445929 run iperf3-srv_10.42.42.10(pid=17708): Launched 08:37:46.573429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:37:46.797125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:47.134761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17709): Launched 08:37:47.413332 run iperf3-srv_10.42.42.10(pid=17710): Launched 08:37:47.526940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:37:47.729698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:48.032541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17711): Launched 08:37:48.294829 run iperf3-srv_10.42.42.10(pid=17712): Launched 08:37:48.408237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:37:48.610916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:37:48.914124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17713): Launched 08:37:49.176677 run iperf3-srv_10.42.42.10(pid=17714): Launched 08:37:49.290244 tst iperf3m4.py:8: start network... 08:37:49.493886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:37:49.963027 run create_hlr_db(pid=17715): Launched 08:37:50.078033 bus /gobi_6: Setting Powered False 08:37:51.138386 run create_hlr_db(pid=17715): Terminated: ok {rc=0} 08:37:51.577372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Launched 08:37:51.897409 run osmo-hlr_10.42.42.2(pid=17718): Launched 08:37:52.019877 run osmo-stp_10.42.42.5: Starting osmo-stp 08:37:52.573434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Launched 08:37:52.892743 run osmo-stp_10.42.42.5(pid=17721): Launched 08:37:53.015609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:37:53.569239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17723): Launched 08:37:53.691054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:37:53.961422 run patchelf(pid=17724): Launched 08:37:54.138182 run osmo-stp_10.42.42.5(pid=17721): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] 08:37:54.273307 run osmo-stp_10.42.42.5(pid=17721): stdout: | (launched: 2022-12-10_08:37:52.834505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:54.409989 run osmo-stp_10.42.42.5(pid=17721): stderr: | 20221210083753027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083753027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083753028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083753028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083753029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083753029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083753029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:54.546503 run osmo-stp_10.42.42.5(pid=17721): stdout: | (launched: 2022-12-10_08:37:52.834505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:37:54.677497 run osmo-stp_10.42.42.5(pid=17721): stderr: | 20221210083753027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083753027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083753028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083753028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083753029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083753029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083753029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:37:54.832920 run patchelf(pid=17724): Terminating (SIGINT) 08:37:55.012236 run patchelf(pid=17724): Terminated: ok {rc=0} 08:37:55.141363 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17721): Process ended prematurely: osmo-stp_10.42.42.5(pid=17721) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:37:55.151293 tst iperf3m4.py:8: Test FAILED (10.8 sec) 08:37:55.179435 run osmo-hlr_10.42.42.2(pid=17718): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17718)] 08:37:55.228725 run osmo-hlr_10.42.42.2(pid=17718): stdout: | (launched: 2022-12-10_08:37:51.839206) 08:37:55.279748 run osmo-hlr_10.42.42.2(pid=17718): stderr: | 20221210083752040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083752040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083752040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083752040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083752040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083752040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083752053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083752061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083752061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083752061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:37:55.331064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17707): Terminating (SIGTERM) 08:37:55.372005 run iperf3-srv_10.42.42.10(pid=17708): Terminating (SIGTERM) 08:37:55.413192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17709): Terminating (SIGTERM) 08:37:55.454651 run iperf3-srv_10.42.42.10(pid=17710): Terminating (SIGTERM) 08:37:55.496107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17711): Terminating (SIGTERM) 08:37:55.537705 run iperf3-srv_10.42.42.10(pid=17712): Terminating (SIGTERM) 08:37:55.580260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17713): Terminating (SIGTERM) 08:37:55.621953 run iperf3-srv_10.42.42.10(pid=17714): Terminating (SIGTERM) 08:37:55.664257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Terminating (SIGTERM) 08:37:55.705846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Terminating (SIGTERM) 08:37:55.746949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17723): Terminating (SIGTERM) 08:37:55.788188 --- ParallelTerminationStrategy: PID 17707 died... 08:37:55.807811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17707): Terminated: ok {rc=0} 08:37:55.853982 --- ParallelTerminationStrategy: PID 17708 died... 08:37:55.873251 run iperf3-srv_10.42.42.10(pid=17708): Terminated {rc=256} 08:37:55.918680 --- ParallelTerminationStrategy: PID 17709 died... 08:37:55.937982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17709): Terminated: ok {rc=0} 08:37:55.983841 --- ParallelTerminationStrategy: PID 17710 died... 08:37:56.003096 run iperf3-srv_10.42.42.10(pid=17710): Terminated {rc=256} 08:37:56.048402 --- ParallelTerminationStrategy: PID 17711 died... 08:37:56.067668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17711): Terminated: ok {rc=0} 08:37:56.113174 --- ParallelTerminationStrategy: PID 17712 died... 08:37:56.132214 run iperf3-srv_10.42.42.10(pid=17712): Terminated {rc=256} 08:37:56.178026 --- ParallelTerminationStrategy: PID 17713 died... 08:37:56.197344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17713): Terminated: ok {rc=0} 08:37:56.242760 --- ParallelTerminationStrategy: PID 17714 died... 08:37:56.262035 run iperf3-srv_10.42.42.10(pid=17714): Terminated {rc=256} 08:37:56.307370 --- ParallelTerminationStrategy: PID 17717 died... 08:37:56.326711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17717): Terminated: ok {rc=0} 08:37:56.372393 --- ParallelTerminationStrategy: PID 17720 died... 08:37:56.391729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17720): Terminated: ok {rc=0} 08:37:56.437405 --- ParallelTerminationStrategy: PID 17723 died... 08:37:56.456789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17723): Terminated: ok {rc=0} 08:37:56.543929 bus /gobi_4: Setting Powered False 08:37:57.642843 bus /gobi_4: Setting Powered False 08:37:58.756666 bus /gobi_1: Setting Powered False 08:37:59.855071 bus /gobi_1: Setting Powered False 08:38:00.979226 bus /gobi_0: Setting Powered False 08:38:02.083112 bus /gobi_0: Setting Powered False 08:38:03.201533 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:38:04.304562 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.315986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:38:04.373134 tst ping.py: using LAC 27176 08:38:04.491343 tst ping.py: using RAC 146 08:38:04.608227 tst ping.py: using CellId 27176 08:38:04.725800 tst ping.py: using BVCI 27177 08:38:04.834105 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.844894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.855555 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.866428 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.877005 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.888009 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.899008 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:04.910115 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:38:05.025059 tst ping.py:19: start network... 08:38:05.224741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:05.684692 run create_hlr_db(pid=17725): Launched 08:38:05.797689 bus /gobi_6: Setting Powered False 08:38:06.857559 run create_hlr_db(pid=17725): Terminated: ok {rc=0} 08:38:07.273394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17727): Launched 08:38:07.570867 run osmo-hlr_10.42.42.2(pid=17728): Launched 08:38:07.683914 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:08.199748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17730): Launched 08:38:08.495222 run osmo-stp_10.42.42.5(pid=17731): Launched 08:38:08.607795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:09.118549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17733): Launched 08:38:09.231779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:09.482494 run patchelf(pid=17734): Launched 08:38:09.648426 run osmo-stp_10.42.42.5(pid=17731): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17731)] 08:38:09.774348 run osmo-stp_10.42.42.5(pid=17731): stdout: | (launched: 2022-12-10_08:38:08.441475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:09.901694 run osmo-stp_10.42.42.5(pid=17731): stderr: | 20221210083808611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083808611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083808611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083808612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083808613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083808613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083808613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:10.029421 run osmo-stp_10.42.42.5(pid=17731): stdout: | (launched: 2022-12-10_08:38:08.441475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:10.151960 run osmo-stp_10.42.42.5(pid=17731): stderr: | 20221210083808611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083808611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083808611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083808612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083808613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083808613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083808613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:10.296481 run patchelf(pid=17734): Terminating (SIGINT) 08:38:10.462733 run patchelf(pid=17734): Terminated: ok {rc=0} 08:38:10.582647 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17731): Process ended prematurely: osmo-stp_10.42.42.5(pid=17731) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17731)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 08:38:10.591297 tst ping.py:22: Test FAILED (6.3 sec) 08:38:10.618083 run osmo-hlr_10.42.42.2(pid=17728): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17728)] 08:38:10.665751 run osmo-hlr_10.42.42.2(pid=17728): stdout: | (launched: 2022-12-10_08:38:07.516485) 08:38:10.714814 run osmo-hlr_10.42.42.2(pid=17728): stderr: | 20221210083807695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083807695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083807695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083807695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083807695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083807695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083807708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083807716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083807717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083807717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:10.764221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17727): Terminating (SIGTERM) 08:38:10.803904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17730): Terminating (SIGTERM) 08:38:10.843461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17733): Terminating (SIGTERM) 08:38:10.883610 --- ParallelTerminationStrategy: PID 17727 died... 08:38:10.902548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17727): Terminated: ok {rc=0} 08:38:10.946771 --- ParallelTerminationStrategy: PID 17730 died... 08:38:10.965146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17730): Terminated: ok {rc=0} 08:38:11.008815 --- ParallelTerminationStrategy: PID 17733 died... 08:38:11.027758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17733): Terminated: ok {rc=0} 08:38:11.114521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:38:12.200673 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.212106 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:38:12.271559 tst ping_idle_ping.py: using LAC 27177 08:38:12.390721 tst ping_idle_ping.py: using RAC 147 08:38:12.510261 tst ping_idle_ping.py: using CellId 27177 08:38:12.630323 tst ping_idle_ping.py: using BVCI 27178 08:38:12.741734 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.752486 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.763133 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.774617 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.785927 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.797218 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.808531 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:38:12.819820 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:38:12.940853 tst ping_idle_ping.py:24: start network... 08:38:13.154863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:13.650367 run create_hlr_db(pid=17735): Launched 08:38:13.779370 bus /gobi_6: Setting Powered False 08:38:14.841501 run create_hlr_db(pid=17735): Terminated: ok {rc=0} 08:38:15.265549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17737): Launched 08:38:15.562309 run osmo-hlr_10.42.42.2(pid=17738): Launched 08:38:15.676216 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:16.267186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17740): Launched 08:38:16.632616 run osmo-stp_10.42.42.5(pid=17763): Launched 08:38:16.839082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:17.518817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17792): Launched 08:38:17.647481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:17.954903 run patchelf(pid=17805): Launched 08:38:18.153315 run osmo-stp_10.42.42.5(pid=17763): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17763)] 08:38:18.296573 run osmo-stp_10.42.42.5(pid=17763): stdout: | (launched: 2022-12-10_08:38:16.566658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:18.441353 run osmo-stp_10.42.42.5(pid=17763): stderr: | 20221210083816866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083816866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083816867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083816867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083816870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083816870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083816870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:18.602902 run osmo-stp_10.42.42.5(pid=17763): stdout: | (launched: 2022-12-10_08:38:16.566658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:18.756909 run osmo-stp_10.42.42.5(pid=17763): stderr: | 20221210083816866 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083816866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083816867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083816867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083816870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083816870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083816870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:18.939413 run patchelf(pid=17805): Terminating (SIGINT) 08:38:19.157260 run patchelf(pid=17805): Terminated: ok {rc=0} 08:38:19.314428 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17763): Process ended prematurely: osmo-stp_10.42.42.5(pid=17763) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17763)] [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:38:19.329050 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 08:38:19.365927 run osmo-hlr_10.42.42.2(pid=17738): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17738)] 08:38:19.434441 run osmo-hlr_10.42.42.2(pid=17738): stdout: | (launched: 2022-12-10_08:38:15.508348) 08:38:19.498277 run osmo-hlr_10.42.42.2(pid=17738): stderr: | 20221210083815684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083815684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083815684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083815684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083815685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083815685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083815701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083815710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083815710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083815710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:19.562674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17737): Terminating (SIGTERM) 08:38:19.617798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17740): Terminating (SIGTERM) 08:38:19.671112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17792): Terminating (SIGTERM) 08:38:19.723523 --- ParallelTerminationStrategy: PID 17737 died... 08:38:19.747123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17737): Terminated: ok {rc=0} 08:38:19.805154 --- ParallelTerminationStrategy: PID 17740 died... 08:38:19.827063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17740): Terminated: ok {rc=0} 08:38:19.877128 --- ParallelTerminationStrategy: PID 17792 died... 08:38:19.901558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17792): Terminated: ok {rc=0} 08:38:20.009690 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:38:21.309997 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:21.317829 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:38:21.342335 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:38:21.379530 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:38:21.434897 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:38:21.457190 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:38:21.494624 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:38:22.057337 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:38:22.065434 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.077940 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:38:22.136134 tst switch_tch_pdch.py: using LAC 27178 08:38:22.261036 tst switch_tch_pdch.py: using RAC 148 08:38:22.384523 tst switch_tch_pdch.py: using CellId 27178 08:38:22.511034 tst switch_tch_pdch.py: using BVCI 27179 08:38:22.630478 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.643011 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.655443 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.667753 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.680198 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.692524 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.704848 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:38:22.717297 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:38:22.840044 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:38:22.962709 tst switch_tch_pdch.py:51: start network... 08:38:23.179835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:23.687641 run create_hlr_db(pid=18020): Launched 08:38:23.851059 bus /gobi_6: Setting Powered False 08:38:24.914558 run create_hlr_db(pid=18020): Terminated: ok {rc=0} 08:38:25.375513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Launched 08:38:25.725658 run osmo-hlr_10.42.42.2(pid=18023): Launched 08:38:25.967989 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:26.623328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Launched 08:38:26.971463 run osmo-stp_10.42.42.5(pid=18026): Launched 08:38:27.214513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:27.873698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18028): Launched 08:38:28.006252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:28.286257 run patchelf(pid=18029): Launched 08:38:28.479285 run osmo-stp_10.42.42.5(pid=18026): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] 08:38:28.617805 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-10_08:38:26.902528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:28.755951 run osmo-stp_10.42.42.5(pid=18026): stderr: | 20221210083827218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083827218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083827218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083827219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083827219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083827219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083827219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:28.894873 run osmo-stp_10.42.42.5(pid=18026): stdout: | (launched: 2022-12-10_08:38:26.902528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:29.029198 run osmo-stp_10.42.42.5(pid=18026): stderr: | 20221210083827218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083827218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083827218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083827219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083827219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083827219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083827219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:29.186923 run patchelf(pid=18029): Terminating (SIGINT) 08:38:29.368687 run patchelf(pid=18029): Terminated: ok {rc=0} 08:38:29.500256 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2372↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] [trial-2372↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:38:29.510685 tst switch_tch_pdch.py:54: Test FAILED (7.4 sec) 08:38:29.540170 run osmo-hlr_10.42.42.2(pid=18023): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18023)] 08:38:29.592853 run osmo-hlr_10.42.42.2(pid=18023): stdout: | (launched: 2022-12-10_08:38:25.652201) 08:38:29.646180 run osmo-hlr_10.42.42.2(pid=18023): stderr: | 20221210083825969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083825970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083825970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083825970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083825970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083825970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083825987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083825996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083825996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083825997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:29.701128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminating (SIGTERM) 08:38:29.744826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminating (SIGTERM) 08:38:29.790954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18028): Terminating (SIGTERM) 08:38:29.836206 --- ParallelTerminationStrategy: PID 18022 died... 08:38:29.857137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18022): Terminated: ok {rc=0} 08:38:29.906655 --- ParallelTerminationStrategy: PID 18025 died... 08:38:29.926989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18025): Terminated: ok {rc=0} 08:38:29.976089 --- ParallelTerminationStrategy: PID 18028 died... 08:38:29.997381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18028): Terminated: ok {rc=0} 08:38:30.088290 bus /gobi_0: Setting Powered False 08:38:31.224988 bus /gobi_0: Setting Powered False 08:38:32.400550 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:38:33.645459 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:33.651780 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:38:33.675936 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:38:33.714578 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:38:33.768421 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:38:33.790834 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:38:33.828291 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:38:34.382769 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:38:34.390459 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:34.402221 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:38:34.461364 tst switch_tch_pdch.py: using LAC 27179 08:38:34.583985 tst switch_tch_pdch.py: using RAC 149 08:38:34.705425 tst switch_tch_pdch.py: using CellId 27179 08:38:34.825546 tst switch_tch_pdch.py: using BVCI 27180 08:38:34.938729 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:34.950860 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:34.962530 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:34.975283 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:34.990837 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:35.003552 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:35.016010 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:38:35.028419 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:38:35.149623 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:38:35.270231 tst switch_tch_pdch.py:51: start network... 08:38:35.477891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:35.944169 run create_hlr_db(pid=18033): Launched 08:38:36.103225 bus /gobi_6: Setting Powered False 08:38:37.163322 run create_hlr_db(pid=18033): Terminated: ok {rc=0} 08:38:37.581737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18035): Launched 08:38:37.904792 run osmo-hlr_10.42.42.2(pid=18036): Launched 08:38:38.147525 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:38.858417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18038): Launched 08:38:39.190673 run osmo-stp_10.42.42.5(pid=18039): Launched 08:38:39.419426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:38:40.105695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18041): Launched 08:38:40.235266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:38:40.500301 run patchelf(pid=18042): Launched 08:38:40.694149 run osmo-stp_10.42.42.5(pid=18039): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18039)] 08:38:40.827190 run osmo-stp_10.42.42.5(pid=18039): stdout: | (launched: 2022-12-10_08:38:39.118855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:40.962156 run osmo-stp_10.42.42.5(pid=18039): stderr: | 20221210083839458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083839458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083839458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083839459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083839461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083839461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083839461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:41.096607 run osmo-stp_10.42.42.5(pid=18039): stdout: | (launched: 2022-12-10_08:38:39.118855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:41.226194 run osmo-stp_10.42.42.5(pid=18039): stderr: | 20221210083839458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083839458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083839458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083839459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083839461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083839461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083839461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:41.378956 run patchelf(pid=18042): Terminating (SIGINT) 08:38:41.554948 run patchelf(pid=18042): Terminated: ok {rc=0} 08:38:41.681744 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18039): Process ended prematurely: osmo-stp_10.42.42.5(pid=18039) [trial-2372↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18039)] [trial-2372↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:38:41.691155 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 08:38:41.718531 run osmo-hlr_10.42.42.2(pid=18036): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18036)] 08:38:41.768311 run osmo-hlr_10.42.42.2(pid=18036): stdout: | (launched: 2022-12-10_08:38:37.842923) 08:38:41.820143 run osmo-hlr_10.42.42.2(pid=18036): stderr: | 20221210083838192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083838192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083838192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083838192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083838192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083838192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083838211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083838229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083838229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083838229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:38:41.871817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18035): Terminating (SIGTERM) 08:38:41.913800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18038): Terminating (SIGTERM) 08:38:41.955250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18041): Terminating (SIGTERM) 08:38:41.997291 --- ParallelTerminationStrategy: PID 18035 died... 08:38:42.017144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18035): Terminated: ok {rc=0} 08:38:42.063088 --- ParallelTerminationStrategy: PID 18038 died... 08:38:42.082486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18038): Terminated: ok {rc=0} 08:38:42.128133 --- ParallelTerminationStrategy: PID 18041 died... 08:38:42.147622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18041): Terminated: ok {rc=0} 08:38:42.233645 bus /gobi_0: Setting Powered False 08:38:43.331575 bus /gobi_0: Setting Powered False 08:38:44.445377 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:trx-b200 --------------------------------------------------------------------- 08:38:45.683251 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:45.687237 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:38:45.720884 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:38:45.727832 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:38:45.780212 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:38:45.815181 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:38:45.822177 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:38:46.360581 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:38:46.367290 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 08:38:46.379611 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 08:38:46.433434 tst mo_mt_sms.py: using LAC 27180 08:38:46.553015 tst mo_mt_sms.py: using RAC 150 08:38:46.677161 tst mo_mt_sms.py: using CellId 27180 08:38:46.799048 tst mo_mt_sms.py: using BVCI 27181 08:38:46.916010 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:38:47.032110 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 08:38:47.150080 tst mo_mt_sms.py:9: start nitb and bts... 08:38:47.366904 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:38:48.015208 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18048): Launched 08:38:48.334384 run osmo-nitb_10.42.42.2(pid=18049): Launched 08:38:48.508680 run osmo-nitb_10.42.42.2(pid=18049): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18049)] 08:38:48.650588 run osmo-nitb_10.42.42.2(pid=18049): stdout: | (launched: 2022-12-10_08:38:48.273219) 08:38:48.794168 run osmo-nitb_10.42.42.2(pid=18049): stderr: | (launched: 2022-12-10_08:38:48.320437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:38:48.937496 run osmo-nitb_10.42.42.2(pid=18049): stdout: | (launched: 2022-12-10_08:38:48.273219) 08:38:49.075666 run osmo-nitb_10.42.42.2(pid=18049): stderr: | (launched: 2022-12-10_08:38:48.320437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18049) [trial-2372↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18049)] 08:38:49.453687 tst osmo-nitb_10.42.42.2(pid=18049): stdout: | (launched: 2022-12-10_08:38:48.273219) 08:38:49.580462 tst osmo-nitb_10.42.42.2(pid=18049): stderr: | (launched: 2022-12-10_08:38:48.320437) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:38:49.729987 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18049) [trial-2372↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18049)] [trial-2372↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 08:38:49.738766 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 08:38:49.745647 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18048): Terminating (SIGTERM) 08:38:49.955956 --- ParallelTerminationStrategy: PID 18048 died... 08:38:49.977670 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18048): Terminated: ok {rc=0} 08:38:50.064696 bus /sierra_3: Setting Powered False 08:38:51.163730 bus /sierra_3: Setting Powered False 08:38:52.280614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:trx-b200 --------------------------------------------------------------------- 08:38:53.480133 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:38:53.484914 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 08:38:53.519495 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:38:53.546243 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 08:38:53.598908 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 08:38:53.632753 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:38:53.659934 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 08:38:54.202416 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 08:38:54.207551 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.218223 tst sms:trx-b200: Using 1 x bts (candidates: 1) 08:38:54.265195 tst mo_mt_sms.py: using LAC 27181 08:38:54.381571 tst mo_mt_sms.py: using RAC 151 08:38:54.497925 tst mo_mt_sms.py: using CellId 27181 08:38:54.617094 tst mo_mt_sms.py: using BVCI 27182 08:38:54.732078 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.743173 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.754155 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.765037 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.775910 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 08:38:54.786839 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:38:54.903346 tst sms:trx-b200: Using 1 x modem (candidates: 2) 08:38:55.021315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:38:55.509201 run create_hlr_db(pid=18053): Launched 08:38:55.637555 bus /sierra_2: Setting Powered False 08:38:56.699962 run create_hlr_db(pid=18053): Terminated: ok {rc=0} 08:38:57.124034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Launched 08:38:57.420810 run osmo-hlr_10.42.42.2(pid=18056): Launched 08:38:57.534661 run osmo-stp_10.42.42.5: Starting osmo-stp 08:38:58.055365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Launched 08:38:58.350577 run osmo-stp_10.42.42.5(pid=18059): Launched 08:38:58.463399 run osmo-msc_10.42.42.6: Starting osmo-msc 08:38:58.999210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18061): Launched 08:38:59.293622 run osmo-msc_10.42.42.6(pid=18062): Launched 08:38:59.459881 run osmo-stp_10.42.42.5(pid=18059): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] 08:38:59.586416 run osmo-stp_10.42.42.5(pid=18059): stdout: | (launched: 2022-12-10_08:38:58.296413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:59.713321 run osmo-stp_10.42.42.5(pid=18059): stderr: | 20221210083858466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083858466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083858467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083858467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083858467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083858468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083858468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:38:59.837429 run osmo-stp_10.42.42.5(pid=18059): stdout: | (launched: 2022-12-10_08:38:58.296413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:38:59.955774 run osmo-stp_10.42.42.5(pid=18059): stderr: | 20221210083858466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083858466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083858467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083858467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083858467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083858468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083858468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:00.097273 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18059): Process ended prematurely: osmo-stp_10.42.42.5(pid=18059) [trial-2372↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] [trial-2372↪sms:trx-b200↪mo_mt_sms.py:16] 08:39:00.105604 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 08:39:00.131278 run osmo-hlr_10.42.42.2(pid=18056): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18056)] 08:39:00.179013 run osmo-hlr_10.42.42.2(pid=18056): stdout: | (launched: 2022-12-10_08:38:57.366662) 08:39:00.227791 run osmo-hlr_10.42.42.2(pid=18056): stderr: | 20221210083857542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083857543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083857543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083857543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083857543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083857543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083857555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083857564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083857564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083857564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:00.295763 run osmo-msc_10.42.42.6(pid=18062): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18062)] 08:39:00.343541 run osmo-msc_10.42.42.6(pid=18062): stdout: | (launched: 2022-12-10_08:38:59.240061) 08:39:00.392580 run osmo-msc_10.42.42.6(pid=18062): stderr: | 20221210083859512 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083859512 DLGLOBAL DEBUG validating counter group 0x7f7bb9ca0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083859512 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083859512 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083859513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083859513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083859515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083859515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083859515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083859515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:00.441619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Terminating (SIGTERM) 08:39:00.480850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Terminating (SIGTERM) 08:39:00.520257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18061): Terminating (SIGTERM) 08:39:00.560143 --- ParallelTerminationStrategy: PID 18055 died... 08:39:00.579269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18055): Terminated: ok {rc=0} 08:39:00.622697 --- ParallelTerminationStrategy: PID 18058 died... 08:39:00.641123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18058): Terminated: ok {rc=0} 08:39:00.684932 --- ParallelTerminationStrategy: PID 18061 died... 08:39:00.703574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18061): Terminated: ok {rc=0} 08:39:00.790524 bus /sierra_3: Setting Powered False 08:39:01.887501 bus /sierra_3: Setting Powered False 08:39:03.007792 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-b200 --------------------------------------------------------------------- 08:39:04.234332 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:04.238921 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:39:04.273186 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 08:39:04.280245 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:39:04.315741 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:39:04.350297 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 08:39:04.357414 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:39:04.877450 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:39:04.882703 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 08:39:04.893969 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 08:39:04.944342 tst assert_extension.py: using LAC 27182 08:39:05.070929 tst assert_extension.py: using RAC 152 08:39:05.196573 tst assert_extension.py: using CellId 27182 08:39:05.315608 tst assert_extension.py: using BVCI 27183 08:39:05.424857 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 08:39:05.573858 tst assert_extension.py:10: start nitb and bts... 08:39:05.790923 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:39:06.441046 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18071): Launched 08:39:06.758360 run osmo-nitb_10.42.42.2(pid=18072): Launched 08:39:06.932203 run osmo-nitb_10.42.42.2(pid=18072): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18072)] 08:39:07.074181 run osmo-nitb_10.42.42.2(pid=18072): stdout: | (launched: 2022-12-10_08:39:06.697499) 08:39:07.216852 run osmo-nitb_10.42.42.2(pid=18072): stderr: | (launched: 2022-12-10_08:39:06.744327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:39:07.359262 run osmo-nitb_10.42.42.2(pid=18072): stdout: | (launched: 2022-12-10_08:39:06.697499) 08:39:07.496469 run osmo-nitb_10.42.42.2(pid=18072): stderr: | (launched: 2022-12-10_08:39:06.744327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18072) [trial-2372↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18072)] 08:39:07.876529 tst osmo-nitb_10.42.42.2(pid=18072): stdout: | (launched: 2022-12-10_08:39:06.697499) 08:39:08.004517 tst osmo-nitb_10.42.42.2(pid=18072): stderr: | (launched: 2022-12-10_08:39:06.744327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:39:08.154927 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18072) [trial-2372↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18072)] [trial-2372↪nitb_ussd:trx-b200↪assert_extension.py:12] 08:39:08.163769 tst assert_extension.py:12: Test FAILED (3.3 sec) 08:39:08.170649 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18071): Terminating (SIGTERM) 08:39:08.382314 --- ParallelTerminationStrategy: PID 18071 died... 08:39:08.403728 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18071): Terminated: ok {rc=0} 08:39:08.491990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:trx-b200 --------------------------------------------------------------------- 08:39:09.669799 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:09.673750 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 08:39:09.707650 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:39:09.734314 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 08:39:09.769918 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 08:39:09.804182 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:39:09.831691 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 08:39:10.356143 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:trx-b200 assert_extension.py ---------------------------------------------- 08:39:10.361366 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.371866 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 08:39:10.418862 tst assert_extension.py: using LAC 27183 08:39:10.537449 tst assert_extension.py: using RAC 153 08:39:10.662110 tst assert_extension.py: using CellId 27183 08:39:10.786290 tst assert_extension.py: using BVCI 27184 08:39:10.902408 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.913468 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.924193 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.935246 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.946212 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 08:39:10.957036 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 08:39:11.072866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:11.561951 run create_hlr_db(pid=18076): Launched 08:39:11.690339 bus /sierra_2: Setting Powered False 08:39:12.752266 run create_hlr_db(pid=18076): Terminated: ok {rc=0} 08:39:13.177223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18078): Launched 08:39:13.473461 run osmo-hlr_10.42.42.2(pid=18079): Launched 08:39:13.588401 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:14.113912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18081): Launched 08:39:14.410344 run osmo-stp_10.42.42.5(pid=18082): Launched 08:39:14.524231 run osmo-msc_10.42.42.6: Starting osmo-msc 08:39:15.060058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18084): Launched 08:39:15.356596 run osmo-msc_10.42.42.6(pid=18085): Launched 08:39:15.522386 run osmo-stp_10.42.42.5(pid=18082): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18082)] 08:39:15.649608 run osmo-stp_10.42.42.5(pid=18082): stdout: | (launched: 2022-12-10_08:39:14.356410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:15.776196 run osmo-stp_10.42.42.5(pid=18082): stderr: | 20221210083914524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083914524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083914524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083914525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083914525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083914525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083914525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:15.914583 run osmo-stp_10.42.42.5(pid=18082): stdout: | (launched: 2022-12-10_08:39:14.356410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:16.035868 run osmo-stp_10.42.42.5(pid=18082): stderr: | 20221210083914524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083914524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083914524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083914525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083914525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083914525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083914525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:16.182668 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18082): Process ended prematurely: osmo-stp_10.42.42.5(pid=18082) [trial-2372↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18082)] [trial-2372↪ussd:trx-b200↪assert_extension.py:17] 08:39:16.191811 tst assert_extension.py:17: Test FAILED (5.8 sec) 08:39:16.221095 run osmo-hlr_10.42.42.2(pid=18079): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18079)] 08:39:16.271592 run osmo-hlr_10.42.42.2(pid=18079): stdout: | (launched: 2022-12-10_08:39:13.419442) 08:39:16.323773 run osmo-hlr_10.42.42.2(pid=18079): stderr: | 20221210083913596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083913596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083913596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083913596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083913596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083913596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083913609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083913618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083913618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083913618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:16.395376 run osmo-msc_10.42.42.6(pid=18085): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18085)] 08:39:16.445653 run osmo-msc_10.42.42.6(pid=18085): stdout: | (launched: 2022-12-10_08:39:15.302106) 08:39:16.497390 run osmo-msc_10.42.42.6(pid=18085): stderr: | 20221210083915572 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083915572 DLGLOBAL DEBUG validating counter group 0x7f51e2382c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083915572 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083915572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083915572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083915573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083915574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083915575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083915575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083915575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:16.550176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18078): Terminating (SIGTERM) 08:39:16.593164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18081): Terminating (SIGTERM) 08:39:16.635786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18084): Terminating (SIGTERM) 08:39:16.677993 --- ParallelTerminationStrategy: PID 18078 died... 08:39:16.700057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18078): Terminated: ok {rc=0} 08:39:16.758460 --- ParallelTerminationStrategy: PID 18081 died... 08:39:16.782312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18081): Terminated: ok {rc=0} 08:39:16.842599 --- ParallelTerminationStrategy: PID 18084 died... 08:39:16.863764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18084): Terminated: ok {rc=0} 08:39:16.951056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:39:18.159162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:18.165528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:39:18.199221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:39:18.225453 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:39:18.277479 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:39:18.310235 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:39:18.336737 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:39:18.886537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:39:18.939787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:18.951358 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:39:19.026651 tst mo_mt_call.py: using LAC 27184 08:39:19.146051 tst mo_mt_call.py: using RAC 154 08:39:19.263304 tst mo_mt_call.py: using CellId 27184 08:39:19.380804 tst mo_mt_call.py: using BVCI 27185 08:39:19.490619 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:19.501762 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:19.512625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:19.523819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:19.535015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:19.546179 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:39:19.660330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:39:19.779160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:20.282092 run create_hlr_db(pid=18090): Launched 08:39:20.412631 bus /sierra_2: Setting Powered False 08:39:21.476199 run create_hlr_db(pid=18090): Terminated: ok {rc=0} 08:39:21.908704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18092): Launched 08:39:22.212362 run osmo-hlr_10.42.42.2(pid=18093): Launched 08:39:22.327203 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:22.866234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18095): Launched 08:39:23.172118 run osmo-stp_10.42.42.5(pid=18096): Launched 08:39:23.287438 run osmo-msc_10.42.42.6: Starting osmo-msc 08:39:23.837181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18098): Launched 08:39:24.142944 run osmo-msc_10.42.42.6(pid=18099): Launched 08:39:24.312170 run osmo-stp_10.42.42.5(pid=18096): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18096)] 08:39:24.441227 run osmo-stp_10.42.42.5(pid=18096): stdout: | (launched: 2022-12-10_08:39:23.113440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:24.570197 run osmo-stp_10.42.42.5(pid=18096): stderr: | 20221210083923288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083923289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083923289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083923289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083923290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083923290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083923290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:24.696254 run osmo-stp_10.42.42.5(pid=18096): stdout: | (launched: 2022-12-10_08:39:23.113440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:24.816507 run osmo-stp_10.42.42.5(pid=18096): stderr: | 20221210083923288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083923289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083923289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083923289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083923290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083923290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083923290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:24.960625 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18096): Process ended prematurely: osmo-stp_10.42.42.5(pid=18096) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18096)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:39:24.969608 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:39:24.996522 run osmo-hlr_10.42.42.2(pid=18093): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18093)] 08:39:25.044224 run osmo-hlr_10.42.42.2(pid=18093): stdout: | (launched: 2022-12-10_08:39:22.154636) 08:39:25.093313 run osmo-hlr_10.42.42.2(pid=18093): stderr: | 20221210083922333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083922334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083922334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083922334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083922334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083922334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083922346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083922356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083922357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083922357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:25.161358 run osmo-msc_10.42.42.6(pid=18099): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18099)] 08:39:25.209276 run osmo-msc_10.42.42.6(pid=18099): stdout: | (launched: 2022-12-10_08:39:24.084545) 08:39:25.258372 run osmo-msc_10.42.42.6(pid=18099): stderr: | 20221210083924360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083924361 DLGLOBAL DEBUG validating counter group 0x7fdcf561ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083924361 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083924361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083924361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083924361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083924363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083924363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083924363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083924363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:25.307685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18092): Terminating (SIGTERM) 08:39:25.347091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18095): Terminating (SIGTERM) 08:39:25.386472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18098): Terminating (SIGTERM) 08:39:25.425777 --- ParallelTerminationStrategy: PID 18092 died... 08:39:25.443843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18092): Terminated: ok {rc=0} 08:39:25.487484 --- ParallelTerminationStrategy: PID 18095 died... 08:39:25.505736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18095): Terminated: ok {rc=0} 08:39:25.549439 --- ParallelTerminationStrategy: PID 18098 died... 08:39:25.567706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18098): Terminated: ok {rc=0} 08:39:25.653348 bus /sierra_3: Setting Powered False 08:39:26.753269 bus /sierra_3: Setting Powered False 08:39:27.869833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:39:29.018321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.030259 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:39:29.101755 tst mo_mt_call_osmux.py: using LAC 27185 08:39:29.229681 tst mo_mt_call_osmux.py: using RAC 155 08:39:29.357453 tst mo_mt_call_osmux.py: using CellId 27185 08:39:29.484783 tst mo_mt_call_osmux.py: using BVCI 27186 08:39:29.601530 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.612842 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.624080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.635366 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.646781 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:39:29.658042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:39:29.776367 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:39:29.892520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:30.365267 run create_hlr_db(pid=18101): Launched 08:39:30.481157 bus /sierra_2: Setting Powered False 08:39:31.542612 run create_hlr_db(pid=18101): Terminated: ok {rc=0} 08:39:32.004791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Launched 08:39:32.342138 run osmo-hlr_10.42.42.2(pid=18104): Launched 08:39:32.465354 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:33.026866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Launched 08:39:33.352272 run osmo-stp_10.42.42.5(pid=18107): Launched 08:39:33.477462 run osmo-msc_10.42.42.6: Starting osmo-msc 08:39:34.063240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18109): Launched 08:39:34.388403 run osmo-msc_10.42.42.6(pid=18110): Launched 08:39:34.567157 run osmo-stp_10.42.42.5(pid=18107): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] 08:39:34.702819 run osmo-stp_10.42.42.5(pid=18107): stdout: | (launched: 2022-12-10_08:39:33.289204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:34.838720 run osmo-stp_10.42.42.5(pid=18107): stderr: | 20221210083933485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083933485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083933485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083933486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083933486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083933486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083933486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:34.973608 run osmo-stp_10.42.42.5(pid=18107): stdout: | (launched: 2022-12-10_08:39:33.289204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:35.101495 run osmo-stp_10.42.42.5(pid=18107): stderr: | 20221210083933485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083933485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083933485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083933486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083933486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083933486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083933486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:35.253913 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18107): Process ended prematurely: osmo-stp_10.42.42.5(pid=18107) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:39:35.263288 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:39:35.290495 run osmo-hlr_10.42.42.2(pid=18104): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18104)] 08:39:35.340320 run osmo-hlr_10.42.42.2(pid=18104): stdout: | (launched: 2022-12-10_08:39:32.279344) 08:39:35.391770 run osmo-hlr_10.42.42.2(pid=18104): stderr: | 20221210083932483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083932483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083932483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083932483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083932483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083932483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083932496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083932506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083932507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083932507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:35.463318 run osmo-msc_10.42.42.6(pid=18110): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18110)] 08:39:35.512877 run osmo-msc_10.42.42.6(pid=18110): stdout: | (launched: 2022-12-10_08:39:34.325088) 08:39:35.563916 run osmo-msc_10.42.42.6(pid=18110): stderr: | 20221210083934652 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083934652 DLGLOBAL DEBUG validating counter group 0x7f37bcfdcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083934652 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083934652 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083934652 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083934652 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083934654 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083934654 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083934655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083934655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:35.615439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Terminating (SIGTERM) 08:39:35.656676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Terminating (SIGTERM) 08:39:35.698005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18109): Terminating (SIGTERM) 08:39:35.739711 --- ParallelTerminationStrategy: PID 18103 died... 08:39:35.759378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18103): Terminated: ok {rc=0} 08:39:35.804714 --- ParallelTerminationStrategy: PID 18106 died... 08:39:35.824001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18106): Terminated: ok {rc=0} 08:39:35.869415 --- ParallelTerminationStrategy: PID 18109 died... 08:39:35.888665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18109): Terminated: ok {rc=0} 08:39:35.975182 bus /sierra_3: Setting Powered False 08:39:37.074353 bus /sierra_3: Setting Powered False 08:39:38.190965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:39:39.437603 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:39:39.444057 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:39:39.479080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:39:39.505474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:39:39.558411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:39:39.593269 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:39:39.620251 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:39:40.167639 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:39:40.221348 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.232830 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:39:40.303404 tst mo_mt_call.py: using LAC 27186 08:39:40.429206 tst mo_mt_call.py: using RAC 156 08:39:40.554268 tst mo_mt_call.py: using CellId 27186 08:39:40.679898 tst mo_mt_call.py: using BVCI 27187 08:39:40.795975 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.807333 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.818703 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.829995 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.841302 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:40.852533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:39:40.967469 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:39:41.082066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:41.550125 run create_hlr_db(pid=18115): Launched 08:39:41.666249 bus /sierra_2: Setting Powered False 08:39:42.726783 run create_hlr_db(pid=18115): Terminated: ok {rc=0} 08:39:43.147576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18117): Launched 08:39:43.449259 run osmo-hlr_10.42.42.2(pid=18118): Launched 08:39:43.565310 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:44.105343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18120): Launched 08:39:44.406047 run osmo-stp_10.42.42.5(pid=18121): Launched 08:39:44.522339 run osmo-msc_10.42.42.6: Starting osmo-msc 08:39:45.068185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18123): Launched 08:39:45.369453 run osmo-msc_10.42.42.6(pid=18124): Launched 08:39:45.539885 run osmo-stp_10.42.42.5(pid=18121): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18121)] 08:39:45.670012 run osmo-stp_10.42.42.5(pid=18121): stdout: | (launched: 2022-12-10_08:39:44.351473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:45.798970 run osmo-stp_10.42.42.5(pid=18121): stderr: | 20221210083944518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083944518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083944518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083944519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083944519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083944519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083944519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:45.934936 run osmo-stp_10.42.42.5(pid=18121): stdout: | (launched: 2022-12-10_08:39:44.351473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:46.059915 run osmo-stp_10.42.42.5(pid=18121): stderr: | 20221210083944518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083944518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083944518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083944519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083944519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083944519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083944519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:46.209674 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18121): Process ended prematurely: osmo-stp_10.42.42.5(pid=18121) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18121)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:39:46.219422 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:39:46.248720 run osmo-hlr_10.42.42.2(pid=18118): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18118)] 08:39:46.298994 run osmo-hlr_10.42.42.2(pid=18118): stdout: | (launched: 2022-12-10_08:39:43.394569) 08:39:46.350790 run osmo-hlr_10.42.42.2(pid=18118): stderr: | 20221210083943571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083943571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083943571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083943571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083943571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083943571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083943583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083943591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083943591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083943591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:46.422214 run osmo-msc_10.42.42.6(pid=18124): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18124)] 08:39:46.471839 run osmo-msc_10.42.42.6(pid=18124): stdout: | (launched: 2022-12-10_08:39:45.314548) 08:39:46.523096 run osmo-msc_10.42.42.6(pid=18124): stderr: | 20221210083945587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083945587 DLGLOBAL DEBUG validating counter group 0x7fd30fc96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083945587 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083945587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083945587 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083945587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083945589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083945590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083945590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083945590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:46.575026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18117): Terminating (SIGTERM) 08:39:46.616748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18120): Terminating (SIGTERM) 08:39:46.658502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18123): Terminating (SIGTERM) 08:39:46.700268 --- ParallelTerminationStrategy: PID 18117 died... 08:39:46.719655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18117): Terminated: ok {rc=0} 08:39:46.766227 --- ParallelTerminationStrategy: PID 18120 died... 08:39:46.785593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18120): Terminated: ok {rc=0} 08:39:46.832749 --- ParallelTerminationStrategy: PID 18123 died... 08:39:46.852263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18123): Terminated: ok {rc=0} 08:39:46.941548 bus /sierra_3: Setting Powered False 08:39:48.040420 bus /sierra_3: Setting Powered False 08:39:49.155784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:39:50.305577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.318080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:39:50.392321 tst mo_mt_call_osmux.py: using LAC 27187 08:39:50.512317 tst mo_mt_call_osmux.py: using RAC 157 08:39:50.629428 tst mo_mt_call_osmux.py: using CellId 27187 08:39:50.754691 tst mo_mt_call_osmux.py: using BVCI 27188 08:39:50.871807 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.883485 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.894887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.906672 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.918371 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:39:50.929969 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:39:51.045761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:39:51.165765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:39:51.664846 run create_hlr_db(pid=18126): Launched 08:39:51.794919 bus /sierra_2: Setting Powered False 08:39:52.858599 run create_hlr_db(pid=18126): Terminated: ok {rc=0} 08:39:53.289975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Launched 08:39:53.593570 run osmo-hlr_10.42.42.2(pid=18129): Launched 08:39:53.709667 run osmo-stp_10.42.42.5: Starting osmo-stp 08:39:54.243124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Launched 08:39:54.544802 run osmo-stp_10.42.42.5(pid=18132): Launched 08:39:54.660172 run osmo-msc_10.42.42.6: Starting osmo-msc 08:39:55.211720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18134): Launched 08:39:55.513598 run osmo-msc_10.42.42.6(pid=18135): Launched 08:39:55.683674 run osmo-stp_10.42.42.5(pid=18132): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] 08:39:55.812679 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-10_08:39:54.490012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:55.941340 run osmo-stp_10.42.42.5(pid=18132): stderr: | 20221210083954661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083954661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083954661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083954662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083954663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083954663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083954663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.068009 run osmo-stp_10.42.42.5(pid=18132): stdout: | (launched: 2022-12-10_08:39:54.490012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:39:56.188642 run osmo-stp_10.42.42.5(pid=18132): stderr: | 20221210083954661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210083954661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210083954661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210083954662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210083954663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210083954663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210083954663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:39:56.332730 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:39:56.341618 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:39:56.368047 run osmo-hlr_10.42.42.2(pid=18129): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18129)] 08:39:56.416257 run osmo-hlr_10.42.42.2(pid=18129): stdout: | (launched: 2022-12-10_08:39:53.538600) 08:39:56.465522 run osmo-hlr_10.42.42.2(pid=18129): stderr: | 20221210083953718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210083953718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210083953718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210083953718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210083953718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210083953718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210083953730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210083953739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210083953739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210083953739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:39:56.534195 run osmo-msc_10.42.42.6(pid=18135): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18135)] 08:39:56.581972 run osmo-msc_10.42.42.6(pid=18135): stdout: | (launched: 2022-12-10_08:39:55.458976) 08:39:56.631257 run osmo-msc_10.42.42.6(pid=18135): stderr: | 20221210083955731 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210083955731 DLGLOBAL DEBUG validating counter group 0x7f4f48365c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210083955731 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210083955731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210083955732 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210083955732 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210083955734 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210083955735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210083955735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210083955735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:39:56.680702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminating (SIGTERM) 08:39:56.720173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminating (SIGTERM) 08:39:56.759565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18134): Terminating (SIGTERM) 08:39:56.799129 --- ParallelTerminationStrategy: PID 18128 died... 08:39:56.818007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18128): Terminated: ok {rc=0} 08:39:56.861662 --- ParallelTerminationStrategy: PID 18131 died... 08:39:56.879770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18131): Terminated: ok {rc=0} 08:39:56.923780 --- ParallelTerminationStrategy: PID 18134 died... 08:39:56.942091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18134): Terminated: ok {rc=0} 08:39:57.027103 bus /sierra_3: Setting Powered False 08:39:58.125073 bus /sierra_3: Setting Powered False 08:39:59.239937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:40:00.487896 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:00.494323 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:40:00.527761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:40:00.553962 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:40:00.604591 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:40:00.637387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:40:00.664178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:40:01.213564 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:40:01.282846 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:01.297717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:40:01.381163 tst mo_mt_call.py: using LAC 27188 08:40:01.505234 tst mo_mt_call.py: using RAC 158 08:40:01.631631 tst mo_mt_call.py: using CellId 27188 08:40:01.786951 tst mo_mt_call.py: using BVCI 27189 08:40:01.942105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:01.956091 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:01.971875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:01.986983 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:02.003667 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:02.020392 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:40:02.161697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:40:02.298218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:02.806040 run create_hlr_db(pid=18143): Launched 08:40:02.935430 bus /sierra_2: Setting Powered False 08:40:03.998373 run create_hlr_db(pid=18143): Terminated: ok {rc=0} 08:40:04.435307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18145): Launched 08:40:04.742124 run osmo-hlr_10.42.42.2(pid=18146): Launched 08:40:04.857832 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:05.391682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18148): Launched 08:40:05.697117 run osmo-stp_10.42.42.5(pid=18149): Launched 08:40:05.812589 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:06.363919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18151): Launched 08:40:06.671829 run osmo-msc_10.42.42.6(pid=18152): Launched 08:40:06.843152 run osmo-stp_10.42.42.5(pid=18149): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18149)] 08:40:06.971792 run osmo-stp_10.42.42.5(pid=18149): stdout: | (launched: 2022-12-10_08:40:05.638530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:07.100672 run osmo-stp_10.42.42.5(pid=18149): stderr: | 20221210084005811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084005811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084005811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084005812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084005812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084005812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084005812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:07.227244 run osmo-stp_10.42.42.5(pid=18149): stdout: | (launched: 2022-12-10_08:40:05.638530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:07.347876 run osmo-stp_10.42.42.5(pid=18149): stderr: | 20221210084005811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084005811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084005811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084005812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084005812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084005812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084005812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:07.492142 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18149): Process ended prematurely: osmo-stp_10.42.42.5(pid=18149) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18149)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:40:07.500802 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:40:07.527187 run osmo-hlr_10.42.42.2(pid=18146): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18146)] 08:40:07.574383 run osmo-hlr_10.42.42.2(pid=18146): stdout: | (launched: 2022-12-10_08:40:04.683033) 08:40:07.623453 run osmo-hlr_10.42.42.2(pid=18146): stderr: | 20221210084004862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084004862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084004862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084004862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084004862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084004862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084004875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084004886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084004886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084004886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:07.691800 run osmo-msc_10.42.42.6(pid=18152): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18152)] 08:40:07.739242 run osmo-msc_10.42.42.6(pid=18152): stdout: | (launched: 2022-12-10_08:40:06.612279) 08:40:07.788104 run osmo-msc_10.42.42.6(pid=18152): stderr: | 20221210084006888 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084006888 DLGLOBAL DEBUG validating counter group 0x7f9855b65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084006888 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084006888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084006888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084006889 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084006890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084006891 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084006891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084006891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:40:07.837586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18145): Terminating (SIGTERM) 08:40:07.876924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18148): Terminating (SIGTERM) 08:40:07.916337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18151): Terminating (SIGTERM) 08:40:07.955964 --- ParallelTerminationStrategy: PID 18145 died... 08:40:07.974709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18145): Terminated: ok {rc=0} 08:40:08.018328 --- ParallelTerminationStrategy: PID 18148 died... 08:40:08.036550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18148): Terminated: ok {rc=0} 08:40:08.080059 --- ParallelTerminationStrategy: PID 18151 died... 08:40:08.098834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18151): Terminated: ok {rc=0} 08:40:08.184581 bus /sierra_3: Setting Powered False 08:40:09.287646 bus /sierra_3: Setting Powered False 08:40:10.404900 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:40:11.550721 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:11.562511 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:40:11.631239 tst mo_mt_call_osmux.py: using LAC 27189 08:40:11.752343 tst mo_mt_call_osmux.py: using RAC 159 08:40:11.879479 tst mo_mt_call_osmux.py: using CellId 27189 08:40:12.015042 tst mo_mt_call_osmux.py: using BVCI 27190 08:40:12.128375 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:12.139576 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:12.150638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:12.161841 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:12.173159 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:40:12.184372 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:40:12.304447 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:40:12.427225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:12.932271 run create_hlr_db(pid=18154): Launched 08:40:13.062784 bus /sierra_2: Setting Powered False 08:40:14.127209 run create_hlr_db(pid=18154): Terminated: ok {rc=0} 08:40:14.563215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18156): Launched 08:40:14.869716 run osmo-hlr_10.42.42.2(pid=18157): Launched 08:40:14.985628 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:15.515568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18159): Launched 08:40:15.820824 run osmo-stp_10.42.42.5(pid=18160): Launched 08:40:16.062122 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:16.795021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18162): Launched 08:40:17.135707 run osmo-msc_10.42.42.6(pid=18163): Launched 08:40:17.414489 run osmo-stp_10.42.42.5(pid=18160): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18160)] 08:40:17.545432 run osmo-stp_10.42.42.5(pid=18160): stdout: | (launched: 2022-12-10_08:40:15.762500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:17.677249 run osmo-stp_10.42.42.5(pid=18160): stderr: | 20221210084015989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084015989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084015989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084015990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084015990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084015990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084015990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:17.805305 run osmo-stp_10.42.42.5(pid=18160): stdout: | (launched: 2022-12-10_08:40:15.762500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:17.926664 run osmo-stp_10.42.42.5(pid=18160): stderr: | 20221210084015989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084015989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084015989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084015990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084015990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084015990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084015990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:18.071995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18160): Process ended prematurely: osmo-stp_10.42.42.5(pid=18160) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18160)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:40:18.081063 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:40:18.107999 run osmo-hlr_10.42.42.2(pid=18157): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18157)] 08:40:18.156683 run osmo-hlr_10.42.42.2(pid=18157): stdout: | (launched: 2022-12-10_08:40:14.810940) 08:40:18.206705 run osmo-hlr_10.42.42.2(pid=18157): stderr: | 20221210084014991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084014991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084014991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084014991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084014991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084014991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084015005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084015014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084015014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084015014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:18.275818 run osmo-msc_10.42.42.6(pid=18163): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18163)] 08:40:18.324087 run osmo-msc_10.42.42.6(pid=18163): stdout: | (launched: 2022-12-10_08:40:17.061148) 08:40:18.373881 run osmo-msc_10.42.42.6(pid=18163): stderr: | 20221210084017543 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084017544 DLGLOBAL DEBUG validating counter group 0x7fefc6819c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084017544 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084017544 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084017544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084017544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084017546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084017546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084017547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084017547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:40:18.424237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18156): Terminating (SIGTERM) 08:40:18.464614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18159): Terminating (SIGTERM) 08:40:18.505088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18162): Terminating (SIGTERM) 08:40:18.545865 --- ParallelTerminationStrategy: PID 18156 died... 08:40:18.565159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18156): Terminated: ok {rc=0} 08:40:18.609984 --- ParallelTerminationStrategy: PID 18159 died... 08:40:18.628502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18159): Terminated: ok {rc=0} 08:40:18.673212 --- ParallelTerminationStrategy: PID 18162 died... 08:40:18.691997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18162): Terminated: ok {rc=0} 08:40:18.778342 bus /sierra_3: Setting Powered False 08:40:19.875998 bus /sierra_3: Setting Powered False 08:40:20.991203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:40:22.244615 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:22.252332 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:40:22.288138 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:40:22.315130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:40:22.364357 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:40:22.397855 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:40:22.424689 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:40:22.976231 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:40:23.025717 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.036777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:40:23.104368 tst mo_mt_call.py: using LAC 27190 08:40:23.221771 tst mo_mt_call.py: using RAC 160 08:40:23.339175 tst mo_mt_call.py: using CellId 27190 08:40:23.456894 tst mo_mt_call.py: using BVCI 27191 08:40:23.567356 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.578506 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.589567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.600872 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.612408 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:23.623727 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:40:23.743207 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:40:23.859741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:24.330041 run create_hlr_db(pid=18168): Launched 08:40:24.445051 bus /sierra_2: Setting Powered False 08:40:25.505568 run create_hlr_db(pid=18168): Terminated: ok {rc=0} 08:40:25.944626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Launched 08:40:26.265520 run osmo-hlr_10.42.42.2(pid=18171): Launched 08:40:26.389048 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:26.945250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Launched 08:40:27.264734 run osmo-stp_10.42.42.5(pid=18174): Launched 08:40:27.387320 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:27.972189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18176): Launched 08:40:28.293205 run osmo-msc_10.42.42.6(pid=18177): Launched 08:40:28.472421 run osmo-stp_10.42.42.5(pid=18174): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] 08:40:28.607748 run osmo-stp_10.42.42.5(pid=18174): stdout: | (launched: 2022-12-10_08:40:27.206791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:28.744147 run osmo-stp_10.42.42.5(pid=18174): stderr: | 20221210084027401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084027401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084027401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084027402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084027402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084027402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084027402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:28.879121 run osmo-stp_10.42.42.5(pid=18174): stdout: | (launched: 2022-12-10_08:40:27.206791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:29.007037 run osmo-stp_10.42.42.5(pid=18174): stderr: | 20221210084027401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084027401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084027401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084027402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084027402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084027402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084027402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:29.160367 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18174): Process ended prematurely: osmo-stp_10.42.42.5(pid=18174) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:40:29.169723 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:40:29.196870 run osmo-hlr_10.42.42.2(pid=18171): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18171)] 08:40:29.246392 run osmo-hlr_10.42.42.2(pid=18171): stdout: | (launched: 2022-12-10_08:40:26.207566) 08:40:29.297395 run osmo-hlr_10.42.42.2(pid=18171): stderr: | 20221210084026407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084026407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084026407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084026407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084026407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084026407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084026419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084026428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084026428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084026428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:29.368341 run osmo-msc_10.42.42.6(pid=18177): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18177)] 08:40:29.417727 run osmo-msc_10.42.42.6(pid=18177): stdout: | (launched: 2022-12-10_08:40:28.235296) 08:40:29.468836 run osmo-msc_10.42.42.6(pid=18177): stderr: | 20221210084028557 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084028557 DLGLOBAL DEBUG validating counter group 0x7fe4e8489c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084028557 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084028557 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084028557 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084028558 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084028559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084028560 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084028560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084028560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:40:29.520203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Terminating (SIGTERM) 08:40:29.561111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Terminating (SIGTERM) 08:40:29.601900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18176): Terminating (SIGTERM) 08:40:29.642824 --- ParallelTerminationStrategy: PID 18170 died... 08:40:29.662007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18170): Terminated: ok {rc=0} 08:40:29.707210 --- ParallelTerminationStrategy: PID 18173 died... 08:40:29.726369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18173): Terminated: ok {rc=0} 08:40:29.772755 --- ParallelTerminationStrategy: PID 18176 died... 08:40:29.791982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18176): Terminated: ok {rc=0} 08:40:29.879449 bus /sierra_3: Setting Powered False 08:40:30.981191 bus /sierra_3: Setting Powered False 08:40:32.098744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:40:33.250203 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.262386 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:40:33.333417 tst mo_mt_call_osmux.py: using LAC 27191 08:40:33.459958 tst mo_mt_call_osmux.py: using RAC 161 08:40:33.591017 tst mo_mt_call_osmux.py: using CellId 27191 08:40:33.716915 tst mo_mt_call_osmux.py: using BVCI 27192 08:40:33.833834 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.845262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.856470 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.867815 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.879158 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:40:33.890531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:40:34.010032 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:40:34.127469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:34.598223 run create_hlr_db(pid=18179): Launched 08:40:34.714619 bus /sierra_2: Setting Powered False 08:40:35.774939 run create_hlr_db(pid=18179): Terminated: ok {rc=0} 08:40:36.196606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18181): Launched 08:40:36.498910 run osmo-hlr_10.42.42.2(pid=18182): Launched 08:40:36.614770 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:37.138717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18184): Launched 08:40:37.442607 run osmo-stp_10.42.42.5(pid=18185): Launched 08:40:37.558577 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:38.106656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18187): Launched 08:40:38.407708 run osmo-msc_10.42.42.6(pid=18188): Launched 08:40:38.577455 run osmo-stp_10.42.42.5(pid=18185): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18185)] 08:40:38.706020 run osmo-stp_10.42.42.5(pid=18185): stdout: | (launched: 2022-12-10_08:40:37.387018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:38.834303 run osmo-stp_10.42.42.5(pid=18185): stderr: | 20221210084037557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084037558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084037558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084037558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084037559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084037559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084037559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:38.960486 run osmo-stp_10.42.42.5(pid=18185): stdout: | (launched: 2022-12-10_08:40:37.387018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:39.080208 run osmo-stp_10.42.42.5(pid=18185): stderr: | 20221210084037557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084037558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084037558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084037558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084037559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084037559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084037559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:39.223927 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18185): Process ended prematurely: osmo-stp_10.42.42.5(pid=18185) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18185)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:40:39.232716 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:40:39.259547 run osmo-hlr_10.42.42.2(pid=18182): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18182)] 08:40:39.306898 run osmo-hlr_10.42.42.2(pid=18182): stdout: | (launched: 2022-12-10_08:40:36.443655) 08:40:39.355751 run osmo-hlr_10.42.42.2(pid=18182): stderr: | 20221210084036618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084036618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084036618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084036618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084036618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084036618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084036630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084036638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084036638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084036638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:39.424081 run osmo-msc_10.42.42.6(pid=18188): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18188)] 08:40:39.471703 run osmo-msc_10.42.42.6(pid=18188): stdout: | (launched: 2022-12-10_08:40:38.352781) 08:40:39.520488 run osmo-msc_10.42.42.6(pid=18188): stderr: | 20221210084038624 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084038624 DLGLOBAL DEBUG validating counter group 0x7fdcbdf47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084038624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084038624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084038625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084038625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084038627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084038628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084038628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084038628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:40:39.569625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18181): Terminating (SIGTERM) 08:40:39.608677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18184): Terminating (SIGTERM) 08:40:39.647853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18187): Terminating (SIGTERM) 08:40:39.687321 --- ParallelTerminationStrategy: PID 18181 died... 08:40:39.706087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18181): Terminated: ok {rc=0} 08:40:39.750395 --- ParallelTerminationStrategy: PID 18184 died... 08:40:39.768480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18184): Terminated: ok {rc=0} 08:40:39.812144 --- ParallelTerminationStrategy: PID 18187 died... 08:40:39.830484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18187): Terminated: ok {rc=0} 08:40:39.915926 bus /sierra_3: Setting Powered False 08:40:41.014731 bus /sierra_3: Setting Powered False 08:40:42.124627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:40:43.376313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:40:43.383271 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:40:43.417360 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:40:43.444649 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:40:43.499808 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:40:43.533908 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:40:43.561284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:40:44.111334 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:40:44.162503 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.173955 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:40:44.244580 tst mo_mt_call.py: using LAC 27192 08:40:44.371254 tst mo_mt_call.py: using RAC 162 08:40:44.499972 tst mo_mt_call.py: using CellId 27192 08:40:44.627911 tst mo_mt_call.py: using BVCI 27193 08:40:44.744748 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.756440 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.767873 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.779239 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.790669 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:44.801971 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:40:44.917493 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:40:45.037566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:45.543755 run create_hlr_db(pid=18193): Launched 08:40:45.674045 bus /sierra_2: Setting Powered False 08:40:46.733239 run create_hlr_db(pid=18193): Terminated: ok {rc=0} 08:40:47.210916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18195): Launched 08:40:47.530619 run osmo-hlr_10.42.42.2(pid=18196): Launched 08:40:47.647333 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:48.187381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18198): Launched 08:40:48.493867 run osmo-stp_10.42.42.5(pid=18199): Launched 08:40:48.610692 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:49.161499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18201): Launched 08:40:49.468075 run osmo-msc_10.42.42.6(pid=18202): Launched 08:40:49.638152 run osmo-stp_10.42.42.5(pid=18199): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18199)] 08:40:49.767821 run osmo-stp_10.42.42.5(pid=18199): stdout: | (launched: 2022-12-10_08:40:48.435015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:49.896770 run osmo-stp_10.42.42.5(pid=18199): stderr: | 20221210084048610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084048610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084048610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084048611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084048611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084048611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084048611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:50.023078 run osmo-stp_10.42.42.5(pid=18199): stdout: | (launched: 2022-12-10_08:40:48.435015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:50.143495 run osmo-stp_10.42.42.5(pid=18199): stderr: | 20221210084048610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084048610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084048610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084048611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084048611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084048611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084048611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:40:50.287956 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18199): Process ended prematurely: osmo-stp_10.42.42.5(pid=18199) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18199)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:40:50.296787 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:40:50.323250 run osmo-hlr_10.42.42.2(pid=18196): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18196)] 08:40:50.371223 run osmo-hlr_10.42.42.2(pid=18196): stdout: | (launched: 2022-12-10_08:40:47.471923) 08:40:50.420448 run osmo-hlr_10.42.42.2(pid=18196): stderr: | 20221210084047651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084047651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084047651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084047651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084047651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084047651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084047663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084047672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084047672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084047672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:40:50.489082 run osmo-msc_10.42.42.6(pid=18202): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18202)] 08:40:50.536815 run osmo-msc_10.42.42.6(pid=18202): stdout: | (launched: 2022-12-10_08:40:49.408594) 08:40:50.585910 run osmo-msc_10.42.42.6(pid=18202): stderr: | 20221210084049683 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084049683 DLGLOBAL DEBUG validating counter group 0x7fbfaedf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084049684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084049684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084049684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084049684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084049686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084049686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084049686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084049686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:40:50.635380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18195): Terminating (SIGTERM) 08:40:50.674921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18198): Terminating (SIGTERM) 08:40:50.714461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18201): Terminating (SIGTERM) 08:40:50.754187 --- ParallelTerminationStrategy: PID 18195 died... 08:40:50.773110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18195): Terminated: ok {rc=0} 08:40:50.817471 --- ParallelTerminationStrategy: PID 18198 died... 08:40:50.835951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18198): Terminated: ok {rc=0} 08:40:50.879705 --- ParallelTerminationStrategy: PID 18201 died... 08:40:50.898184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18201): Terminated: ok {rc=0} 08:40:50.983430 bus /sierra_3: Setting Powered False 08:40:52.083573 bus /sierra_3: Setting Powered False 08:40:53.198753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:40:54.345304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.356891 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:40:54.429076 tst mo_mt_call_osmux.py: using LAC 27193 08:40:54.548785 tst mo_mt_call_osmux.py: using RAC 163 08:40:54.667535 tst mo_mt_call_osmux.py: using CellId 27193 08:40:54.797938 tst mo_mt_call_osmux.py: using BVCI 27194 08:40:54.917792 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.929504 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.940917 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.952629 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.964481 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:40:54.975951 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:40:55.095226 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:40:55.211465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:40:55.686313 run create_hlr_db(pid=18204): Launched 08:40:55.802783 bus /sierra_2: Setting Powered False 08:40:56.863158 run create_hlr_db(pid=18204): Terminated: ok {rc=0} 08:40:57.289168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18206): Launched 08:40:57.596916 run osmo-hlr_10.42.42.2(pid=18207): Launched 08:40:57.713730 run osmo-stp_10.42.42.5: Starting osmo-stp 08:40:58.253026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18209): Launched 08:40:58.559757 run osmo-stp_10.42.42.5(pid=18210): Launched 08:40:58.676541 run osmo-msc_10.42.42.6: Starting osmo-msc 08:40:59.230082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18212): Launched 08:40:59.536418 run osmo-msc_10.42.42.6(pid=18213): Launched 08:40:59.707659 run osmo-stp_10.42.42.5(pid=18210): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18210)] 08:40:59.836597 run osmo-stp_10.42.42.5(pid=18210): stdout: | (launched: 2022-12-10_08:40:58.500333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:40:59.965107 run osmo-stp_10.42.42.5(pid=18210): stderr: | 20221210084058674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084058674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084058675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084058675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084058677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084058678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084058678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:00.092059 run osmo-stp_10.42.42.5(pid=18210): stdout: | (launched: 2022-12-10_08:40:58.500333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:00.212838 run osmo-stp_10.42.42.5(pid=18210): stderr: | 20221210084058674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084058674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084058675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084058675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084058677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084058678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084058678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:00.357666 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18210): Process ended prematurely: osmo-stp_10.42.42.5(pid=18210) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18210)] [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:41:00.366550 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:41:00.392875 run osmo-hlr_10.42.42.2(pid=18207): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18207)] 08:41:00.440649 run osmo-hlr_10.42.42.2(pid=18207): stdout: | (launched: 2022-12-10_08:40:57.537300) 08:41:00.491779 run osmo-hlr_10.42.42.2(pid=18207): stderr: | 20221210084057720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084057720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084057720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084057720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084057720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084057720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084057732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084057741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084057741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084057741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:00.560526 run osmo-msc_10.42.42.6(pid=18213): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18213)] 08:41:00.608017 run osmo-msc_10.42.42.6(pid=18213): stdout: | (launched: 2022-12-10_08:40:59.477191) 08:41:00.656703 run osmo-msc_10.42.42.6(pid=18213): stderr: | 20221210084059753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084059753 DLGLOBAL DEBUG validating counter group 0x7f0ab355dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084059753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084059753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084059753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084059753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084059755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084059755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084059756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084059756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:00.705931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18206): Terminating (SIGTERM) 08:41:00.745578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18209): Terminating (SIGTERM) 08:41:00.785270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18212): Terminating (SIGTERM) 08:41:00.825336 --- ParallelTerminationStrategy: PID 18206 died... 08:41:00.844482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18206): Terminated: ok {rc=0} 08:41:00.890572 --- ParallelTerminationStrategy: PID 18209 died... 08:41:00.909879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18209): Terminated: ok {rc=0} 08:41:00.955640 --- ParallelTerminationStrategy: PID 18212 died... 08:41:00.974974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18212): Terminated: ok {rc=0} 08:41:01.062351 bus /sierra_3: Setting Powered False 08:41:02.163916 bus /sierra_3: Setting Powered False 08:41:03.279256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:41:04.534017 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:04.540869 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:41:04.575588 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:41:04.603289 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:41:04.661720 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:41:04.697083 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:41:04.724634 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:41:05.275267 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:41:05.327526 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.339272 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:41:05.409733 tst mo_mt_call.py: using LAC 27194 08:41:05.529356 tst mo_mt_call.py: using RAC 164 08:41:05.652866 tst mo_mt_call.py: using CellId 27194 08:41:05.771817 tst mo_mt_call.py: using BVCI 27195 08:41:05.882543 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.893842 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.905219 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.916268 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.927424 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:05.938534 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:41:06.058966 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:41:06.175653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:06.645912 run create_hlr_db(pid=18218): Launched 08:41:06.761103 bus /sierra_2: Setting Powered False 08:41:07.821193 run create_hlr_db(pid=18218): Terminated: ok {rc=0} 08:41:08.261761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18221): Launched 08:41:08.582451 run osmo-hlr_10.42.42.2(pid=18222): Launched 08:41:08.705306 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:09.263705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18224): Launched 08:41:09.583136 run osmo-stp_10.42.42.5(pid=18225): Launched 08:41:09.705464 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:10.287354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18227): Launched 08:41:10.608758 run osmo-msc_10.42.42.6(pid=18228): Launched 08:41:10.790234 run osmo-stp_10.42.42.5(pid=18225): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18225)] 08:41:10.925941 run osmo-stp_10.42.42.5(pid=18225): stdout: | (launched: 2022-12-10_08:41:09.525302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:11.063251 run osmo-stp_10.42.42.5(pid=18225): stderr: | 20221210084109720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084109720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084109721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084109721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084109721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084109722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084109722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:11.199232 run osmo-stp_10.42.42.5(pid=18225): stdout: | (launched: 2022-12-10_08:41:09.525302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:11.327597 run osmo-stp_10.42.42.5(pid=18225): stderr: | 20221210084109720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084109720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084109721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084109721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084109721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084109722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084109722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:11.481400 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18225): Process ended prematurely: osmo-stp_10.42.42.5(pid=18225) [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18225)] [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:41:11.490959 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:41:11.518594 run osmo-hlr_10.42.42.2(pid=18222): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18222)] 08:41:11.568809 run osmo-hlr_10.42.42.2(pid=18222): stdout: | (launched: 2022-12-10_08:41:08.524399) 08:41:11.620311 run osmo-hlr_10.42.42.2(pid=18222): stderr: | 20221210084108725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084108725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084108725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084108725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084108725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084108725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084108737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084108746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084108746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084108746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:11.692078 run osmo-msc_10.42.42.6(pid=18228): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18228)] 08:41:11.742123 run osmo-msc_10.42.42.6(pid=18228): stdout: | (launched: 2022-12-10_08:41:10.550477) 08:41:11.793672 run osmo-msc_10.42.42.6(pid=18228): stderr: | 20221210084110875 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084110875 DLGLOBAL DEBUG validating counter group 0x7f71f2870c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084110875 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084110875 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084110875 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084110875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084110877 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084110877 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084110878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084110878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:11.845533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18221): Terminating (SIGTERM) 08:41:11.887240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18224): Terminating (SIGTERM) 08:41:11.929055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18227): Terminating (SIGTERM) 08:41:11.971104 --- ParallelTerminationStrategy: PID 18221 died... 08:41:11.990647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18221): Terminated: ok {rc=0} 08:41:12.036926 --- ParallelTerminationStrategy: PID 18224 died... 08:41:12.056834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18224): Terminated: ok {rc=0} 08:41:12.103192 --- ParallelTerminationStrategy: PID 18227 died... 08:41:12.122719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18227): Terminated: ok {rc=0} 08:41:12.209622 bus /sierra_3: Setting Powered False 08:41:13.306525 bus /sierra_3: Setting Powered False 08:41:14.420404 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:41:15.569693 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:15.582130 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:41:15.655127 tst mo_mt_call_osmux.py: using LAC 27195 08:41:15.786128 tst mo_mt_call_osmux.py: using RAC 165 08:41:15.921369 tst mo_mt_call_osmux.py: using CellId 27195 08:41:16.064674 tst mo_mt_call_osmux.py: using BVCI 27196 08:41:16.180342 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:16.192498 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:16.205521 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:16.219155 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:16.232408 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:41:16.244350 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:41:16.364040 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:41:16.503243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:17.051112 run create_hlr_db(pid=18230): Launched 08:41:17.213978 bus /sierra_2: Setting Powered False 08:41:18.277585 run create_hlr_db(pid=18230): Terminated: ok {rc=0} 08:41:18.710082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18232): Launched 08:41:19.012678 run osmo-hlr_10.42.42.2(pid=18233): Launched 08:41:19.128702 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:19.652634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18235): Launched 08:41:19.954215 run osmo-stp_10.42.42.5(pid=18236): Launched 08:41:20.069669 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:20.617295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18238): Launched 08:41:20.918429 run osmo-msc_10.42.42.6(pid=18239): Launched 08:41:21.090041 run osmo-stp_10.42.42.5(pid=18236): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18236)] 08:41:21.218785 run osmo-stp_10.42.42.5(pid=18236): stdout: | (launched: 2022-12-10_08:41:19.899605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:21.346979 run osmo-stp_10.42.42.5(pid=18236): stderr: | 20221210084120068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084120068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084120068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084120069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084120069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084120070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084120070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:21.473242 run osmo-stp_10.42.42.5(pid=18236): stdout: | (launched: 2022-12-10_08:41:19.899605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:21.593792 run osmo-stp_10.42.42.5(pid=18236): stderr: | 20221210084120068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084120068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084120068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084120069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084120069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084120070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084120070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:21.738332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18236): Process ended prematurely: osmo-stp_10.42.42.5(pid=18236) [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18236)] [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:41:21.747085 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:41:21.773260 run osmo-hlr_10.42.42.2(pid=18233): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18233)] 08:41:21.820907 run osmo-hlr_10.42.42.2(pid=18233): stdout: | (launched: 2022-12-10_08:41:18.957781) 08:41:21.869900 run osmo-hlr_10.42.42.2(pid=18233): stderr: | 20221210084119136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084119136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084119136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084119136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084119136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084119136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084119149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084119157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084119157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084119158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:21.938795 run osmo-msc_10.42.42.6(pid=18239): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18239)] 08:41:21.986245 run osmo-msc_10.42.42.6(pid=18239): stdout: | (launched: 2022-12-10_08:41:20.863552) 08:41:22.035200 run osmo-msc_10.42.42.6(pid=18239): stderr: | 20221210084121137 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084121137 DLGLOBAL DEBUG validating counter group 0x7fda03264c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084121137 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084121137 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084121137 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084121138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084121139 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084121140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084121140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084121140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:22.084561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18232): Terminating (SIGTERM) 08:41:22.123818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18235): Terminating (SIGTERM) 08:41:22.163146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18238): Terminating (SIGTERM) 08:41:22.202558 --- ParallelTerminationStrategy: PID 18232 died... 08:41:22.221304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18232): Terminated: ok {rc=0} 08:41:22.264793 --- ParallelTerminationStrategy: PID 18235 died... 08:41:22.282902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18235): Terminated: ok {rc=0} 08:41:22.326115 --- ParallelTerminationStrategy: PID 18238 died... 08:41:22.344268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18238): Terminated: ok {rc=0} 08:41:22.429345 bus /sierra_3: Setting Powered False 08:41:23.527583 bus /sierra_3: Setting Powered False 08:41:24.638923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:41:25.882244 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:25.887773 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:41:25.921235 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:41:25.947828 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:41:25.998870 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:41:26.031761 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:41:26.058717 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:41:26.607309 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:41:26.655931 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:26.666759 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:41:26.736048 tst mo_mt_call.py: using LAC 27196 08:41:26.856042 tst mo_mt_call.py: using RAC 166 08:41:26.975066 tst mo_mt_call.py: using CellId 27196 08:41:27.095012 tst mo_mt_call.py: using BVCI 27197 08:41:27.205650 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:27.216330 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:27.226946 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:27.237965 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:27.248808 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:27.259723 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:41:27.374818 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:41:27.489515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:27.962300 run create_hlr_db(pid=18246): Launched 08:41:28.076558 bus /sierra_2: Setting Powered False 08:41:29.137533 run create_hlr_db(pid=18246): Terminated: ok {rc=0} 08:41:29.584018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Launched 08:41:29.909075 run osmo-hlr_10.42.42.2(pid=18249): Launched 08:41:30.032503 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:30.594037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Launched 08:41:30.937032 run osmo-stp_10.42.42.5(pid=18252): Launched 08:41:31.156879 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:31.905122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18254): Launched 08:41:32.267163 run osmo-msc_10.42.42.6(pid=18255): Launched 08:41:32.571406 run osmo-stp_10.42.42.5(pid=18252): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] 08:41:32.707702 run osmo-stp_10.42.42.5(pid=18252): stdout: | (launched: 2022-12-10_08:41:30.865392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:32.845179 run osmo-stp_10.42.42.5(pid=18252): stderr: | 20221210084131148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084131148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084131148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084131148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084131152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084131152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084131152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:32.979673 run osmo-stp_10.42.42.5(pid=18252): stdout: | (launched: 2022-12-10_08:41:30.865392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:33.108862 run osmo-stp_10.42.42.5(pid=18252): stderr: | 20221210084131148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084131148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084131148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084131148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084131152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084131152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084131152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:33.263101 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18252): Process ended prematurely: osmo-stp_10.42.42.5(pid=18252) [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:41:33.272402 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 08:41:33.300080 run osmo-hlr_10.42.42.2(pid=18249): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18249)] 08:41:33.349977 run osmo-hlr_10.42.42.2(pid=18249): stdout: | (launched: 2022-12-10_08:41:29.846863) 08:41:33.401554 run osmo-hlr_10.42.42.2(pid=18249): stderr: | 20221210084130048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084130048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084130048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084130048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084130048 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084130049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084130061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084130070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084130070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084130070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:33.472914 run osmo-msc_10.42.42.6(pid=18255): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18255)] 08:41:33.522481 run osmo-msc_10.42.42.6(pid=18255): stdout: | (launched: 2022-12-10_08:41:32.202234) 08:41:33.573488 run osmo-msc_10.42.42.6(pid=18255): stderr: | 20221210084132610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084132610 DLGLOBAL DEBUG validating counter group 0x7f634ff53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084132610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084132610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084132610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084132611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084132612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084132613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084132613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084132613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:33.624701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Terminating (SIGTERM) 08:41:33.665539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Terminating (SIGTERM) 08:41:33.706750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18254): Terminating (SIGTERM) 08:41:33.748538 --- ParallelTerminationStrategy: PID 18248 died... 08:41:33.768441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18248): Terminated: ok {rc=0} 08:41:33.814902 --- ParallelTerminationStrategy: PID 18251 died... 08:41:33.834423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18251): Terminated: ok {rc=0} 08:41:33.880383 --- ParallelTerminationStrategy: PID 18254 died... 08:41:33.899774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18254): Terminated: ok {rc=0} 08:41:33.987199 bus /sierra_3: Setting Powered False 08:41:35.087240 bus /sierra_3: Setting Powered False 08:41:36.203991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:41:37.349174 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.360713 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:41:37.431282 tst mo_mt_call_osmux.py: using LAC 27197 08:41:37.560895 tst mo_mt_call_osmux.py: using RAC 167 08:41:37.688076 tst mo_mt_call_osmux.py: using CellId 27197 08:41:37.815060 tst mo_mt_call_osmux.py: using BVCI 27198 08:41:37.934482 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.946111 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.957318 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.968427 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.979589 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:41:37.990797 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:41:38.111793 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:41:38.230677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:38.734250 run create_hlr_db(pid=18257): Launched 08:41:38.863644 bus /sierra_2: Setting Powered False 08:41:39.927108 run create_hlr_db(pid=18257): Terminated: ok {rc=0} 08:41:40.379757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Launched 08:41:40.705020 run osmo-hlr_10.42.42.2(pid=18260): Launched 08:41:40.827307 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:41.390071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Launched 08:41:41.716807 run osmo-stp_10.42.42.5(pid=18263): Launched 08:41:41.838984 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:42.425165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18265): Launched 08:41:42.751362 run osmo-msc_10.42.42.6(pid=18266): Launched 08:41:42.931440 run osmo-stp_10.42.42.5(pid=18263): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] 08:41:43.067594 run osmo-stp_10.42.42.5(pid=18263): stdout: | (launched: 2022-12-10_08:41:41.654594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:43.204159 run osmo-stp_10.42.42.5(pid=18263): stderr: | 20221210084141849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084141850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084141850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084141850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084141851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084141851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084141851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:43.340369 run osmo-stp_10.42.42.5(pid=18263): stdout: | (launched: 2022-12-10_08:41:41.654594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:43.468884 run osmo-stp_10.42.42.5(pid=18263): stderr: | 20221210084141849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084141850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084141850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084141850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084141851 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084141851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084141851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:43.622332 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18263): Process ended prematurely: osmo-stp_10.42.42.5(pid=18263) [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:41:43.631780 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:41:43.659370 run osmo-hlr_10.42.42.2(pid=18260): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18260)] 08:41:43.709307 run osmo-hlr_10.42.42.2(pid=18260): stdout: | (launched: 2022-12-10_08:41:40.641778) 08:41:43.760748 run osmo-hlr_10.42.42.2(pid=18260): stderr: | 20221210084140845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084140845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084140845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084140845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084140845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084140846 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084140857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084140866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084140866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084140866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:43.832559 run osmo-msc_10.42.42.6(pid=18266): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18266)] 08:41:43.882317 run osmo-msc_10.42.42.6(pid=18266): stdout: | (launched: 2022-12-10_08:41:42.687406) 08:41:43.933662 run osmo-msc_10.42.42.6(pid=18266): stderr: | 20221210084143014 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084143014 DLGLOBAL DEBUG validating counter group 0x7f9b38be7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084143014 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084143014 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084143014 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084143014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084143016 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084143016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084143017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084143017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:43.985437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Terminating (SIGTERM) 08:41:44.026712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Terminating (SIGTERM) 08:41:44.068268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18265): Terminating (SIGTERM) 08:41:44.110293 --- ParallelTerminationStrategy: PID 18259 died... 08:41:44.129992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18259): Terminated: ok {rc=0} 08:41:44.175697 --- ParallelTerminationStrategy: PID 18262 died... 08:41:44.194994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18262): Terminated: ok {rc=0} 08:41:44.240464 --- ParallelTerminationStrategy: PID 18265 died... 08:41:44.259735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18265): Terminated: ok {rc=0} 08:41:44.346775 bus /sierra_3: Setting Powered False 08:41:45.444989 bus /sierra_3: Setting Powered False 08:41:46.561159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 08:41:47.816337 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:41:47.821619 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 08:41:47.855544 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 08:41:47.882702 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 08:41:47.934232 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 08:41:47.967872 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 08:41:47.994947 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 08:41:48.546966 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 08:41:48.598081 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:48.609732 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:41:48.660915 tst mo_mt_call.py: using LAC 27198 08:41:48.788204 tst mo_mt_call.py: using RAC 168 08:41:48.913919 tst mo_mt_call.py: using CellId 27198 08:41:49.033989 tst mo_mt_call.py: using BVCI 27199 08:41:49.147102 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:49.158328 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:49.169741 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:49.182127 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:49.192902 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:49.204559 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:41:49.324560 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:41:49.440545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:41:49.910007 run create_hlr_db(pid=18271): Launched 08:41:50.024426 bus /sierra_2: Setting Powered False 08:41:51.085192 run create_hlr_db(pid=18271): Terminated: ok {rc=0} 08:41:51.525045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Launched 08:41:51.846580 run osmo-hlr_10.42.42.2(pid=18274): Launched 08:41:51.969895 run osmo-stp_10.42.42.5: Starting osmo-stp 08:41:52.522899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Launched 08:41:52.842653 run osmo-stp_10.42.42.5(pid=18277): Launched 08:41:52.965473 run osmo-msc_10.42.42.6: Starting osmo-msc 08:41:53.546432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Launched 08:41:53.867196 run osmo-msc_10.42.42.6(pid=18280): Launched 08:41:54.046540 run osmo-stp_10.42.42.5(pid=18277): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] 08:41:54.182499 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-10_08:41:52.784836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:54.318220 run osmo-stp_10.42.42.5(pid=18277): stderr: | 20221210084152976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084152976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084152976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084152977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084152979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084152979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084152979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:54.453076 run osmo-stp_10.42.42.5(pid=18277): stdout: | (launched: 2022-12-10_08:41:52.784836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:41:54.580892 run osmo-stp_10.42.42.5(pid=18277): stderr: | 20221210084152976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084152976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084152976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084152977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084152979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084152979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084152979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:41:54.734088 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 08:41:54.743518 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:41:54.770859 run osmo-hlr_10.42.42.2(pid=18274): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18274)] 08:41:54.820489 run osmo-hlr_10.42.42.2(pid=18274): stdout: | (launched: 2022-12-10_08:41:51.788582) 08:41:54.871806 run osmo-hlr_10.42.42.2(pid=18274): stderr: | 20221210084151985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084151985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084151986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084151986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084151986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084151986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084151999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084152007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084152007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084152007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:41:54.943076 run osmo-msc_10.42.42.6(pid=18280): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18280)] 08:41:54.992616 run osmo-msc_10.42.42.6(pid=18280): stdout: | (launched: 2022-12-10_08:41:53.809077) 08:41:55.043574 run osmo-msc_10.42.42.6(pid=18280): stderr: | 20221210084154133 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084154133 DLGLOBAL DEBUG validating counter group 0x7f4fca68bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084154133 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084154133 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084154133 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084154134 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084154135 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084154136 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084154136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084154136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:41:55.095167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminating (SIGTERM) 08:41:55.136472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminating (SIGTERM) 08:41:55.177831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Terminating (SIGTERM) 08:41:55.219204 --- ParallelTerminationStrategy: PID 18273 died... 08:41:55.238444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18273): Terminated: ok {rc=0} 08:41:55.284076 --- ParallelTerminationStrategy: PID 18276 died... 08:41:55.303421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18276): Terminated: ok {rc=0} 08:41:55.349967 --- ParallelTerminationStrategy: PID 18279 died... 08:41:55.369458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18279): Terminated: ok {rc=0} 08:41:55.456467 bus /sierra_3: Setting Powered False 08:41:56.555248 bus /sierra_3: Setting Powered False 08:41:57.673175 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 08:41:58.818379 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:58.829850 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 08:41:58.879569 tst mo_mt_call_osmux.py: using LAC 27199 08:41:58.999885 tst mo_mt_call_osmux.py: using RAC 169 08:41:59.128431 tst mo_mt_call_osmux.py: using CellId 27199 08:41:59.255608 tst mo_mt_call_osmux.py: using BVCI 27200 08:41:59.366980 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:59.378068 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:59.388799 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:59.400027 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:59.411217 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 08:41:59.422463 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:41:59.540877 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 08:41:59.656651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:00.126901 run create_hlr_db(pid=18282): Launched 08:42:00.242150 bus /sierra_2: Setting Powered False 08:42:01.306060 run create_hlr_db(pid=18282): Terminated: ok {rc=0} 08:42:01.794349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Launched 08:42:02.138336 run osmo-hlr_10.42.42.2(pid=18287): Launched 08:42:02.329809 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:02.887349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Launched 08:42:03.208192 run osmo-stp_10.42.42.5(pid=18290): Launched 08:42:03.331637 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:03.914035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18292): Launched 08:42:04.234915 run osmo-msc_10.42.42.6(pid=18293): Launched 08:42:04.414721 run osmo-stp_10.42.42.5(pid=18290): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] 08:42:04.549759 run osmo-stp_10.42.42.5(pid=18290): stdout: | (launched: 2022-12-10_08:42:03.150304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:04.685511 run osmo-stp_10.42.42.5(pid=18290): stderr: | 20221210084203341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084203341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084203342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084203342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084203343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084203343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084203343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:04.820295 run osmo-stp_10.42.42.5(pid=18290): stdout: | (launched: 2022-12-10_08:42:03.150304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:04.948041 run osmo-stp_10.42.42.5(pid=18290): stderr: | 20221210084203341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084203341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084203342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084203342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084203343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084203343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084203343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:05.101368 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18290): Process ended prematurely: osmo-stp_10.42.42.5(pid=18290) [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 08:42:05.110682 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:42:05.137837 run osmo-hlr_10.42.42.2(pid=18287): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18287)] 08:42:05.187362 run osmo-hlr_10.42.42.2(pid=18287): stdout: | (launched: 2022-12-10_08:42:02.074263) 08:42:05.238621 run osmo-hlr_10.42.42.2(pid=18287): stderr: | 20221210084202348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084202348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084202348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084202348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084202348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084202348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084202361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084202369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084202369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084202369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:05.309695 run osmo-msc_10.42.42.6(pid=18293): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18293)] 08:42:05.359211 run osmo-msc_10.42.42.6(pid=18293): stdout: | (launched: 2022-12-10_08:42:04.176785) 08:42:05.410679 run osmo-msc_10.42.42.6(pid=18293): stderr: | 20221210084204498 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084204498 DLGLOBAL DEBUG validating counter group 0x7f6b33a63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084204498 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084204498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084204498 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084204499 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084204500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084204501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084204501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084204501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:05.462172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Terminating (SIGTERM) 08:42:05.503041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Terminating (SIGTERM) 08:42:05.544003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18292): Terminating (SIGTERM) 08:42:05.585306 --- ParallelTerminationStrategy: PID 18286 died... 08:42:05.604837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18286): Terminated: ok {rc=0} 08:42:05.650143 --- ParallelTerminationStrategy: PID 18289 died... 08:42:05.669366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18289): Terminated: ok {rc=0} 08:42:05.714863 --- ParallelTerminationStrategy: PID 18292 died... 08:42:05.734048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18292): Terminated: ok {rc=0} 08:42:05.820358 bus /sierra_3: Setting Powered False 08:42:06.917970 bus /sierra_3: Setting Powered False 08:42:08.033256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:42:09.283673 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:09.290345 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:42:09.324544 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:42:09.351913 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:42:09.406620 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:42:09.441552 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:42:09.469010 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:42:10.020070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:42:10.072437 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.084154 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:42:10.138080 tst mo_mt_call.py: using LAC 27200 08:42:10.260112 tst mo_mt_call.py: using RAC 170 08:42:10.385359 tst mo_mt_call.py: using CellId 27200 08:42:10.505626 tst mo_mt_call.py: using BVCI 27201 08:42:10.617518 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.628568 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.639751 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.651567 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.663509 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:10.676052 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:42:10.797350 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:42:10.917415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:11.421703 run create_hlr_db(pid=18298): Launched 08:42:11.552900 bus /sierra_2: Setting Powered False 08:42:12.616906 run create_hlr_db(pid=18298): Terminated: ok {rc=0} 08:42:13.053062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18300): Launched 08:42:13.359437 run osmo-hlr_10.42.42.2(pid=18301): Launched 08:42:13.475339 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:14.007632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18303): Launched 08:42:14.314127 run osmo-stp_10.42.42.5(pid=18304): Launched 08:42:14.430466 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:14.982629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18306): Launched 08:42:15.289770 run osmo-msc_10.42.42.6(pid=18307): Launched 08:42:15.460599 run osmo-stp_10.42.42.5(pid=18304): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18304)] 08:42:15.589733 run osmo-stp_10.42.42.5(pid=18304): stdout: | (launched: 2022-12-10_08:42:14.254753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:15.718634 run osmo-stp_10.42.42.5(pid=18304): stderr: | 20221210084214429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084214429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084214429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084214429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084214430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084214430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084214430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:15.846196 run osmo-stp_10.42.42.5(pid=18304): stdout: | (launched: 2022-12-10_08:42:14.254753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:15.985134 run osmo-stp_10.42.42.5(pid=18304): stderr: | 20221210084214429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084214429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084214429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084214429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084214430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084214430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084214430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:16.142737 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18304): Process ended prematurely: osmo-stp_10.42.42.5(pid=18304) [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18304)] [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:42:16.153270 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:42:16.183424 run osmo-hlr_10.42.42.2(pid=18301): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18301)] 08:42:16.236083 run osmo-hlr_10.42.42.2(pid=18301): stdout: | (launched: 2022-12-10_08:42:13.300470) 08:42:16.289942 run osmo-hlr_10.42.42.2(pid=18301): stderr: | 20221210084213481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084213481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084213481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084213481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084213481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084213481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084213493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084213502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084213502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084213502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:16.363997 run osmo-msc_10.42.42.6(pid=18307): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18307)] 08:42:16.416718 run osmo-msc_10.42.42.6(pid=18307): stdout: | (launched: 2022-12-10_08:42:15.230383) 08:42:16.470105 run osmo-msc_10.42.42.6(pid=18307): stderr: | 20221210084215506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084215506 DLGLOBAL DEBUG validating counter group 0x7f058a462c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084215506 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084215506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084215507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084215507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084215508 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084215509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084215509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084215509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:16.524919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18300): Terminating (SIGTERM) 08:42:16.569420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18303): Terminating (SIGTERM) 08:42:16.616035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18306): Terminating (SIGTERM) 08:42:16.662262 --- ParallelTerminationStrategy: PID 18300 died... 08:42:16.683339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18300): Terminated: ok {rc=0} 08:42:16.734242 --- ParallelTerminationStrategy: PID 18303 died... 08:42:16.754565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18303): Terminated: ok {rc=0} 08:42:16.804069 --- ParallelTerminationStrategy: PID 18306 died... 08:42:16.824515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18306): Terminated: ok {rc=0} 08:42:16.914737 bus /sierra_3: Setting Powered False 08:42:18.013392 bus /sierra_3: Setting Powered False 08:42:19.127879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:42:20.275124 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.287537 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:42:20.341550 tst mo_mt_call_osmux.py: using LAC 27201 08:42:20.469550 tst mo_mt_call_osmux.py: using RAC 171 08:42:20.598065 tst mo_mt_call_osmux.py: using CellId 27201 08:42:20.726381 tst mo_mt_call_osmux.py: using BVCI 27202 08:42:20.845150 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.856778 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.868363 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.879903 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.891477 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:42:20.902992 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:42:21.020548 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:42:21.142564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:21.618236 run create_hlr_db(pid=18309): Launched 08:42:21.735210 bus /sierra_2: Setting Powered False 08:42:22.795223 run create_hlr_db(pid=18309): Terminated: ok {rc=0} 08:42:23.241404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Launched 08:42:23.566344 run osmo-hlr_10.42.42.2(pid=18312): Launched 08:42:23.688815 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:24.246065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Launched 08:42:24.570906 run osmo-stp_10.42.42.5(pid=18315): Launched 08:42:24.693487 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:25.279323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18317): Launched 08:42:25.603688 run osmo-msc_10.42.42.6(pid=18318): Launched 08:42:25.775953 run osmo-stp_10.42.42.5(pid=18315): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] 08:42:25.907012 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-10_08:42:24.507432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:26.036707 run osmo-stp_10.42.42.5(pid=18315): stderr: | 20221210084224704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084224704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084224705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084224705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084224707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084224707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084224708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:26.162994 run osmo-stp_10.42.42.5(pid=18315): stdout: | (launched: 2022-12-10_08:42:24.507432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:26.283609 run osmo-stp_10.42.42.5(pid=18315): stderr: | 20221210084224704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084224704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084224705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084224705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084224707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084224707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084224708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:26.427759 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:42:26.436662 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:42:26.463174 run osmo-hlr_10.42.42.2(pid=18312): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18312)] 08:42:26.510433 run osmo-hlr_10.42.42.2(pid=18312): stdout: | (launched: 2022-12-10_08:42:23.503074) 08:42:26.559487 run osmo-hlr_10.42.42.2(pid=18312): stderr: | 20221210084223708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084223708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084223708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084223708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084223708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084223708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084223720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084223728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084223728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084223728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:26.627766 run osmo-msc_10.42.42.6(pid=18318): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18318)] 08:42:26.675277 run osmo-msc_10.42.42.6(pid=18318): stdout: | (launched: 2022-12-10_08:42:25.540925) 08:42:26.724260 run osmo-msc_10.42.42.6(pid=18318): stderr: | 20221210084225816 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084225816 DLGLOBAL DEBUG validating counter group 0x7f6403ac4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084225816 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084225816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084225816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084225816 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084225818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084225819 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084225819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084225819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:26.773462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminating (SIGTERM) 08:42:26.812414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminating (SIGTERM) 08:42:26.851718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18317): Terminating (SIGTERM) 08:42:26.891284 --- ParallelTerminationStrategy: PID 18311 died... 08:42:26.910178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18311): Terminated: ok {rc=0} 08:42:26.954170 --- ParallelTerminationStrategy: PID 18314 died... 08:42:26.972366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18314): Terminated: ok {rc=0} 08:42:27.015896 --- ParallelTerminationStrategy: PID 18317 died... 08:42:27.034134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18317): Terminated: ok {rc=0} 08:42:27.119571 bus /sierra_3: Setting Powered False 08:42:28.217835 bus /sierra_3: Setting Powered False 08:42:29.333080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:trx-b200 --------------------------------------------------------------------- 08:42:30.579477 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:30.583718 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 08:42:30.617522 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 08:42:30.643937 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 08:42:30.727157 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 08:42:30.760081 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 08:42:30.786598 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 08:42:31.370526 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 08:42:31.376455 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:31.387581 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:42:31.439334 tst emergency_mo_mt_call.py: using LAC 27202 08:42:31.558037 tst emergency_mo_mt_call.py: using RAC 172 08:42:31.678297 tst emergency_mo_mt_call.py: using CellId 27202 08:42:31.843052 tst emergency_mo_mt_call.py: using BVCI 27203 08:42:31.963494 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:31.974798 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:31.986051 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:31.997286 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:32.009495 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:32.020491 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:32.135579 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:32.254494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:32.751735 run create_hlr_db(pid=18323): Launched 08:42:32.881027 bus /sierra_2: Setting Powered False 08:42:33.943727 run create_hlr_db(pid=18323): Terminated: ok {rc=0} 08:42:34.370591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18325): Launched 08:42:34.668550 run osmo-hlr_10.42.42.2(pid=18326): Launched 08:42:34.782743 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:35.307877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18328): Launched 08:42:35.605475 run osmo-stp_10.42.42.5(pid=18329): Launched 08:42:35.734827 tst emergency_mo_mt_call.py: using MSISDN 7646 08:42:35.888188 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:36.428136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18331): Launched 08:42:36.725023 run osmo-msc_10.42.42.6(pid=18332): Launched 08:42:36.891122 run osmo-stp_10.42.42.5(pid=18329): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18329)] 08:42:37.018188 run osmo-stp_10.42.42.5(pid=18329): stdout: | (launched: 2022-12-10_08:42:35.550603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:37.145504 run osmo-stp_10.42.42.5(pid=18329): stderr: | 20221210084235720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084235721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084235721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084235721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084235722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084235722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084235722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:37.270155 run osmo-stp_10.42.42.5(pid=18329): stdout: | (launched: 2022-12-10_08:42:35.550603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:37.388615 run osmo-stp_10.42.42.5(pid=18329): stderr: | 20221210084235720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084235721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084235721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084235721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084235722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084235722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084235722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:37.530276 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18329): Process ended prematurely: osmo-stp_10.42.42.5(pid=18329) [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18329)] [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 08:42:37.538671 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 08:42:37.564756 run osmo-hlr_10.42.42.2(pid=18326): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18326)] 08:42:37.612867 run osmo-hlr_10.42.42.2(pid=18326): stdout: | (launched: 2022-12-10_08:42:34.614146) 08:42:37.662528 run osmo-hlr_10.42.42.2(pid=18326): stderr: | 20221210084234788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084234788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084234788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084234788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084234788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084234788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084234801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084234810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084234810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084234810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:37.731231 run osmo-msc_10.42.42.6(pid=18332): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18332)] 08:42:37.778912 run osmo-msc_10.42.42.6(pid=18332): stdout: | (launched: 2022-12-10_08:42:36.670502) 08:42:37.827930 run osmo-msc_10.42.42.6(pid=18332): stderr: | 20221210084236942 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084236942 DLGLOBAL DEBUG validating counter group 0x7f1f975a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084236942 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084236942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084236943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084236943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084236945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084236945 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084236946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084236946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:37.877430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18325): Terminating (SIGTERM) 08:42:37.916984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18328): Terminating (SIGTERM) 08:42:37.956767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18331): Terminating (SIGTERM) 08:42:37.996632 --- ParallelTerminationStrategy: PID 18325 died... 08:42:38.015542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18325): Terminated: ok {rc=0} 08:42:38.059638 --- ParallelTerminationStrategy: PID 18328 died... 08:42:38.077878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18328): Terminated: ok {rc=0} 08:42:38.121958 --- ParallelTerminationStrategy: PID 18331 died... 08:42:38.140378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18331): Terminated: ok {rc=0} 08:42:38.223427 bus /sierra_3: Setting Powered False 08:42:39.320137 bus /sierra_3: Setting Powered False 08:42:40.435203 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 08:42:41.520424 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:41.531742 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 08:42:41.582248 tst emergency_preemptive_call.py: using LAC 27203 08:42:41.699590 tst emergency_preemptive_call.py: using RAC 173 08:42:41.817079 tst emergency_preemptive_call.py: using CellId 27203 08:42:41.933856 tst emergency_preemptive_call.py: using BVCI 27204 08:42:42.041628 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:42.052244 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:42.062753 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:42.073516 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:42.084236 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 08:42:42.095026 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:42.213774 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:42.331188 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:42.449482 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 08:42:42.569547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:42:43.062534 run create_hlr_db(pid=18334): Launched 08:42:43.191322 bus /sierra_2: Setting Powered False 08:42:44.254225 run create_hlr_db(pid=18334): Terminated: ok {rc=0} 08:42:44.696318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Launched 08:42:45.012155 run osmo-hlr_10.42.42.2(pid=18337): Launched 08:42:45.132785 run osmo-stp_10.42.42.5: Starting osmo-stp 08:42:45.677604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Launched 08:42:46.002332 run osmo-stp_10.42.42.5(pid=18340): Launched 08:42:46.163579 tst emergency_preemptive_call.py: using MSISDN 7647 08:42:46.595823 run osmo-msc_10.42.42.6: Starting osmo-msc 08:42:47.170732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Launched 08:42:47.495167 run osmo-msc_10.42.42.6(pid=18343): Launched 08:42:47.670708 run osmo-stp_10.42.42.5(pid=18340): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] 08:42:47.804457 run osmo-stp_10.42.42.5(pid=18340): stdout: | (launched: 2022-12-10_08:42:45.940867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:47.937898 run osmo-stp_10.42.42.5(pid=18340): stderr: | 20221210084246302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084246302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084246303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084246304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084246306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084246306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084246306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:48.071730 run osmo-stp_10.42.42.5(pid=18340): stdout: | (launched: 2022-12-10_08:42:45.940867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:42:48.198443 run osmo-stp_10.42.42.5(pid=18340): stderr: | 20221210084246302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084246302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084246303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084246304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084246306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084246306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084246306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:42:48.349053 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18340): Process ended prematurely: osmo-stp_10.42.42.5(pid=18340) [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py:32] 08:42:48.358034 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 08:42:48.385248 run osmo-hlr_10.42.42.2(pid=18337): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18337)] 08:42:48.435571 run osmo-hlr_10.42.42.2(pid=18337): stdout: | (launched: 2022-12-10_08:42:44.954965) 08:42:48.487521 run osmo-hlr_10.42.42.2(pid=18337): stderr: | 20221210084245154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084245154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084245154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084245154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084245154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084245154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084245167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084245177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084245177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084245177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:42:48.559987 run osmo-msc_10.42.42.6(pid=18343): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18343)] 08:42:48.610027 run osmo-msc_10.42.42.6(pid=18343): stdout: | (launched: 2022-12-10_08:42:47.437897) 08:42:48.661344 run osmo-msc_10.42.42.6(pid=18343): stderr: | 20221210084247763 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084247763 DLGLOBAL DEBUG validating counter group 0x7f1ddb15ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084247763 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084247763 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084247764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084247764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084247766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084247766 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084247766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084247766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:42:48.712906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Terminating (SIGTERM) 08:42:48.754329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Terminating (SIGTERM) 08:42:48.795765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Terminating (SIGTERM) 08:42:48.837716 --- ParallelTerminationStrategy: PID 18336 died... 08:42:48.857506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Terminated: ok {rc=0} 08:42:48.903683 --- ParallelTerminationStrategy: PID 18339 died... 08:42:48.923139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Terminated: ok {rc=0} 08:42:48.969278 --- ParallelTerminationStrategy: PID 18342 died... 08:42:48.988586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Terminated: ok {rc=0} 08:42:49.076563 bus /sierra_9: Setting Powered False 08:42:50.177652 bus /sierra_9: Setting Powered False 08:42:51.293681 bus /sierra_8: Setting Powered False 08:42:52.389985 bus /sierra_8: Setting Powered False 08:42:53.505662 bus /sierra_3: Setting Powered False 08:42:54.603622 bus /sierra_3: Setting Powered False 08:42:55.719074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-b200 --------------------------------------------------------------------- 08:42:57.003461 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:42:57.008034 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 08:42:57.041691 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 08:42:57.080716 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 08:42:57.169741 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 08:42:57.203433 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 08:42:57.242480 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 08:42:57.835302 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 08:42:57.887457 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:57.898530 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:42:57.948242 tst cs_paging_gprs_active.py: using LAC 27204 08:42:58.076629 tst cs_paging_gprs_active.py: using RAC 174 08:42:58.206631 tst cs_paging_gprs_active.py: using CellId 27204 08:42:58.337071 tst cs_paging_gprs_active.py: using BVCI 27205 08:42:58.454262 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.465297 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.476023 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.486824 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.497526 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.508173 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.519045 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.529861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:42:58.540680 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:42:58.657869 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:42:58.776471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:42:58.995077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:42:59.325143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Launched 08:42:59.611190 run iperf3-srv_10.42.42.10(pid=18350): Launched 08:42:59.732309 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:42:59.951590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:00.279756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Launched 08:43:00.564352 run iperf3-srv_10.42.42.10(pid=18352): Launched 08:43:00.685215 tst cs_paging_gprs_active.py:38: start network... 08:43:00.920373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:01.443081 run create_hlr_db(pid=18353): Launched 08:43:01.601187 bus /sierra_2: Setting Powered False 08:43:02.665656 run create_hlr_db(pid=18353): Terminated: ok {rc=0} 08:43:03.122270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Launched 08:43:03.448606 run osmo-hlr_10.42.42.2(pid=18356): Launched 08:43:03.570812 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:04.129374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Launched 08:43:04.455643 run osmo-stp_10.42.42.5(pid=18359): Launched 08:43:04.578618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:05.142216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18361): Launched 08:43:05.265500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:05.543751 run patchelf(pid=18362): Launched 08:43:05.723213 run osmo-stp_10.42.42.5(pid=18359): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] 08:43:05.860414 run osmo-stp_10.42.42.5(pid=18359): stdout: | (launched: 2022-12-10_08:43:04.393441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:05.999945 run osmo-stp_10.42.42.5(pid=18359): stderr: | 20221210084304589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084304589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084304589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084304590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084304590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084304590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084304590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.139521 run osmo-stp_10.42.42.5(pid=18359): stdout: | (launched: 2022-12-10_08:43:04.393441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:06.272549 run osmo-stp_10.42.42.5(pid=18359): stderr: | 20221210084304589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084304589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084304589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084304590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084304590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084304590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084304590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:06.430057 run patchelf(pid=18362): Terminating (SIGINT) 08:43:06.611158 run patchelf(pid=18362): Terminated: ok {rc=0} 08:43:06.741738 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18359): Process ended prematurely: osmo-stp_10.42.42.5(pid=18359) [trial-2372↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] [trial-2372↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 08:43:06.751682 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:43:06.779759 run osmo-hlr_10.42.42.2(pid=18356): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18356)] 08:43:06.829339 run osmo-hlr_10.42.42.2(pid=18356): stdout: | (launched: 2022-12-10_08:43:03.385749) 08:43:06.880797 run osmo-hlr_10.42.42.2(pid=18356): stderr: | 20221210084303587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084303587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084303587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084303587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084303587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084303587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084303599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084303608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084303608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084303609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:06.932603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Terminating (SIGTERM) 08:43:06.974214 run iperf3-srv_10.42.42.10(pid=18350): Terminating (SIGTERM) 08:43:07.015932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminating (SIGTERM) 08:43:07.057574 run iperf3-srv_10.42.42.10(pid=18352): Terminating (SIGTERM) 08:43:07.099325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Terminating (SIGTERM) 08:43:07.141047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Terminating (SIGTERM) 08:43:07.182628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18361): Terminating (SIGTERM) 08:43:07.224721 --- ParallelTerminationStrategy: PID 18349 died... 08:43:07.244688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18349): Terminated: ok {rc=0} 08:43:07.290794 --- ParallelTerminationStrategy: PID 18350 died... 08:43:07.310058 run iperf3-srv_10.42.42.10(pid=18350): Terminated {rc=256} 08:43:07.355406 --- ParallelTerminationStrategy: PID 18351 died... 08:43:07.374641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18351): Terminated: ok {rc=0} 08:43:07.419819 --- ParallelTerminationStrategy: PID 18352 died... 08:43:07.438989 run iperf3-srv_10.42.42.10(pid=18352): Terminated {rc=256} 08:43:07.484162 --- ParallelTerminationStrategy: PID 18355 died... 08:43:07.503433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18355): Terminated: ok {rc=0} 08:43:07.548702 --- ParallelTerminationStrategy: PID 18358 died... 08:43:07.567872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18358): Terminated: ok {rc=0} 08:43:07.613475 --- ParallelTerminationStrategy: PID 18361 died... 08:43:07.632712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18361): Terminated: ok {rc=0} 08:43:07.718983 bus /gobi_0: Setting Powered False 08:43:08.819285 bus /gobi_0: Setting Powered False 08:43:09.934904 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200 iperf3.py ---------------------------------------------- 08:43:11.078251 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.089536 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:43:11.140862 tst iperf3.py: using LAC 27205 08:43:11.260292 tst iperf3.py: using RAC 175 08:43:11.380051 tst iperf3.py: using CellId 27205 08:43:11.500913 tst iperf3.py: using BVCI 27206 08:43:11.613513 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.623990 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.634281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.644805 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.655317 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.665816 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.676611 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.687266 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:11.698111 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:11.817115 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:43:12.036769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:12.366233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18363): Launched 08:43:12.651562 run iperf3-srv_10.42.42.10(pid=18364): Launched 08:43:12.772610 tst iperf3.py:8: start network... 08:43:12.990405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:13.494699 run create_hlr_db(pid=18365): Launched 08:43:13.625796 bus /gobi_6: Setting Powered False 08:43:14.689056 run create_hlr_db(pid=18365): Terminated: ok {rc=0} 08:43:15.124350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18367): Launched 08:43:15.431146 run osmo-hlr_10.42.42.2(pid=18368): Launched 08:43:15.547748 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:16.137720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18370): Launched 08:43:16.493744 run osmo-stp_10.42.42.5(pid=18371): Launched 08:43:16.723739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:17.375937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18373): Launched 08:43:17.499458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:17.777320 run patchelf(pid=18374): Launched 08:43:17.956347 run osmo-stp_10.42.42.5(pid=18371): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18371)] 08:43:18.093723 run osmo-stp_10.42.42.5(pid=18371): stdout: | (launched: 2022-12-10_08:43:16.420621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:18.232304 run osmo-stp_10.42.42.5(pid=18371): stderr: | 20221210084316728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084316736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084316736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084316737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084316737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084316737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084316737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:18.370692 run osmo-stp_10.42.42.5(pid=18371): stdout: | (launched: 2022-12-10_08:43:16.420621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:18.503251 run osmo-stp_10.42.42.5(pid=18371): stderr: | 20221210084316728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084316736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084316736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084316737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084316737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084316737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084316737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:18.660400 run patchelf(pid=18374): Terminating (SIGINT) 08:43:18.841949 run patchelf(pid=18374): Terminated: ok {rc=0} 08:43:18.972713 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18371): Process ended prematurely: osmo-stp_10.42.42.5(pid=18371) [trial-2372↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18371)] [trial-2372↪gprs:trx-b200↪iperf3.py:8] 08:43:18.982620 tst iperf3.py:8: Test FAILED (7.9 sec) 08:43:19.010497 run osmo-hlr_10.42.42.2(pid=18368): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18368)] 08:43:19.059695 run osmo-hlr_10.42.42.2(pid=18368): stdout: | (launched: 2022-12-10_08:43:15.372133) 08:43:19.111125 run osmo-hlr_10.42.42.2(pid=18368): stderr: | 20221210084315550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084315550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084315550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084315550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084315550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084315550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084315561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084315570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084315570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084315570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:19.162639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18363): Terminating (SIGTERM) 08:43:19.203893 run iperf3-srv_10.42.42.10(pid=18364): Terminating (SIGTERM) 08:43:19.245263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18367): Terminating (SIGTERM) 08:43:19.286779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18370): Terminating (SIGTERM) 08:43:19.328172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18373): Terminating (SIGTERM) 08:43:19.369843 --- ParallelTerminationStrategy: PID 18363 died... 08:43:19.389605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18363): Terminated: ok {rc=0} 08:43:19.435355 --- ParallelTerminationStrategy: PID 18364 died... 08:43:19.454560 run iperf3-srv_10.42.42.10(pid=18364): Terminated {rc=256} 08:43:19.500078 --- ParallelTerminationStrategy: PID 18367 died... 08:43:19.519234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18367): Terminated: ok {rc=0} 08:43:19.564936 --- ParallelTerminationStrategy: PID 18370 died... 08:43:19.584462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18370): Terminated: ok {rc=0} 08:43:19.630038 --- ParallelTerminationStrategy: PID 18373 died... 08:43:19.649449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18373): Terminated: ok {rc=0} 08:43:19.736744 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 08:43:20.885618 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:20.897277 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:43:20.948042 tst iperf3m4.py: using LAC 27206 08:43:21.077063 tst iperf3m4.py: using RAC 176 08:43:21.204072 tst iperf3m4.py: using CellId 27206 08:43:21.332720 tst iperf3m4.py: using BVCI 27207 08:43:21.452052 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.463401 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.474246 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.485152 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.495915 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.506741 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.517768 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.528548 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:21.539548 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:21.658811 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:21.779629 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:21.897588 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:22.014980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:43:22.220681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:22.530604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18375): Launched 08:43:22.798830 run iperf3-srv_10.42.42.10(pid=18376): Launched 08:43:22.913042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:43:23.116650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:23.426494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18377): Launched 08:43:23.693519 run iperf3-srv_10.42.42.10(pid=18378): Launched 08:43:23.807259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:43:24.011699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:24.321090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18379): Launched 08:43:24.589356 run iperf3-srv_10.42.42.10(pid=18380): Launched 08:43:24.703629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:43:24.908148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:25.218299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18381): Launched 08:43:25.485635 run iperf3-srv_10.42.42.10(pid=18382): Launched 08:43:25.599215 tst iperf3m4.py:8: start network... 08:43:25.802700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:26.277021 run create_hlr_db(pid=18383): Launched 08:43:26.394397 bus /gobi_6: Setting Powered False 08:43:27.455604 run create_hlr_db(pid=18383): Terminated: ok {rc=0} 08:43:27.883113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18385): Launched 08:43:28.190951 run osmo-hlr_10.42.42.2(pid=18386): Launched 08:43:28.307183 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:28.849266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18388): Launched 08:43:29.155780 run osmo-stp_10.42.42.5(pid=18389): Launched 08:43:29.271868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:29.798710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18391): Launched 08:43:29.914473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:30.176195 run patchelf(pid=18392): Launched 08:43:30.345474 run osmo-stp_10.42.42.5(pid=18389): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18389)] 08:43:30.474820 run osmo-stp_10.42.42.5(pid=18389): stdout: | (launched: 2022-12-10_08:43:29.096907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:30.605510 run osmo-stp_10.42.42.5(pid=18389): stderr: | 20221210084329271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084329271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084329271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084329272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084329272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084329272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084329272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:30.736214 run osmo-stp_10.42.42.5(pid=18389): stdout: | (launched: 2022-12-10_08:43:29.096907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:30.887017 run osmo-stp_10.42.42.5(pid=18389): stderr: | 20221210084329271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084329271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084329271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084329272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084329272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084329272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084329272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:31.053386 run patchelf(pid=18392): Terminating (SIGINT) 08:43:31.240004 run patchelf(pid=18392): Terminated: ok {rc=0} 08:43:31.374981 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18389): Process ended prematurely: osmo-stp_10.42.42.5(pid=18389) [trial-2372↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18389)] [trial-2372↪gprs:trx-b200↪iperf3m4.py:8] 08:43:31.385908 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:43:31.417223 run osmo-hlr_10.42.42.2(pid=18386): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18386)] 08:43:31.469406 run osmo-hlr_10.42.42.2(pid=18386): stdout: | (launched: 2022-12-10_08:43:28.131479) 08:43:31.523042 run osmo-hlr_10.42.42.2(pid=18386): stderr: | 20221210084328313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084328313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084328313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084328313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084328313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084328313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084328325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084328334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084328334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084328334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:31.577061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18375): Terminating (SIGTERM) 08:43:31.621548 run iperf3-srv_10.42.42.10(pid=18376): Terminating (SIGTERM) 08:43:31.667910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18377): Terminating (SIGTERM) 08:43:31.712831 run iperf3-srv_10.42.42.10(pid=18378): Terminating (SIGTERM) 08:43:31.758401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18379): Terminating (SIGTERM) 08:43:31.801988 run iperf3-srv_10.42.42.10(pid=18380): Terminating (SIGTERM) 08:43:31.848365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18381): Terminating (SIGTERM) 08:43:31.892391 run iperf3-srv_10.42.42.10(pid=18382): Terminating (SIGTERM) 08:43:31.938161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18385): Terminating (SIGTERM) 08:43:31.982034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18388): Terminating (SIGTERM) 08:43:32.027417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18391): Terminating (SIGTERM) 08:43:32.072475 --- ParallelTerminationStrategy: PID 18375 died... 08:43:32.093292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18375): Terminated: ok {rc=0} 08:43:32.142486 --- ParallelTerminationStrategy: PID 18376 died... 08:43:32.162630 run iperf3-srv_10.42.42.10(pid=18376): Terminated {rc=256} 08:43:32.209172 --- ParallelTerminationStrategy: PID 18377 died... 08:43:32.228689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18377): Terminated: ok {rc=0} 08:43:32.274867 --- ParallelTerminationStrategy: PID 18378 died... 08:43:32.294465 run iperf3-srv_10.42.42.10(pid=18378): Terminated {rc=256} 08:43:32.340437 --- ParallelTerminationStrategy: PID 18379 died... 08:43:32.359894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18379): Terminated: ok {rc=0} 08:43:32.405999 --- ParallelTerminationStrategy: PID 18380 died... 08:43:32.425584 run iperf3-srv_10.42.42.10(pid=18380): Terminated {rc=256} 08:43:32.471543 --- ParallelTerminationStrategy: PID 18381 died... 08:43:32.491065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18381): Terminated: ok {rc=0} 08:43:32.537122 --- ParallelTerminationStrategy: PID 18382 died... 08:43:32.556565 run iperf3-srv_10.42.42.10(pid=18382): Terminated {rc=256} 08:43:32.602698 --- ParallelTerminationStrategy: PID 18385 died... 08:43:32.622422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18385): Terminated: ok {rc=0} 08:43:32.668572 --- ParallelTerminationStrategy: PID 18388 died... 08:43:32.688367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18388): Terminated: ok {rc=0} 08:43:32.734469 --- ParallelTerminationStrategy: PID 18391 died... 08:43:32.754101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18391): Terminated: ok {rc=0} 08:43:32.841994 bus /gobi_4: Setting Powered False 08:43:33.940412 bus /gobi_4: Setting Powered False 08:43:35.056039 bus /gobi_1: Setting Powered False 08:43:36.152899 bus /gobi_1: Setting Powered False 08:43:37.266232 bus /gobi_0: Setting Powered False 08:43:38.364175 bus /gobi_0: Setting Powered False 08:43:39.479607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200 ping.py ---------------------------------------------- 08:43:40.581448 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:40.592353 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:43:40.641371 tst ping.py: using LAC 27207 08:43:40.760678 tst ping.py: using RAC 177 08:43:40.886038 tst ping.py: using CellId 27207 08:43:41.010417 tst ping.py: using BVCI 27208 08:43:41.126157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.137428 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.148499 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.159609 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.170524 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.181621 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.192576 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:41.203515 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:41.322773 tst ping.py:19: start network... 08:43:41.525032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:41.991330 run create_hlr_db(pid=18393): Launched 08:43:42.105638 bus /gobi_6: Setting Powered False 08:43:43.165716 run create_hlr_db(pid=18393): Terminated: ok {rc=0} 08:43:43.606413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Launched 08:43:43.927416 run osmo-hlr_10.42.42.2(pid=18396): Launched 08:43:44.048911 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:44.605465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Launched 08:43:44.927429 run osmo-stp_10.42.42.5(pid=18399): Launched 08:43:45.048844 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:45.602186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18401): Launched 08:43:45.722841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:46.026263 run patchelf(pid=18402): Launched 08:43:46.214479 run osmo-stp_10.42.42.5(pid=18399): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] 08:43:46.347367 run osmo-stp_10.42.42.5(pid=18399): stdout: | (launched: 2022-12-10_08:43:44.864386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:46.498775 run osmo-stp_10.42.42.5(pid=18399): stderr: | 20221210084345060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084345060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084345060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084345061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084345063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084345063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084345063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:46.648313 run osmo-stp_10.42.42.5(pid=18399): stdout: | (launched: 2022-12-10_08:43:44.864386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:46.778594 run osmo-stp_10.42.42.5(pid=18399): stderr: | 20221210084345060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084345060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084345060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084345061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084345063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084345063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084345063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:46.932307 run patchelf(pid=18402): Terminating (SIGINT) 08:43:47.107771 run patchelf(pid=18402): Terminated: ok {rc=0} 08:43:47.235517 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18399): Process ended prematurely: osmo-stp_10.42.42.5(pid=18399) [trial-2372↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] [trial-2372↪gprs:trx-b200↪ping.py:22] 08:43:47.245191 tst ping.py:22: Test FAILED (6.7 sec) 08:43:47.275387 run osmo-hlr_10.42.42.2(pid=18396): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18396)] 08:43:47.328541 run osmo-hlr_10.42.42.2(pid=18396): stdout: | (launched: 2022-12-10_08:43:43.865780) 08:43:47.380822 run osmo-hlr_10.42.42.2(pid=18396): stderr: | 20221210084344065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084344065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084344065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084344065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084344065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084344065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084344111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084344120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084344121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084344121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:47.433311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Terminating (SIGTERM) 08:43:47.475518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Terminating (SIGTERM) 08:43:47.517861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18401): Terminating (SIGTERM) 08:43:47.560448 --- ParallelTerminationStrategy: PID 18395 died... 08:43:47.580567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18395): Terminated: ok {rc=0} 08:43:47.627495 --- ParallelTerminationStrategy: PID 18398 died... 08:43:47.647373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18398): Terminated: ok {rc=0} 08:43:47.694360 --- ParallelTerminationStrategy: PID 18401 died... 08:43:47.714071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18401): Terminated: ok {rc=0} 08:43:47.801752 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 08:43:48.890259 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:48.902343 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 08:43:48.954643 tst ping_idle_ping.py: using LAC 27208 08:43:49.081945 tst ping_idle_ping.py: using RAC 178 08:43:49.209438 tst ping_idle_ping.py: using CellId 27208 08:43:49.335673 tst ping_idle_ping.py: using BVCI 27209 08:43:49.452436 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.463487 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.474506 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.485657 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.496538 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.507635 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.518800 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 08:43:49.529968 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 08:43:49.646320 tst ping_idle_ping.py:24: start network... 08:43:49.862443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:43:50.364340 run create_hlr_db(pid=18403): Launched 08:43:50.493581 bus /gobi_6: Setting Powered False 08:43:51.556588 run create_hlr_db(pid=18403): Terminated: ok {rc=0} 08:43:51.988413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18405): Launched 08:43:52.292275 run osmo-hlr_10.42.42.2(pid=18406): Launched 08:43:52.407006 run osmo-stp_10.42.42.5: Starting osmo-stp 08:43:52.929350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18408): Launched 08:43:53.231650 run osmo-stp_10.42.42.5(pid=18409): Launched 08:43:53.345417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:43:53.864800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18411): Launched 08:43:53.979833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:43:54.237273 run patchelf(pid=18412): Launched 08:43:54.404671 run osmo-stp_10.42.42.5(pid=18409): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18409)] 08:43:54.531635 run osmo-stp_10.42.42.5(pid=18409): stdout: | (launched: 2022-12-10_08:43:53.173955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:54.659957 run osmo-stp_10.42.42.5(pid=18409): stderr: | 20221210084353345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084353345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084353345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084353346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084353348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084353348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084353348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:54.788537 run osmo-stp_10.42.42.5(pid=18409): stdout: | (launched: 2022-12-10_08:43:53.173955) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:43:54.911528 run osmo-stp_10.42.42.5(pid=18409): stderr: | 20221210084353345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084353345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084353345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084353346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084353348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084353348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084353348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:43:55.057954 run patchelf(pid=18412): Terminating (SIGINT) 08:43:55.226547 run patchelf(pid=18412): Terminated: ok {rc=0} 08:43:55.347827 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18409): Process ended prematurely: osmo-stp_10.42.42.5(pid=18409) [trial-2372↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18409)] [trial-2372↪gprs:trx-b200↪ping_idle_ping.py:27] 08:43:55.356631 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:43:55.383526 run osmo-hlr_10.42.42.2(pid=18406): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18406)] 08:43:55.430802 run osmo-hlr_10.42.42.2(pid=18406): stdout: | (launched: 2022-12-10_08:43:52.233163) 08:43:55.479727 run osmo-hlr_10.42.42.2(pid=18406): stderr: | 20221210084352410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084352411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084352411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084352411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084352411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084352411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084352422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084352431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084352431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084352431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:43:55.529398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18405): Terminating (SIGTERM) 08:43:55.568868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18408): Terminating (SIGTERM) 08:43:55.608154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18411): Terminating (SIGTERM) 08:43:55.647857 --- ParallelTerminationStrategy: PID 18405 died... 08:43:55.666863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18405): Terminated: ok {rc=0} 08:43:55.710934 --- ParallelTerminationStrategy: PID 18408 died... 08:43:55.729485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18408): Terminated: ok {rc=0} 08:43:55.773152 --- ParallelTerminationStrategy: PID 18411 died... 08:43:55.791935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18411): Terminated: ok {rc=0} 08:43:55.875518 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 08:43:57.189170 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:43:57.194796 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:43:57.229072 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:43:57.268549 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:43:57.356152 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:43:57.390073 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:43:57.429284 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:43:58.026755 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:43:58.079258 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.090716 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:43:58.141123 tst cs_paging_gprs_active.py: using LAC 27209 08:43:58.266725 tst cs_paging_gprs_active.py: using RAC 179 08:43:58.394060 tst cs_paging_gprs_active.py: using CellId 27209 08:43:58.512737 tst cs_paging_gprs_active.py: using BVCI 27210 08:43:58.623324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.634378 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.644811 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.655774 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.666775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.677737 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.688521 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.699235 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:43:58.710207 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:43:58.824578 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:43:58.944638 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:43:59.151095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:43:59.457519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Launched 08:43:59.722647 run iperf3-srv_10.42.42.10(pid=18418): Launched 08:43:59.837373 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:44:00.042329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:00.349648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Launched 08:44:00.615315 run iperf3-srv_10.42.42.10(pid=18420): Launched 08:44:00.730004 tst cs_paging_gprs_active.py:38: start network... 08:44:00.938098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:01.429047 run create_hlr_db(pid=18421): Launched 08:44:01.579587 bus /gobi_6: Setting Powered False 08:44:02.640668 run create_hlr_db(pid=18421): Terminated: ok {rc=0} 08:44:03.083989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18423): Launched 08:44:03.407630 run osmo-hlr_10.42.42.2(pid=18424): Launched 08:44:03.531914 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:04.088604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18426): Launched 08:44:04.412572 run osmo-stp_10.42.42.5(pid=18427): Launched 08:44:04.536467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:44:05.096449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18429): Launched 08:44:05.219950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:44:05.493740 run patchelf(pid=18430): Launched 08:44:05.672913 run osmo-stp_10.42.42.5(pid=18427): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18427)] 08:44:05.809940 run osmo-stp_10.42.42.5(pid=18427): stdout: | (launched: 2022-12-10_08:44:04.353892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:05.948399 run osmo-stp_10.42.42.5(pid=18427): stderr: | 20221210084404547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084404547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084404547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084404547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084404548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084404548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084404548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:06.086948 run osmo-stp_10.42.42.5(pid=18427): stdout: | (launched: 2022-12-10_08:44:04.353892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:06.220651 run osmo-stp_10.42.42.5(pid=18427): stderr: | 20221210084404547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084404547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084404547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084404547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084404548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084404548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084404548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:06.378525 run patchelf(pid=18430): Terminating (SIGINT) 08:44:06.560179 run patchelf(pid=18430): Terminated: ok {rc=0} 08:44:06.691448 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18427): Process ended prematurely: osmo-stp_10.42.42.5(pid=18427) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18427)] [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:44:06.701655 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:44:06.729604 run osmo-hlr_10.42.42.2(pid=18424): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18424)] 08:44:06.778804 run osmo-hlr_10.42.42.2(pid=18424): stdout: | (launched: 2022-12-10_08:44:03.349380) 08:44:06.829784 run osmo-hlr_10.42.42.2(pid=18424): stderr: | 20221210084403548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084403548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084403548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084403548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084403548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084403548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084403599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084403609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084403609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084403609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:06.881298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Terminating (SIGTERM) 08:44:06.922503 run iperf3-srv_10.42.42.10(pid=18418): Terminating (SIGTERM) 08:44:06.963758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Terminating (SIGTERM) 08:44:07.004708 run iperf3-srv_10.42.42.10(pid=18420): Terminating (SIGTERM) 08:44:07.045828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18423): Terminating (SIGTERM) 08:44:07.087041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18426): Terminating (SIGTERM) 08:44:07.128550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18429): Terminating (SIGTERM) 08:44:07.169820 --- ParallelTerminationStrategy: PID 18417 died... 08:44:07.189590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18417): Terminated: ok {rc=0} 08:44:07.235185 --- ParallelTerminationStrategy: PID 18418 died... 08:44:07.254361 run iperf3-srv_10.42.42.10(pid=18418): Terminated {rc=256} 08:44:07.299511 --- ParallelTerminationStrategy: PID 18419 died... 08:44:07.318845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18419): Terminated: ok {rc=0} 08:44:07.364150 --- ParallelTerminationStrategy: PID 18420 died... 08:44:07.383338 run iperf3-srv_10.42.42.10(pid=18420): Terminated {rc=256} 08:44:07.428509 --- ParallelTerminationStrategy: PID 18423 died... 08:44:07.447565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18423): Terminated: ok {rc=0} 08:44:07.493161 --- ParallelTerminationStrategy: PID 18426 died... 08:44:07.512343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18426): Terminated: ok {rc=0} 08:44:07.557691 --- ParallelTerminationStrategy: PID 18429 died... 08:44:07.577302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18429): Terminated: ok {rc=0} 08:44:07.663466 bus /gobi_0: Setting Powered False 08:44:08.762917 bus /gobi_0: Setting Powered False 08:44:09.876293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:44:11.024296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.036213 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:44:11.095850 tst iperf3.py: using LAC 27210 08:44:11.226655 tst iperf3.py: using RAC 180 08:44:11.352807 tst iperf3.py: using CellId 27210 08:44:11.478941 tst iperf3.py: using BVCI 27211 08:44:11.596861 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.608159 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.619163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.630622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.641864 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.652999 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.664329 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.675461 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:11.686804 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:11.806209 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:44:12.024775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:12.349612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18431): Launched 08:44:12.631036 run iperf3-srv_10.42.42.10(pid=18432): Launched 08:44:12.752266 tst iperf3.py:8: start network... 08:44:12.970537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:13.471130 run create_hlr_db(pid=18433): Launched 08:44:13.601497 bus /gobi_6: Setting Powered False 08:44:14.665216 run create_hlr_db(pid=18433): Terminated: ok {rc=0} 08:44:15.096846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Launched 08:44:15.400172 run osmo-hlr_10.42.42.2(pid=18436): Launched 08:44:15.517796 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:16.091747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Launched 08:44:16.437526 run osmo-stp_10.42.42.5(pid=18439): Launched 08:44:16.786692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:44:17.365125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18441): Launched 08:44:17.487464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:44:17.760056 run patchelf(pid=18442): Launched 08:44:17.939195 run osmo-stp_10.42.42.5(pid=18439): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] 08:44:18.075551 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-10_08:44:16.368169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:18.214514 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221210084416590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084416591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084416591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084416591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084416594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084416595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084416595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:18.352817 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-10_08:44:16.368169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:18.486188 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221210084416590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084416591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084416591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084416591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084416594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084416595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084416595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:18.643220 run patchelf(pid=18442): Terminating (SIGINT) 08:44:18.823710 run patchelf(pid=18442): Terminated: ok {rc=0} 08:44:18.954182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 08:44:18.964074 tst iperf3.py:8: Test FAILED (8.0 sec) 08:44:18.992433 run osmo-hlr_10.42.42.2(pid=18436): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18436)] 08:44:19.042412 run osmo-hlr_10.42.42.2(pid=18436): stdout: | (launched: 2022-12-10_08:44:15.344858) 08:44:19.094161 run osmo-hlr_10.42.42.2(pid=18436): stderr: | 20221210084415523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084415523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084415523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084415524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084415524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084415524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084415536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084415544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084415545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084415545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:19.146975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18431): Terminating (SIGTERM) 08:44:19.188821 run iperf3-srv_10.42.42.10(pid=18432): Terminating (SIGTERM) 08:44:19.230548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminating (SIGTERM) 08:44:19.272178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminating (SIGTERM) 08:44:19.314042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18441): Terminating (SIGTERM) 08:44:19.355988 --- ParallelTerminationStrategy: PID 18431 died... 08:44:19.376060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18431): Terminated: ok {rc=0} 08:44:19.422154 --- ParallelTerminationStrategy: PID 18432 died... 08:44:19.441442 run iperf3-srv_10.42.42.10(pid=18432): Terminated {rc=256} 08:44:19.487212 --- ParallelTerminationStrategy: PID 18435 died... 08:44:19.506559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminated: ok {rc=0} 08:44:19.552269 --- ParallelTerminationStrategy: PID 18438 died... 08:44:19.571692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminated: ok {rc=0} 08:44:19.617385 --- ParallelTerminationStrategy: PID 18441 died... 08:44:19.636993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18441): Terminated: ok {rc=0} 08:44:19.723939 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:44:20.870747 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:20.882211 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:44:20.933228 tst iperf3m4.py: using LAC 27211 08:44:21.054326 tst iperf3m4.py: using RAC 181 08:44:21.177212 tst iperf3m4.py: using CellId 27211 08:44:21.306352 tst iperf3m4.py: using BVCI 27212 08:44:21.426551 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.437987 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.448937 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.460445 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.471955 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.484537 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.496668 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.507615 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:21.518681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:21.635284 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:21.758045 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:21.875220 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:21.992901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:44:22.199401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:22.505632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Launched 08:44:22.770497 run iperf3-srv_10.42.42.10(pid=18445): Launched 08:44:22.884688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:44:23.089142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:23.393290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18446): Launched 08:44:23.656685 run iperf3-srv_10.42.42.10(pid=18447): Launched 08:44:23.770505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:44:23.974918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:24.280190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18448): Launched 08:44:24.545514 run iperf3-srv_10.42.42.10(pid=18449): Launched 08:44:24.659618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:44:24.863505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:25.169249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18450): Launched 08:44:25.433562 run iperf3-srv_10.42.42.10(pid=18451): Launched 08:44:25.547712 tst iperf3m4.py:8: start network... 08:44:25.752097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:26.225668 run create_hlr_db(pid=18452): Launched 08:44:26.347949 bus /gobi_6: Setting Powered False 08:44:27.409292 run create_hlr_db(pid=18452): Terminated: ok {rc=0} 08:44:27.852137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18454): Launched 08:44:28.176423 run osmo-hlr_10.42.42.2(pid=18455): Launched 08:44:28.300602 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:28.863404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18457): Launched 08:44:29.186904 run osmo-stp_10.42.42.5(pid=18458): Launched 08:44:29.310708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:44:29.869564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18460): Launched 08:44:29.992201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:44:30.265883 run patchelf(pid=18461): Launched 08:44:30.445417 run osmo-stp_10.42.42.5(pid=18458): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18458)] 08:44:30.582789 run osmo-stp_10.42.42.5(pid=18458): stdout: | (launched: 2022-12-10_08:44:29.127803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:30.720908 run osmo-stp_10.42.42.5(pid=18458): stderr: | 20221210084429320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084429320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084429320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084429321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084429323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084429323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084429323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:30.873608 run osmo-stp_10.42.42.5(pid=18458): stdout: | (launched: 2022-12-10_08:44:29.127803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:31.009861 run osmo-stp_10.42.42.5(pid=18458): stderr: | 20221210084429320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084429320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084429320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084429321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084429323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084429323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084429323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:31.212050 run patchelf(pid=18461): Terminating (SIGINT) 08:44:31.417868 run patchelf(pid=18461): Terminated: ok {rc=0} 08:44:31.553792 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18458): Process ended prematurely: osmo-stp_10.42.42.5(pid=18458) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18458)] [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 08:44:31.564267 tst iperf3m4.py:8: Test FAILED (10.7 sec) 08:44:31.594158 run osmo-hlr_10.42.42.2(pid=18455): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18455)] 08:44:31.645626 run osmo-hlr_10.42.42.2(pid=18455): stdout: | (launched: 2022-12-10_08:44:28.117606) 08:44:31.697821 run osmo-hlr_10.42.42.2(pid=18455): stderr: | 20221210084428320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084428320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084428320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084428320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084428320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084428320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084428332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084428341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084428341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084428341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:31.750643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Terminating (SIGTERM) 08:44:31.793708 run iperf3-srv_10.42.42.10(pid=18445): Terminating (SIGTERM) 08:44:31.838993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18446): Terminating (SIGTERM) 08:44:31.882716 run iperf3-srv_10.42.42.10(pid=18447): Terminating (SIGTERM) 08:44:31.927824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18448): Terminating (SIGTERM) 08:44:31.970958 run iperf3-srv_10.42.42.10(pid=18449): Terminating (SIGTERM) 08:44:32.017219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18450): Terminating (SIGTERM) 08:44:32.060658 run iperf3-srv_10.42.42.10(pid=18451): Terminating (SIGTERM) 08:44:32.107436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18454): Terminating (SIGTERM) 08:44:32.150773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18457): Terminating (SIGTERM) 08:44:32.193084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18460): Terminating (SIGTERM) 08:44:32.235622 --- ParallelTerminationStrategy: PID 18444 died... 08:44:32.256011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18444): Terminated: ok {rc=0} 08:44:32.302091 --- ParallelTerminationStrategy: PID 18445 died... 08:44:32.321448 run iperf3-srv_10.42.42.10(pid=18445): Terminated {rc=256} 08:44:32.367047 --- ParallelTerminationStrategy: PID 18446 died... 08:44:32.386632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18446): Terminated: ok {rc=0} 08:44:32.432075 --- ParallelTerminationStrategy: PID 18447 died... 08:44:32.451473 run iperf3-srv_10.42.42.10(pid=18447): Terminated {rc=256} 08:44:32.496821 --- ParallelTerminationStrategy: PID 18448 died... 08:44:32.516549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18448): Terminated: ok {rc=0} 08:44:32.562760 --- ParallelTerminationStrategy: PID 18449 died... 08:44:32.582368 run iperf3-srv_10.42.42.10(pid=18449): Terminated {rc=256} 08:44:32.628009 --- ParallelTerminationStrategy: PID 18450 died... 08:44:32.647302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18450): Terminated: ok {rc=0} 08:44:32.692909 --- ParallelTerminationStrategy: PID 18451 died... 08:44:32.712372 run iperf3-srv_10.42.42.10(pid=18451): Terminated {rc=256} 08:44:32.757927 --- ParallelTerminationStrategy: PID 18454 died... 08:44:32.777424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18454): Terminated: ok {rc=0} 08:44:32.823106 --- ParallelTerminationStrategy: PID 18457 died... 08:44:32.842610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18457): Terminated: ok {rc=0} 08:44:32.888394 --- ParallelTerminationStrategy: PID 18460 died... 08:44:32.907884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18460): Terminated: ok {rc=0} 08:44:32.994940 bus /gobi_4: Setting Powered False 08:44:34.094490 bus /gobi_4: Setting Powered False 08:44:35.209214 bus /gobi_1: Setting Powered False 08:44:36.304748 bus /gobi_1: Setting Powered False 08:44:37.419695 bus /gobi_0: Setting Powered False 08:44:38.518282 bus /gobi_0: Setting Powered False 08:44:39.634091 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 08:44:40.735054 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:40.746801 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:44:40.800171 tst ping.py: using LAC 27212 08:44:40.920545 tst ping.py: using RAC 182 08:44:41.038184 tst ping.py: using CellId 27212 08:44:41.159308 tst ping.py: using BVCI 27213 08:44:41.269993 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.280867 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.291482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.302369 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.313088 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.323850 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.334809 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:41.345727 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:41.462893 tst ping.py:19: start network... 08:44:41.676121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:42.167319 run create_hlr_db(pid=18462): Launched 08:44:42.296246 bus /gobi_6: Setting Powered False 08:44:43.359862 run create_hlr_db(pid=18462): Terminated: ok {rc=0} 08:44:43.802711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Launched 08:44:44.119381 run osmo-hlr_10.42.42.2(pid=18465): Launched 08:44:44.240742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:44.792309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Launched 08:44:45.108840 run osmo-stp_10.42.42.5(pid=18468): Launched 08:44:45.230948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:44:45.785206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18470): Launched 08:44:45.908700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:44:46.189790 run patchelf(pid=18471): Launched 08:44:46.375009 run osmo-stp_10.42.42.5(pid=18468): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] 08:44:46.512039 run osmo-stp_10.42.42.5(pid=18468): stdout: | (launched: 2022-12-10_08:44:45.051352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:46.650591 run osmo-stp_10.42.42.5(pid=18468): stderr: | 20221210084445246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084445246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084445246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084445247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084445247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084445247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084445247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:46.789283 run osmo-stp_10.42.42.5(pid=18468): stdout: | (launched: 2022-12-10_08:44:45.051352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:46.922056 run osmo-stp_10.42.42.5(pid=18468): stderr: | 20221210084445246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084445246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084445246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084445247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084445247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084445247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084445247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:47.079650 run patchelf(pid=18471): Terminating (SIGINT) 08:44:47.261996 run patchelf(pid=18471): Terminated: ok {rc=0} 08:44:47.390205 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18468): Process ended prematurely: osmo-stp_10.42.42.5(pid=18468) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 08:44:47.399583 tst ping.py:22: Test FAILED (6.7 sec) 08:44:47.427471 run osmo-hlr_10.42.42.2(pid=18465): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18465)] 08:44:47.477170 run osmo-hlr_10.42.42.2(pid=18465): stdout: | (launched: 2022-12-10_08:44:44.061866) 08:44:47.528596 run osmo-hlr_10.42.42.2(pid=18465): stderr: | 20221210084444261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084444261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084444261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084444261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084444261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084444261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084444274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084444282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084444282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084444282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:47.580440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminating (SIGTERM) 08:44:47.622015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminating (SIGTERM) 08:44:47.663394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18470): Terminating (SIGTERM) 08:44:47.705408 --- ParallelTerminationStrategy: PID 18464 died... 08:44:47.725316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18464): Terminated: ok {rc=0} 08:44:47.771046 --- ParallelTerminationStrategy: PID 18467 died... 08:44:47.790371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18467): Terminated: ok {rc=0} 08:44:47.835792 --- ParallelTerminationStrategy: PID 18470 died... 08:44:47.855077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18470): Terminated: ok {rc=0} 08:44:47.941749 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:44:49.028276 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.040556 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:44:49.093897 tst ping_idle_ping.py: using LAC 27213 08:44:49.220304 tst ping_idle_ping.py: using RAC 183 08:44:49.348230 tst ping_idle_ping.py: using CellId 27213 08:44:49.472314 tst ping_idle_ping.py: using BVCI 27214 08:44:49.587759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.599095 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.610181 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.621253 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.632266 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.643231 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.654432 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:44:49.665564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:44:49.782881 tst ping_idle_ping.py:24: start network... 08:44:49.996437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:44:50.489638 run create_hlr_db(pid=18472): Launched 08:44:50.618963 bus /gobi_6: Setting Powered False 08:44:51.681779 run create_hlr_db(pid=18472): Terminated: ok {rc=0} 08:44:52.109442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18474): Launched 08:44:52.409321 run osmo-hlr_10.42.42.2(pid=18475): Launched 08:44:52.524335 run osmo-stp_10.42.42.5: Starting osmo-stp 08:44:53.057354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18477): Launched 08:44:53.357576 run osmo-stp_10.42.42.5(pid=18478): Launched 08:44:53.471608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:44:54.002404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18480): Launched 08:44:54.116782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:44:54.369755 run patchelf(pid=18481): Launched 08:44:54.537247 run osmo-stp_10.42.42.5(pid=18478): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18478)] 08:44:54.664550 run osmo-stp_10.42.42.5(pid=18478): stdout: | (launched: 2022-12-10_08:44:53.302411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:54.793782 run osmo-stp_10.42.42.5(pid=18478): stderr: | 20221210084453473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084453473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084453474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084453474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084453474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084453475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084453475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:54.922896 run osmo-stp_10.42.42.5(pid=18478): stdout: | (launched: 2022-12-10_08:44:53.302411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:44:55.046183 run osmo-stp_10.42.42.5(pid=18478): stderr: | 20221210084453473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084453473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084453474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084453474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084453474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084453475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084453475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:44:55.192497 run patchelf(pid=18481): Terminating (SIGINT) 08:44:55.362104 run patchelf(pid=18481): Terminated: ok {rc=0} 08:44:55.484790 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18478): Process ended prematurely: osmo-stp_10.42.42.5(pid=18478) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18478)] [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 08:44:55.493681 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:44:55.520777 run osmo-hlr_10.42.42.2(pid=18475): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18475)] 08:44:55.568423 run osmo-hlr_10.42.42.2(pid=18475): stdout: | (launched: 2022-12-10_08:44:52.354703) 08:44:55.617866 run osmo-hlr_10.42.42.2(pid=18475): stderr: | 20221210084452528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084452528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084452528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084452528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084452528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084452528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084452540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084452551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084452551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084452551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:44:55.667985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18474): Terminating (SIGTERM) 08:44:55.707711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18477): Terminating (SIGTERM) 08:44:55.747634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18480): Terminating (SIGTERM) 08:44:55.788076 --- ParallelTerminationStrategy: PID 18474 died... 08:44:55.807231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18474): Terminated: ok {rc=0} 08:44:55.852106 --- ParallelTerminationStrategy: PID 18477 died... 08:44:55.870948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18477): Terminated: ok {rc=0} 08:44:55.915737 --- ParallelTerminationStrategy: PID 18480 died... 08:44:55.934490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18480): Terminated: ok {rc=0} 08:44:56.018019 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:44:57.321986 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:44:57.327893 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:44:57.361545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:44:57.399709 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:44:57.485566 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:44:57.518480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:44:57.556629 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:44:58.154127 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:44:58.205913 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.216824 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:44:58.287277 tst cs_paging_gprs_active.py: using LAC 27214 08:44:58.406192 tst cs_paging_gprs_active.py: using RAC 184 08:44:58.526314 tst cs_paging_gprs_active.py: using CellId 27214 08:44:58.646299 tst cs_paging_gprs_active.py: using BVCI 27215 08:44:58.759163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.770303 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.781221 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.792160 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.802896 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.814036 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.825161 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.836043 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:44:58.847163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:44:58.961613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:44:59.077659 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:44:59.284187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:44:59.594570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18485): Launched 08:44:59.862976 run iperf3-srv_10.42.42.10(pid=18486): Launched 08:44:59.977254 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:45:00.181826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:00.490530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18487): Launched 08:45:00.758263 run iperf3-srv_10.42.42.10(pid=18488): Launched 08:45:00.891618 tst cs_paging_gprs_active.py:38: start network... 08:45:01.118899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:01.645355 run create_hlr_db(pid=18489): Launched 08:45:01.766106 bus /gobi_6: Setting Powered False 08:45:02.826672 run create_hlr_db(pid=18489): Terminated: ok {rc=0} 08:45:03.281126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18501): Launched 08:45:03.607317 run osmo-hlr_10.42.42.2(pid=18502): Launched 08:45:03.729750 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:04.297555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18504): Launched 08:45:04.624792 run osmo-stp_10.42.42.5(pid=18505): Launched 08:45:04.747367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:05.311613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18507): Launched 08:45:05.435267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:05.714951 run patchelf(pid=18508): Launched 08:45:05.894606 run osmo-stp_10.42.42.5(pid=18505): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18505)] 08:45:06.031228 run osmo-stp_10.42.42.5(pid=18505): stdout: | (launched: 2022-12-10_08:45:04.561598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:06.170222 run osmo-stp_10.42.42.5(pid=18505): stderr: | 20221210084504760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084504760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084504760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084504761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084504761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084504761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084504761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:06.308675 run osmo-stp_10.42.42.5(pid=18505): stdout: | (launched: 2022-12-10_08:45:04.561598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:06.441526 run osmo-stp_10.42.42.5(pid=18505): stderr: | 20221210084504760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084504760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084504760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084504761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084504761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084504761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084504761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:06.598398 run patchelf(pid=18508): Terminating (SIGINT) 08:45:06.779581 run patchelf(pid=18508): Terminated: ok {rc=0} 08:45:06.910413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18505): Process ended prematurely: osmo-stp_10.42.42.5(pid=18505) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18505)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:45:06.920217 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:45:06.948401 run osmo-hlr_10.42.42.2(pid=18502): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18502)] 08:45:06.998205 run osmo-hlr_10.42.42.2(pid=18502): stdout: | (launched: 2022-12-10_08:45:03.544773) 08:45:07.049595 run osmo-hlr_10.42.42.2(pid=18502): stderr: | 20221210084503747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084503747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084503747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084503748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084503748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084503748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084503761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084503769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084503769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084503769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:07.101415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18485): Terminating (SIGTERM) 08:45:07.143406 run iperf3-srv_10.42.42.10(pid=18486): Terminating (SIGTERM) 08:45:07.185608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18487): Terminating (SIGTERM) 08:45:07.227470 run iperf3-srv_10.42.42.10(pid=18488): Terminating (SIGTERM) 08:45:07.270505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18501): Terminating (SIGTERM) 08:45:07.312292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18504): Terminating (SIGTERM) 08:45:07.353791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18507): Terminating (SIGTERM) 08:45:07.395118 --- ParallelTerminationStrategy: PID 18485 died... 08:45:07.414711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18485): Terminated: ok {rc=0} 08:45:07.461220 --- ParallelTerminationStrategy: PID 18486 died... 08:45:07.480489 run iperf3-srv_10.42.42.10(pid=18486): Terminated {rc=256} 08:45:07.526025 --- ParallelTerminationStrategy: PID 18487 died... 08:45:07.545390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18487): Terminated: ok {rc=0} 08:45:07.590813 --- ParallelTerminationStrategy: PID 18488 died... 08:45:07.610002 run iperf3-srv_10.42.42.10(pid=18488): Terminated {rc=256} 08:45:07.655468 --- ParallelTerminationStrategy: PID 18501 died... 08:45:07.674853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18501): Terminated: ok {rc=0} 08:45:07.720345 --- ParallelTerminationStrategy: PID 18504 died... 08:45:07.739711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18504): Terminated: ok {rc=0} 08:45:07.785341 --- ParallelTerminationStrategy: PID 18507 died... 08:45:07.804679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18507): Terminated: ok {rc=0} 08:45:07.891403 bus /gobi_0: Setting Powered False 08:45:08.990124 bus /gobi_0: Setting Powered False 08:45:10.106512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:45:11.251927 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.263309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:45:11.335232 tst iperf3.py: using LAC 27215 08:45:11.458034 tst iperf3.py: using RAC 185 08:45:11.577784 tst iperf3.py: using CellId 27215 08:45:11.697399 tst iperf3.py: using BVCI 27216 08:45:11.808185 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.818989 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.829667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.840545 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.851328 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.862246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.873585 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.884311 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:11.895802 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:12.013615 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:45:12.232561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:12.569716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18510): Launched 08:45:12.901287 run iperf3-srv_10.42.42.10(pid=18530): Launched 08:45:13.028165 tst iperf3.py:8: start network... 08:45:13.238380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:13.726334 run create_hlr_db(pid=18693): Launched 08:45:13.877438 bus /gobi_6: Setting Powered False 08:45:14.941740 run create_hlr_db(pid=18693): Terminated: ok {rc=0} 08:45:15.377353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Launched 08:45:15.685191 run osmo-hlr_10.42.42.2(pid=18867): Launched 08:45:15.801458 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:16.460323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Launched 08:45:16.868246 run osmo-stp_10.42.42.5(pid=18870): Launched 08:45:16.995145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:17.715312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Launched 08:45:17.832519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:18.094202 run patchelf(pid=18873): Launched 08:45:18.263504 run osmo-stp_10.42.42.5(pid=18870): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] 08:45:18.392083 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-10_08:45:16.797457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:18.523006 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221210084517166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084517166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084517167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084517167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084517171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084517172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084517173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:18.653566 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-10_08:45:16.797457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:18.779225 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221210084517166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084517166 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084517167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084517167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084517171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084517172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084517173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:18.927330 run patchelf(pid=18873): Terminating (SIGINT) 08:45:19.098441 run patchelf(pid=18873): Terminated: ok {rc=0} 08:45:19.221680 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 08:45:19.230874 tst iperf3.py:8: Test FAILED (8.0 sec) 08:45:19.258360 run osmo-hlr_10.42.42.2(pid=18867): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18867)] 08:45:19.306257 run osmo-hlr_10.42.42.2(pid=18867): stdout: | (launched: 2022-12-10_08:45:15.625711) 08:45:19.355811 run osmo-hlr_10.42.42.2(pid=18867): stderr: | 20221210084515806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084515806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084515806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084515806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084515806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084515806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084515819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084515837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084515838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084515838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:19.405928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18510): Terminating (SIGTERM) 08:45:19.445688 run iperf3-srv_10.42.42.10(pid=18530): Terminating (SIGTERM) 08:45:19.485717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminating (SIGTERM) 08:45:19.525567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminating (SIGTERM) 08:45:19.565322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminating (SIGTERM) 08:45:19.605825 --- ParallelTerminationStrategy: PID 18510 died... 08:45:19.624666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18510): Terminated: ok {rc=0} 08:45:19.668765 --- ParallelTerminationStrategy: PID 18530 died... 08:45:19.687205 run iperf3-srv_10.42.42.10(pid=18530): Terminated {rc=256} 08:45:19.731141 --- ParallelTerminationStrategy: PID 18866 died... 08:45:19.749602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminated: ok {rc=0} 08:45:19.793480 --- ParallelTerminationStrategy: PID 18869 died... 08:45:19.811958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminated: ok {rc=0} 08:45:19.855899 --- ParallelTerminationStrategy: PID 18872 died... 08:45:19.874322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminated: ok {rc=0} 08:45:19.959716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:45:21.107820 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.119227 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:45:21.188886 tst iperf3m4.py: using LAC 27216 08:45:21.309764 tst iperf3m4.py: using RAC 186 08:45:21.431592 tst iperf3m4.py: using CellId 27216 08:45:21.560122 tst iperf3m4.py: using BVCI 27217 08:45:21.678690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.690092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.701319 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.712917 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.724465 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.736124 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.747803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.759562 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:21.771289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:21.889228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:22.007528 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:22.126317 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:22.243476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:45:22.449486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:22.759206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Launched 08:45:23.032611 run iperf3-srv_10.42.42.10(pid=18876): Launched 08:45:23.170877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:45:23.382409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:23.725575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18978): Launched 08:45:24.014426 run iperf3-srv_10.42.42.10(pid=19051): Launched 08:45:24.150925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:45:24.374349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:24.713693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19053): Launched 08:45:25.015921 run iperf3-srv_10.42.42.10(pid=19054): Launched 08:45:25.152763 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:45:25.377307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:45:25.717536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19055): Launched 08:45:26.025514 run iperf3-srv_10.42.42.10(pid=19056): Launched 08:45:26.160359 tst iperf3m4.py:8: start network... 08:45:26.385543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:26.908024 run create_hlr_db(pid=19057): Launched 08:45:27.059277 bus /gobi_6: Setting Powered False 08:45:28.125668 run create_hlr_db(pid=19057): Terminated: ok {rc=0} 08:45:28.599591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Launched 08:45:28.957763 run osmo-hlr_10.42.42.2(pid=19061): Launched 08:45:29.115079 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:29.681676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Launched 08:45:30.007990 run osmo-stp_10.42.42.5(pid=19064): Launched 08:45:30.130582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:30.694722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Launched 08:45:30.818138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:31.126061 run patchelf(pid=19067): Launched 08:45:31.317136 run osmo-stp_10.42.42.5(pid=19064): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] 08:45:31.456284 run osmo-stp_10.42.42.5(pid=19064): stdout: | (launched: 2022-12-10_08:45:29.945307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:31.597875 run osmo-stp_10.42.42.5(pid=19064): stderr: | 20221210084530142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084530142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084530142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084530142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084530143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084530143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084530143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:31.739571 run osmo-stp_10.42.42.5(pid=19064): stdout: | (launched: 2022-12-10_08:45:29.945307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:31.875680 run osmo-stp_10.42.42.5(pid=19064): stderr: | 20221210084530142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084530142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084530142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084530142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084530143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084530143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084530143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:32.036541 run patchelf(pid=19067): Terminating (SIGINT) 08:45:32.222104 run patchelf(pid=19067): Terminated: ok {rc=0} 08:45:32.354181 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19064): Process ended prematurely: osmo-stp_10.42.42.5(pid=19064) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:45:32.364170 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:45:32.393095 run osmo-hlr_10.42.42.2(pid=19061): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19061)] 08:45:32.443399 run osmo-hlr_10.42.42.2(pid=19061): stdout: | (launched: 2022-12-10_08:45:28.886775) 08:45:32.495482 run osmo-hlr_10.42.42.2(pid=19061): stderr: | 20221210084529123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084529123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084529123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084529124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084529124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084529124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084529136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084529145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084529145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084529145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:32.547952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Terminating (SIGTERM) 08:45:32.589958 run iperf3-srv_10.42.42.10(pid=18876): Terminating (SIGTERM) 08:45:32.631818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18978): Terminating (SIGTERM) 08:45:32.673807 run iperf3-srv_10.42.42.10(pid=19051): Terminating (SIGTERM) 08:45:32.715420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19053): Terminating (SIGTERM) 08:45:32.757546 run iperf3-srv_10.42.42.10(pid=19054): Terminating (SIGTERM) 08:45:32.799379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19055): Terminating (SIGTERM) 08:45:32.841729 run iperf3-srv_10.42.42.10(pid=19056): Terminating (SIGTERM) 08:45:32.885090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Terminating (SIGTERM) 08:45:32.927054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Terminating (SIGTERM) 08:45:32.968755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Terminating (SIGTERM) 08:45:33.010730 --- ParallelTerminationStrategy: PID 18874 died... 08:45:33.030694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18874): Terminated: ok {rc=0} 08:45:33.077480 --- ParallelTerminationStrategy: PID 18876 died... 08:45:33.096886 run iperf3-srv_10.42.42.10(pid=18876): Terminated {rc=256} 08:45:33.142946 --- ParallelTerminationStrategy: PID 18978 died... 08:45:33.162387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18978): Terminated: ok {rc=0} 08:45:33.208653 --- ParallelTerminationStrategy: PID 19051 died... 08:45:33.228253 run iperf3-srv_10.42.42.10(pid=19051): Terminated {rc=256} 08:45:33.274100 --- ParallelTerminationStrategy: PID 19053 died... 08:45:33.293596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19053): Terminated: ok {rc=0} 08:45:33.339363 --- ParallelTerminationStrategy: PID 19054 died... 08:45:33.358794 run iperf3-srv_10.42.42.10(pid=19054): Terminated {rc=256} 08:45:33.404623 --- ParallelTerminationStrategy: PID 19055 died... 08:45:33.424045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19055): Terminated: ok {rc=0} 08:45:33.470086 --- ParallelTerminationStrategy: PID 19056 died... 08:45:33.489599 run iperf3-srv_10.42.42.10(pid=19056): Terminated {rc=256} 08:45:33.535237 --- ParallelTerminationStrategy: PID 19059 died... 08:45:33.554978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19059): Terminated: ok {rc=0} 08:45:33.600710 --- ParallelTerminationStrategy: PID 19063 died... 08:45:33.620316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19063): Terminated: ok {rc=0} 08:45:33.666145 --- ParallelTerminationStrategy: PID 19066 died... 08:45:33.685642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19066): Terminated: ok {rc=0} 08:45:33.772738 bus /gobi_4: Setting Powered False 08:45:34.869586 bus /gobi_4: Setting Powered False 08:45:35.983838 bus /gobi_1: Setting Powered False 08:45:37.081855 bus /gobi_1: Setting Powered False 08:45:38.197849 bus /gobi_0: Setting Powered False 08:45:39.295890 bus /gobi_0: Setting Powered False 08:45:40.411968 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:45:41.514241 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:41.525848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:45:41.595363 tst ping.py: using LAC 27217 08:45:41.720596 tst ping.py: using RAC 187 08:45:41.845110 tst ping.py: using CellId 27217 08:45:41.970899 tst ping.py: using BVCI 27218 08:45:42.088755 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.100200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.111391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.122555 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.133537 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.144596 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.155839 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:42.166982 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:42.287127 tst ping.py:19: start network... 08:45:42.501654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:42.998912 run create_hlr_db(pid=19068): Launched 08:45:43.127752 bus /gobi_6: Setting Powered False 08:45:44.191401 run create_hlr_db(pid=19068): Terminated: ok {rc=0} 08:45:44.639325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19070): Launched 08:45:44.960722 run osmo-hlr_10.42.42.2(pid=19071): Launched 08:45:45.082308 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:45.637564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19073): Launched 08:45:45.981665 run osmo-stp_10.42.42.5(pid=19074): Launched 08:45:46.273210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:46.848057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19076): Launched 08:45:46.973771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:47.246967 run patchelf(pid=19077): Launched 08:45:47.441810 run osmo-stp_10.42.42.5(pid=19074): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19074)] 08:45:47.576361 run osmo-stp_10.42.42.5(pid=19074): stdout: | (launched: 2022-12-10_08:45:45.912411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:47.712510 run osmo-stp_10.42.42.5(pid=19074): stderr: | 20221210084546127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084546127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084546128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084546129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084546130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084546130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084546130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:47.848631 run osmo-stp_10.42.42.5(pid=19074): stdout: | (launched: 2022-12-10_08:45:45.912411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:47.979086 run osmo-stp_10.42.42.5(pid=19074): stderr: | 20221210084546127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084546127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084546128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084546129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084546130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084546130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084546130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:48.133769 run patchelf(pid=19077): Terminating (SIGINT) 08:45:48.312569 run patchelf(pid=19077): Terminated: ok {rc=0} 08:45:48.441097 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19074): Process ended prematurely: osmo-stp_10.42.42.5(pid=19074) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19074)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 08:45:48.450387 tst ping.py:22: Test FAILED (6.9 sec) 08:45:48.478325 run osmo-hlr_10.42.42.2(pid=19071): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19071)] 08:45:48.528291 run osmo-hlr_10.42.42.2(pid=19071): stdout: | (launched: 2022-12-10_08:45:44.898968) 08:45:48.579900 run osmo-hlr_10.42.42.2(pid=19071): stderr: | 20221210084545102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084545102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084545102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084545102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084545102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084545102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084545114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084545122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084545123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084545123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:48.631935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19070): Terminating (SIGTERM) 08:45:48.673806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19073): Terminating (SIGTERM) 08:45:48.715790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19076): Terminating (SIGTERM) 08:45:48.757997 --- ParallelTerminationStrategy: PID 19070 died... 08:45:48.778056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19070): Terminated: ok {rc=0} 08:45:48.824219 --- ParallelTerminationStrategy: PID 19073 died... 08:45:48.843743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19073): Terminated: ok {rc=0} 08:45:48.889611 --- ParallelTerminationStrategy: PID 19076 died... 08:45:48.909109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19076): Terminated: ok {rc=0} 08:45:48.996696 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:45:50.083990 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.096340 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:45:50.169036 tst ping_idle_ping.py: using LAC 27218 08:45:50.294456 tst ping_idle_ping.py: using RAC 188 08:45:50.421274 tst ping_idle_ping.py: using CellId 27218 08:45:50.546026 tst ping_idle_ping.py: using BVCI 27219 08:45:50.661755 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.673232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.684390 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.695713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.706872 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.718069 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.729350 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:45:50.740511 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:45:50.859374 tst ping_idle_ping.py:24: start network... 08:45:51.076034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:45:51.583347 run create_hlr_db(pid=19078): Launched 08:45:51.711485 bus /gobi_6: Setting Powered False 08:45:52.775382 run create_hlr_db(pid=19078): Terminated: ok {rc=0} 08:45:53.206997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Launched 08:45:53.509948 run osmo-hlr_10.42.42.2(pid=19081): Launched 08:45:53.626200 run osmo-stp_10.42.42.5: Starting osmo-stp 08:45:54.152867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Launched 08:45:54.456915 run osmo-stp_10.42.42.5(pid=19084): Launched 08:45:54.572591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:45:55.093326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Launched 08:45:55.208036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:45:55.464258 run patchelf(pid=19087): Launched 08:45:55.630733 run osmo-stp_10.42.42.5(pid=19084): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] 08:45:55.757275 run osmo-stp_10.42.42.5(pid=19084): stdout: | (launched: 2022-12-10_08:45:54.398006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:55.885196 run osmo-stp_10.42.42.5(pid=19084): stderr: | 20221210084554571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084554571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084554571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084554572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084554572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084554572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084554572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:56.013239 run osmo-stp_10.42.42.5(pid=19084): stdout: | (launched: 2022-12-10_08:45:54.398006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:45:56.135865 run osmo-stp_10.42.42.5(pid=19084): stderr: | 20221210084554571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084554571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084554571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084554572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084554572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084554572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084554572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:45:56.281479 run patchelf(pid=19087): Terminating (SIGINT) 08:45:56.449565 run patchelf(pid=19087): Terminated: ok {rc=0} 08:45:56.570532 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19084): Process ended prematurely: osmo-stp_10.42.42.5(pid=19084) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:45:56.579342 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:45:56.606031 run osmo-hlr_10.42.42.2(pid=19081): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19081)] 08:45:56.653328 run osmo-hlr_10.42.42.2(pid=19081): stdout: | (launched: 2022-12-10_08:45:53.451659) 08:45:56.702315 run osmo-hlr_10.42.42.2(pid=19081): stderr: | 20221210084553628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084553628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084553628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084553628 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084553628 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084553628 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084553641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084553649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084553650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084553650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:45:56.751753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Terminating (SIGTERM) 08:45:56.791213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Terminating (SIGTERM) 08:45:56.830786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Terminating (SIGTERM) 08:45:56.870555 --- ParallelTerminationStrategy: PID 19080 died... 08:45:56.889283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19080): Terminated: ok {rc=0} 08:45:56.933171 --- ParallelTerminationStrategy: PID 19083 died... 08:45:56.951399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19083): Terminated: ok {rc=0} 08:45:56.994942 --- ParallelTerminationStrategy: PID 19086 died... 08:45:57.013175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19086): Terminated: ok {rc=0} 08:45:57.097551 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:45:58.398213 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:45:58.405181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:45:58.441090 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:45:58.481181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:45:58.570287 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:45:58.604635 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:45:58.644385 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:45:59.245568 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:45:59.298972 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.310495 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:45:59.381440 tst cs_paging_gprs_active.py: using LAC 27219 08:45:59.506410 tst cs_paging_gprs_active.py: using RAC 189 08:45:59.634800 tst cs_paging_gprs_active.py: using CellId 27219 08:45:59.762884 tst cs_paging_gprs_active.py: using BVCI 27220 08:45:59.882543 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.893780 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.904854 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.916480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.927880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.941233 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.952102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.963154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:45:59.974137 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:00.095123 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:00.217425 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:46:00.436307 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:00.760706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19091): Launched 08:46:01.062695 run iperf3-srv_10.42.42.10(pid=19092): Launched 08:46:01.191301 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:46:01.444104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:01.771916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19093): Launched 08:46:02.065763 run iperf3-srv_10.42.42.10(pid=19094): Launched 08:46:02.191885 tst cs_paging_gprs_active.py:38: start network... 08:46:02.398778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:02.875194 run create_hlr_db(pid=19095): Launched 08:46:02.992878 bus /gobi_6: Setting Powered False 08:46:04.053461 run create_hlr_db(pid=19095): Terminated: ok {rc=0} 08:46:04.496028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Launched 08:46:04.819108 run osmo-hlr_10.42.42.2(pid=19098): Launched 08:46:04.942098 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:05.499291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Launched 08:46:05.822792 run osmo-stp_10.42.42.5(pid=19101): Launched 08:46:05.946258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:06.505524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19103): Launched 08:46:06.628666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:06.902440 run patchelf(pid=19104): Launched 08:46:07.081843 run osmo-stp_10.42.42.5(pid=19101): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] 08:46:07.219272 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-10_08:46:05.764301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:07.358393 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221210084605956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084605956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084605956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084605957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084605959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084605959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084605959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:07.497167 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-10_08:46:05.764301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:07.629774 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221210084605956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084605956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084605956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084605957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084605959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084605959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084605959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:07.787132 run patchelf(pid=19104): Terminating (SIGINT) 08:46:07.969505 run patchelf(pid=19104): Terminated: ok {rc=0} 08:46:08.100439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:46:08.110530 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 08:46:08.138638 run osmo-hlr_10.42.42.2(pid=19098): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19098)] 08:46:08.188871 run osmo-hlr_10.42.42.2(pid=19098): stdout: | (launched: 2022-12-10_08:46:04.760793) 08:46:08.240451 run osmo-hlr_10.42.42.2(pid=19098): stderr: | 20221210084604958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084604958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084604958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084604958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084604958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084604959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084604971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084604980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084604980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084604980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:08.292454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19091): Terminating (SIGTERM) 08:46:08.334260 run iperf3-srv_10.42.42.10(pid=19092): Terminating (SIGTERM) 08:46:08.375744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19093): Terminating (SIGTERM) 08:46:08.417241 run iperf3-srv_10.42.42.10(pid=19094): Terminating (SIGTERM) 08:46:08.458904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminating (SIGTERM) 08:46:08.500577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminating (SIGTERM) 08:46:08.542378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19103): Terminating (SIGTERM) 08:46:08.584202 --- ParallelTerminationStrategy: PID 19091 died... 08:46:08.603998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19091): Terminated: ok {rc=0} 08:46:08.650287 --- ParallelTerminationStrategy: PID 19092 died... 08:46:08.669652 run iperf3-srv_10.42.42.10(pid=19092): Terminated {rc=256} 08:46:08.715089 --- ParallelTerminationStrategy: PID 19093 died... 08:46:08.734437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19093): Terminated: ok {rc=0} 08:46:08.779867 --- ParallelTerminationStrategy: PID 19094 died... 08:46:08.799188 run iperf3-srv_10.42.42.10(pid=19094): Terminated {rc=256} 08:46:08.844533 --- ParallelTerminationStrategy: PID 19097 died... 08:46:08.863865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminated: ok {rc=0} 08:46:08.909512 --- ParallelTerminationStrategy: PID 19100 died... 08:46:08.928856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminated: ok {rc=0} 08:46:08.974394 --- ParallelTerminationStrategy: PID 19103 died... 08:46:08.993790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19103): Terminated: ok {rc=0} 08:46:09.080189 bus /gobi_0: Setting Powered False 08:46:10.178998 bus /gobi_0: Setting Powered False 08:46:11.296353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:46:12.442842 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:12.454283 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:12.527221 tst iperf3.py: using LAC 27220 08:46:12.648849 tst iperf3.py: using RAC 190 08:46:12.769727 tst iperf3.py: using CellId 27220 08:46:12.890114 tst iperf3.py: using BVCI 27221 08:46:13.001632 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.012394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.023060 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.034601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.045950 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.057437 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.068886 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.080044 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:13.091445 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:13.211041 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:46:13.430695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:13.754957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Launched 08:46:14.035451 run iperf3-srv_10.42.42.10(pid=19106): Launched 08:46:14.156679 tst iperf3.py:8: start network... 08:46:14.375158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:14.875679 run create_hlr_db(pid=19107): Launched 08:46:15.006756 bus /gobi_6: Setting Powered False 08:46:16.069984 run create_hlr_db(pid=19107): Terminated: ok {rc=0} 08:46:16.545850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19109): Launched 08:46:16.885698 run osmo-hlr_10.42.42.2(pid=19110): Launched 08:46:17.019078 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:17.604312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19112): Launched 08:46:17.927337 run osmo-stp_10.42.42.5(pid=19113): Launched 08:46:18.050000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:18.609109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19115): Launched 08:46:18.731786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:19.005033 run patchelf(pid=19116): Launched 08:46:19.184456 run osmo-stp_10.42.42.5(pid=19113): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19113)] 08:46:19.321884 run osmo-stp_10.42.42.5(pid=19113): stdout: | (launched: 2022-12-10_08:46:17.868727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:19.461178 run osmo-stp_10.42.42.5(pid=19113): stderr: | 20221210084618062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084618062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084618063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084618063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084618064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084618064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084618064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:19.599798 run osmo-stp_10.42.42.5(pid=19113): stdout: | (launched: 2022-12-10_08:46:17.868727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:19.733039 run osmo-stp_10.42.42.5(pid=19113): stderr: | 20221210084618062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084618062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084618063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084618063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084618064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084618064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084618064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:19.890915 run patchelf(pid=19116): Terminating (SIGINT) 08:46:20.071859 run patchelf(pid=19116): Terminated: ok {rc=0} 08:46:20.202866 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19113): Process ended prematurely: osmo-stp_10.42.42.5(pid=19113) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19113)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 08:46:20.212862 tst iperf3.py:8: Test FAILED (7.8 sec) 08:46:20.241284 run osmo-hlr_10.42.42.2(pid=19110): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19110)] 08:46:20.290793 run osmo-hlr_10.42.42.2(pid=19110): stdout: | (launched: 2022-12-10_08:46:16.817239) 08:46:20.342230 run osmo-hlr_10.42.42.2(pid=19110): stderr: | 20221210084617214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084617214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084617214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084617214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084617214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084617215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084617227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084617235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084617235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084617235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:20.394175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Terminating (SIGTERM) 08:46:20.435582 run iperf3-srv_10.42.42.10(pid=19106): Terminating (SIGTERM) 08:46:20.477139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19109): Terminating (SIGTERM) 08:46:20.518650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19112): Terminating (SIGTERM) 08:46:20.560339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19115): Terminating (SIGTERM) 08:46:20.601916 --- ParallelTerminationStrategy: PID 19105 died... 08:46:20.621590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19105): Terminated: ok {rc=0} 08:46:20.667468 --- ParallelTerminationStrategy: PID 19106 died... 08:46:20.686898 run iperf3-srv_10.42.42.10(pid=19106): Terminated {rc=256} 08:46:20.732725 --- ParallelTerminationStrategy: PID 19109 died... 08:46:20.752164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19109): Terminated: ok {rc=0} 08:46:20.797619 --- ParallelTerminationStrategy: PID 19112 died... 08:46:20.817029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19112): Terminated: ok {rc=0} 08:46:20.862350 --- ParallelTerminationStrategy: PID 19115 died... 08:46:20.881766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19115): Terminated: ok {rc=0} 08:46:20.968174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:46:22.117834 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.129896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:22.202940 tst iperf3m4.py: using LAC 27221 08:46:22.332001 tst iperf3m4.py: using RAC 191 08:46:22.464770 tst iperf3m4.py: using CellId 27221 08:46:22.591517 tst iperf3m4.py: using BVCI 27222 08:46:22.711712 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.723240 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.734569 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.745957 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.757332 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.768676 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.779954 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.791209 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:22.802744 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:22.921103 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:23.042554 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:23.159493 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:23.278465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:46:23.499223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:23.824416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Launched 08:46:24.105033 run iperf3-srv_10.42.42.10(pid=19118): Launched 08:46:24.226683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:46:24.445600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:24.769717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Launched 08:46:25.050116 run iperf3-srv_10.42.42.10(pid=19120): Launched 08:46:25.171087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:46:25.389929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:25.715244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19121): Launched 08:46:25.995758 run iperf3-srv_10.42.42.10(pid=19122): Launched 08:46:26.116901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:46:26.336122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:46:26.660263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19123): Launched 08:46:26.940805 run iperf3-srv_10.42.42.10(pid=19124): Launched 08:46:27.061522 tst iperf3m4.py:8: start network... 08:46:27.279951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:27.782621 run create_hlr_db(pid=19125): Launched 08:46:27.913236 bus /gobi_6: Setting Powered False 08:46:28.977412 run create_hlr_db(pid=19125): Terminated: ok {rc=0} 08:46:29.428253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19127): Launched 08:46:29.751908 run osmo-hlr_10.42.42.2(pid=19128): Launched 08:46:29.875380 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:30.432382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19130): Launched 08:46:30.754731 run osmo-stp_10.42.42.5(pid=19131): Launched 08:46:30.935718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:31.662788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19133): Launched 08:46:31.794589 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:32.081683 run patchelf(pid=19134): Launched 08:46:32.266741 run osmo-stp_10.42.42.5(pid=19131): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19131)] 08:46:32.397669 run osmo-stp_10.42.42.5(pid=19131): stdout: | (launched: 2022-12-10_08:46:30.695999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:32.530343 run osmo-stp_10.42.42.5(pid=19131): stderr: | 20221210084630957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084630957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084630958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084630958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084630958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084630959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084630959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:32.661524 run osmo-stp_10.42.42.5(pid=19131): stdout: | (launched: 2022-12-10_08:46:30.695999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:32.787598 run osmo-stp_10.42.42.5(pid=19131): stderr: | 20221210084630957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084630957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084630958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084630958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084630958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084630959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084630959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:32.936655 run patchelf(pid=19134): Terminating (SIGINT) 08:46:33.107899 run patchelf(pid=19134): Terminated: ok {rc=0} 08:46:33.231641 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19131): Process ended prematurely: osmo-stp_10.42.42.5(pid=19131) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19131)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:46:33.241230 tst iperf3m4.py:8: Test FAILED (11.2 sec) 08:46:33.269480 run osmo-hlr_10.42.42.2(pid=19128): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19128)] 08:46:33.317796 run osmo-hlr_10.42.42.2(pid=19128): stdout: | (launched: 2022-12-10_08:46:29.692865) 08:46:33.367861 run osmo-hlr_10.42.42.2(pid=19128): stderr: | 20221210084629891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084629891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084629891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084629891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084629891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084629891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084629903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084629912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084629912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084629912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:33.418351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Terminating (SIGTERM) 08:46:33.458723 run iperf3-srv_10.42.42.10(pid=19118): Terminating (SIGTERM) 08:46:33.499064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Terminating (SIGTERM) 08:46:33.540078 run iperf3-srv_10.42.42.10(pid=19120): Terminating (SIGTERM) 08:46:33.580294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19121): Terminating (SIGTERM) 08:46:33.620603 run iperf3-srv_10.42.42.10(pid=19122): Terminating (SIGTERM) 08:46:33.661025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19123): Terminating (SIGTERM) 08:46:33.701931 run iperf3-srv_10.42.42.10(pid=19124): Terminating (SIGTERM) 08:46:33.742152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19127): Terminating (SIGTERM) 08:46:33.782887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19130): Terminating (SIGTERM) 08:46:33.823281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19133): Terminating (SIGTERM) 08:46:33.863785 --- ParallelTerminationStrategy: PID 19117 died... 08:46:33.882519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19117): Terminated: ok {rc=0} 08:46:33.927406 --- ParallelTerminationStrategy: PID 19118 died... 08:46:33.946162 run iperf3-srv_10.42.42.10(pid=19118): Terminated {rc=256} 08:46:33.990962 --- ParallelTerminationStrategy: PID 19119 died... 08:46:34.009785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19119): Terminated: ok {rc=0} 08:46:34.054922 --- ParallelTerminationStrategy: PID 19120 died... 08:46:34.073690 run iperf3-srv_10.42.42.10(pid=19120): Terminated {rc=256} 08:46:34.118236 --- ParallelTerminationStrategy: PID 19121 died... 08:46:34.136942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19121): Terminated: ok {rc=0} 08:46:34.181696 --- ParallelTerminationStrategy: PID 19122 died... 08:46:34.200450 run iperf3-srv_10.42.42.10(pid=19122): Terminated {rc=256} 08:46:34.245066 --- ParallelTerminationStrategy: PID 19123 died... 08:46:34.263836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19123): Terminated: ok {rc=0} 08:46:34.308717 --- ParallelTerminationStrategy: PID 19124 died... 08:46:34.327574 run iperf3-srv_10.42.42.10(pid=19124): Terminated {rc=256} 08:46:34.372285 --- ParallelTerminationStrategy: PID 19127 died... 08:46:34.391049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19127): Terminated: ok {rc=0} 08:46:34.435804 --- ParallelTerminationStrategy: PID 19130 died... 08:46:34.454737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19130): Terminated: ok {rc=0} 08:46:34.499436 --- ParallelTerminationStrategy: PID 19133 died... 08:46:34.518335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19133): Terminated: ok {rc=0} 08:46:34.604752 bus /gobi_4: Setting Powered False 08:46:35.704659 bus /gobi_4: Setting Powered False 08:46:36.820813 bus /gobi_1: Setting Powered False 08:46:37.919950 bus /gobi_1: Setting Powered False 08:46:39.034253 bus /gobi_0: Setting Powered False 08:46:40.133337 bus /gobi_0: Setting Powered False 08:46:41.249975 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:46:42.352313 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.363665 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:42.434252 tst ping.py: using LAC 27222 08:46:42.565591 tst ping.py: using RAC 192 08:46:42.684707 tst ping.py: using CellId 27222 08:46:42.800528 tst ping.py: using BVCI 27223 08:46:42.909324 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.920457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.931091 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.942171 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.953048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.963931 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.974959 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:42.986017 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:43.104752 tst ping.py:19: start network... 08:46:43.320082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:43.813376 run create_hlr_db(pid=19135): Launched 08:46:43.943015 bus /gobi_6: Setting Powered False 08:46:45.006093 run create_hlr_db(pid=19135): Terminated: ok {rc=0} 08:46:45.449425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Launched 08:46:45.767147 run osmo-hlr_10.42.42.2(pid=19138): Launched 08:46:45.953594 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:46.699125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Launched 08:46:47.105227 run osmo-stp_10.42.42.5(pid=19141): Launched 08:46:47.261855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:47.958492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19143): Launched 08:46:48.072672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:48.324175 run patchelf(pid=19144): Launched 08:46:48.490571 run osmo-stp_10.42.42.5(pid=19141): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] 08:46:48.617222 run osmo-stp_10.42.42.5(pid=19141): stdout: | (launched: 2022-12-10_08:46:47.030246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:48.745290 run osmo-stp_10.42.42.5(pid=19141): stderr: | 20221210084647373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084647374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084647374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084647374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084647375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084647375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084647375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:48.873492 run osmo-stp_10.42.42.5(pid=19141): stdout: | (launched: 2022-12-10_08:46:47.030246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:48.996434 run osmo-stp_10.42.42.5(pid=19141): stderr: | 20221210084647373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084647374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084647374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084647374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084647375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084647375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084647375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:49.142159 run patchelf(pid=19144): Terminating (SIGINT) 08:46:49.310219 run patchelf(pid=19144): Terminated: ok {rc=0} 08:46:49.431266 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19141): Process ended prematurely: osmo-stp_10.42.42.5(pid=19141) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 08:46:49.440018 tst ping.py:22: Test FAILED (7.1 sec) 08:46:49.466444 run osmo-hlr_10.42.42.2(pid=19138): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19138)] 08:46:49.514369 run osmo-hlr_10.42.42.2(pid=19138): stdout: | (launched: 2022-12-10_08:46:45.709526) 08:46:49.563383 run osmo-hlr_10.42.42.2(pid=19138): stderr: | 20221210084645945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084645945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084645945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084645945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084645945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084645945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084645967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084645988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084645988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084645988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:49.613397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminating (SIGTERM) 08:46:49.653060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Terminating (SIGTERM) 08:46:49.692427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19143): Terminating (SIGTERM) 08:46:49.731944 --- ParallelTerminationStrategy: PID 19137 died... 08:46:49.750987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminated: ok {rc=0} 08:46:49.794597 --- ParallelTerminationStrategy: PID 19140 died... 08:46:49.812683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19140): Terminated: ok {rc=0} 08:46:49.856126 --- ParallelTerminationStrategy: PID 19143 died... 08:46:49.874413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19143): Terminated: ok {rc=0} 08:46:49.957254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:46:51.044135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.056477 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:46:51.130218 tst ping_idle_ping.py: using LAC 27223 08:46:51.257550 tst ping_idle_ping.py: using RAC 193 08:46:51.379196 tst ping_idle_ping.py: using CellId 27223 08:46:51.497392 tst ping_idle_ping.py: using BVCI 27224 08:46:51.606945 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.617730 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.628355 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.639233 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.650088 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.661057 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.671993 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:46:51.682835 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:46:51.797191 tst ping_idle_ping.py:24: start network... 08:46:51.999994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:46:52.468054 run create_hlr_db(pid=19145): Launched 08:46:52.582764 bus /gobi_6: Setting Powered False 08:46:53.642112 run create_hlr_db(pid=19145): Terminated: ok {rc=0} 08:46:54.080426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Launched 08:46:54.399634 run osmo-hlr_10.42.42.2(pid=19148): Launched 08:46:54.521696 run osmo-stp_10.42.42.5: Starting osmo-stp 08:46:55.071447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Launched 08:46:55.389872 run osmo-stp_10.42.42.5(pid=19151): Launched 08:46:55.511018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:46:56.061405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Launched 08:46:56.182610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:46:56.451972 run patchelf(pid=19154): Launched 08:46:56.629100 run osmo-stp_10.42.42.5(pid=19151): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] 08:46:56.763887 run osmo-stp_10.42.42.5(pid=19151): stdout: | (launched: 2022-12-10_08:46:55.332077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:56.900285 run osmo-stp_10.42.42.5(pid=19151): stderr: | 20221210084655524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084655524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084655525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084655525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084655525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084655526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084655526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:57.036216 run osmo-stp_10.42.42.5(pid=19151): stdout: | (launched: 2022-12-10_08:46:55.332077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:46:57.167046 run osmo-stp_10.42.42.5(pid=19151): stderr: | 20221210084655524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084655524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084655525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084655525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084655525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084655526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084655526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:46:57.322326 run patchelf(pid=19154): Terminating (SIGINT) 08:46:57.500906 run patchelf(pid=19154): Terminated: ok {rc=0} 08:46:57.629502 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19151): Process ended prematurely: osmo-stp_10.42.42.5(pid=19151) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:46:57.638802 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:46:57.666604 run osmo-hlr_10.42.42.2(pid=19148): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19148)] 08:46:57.716246 run osmo-hlr_10.42.42.2(pid=19148): stdout: | (launched: 2022-12-10_08:46:54.341893) 08:46:57.767386 run osmo-hlr_10.42.42.2(pid=19148): stderr: | 20221210084654541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084654541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084654541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084654542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084654542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084654542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084654555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084654563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084654563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084654563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:46:57.818808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Terminating (SIGTERM) 08:46:57.859993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Terminating (SIGTERM) 08:46:57.901228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Terminating (SIGTERM) 08:46:57.942657 --- ParallelTerminationStrategy: PID 19147 died... 08:46:57.962326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19147): Terminated: ok {rc=0} 08:46:58.007878 --- ParallelTerminationStrategy: PID 19150 died... 08:46:58.026932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19150): Terminated: ok {rc=0} 08:46:58.072732 --- ParallelTerminationStrategy: PID 19153 died... 08:46:58.092186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19153): Terminated: ok {rc=0} 08:46:58.179275 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:46:59.491670 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:46:59.498763 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:46:59.532888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:46:59.572297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:46:59.660129 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:46:59.694355 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:46:59.734097 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:47:00.330995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:47:00.382442 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.393785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:00.446798 tst cs_paging_gprs_active.py: using LAC 27224 08:47:00.574513 tst cs_paging_gprs_active.py: using RAC 194 08:47:00.699580 tst cs_paging_gprs_active.py: using CellId 27224 08:47:00.820621 tst cs_paging_gprs_active.py: using BVCI 27225 08:47:00.936439 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.948324 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.959979 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.973330 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.985839 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:00.997606 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:01.010097 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:01.023498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:01.036181 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:01.165186 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:01.304393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:47:01.532597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:01.882002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19159): Launched 08:47:02.186105 run iperf3-srv_10.42.42.10(pid=19160): Launched 08:47:02.311813 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:47:02.532549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:02.864175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19161): Launched 08:47:03.151750 run iperf3-srv_10.42.42.10(pid=19162): Launched 08:47:03.274076 tst cs_paging_gprs_active.py:38: start network... 08:47:03.494207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:04.003521 run create_hlr_db(pid=19163): Launched 08:47:04.135045 bus /gobi_6: Setting Powered False 08:47:05.199232 run create_hlr_db(pid=19163): Terminated: ok {rc=0} 08:47:05.639014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19165): Launched 08:47:05.949064 run osmo-hlr_10.42.42.2(pid=19166): Launched 08:47:06.065866 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:06.611009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19168): Launched 08:47:06.921061 run osmo-stp_10.42.42.5(pid=19169): Launched 08:47:07.037630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:07.569586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19171): Launched 08:47:07.686857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:07.949683 run patchelf(pid=19172): Launched 08:47:08.119161 run osmo-stp_10.42.42.5(pid=19169): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19169)] 08:47:08.249194 run osmo-stp_10.42.42.5(pid=19169): stdout: | (launched: 2022-12-10_08:47:06.861210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:08.380615 run osmo-stp_10.42.42.5(pid=19169): stderr: | 20221210084707036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084707036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084707036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084707036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084707037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084707037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084707037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:08.511894 run osmo-stp_10.42.42.5(pid=19169): stdout: | (launched: 2022-12-10_08:47:06.861210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:08.638292 run osmo-stp_10.42.42.5(pid=19169): stderr: | 20221210084707036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084707036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084707036 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084707036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084707037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084707037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084707037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:08.787360 run patchelf(pid=19172): Terminating (SIGINT) 08:47:08.959300 run patchelf(pid=19172): Terminated: ok {rc=0} 08:47:09.083225 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19169): Process ended prematurely: osmo-stp_10.42.42.5(pid=19169) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19169)] [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:47:09.092510 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:47:09.119436 run osmo-hlr_10.42.42.2(pid=19166): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19166)] 08:47:09.168816 run osmo-hlr_10.42.42.2(pid=19166): stdout: | (launched: 2022-12-10_08:47:05.889871) 08:47:09.218808 run osmo-hlr_10.42.42.2(pid=19166): stderr: | 20221210084706070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084706070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084706070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084706070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084706070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084706070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084706083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084706091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084706092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084706092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:09.269362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19159): Terminating (SIGTERM) 08:47:09.309965 run iperf3-srv_10.42.42.10(pid=19160): Terminating (SIGTERM) 08:47:09.350525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19161): Terminating (SIGTERM) 08:47:09.391225 run iperf3-srv_10.42.42.10(pid=19162): Terminating (SIGTERM) 08:47:09.431633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19165): Terminating (SIGTERM) 08:47:09.472267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19168): Terminating (SIGTERM) 08:47:09.512661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19171): Terminating (SIGTERM) 08:47:09.553488 --- ParallelTerminationStrategy: PID 19159 died... 08:47:09.572476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19159): Terminated: ok {rc=0} 08:47:09.617914 --- ParallelTerminationStrategy: PID 19160 died... 08:47:09.636357 run iperf3-srv_10.42.42.10(pid=19160): Terminated {rc=256} 08:47:09.681462 --- ParallelTerminationStrategy: PID 19161 died... 08:47:09.700069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19161): Terminated: ok {rc=0} 08:47:09.745450 --- ParallelTerminationStrategy: PID 19162 died... 08:47:09.763953 run iperf3-srv_10.42.42.10(pid=19162): Terminated {rc=256} 08:47:09.809341 --- ParallelTerminationStrategy: PID 19165 died... 08:47:09.827914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19165): Terminated: ok {rc=0} 08:47:09.873233 --- ParallelTerminationStrategy: PID 19168 died... 08:47:09.891642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19168): Terminated: ok {rc=0} 08:47:09.937028 --- ParallelTerminationStrategy: PID 19171 died... 08:47:09.955655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19171): Terminated: ok {rc=0} 08:47:10.043242 bus /gobi_0: Setting Powered False 08:47:11.142020 bus /gobi_0: Setting Powered False 08:47:12.257786 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:47:13.404572 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:13.416377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:13.475354 tst iperf3.py: using LAC 27225 08:47:13.594330 tst iperf3.py: using RAC 195 08:47:13.716892 tst iperf3.py: using CellId 27225 08:47:13.836446 tst iperf3.py: using BVCI 27226 08:47:13.948015 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:13.959283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:13.970409 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:13.981753 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:13.992813 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:14.004076 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:14.015394 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:14.026592 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:14.038054 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:14.158752 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:14.378929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:14.709668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19173): Launched 08:47:14.996848 run iperf3-srv_10.42.42.10(pid=19174): Launched 08:47:15.118131 tst iperf3.py:8: start network... 08:47:15.338012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:15.858644 run create_hlr_db(pid=19175): Launched 08:47:16.022552 bus /gobi_6: Setting Powered False 08:47:17.098952 run create_hlr_db(pid=19175): Terminated: ok {rc=0} 08:47:17.577680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Launched 08:47:17.887449 run osmo-hlr_10.42.42.2(pid=19178): Launched 08:47:18.004085 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:18.550059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Launched 08:47:18.860046 run osmo-stp_10.42.42.5(pid=19181): Launched 08:47:18.976778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:19.506581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19183): Launched 08:47:19.622806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:19.885104 run patchelf(pid=19184): Launched 08:47:20.054896 run osmo-stp_10.42.42.5(pid=19181): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] 08:47:20.184107 run osmo-stp_10.42.42.5(pid=19181): stdout: | (launched: 2022-12-10_08:47:18.800038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:20.315151 run osmo-stp_10.42.42.5(pid=19181): stderr: | 20221210084718974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084718974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084718974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084718975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084718975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084718975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084718975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:20.446449 run osmo-stp_10.42.42.5(pid=19181): stdout: | (launched: 2022-12-10_08:47:18.800038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:20.572047 run osmo-stp_10.42.42.5(pid=19181): stderr: | 20221210084718974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084718974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084718974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084718975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084718975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084718975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084718975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:20.720802 run patchelf(pid=19184): Terminating (SIGINT) 08:47:20.892254 run patchelf(pid=19184): Terminated: ok {rc=0} 08:47:21.015705 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19181): Process ended prematurely: osmo-stp_10.42.42.5(pid=19181) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:47:21.025080 tst iperf3.py:8: Test FAILED (7.7 sec) 08:47:21.052227 run osmo-hlr_10.42.42.2(pid=19178): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19178)] 08:47:21.099941 run osmo-hlr_10.42.42.2(pid=19178): stdout: | (launched: 2022-12-10_08:47:17.827820) 08:47:21.148896 run osmo-hlr_10.42.42.2(pid=19178): stderr: | 20221210084718010 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084718010 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084718010 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084718010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084718010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084718010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084718022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084718031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084718031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084718031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:21.198607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19173): Terminating (SIGTERM) 08:47:21.238302 run iperf3-srv_10.42.42.10(pid=19174): Terminating (SIGTERM) 08:47:21.277846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Terminating (SIGTERM) 08:47:21.317412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Terminating (SIGTERM) 08:47:21.357150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19183): Terminating (SIGTERM) 08:47:21.396844 --- ParallelTerminationStrategy: PID 19173 died... 08:47:21.415623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19173): Terminated: ok {rc=0} 08:47:21.459788 --- ParallelTerminationStrategy: PID 19174 died... 08:47:21.478246 run iperf3-srv_10.42.42.10(pid=19174): Terminated {rc=256} 08:47:21.521967 --- ParallelTerminationStrategy: PID 19177 died... 08:47:21.540239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Terminated: ok {rc=0} 08:47:21.585053 --- ParallelTerminationStrategy: PID 19180 died... 08:47:21.603514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Terminated: ok {rc=0} 08:47:21.647275 --- ParallelTerminationStrategy: PID 19183 died... 08:47:21.665731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19183): Terminated: ok {rc=0} 08:47:21.751174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:47:22.901717 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:22.913995 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:22.968222 tst iperf3m4.py: using LAC 27226 08:47:23.096803 tst iperf3m4.py: using RAC 196 08:47:23.223290 tst iperf3m4.py: using CellId 27226 08:47:23.353808 tst iperf3m4.py: using BVCI 27227 08:47:23.467227 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.478601 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.489838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.501112 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.512429 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.523839 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.535283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.546526 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:23.557895 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:23.678285 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:23.798205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:23.916496 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:24.037476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:47:24.258192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:24.588662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19186): Launched 08:47:24.875739 run iperf3-srv_10.42.42.10(pid=19187): Launched 08:47:24.996590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:47:25.214731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:25.544050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19188): Launched 08:47:25.828729 run iperf3-srv_10.42.42.10(pid=19189): Launched 08:47:25.950352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:47:26.168672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:26.500254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19190): Launched 08:47:26.785524 run iperf3-srv_10.42.42.10(pid=19191): Launched 08:47:26.906299 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:47:27.123857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:47:27.455344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19192): Launched 08:47:27.741675 run iperf3-srv_10.42.42.10(pid=19193): Launched 08:47:27.862460 tst iperf3m4.py:8: start network... 08:47:28.081010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:28.589756 run create_hlr_db(pid=19194): Launched 08:47:28.720652 bus /gobi_6: Setting Powered False 08:47:29.784659 run create_hlr_db(pid=19194): Terminated: ok {rc=0} 08:47:30.222995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Launched 08:47:30.531628 run osmo-hlr_10.42.42.2(pid=19197): Launched 08:47:30.649588 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:31.285821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Launched 08:47:31.631285 run osmo-stp_10.42.42.5(pid=19200): Launched 08:47:31.831646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:32.499382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19202): Launched 08:47:32.619385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:32.880201 run patchelf(pid=19203): Launched 08:47:33.050293 run osmo-stp_10.42.42.5(pid=19200): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] 08:47:33.179075 run osmo-stp_10.42.42.5(pid=19200): stdout: | (launched: 2022-12-10_08:47:31.564157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:33.309190 run osmo-stp_10.42.42.5(pid=19200): stderr: | 20221210084731922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084731922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084731922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084731923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084731923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084731923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084731923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:33.440069 run osmo-stp_10.42.42.5(pid=19200): stdout: | (launched: 2022-12-10_08:47:31.564157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:33.565264 run osmo-stp_10.42.42.5(pid=19200): stderr: | 20221210084731922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084731922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084731922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084731923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084731923 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084731923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084731923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:33.713560 run patchelf(pid=19203): Terminating (SIGINT) 08:47:33.884557 run patchelf(pid=19203): Terminated: ok {rc=0} 08:47:34.008628 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19200): Process ended prematurely: osmo-stp_10.42.42.5(pid=19200) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:47:34.018366 tst iperf3m4.py:8: Test FAILED (11.2 sec) 08:47:34.045711 run osmo-hlr_10.42.42.2(pid=19197): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19197)] 08:47:34.093852 run osmo-hlr_10.42.42.2(pid=19197): stdout: | (launched: 2022-12-10_08:47:30.471947) 08:47:34.143045 run osmo-hlr_10.42.42.2(pid=19197): stderr: | 20221210084730654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084730654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084730654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084730654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084730654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084730654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084730667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084730678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084730678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084730678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:34.192549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19186): Terminating (SIGTERM) 08:47:34.231862 run iperf3-srv_10.42.42.10(pid=19187): Terminating (SIGTERM) 08:47:34.271273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19188): Terminating (SIGTERM) 08:47:34.310692 run iperf3-srv_10.42.42.10(pid=19189): Terminating (SIGTERM) 08:47:34.350448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19190): Terminating (SIGTERM) 08:47:34.389896 run iperf3-srv_10.42.42.10(pid=19191): Terminating (SIGTERM) 08:47:34.429295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19192): Terminating (SIGTERM) 08:47:34.468843 run iperf3-srv_10.42.42.10(pid=19193): Terminating (SIGTERM) 08:47:34.508077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Terminating (SIGTERM) 08:47:34.547550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Terminating (SIGTERM) 08:47:34.586922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19202): Terminating (SIGTERM) 08:47:34.626543 --- ParallelTerminationStrategy: PID 19186 died... 08:47:34.644984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19186): Terminated: ok {rc=0} 08:47:34.688714 --- ParallelTerminationStrategy: PID 19187 died... 08:47:34.707095 run iperf3-srv_10.42.42.10(pid=19187): Terminated {rc=256} 08:47:34.750969 --- ParallelTerminationStrategy: PID 19188 died... 08:47:34.769248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19188): Terminated: ok {rc=0} 08:47:34.812930 --- ParallelTerminationStrategy: PID 19189 died... 08:47:34.831398 run iperf3-srv_10.42.42.10(pid=19189): Terminated {rc=256} 08:47:34.875044 --- ParallelTerminationStrategy: PID 19190 died... 08:47:34.893507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19190): Terminated: ok {rc=0} 08:47:34.937641 --- ParallelTerminationStrategy: PID 19191 died... 08:47:34.955885 run iperf3-srv_10.42.42.10(pid=19191): Terminated {rc=256} 08:47:34.999363 --- ParallelTerminationStrategy: PID 19192 died... 08:47:35.017744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19192): Terminated: ok {rc=0} 08:47:35.061292 --- ParallelTerminationStrategy: PID 19193 died... 08:47:35.079501 run iperf3-srv_10.42.42.10(pid=19193): Terminated {rc=256} 08:47:35.122992 --- ParallelTerminationStrategy: PID 19196 died... 08:47:35.141414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19196): Terminated: ok {rc=0} 08:47:35.185162 --- ParallelTerminationStrategy: PID 19199 died... 08:47:35.203359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19199): Terminated: ok {rc=0} 08:47:35.247407 --- ParallelTerminationStrategy: PID 19202 died... 08:47:35.265695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19202): Terminated: ok {rc=0} 08:47:35.350390 bus /gobi_4: Setting Powered False 08:47:36.448535 bus /gobi_4: Setting Powered False 08:47:37.560077 bus /gobi_1: Setting Powered False 08:47:38.656429 bus /gobi_1: Setting Powered False 08:47:39.772270 bus /gobi_0: Setting Powered False 08:47:40.868849 bus /gobi_0: Setting Powered False 08:47:41.983601 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:47:43.084896 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.096626 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:43.148913 tst ping.py: using LAC 27227 08:47:43.268900 tst ping.py: using RAC 197 08:47:43.386767 tst ping.py: using CellId 27227 08:47:43.506211 tst ping.py: using BVCI 27228 08:47:43.616649 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.627991 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.639150 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.650569 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.661868 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.673232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.684660 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:43.695984 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:43.810505 tst ping.py:19: start network... 08:47:44.010664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:44.478183 run create_hlr_db(pid=19204): Launched 08:47:44.592078 bus /gobi_6: Setting Powered False 08:47:45.651130 run create_hlr_db(pid=19204): Terminated: ok {rc=0} 08:47:46.109925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Launched 08:47:46.450534 run osmo-hlr_10.42.42.2(pid=19207): Launched 08:47:46.613469 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:47.311131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Launched 08:47:47.626971 run osmo-stp_10.42.42.5(pid=19210): Launched 08:47:47.742385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:48.263604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19212): Launched 08:47:48.377784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:48.635145 run patchelf(pid=19213): Launched 08:47:48.802379 run osmo-stp_10.42.42.5(pid=19210): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] 08:47:48.929792 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-10_08:47:47.567941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:49.058411 run osmo-stp_10.42.42.5(pid=19210): stderr: | 20221210084747742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084747742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084747742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084747743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084747743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084747743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084747743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:49.187142 run osmo-stp_10.42.42.5(pid=19210): stdout: | (launched: 2022-12-10_08:47:47.567941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:49.310627 run osmo-stp_10.42.42.5(pid=19210): stderr: | 20221210084747742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084747742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084747742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084747743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084747743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084747743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084747743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:49.456739 run patchelf(pid=19213): Terminating (SIGINT) 08:47:49.626091 run patchelf(pid=19213): Terminated: ok {rc=0} 08:47:49.747766 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:47:49.756565 tst ping.py:22: Test FAILED (6.7 sec) 08:47:49.783447 run osmo-hlr_10.42.42.2(pid=19207): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19207)] 08:47:49.831639 run osmo-hlr_10.42.42.2(pid=19207): stdout: | (launched: 2022-12-10_08:47:46.385839) 08:47:49.881089 run osmo-hlr_10.42.42.2(pid=19207): stderr: | 20221210084746672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084746673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084746673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084746673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084746673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084746673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084746692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084746710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084746710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084746710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:49.930799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminating (SIGTERM) 08:47:49.970520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminating (SIGTERM) 08:47:50.010298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19212): Terminating (SIGTERM) 08:47:50.050229 --- ParallelTerminationStrategy: PID 19206 died... 08:47:50.069235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19206): Terminated: ok {rc=0} 08:47:50.113879 --- ParallelTerminationStrategy: PID 19209 died... 08:47:50.132348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19209): Terminated: ok {rc=0} 08:47:50.177236 --- ParallelTerminationStrategy: PID 19212 died... 08:47:50.195724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19212): Terminated: ok {rc=0} 08:47:50.279813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:47:51.366696 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.379167 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:47:51.434285 tst ping_idle_ping.py: using LAC 27228 08:47:51.560603 tst ping_idle_ping.py: using RAC 198 08:47:51.685651 tst ping_idle_ping.py: using CellId 27228 08:47:51.810870 tst ping_idle_ping.py: using BVCI 27229 08:47:51.927212 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.939028 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.950690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.962303 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.973754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.985387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:51.997087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:47:52.008565 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:47:52.123955 tst ping_idle_ping.py:24: start network... 08:47:52.327272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:47:52.800713 run create_hlr_db(pid=19214): Launched 08:47:52.916881 bus /gobi_6: Setting Powered False 08:47:53.977783 run create_hlr_db(pid=19214): Terminated: ok {rc=0} 08:47:54.421705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19216): Launched 08:47:54.745366 run osmo-hlr_10.42.42.2(pid=19217): Launched 08:47:54.867448 run osmo-stp_10.42.42.5: Starting osmo-stp 08:47:55.425241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19219): Launched 08:47:55.750650 run osmo-stp_10.42.42.5(pid=19220): Launched 08:47:55.872159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:47:56.428847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19222): Launched 08:47:56.550281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:47:56.823296 run patchelf(pid=19223): Launched 08:47:57.000451 run osmo-stp_10.42.42.5(pid=19220): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19220)] 08:47:57.135376 run osmo-stp_10.42.42.5(pid=19220): stdout: | (launched: 2022-12-10_08:47:55.686935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:57.272061 run osmo-stp_10.42.42.5(pid=19220): stderr: | 20221210084755884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084755885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084755885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084755885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084755886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084755886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084755886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:57.408427 run osmo-stp_10.42.42.5(pid=19220): stdout: | (launched: 2022-12-10_08:47:55.686935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:47:57.539583 run osmo-stp_10.42.42.5(pid=19220): stderr: | 20221210084755884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084755885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084755885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084755885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084755886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084755886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084755886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:47:57.695064 run patchelf(pid=19223): Terminating (SIGINT) 08:47:57.874144 run patchelf(pid=19223): Terminated: ok {rc=0} 08:47:58.002496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19220): Process ended prematurely: osmo-stp_10.42.42.5(pid=19220) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19220)] [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:47:58.011947 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:47:58.039585 run osmo-hlr_10.42.42.2(pid=19217): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19217)] 08:47:58.089140 run osmo-hlr_10.42.42.2(pid=19217): stdout: | (launched: 2022-12-10_08:47:54.682275) 08:47:58.140111 run osmo-hlr_10.42.42.2(pid=19217): stderr: | 20221210084754884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084754884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084754884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084754884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084754884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084754884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084754902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084754912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084754912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084754912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:47:58.191831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19216): Terminating (SIGTERM) 08:47:58.233310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19219): Terminating (SIGTERM) 08:47:58.274925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19222): Terminating (SIGTERM) 08:47:58.316660 --- ParallelTerminationStrategy: PID 19216 died... 08:47:58.336382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19216): Terminated: ok {rc=0} 08:47:58.381904 --- ParallelTerminationStrategy: PID 19219 died... 08:47:58.401251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19219): Terminated: ok {rc=0} 08:47:58.446616 --- ParallelTerminationStrategy: PID 19222 died... 08:47:58.465952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19222): Terminated: ok {rc=0} 08:47:58.553059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:47:59.863526 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:47:59.870495 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:47:59.904501 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:47:59.939865 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:47:59.995774 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:48:00.029973 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:48:00.064512 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:48:00.625629 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:48:00.630710 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:00.642459 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:48:00.714966 tst switch_tch_pdch.py: using LAC 27229 08:48:00.847992 tst switch_tch_pdch.py: using RAC 199 08:48:00.983067 tst switch_tch_pdch.py: using CellId 27229 08:48:01.113052 tst switch_tch_pdch.py: using BVCI 27230 08:48:01.237433 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.250185 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.262337 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.274663 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.286902 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.299255 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.311985 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:48:01.324130 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:48:01.446701 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:48:01.569689 tst switch_tch_pdch.py:51: start network... 08:48:01.786917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:02.286930 run create_hlr_db(pid=19228): Launched 08:48:02.415728 bus /gobi_6: Setting Powered False 08:48:03.478403 run create_hlr_db(pid=19228): Terminated: ok {rc=0} 08:48:03.920733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19230): Launched 08:48:04.237490 run osmo-hlr_10.42.42.2(pid=19231): Launched 08:48:04.359357 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:04.910671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19233): Launched 08:48:05.227305 run osmo-stp_10.42.42.5(pid=19234): Launched 08:48:05.348581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:05.897243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19236): Launched 08:48:06.018156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:06.287244 run patchelf(pid=19237): Launched 08:48:06.463706 run osmo-stp_10.42.42.5(pid=19234): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19234)] 08:48:06.598139 run osmo-stp_10.42.42.5(pid=19234): stdout: | (launched: 2022-12-10_08:48:05.169760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:06.733952 run osmo-stp_10.42.42.5(pid=19234): stderr: | 20221210084805361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084805361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084805361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084805361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084805362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084805362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084805362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:06.869859 run osmo-stp_10.42.42.5(pid=19234): stdout: | (launched: 2022-12-10_08:48:05.169760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:07.000505 run osmo-stp_10.42.42.5(pid=19234): stderr: | 20221210084805361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084805361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084805361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084805361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084805362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084805362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084805362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:07.155488 run patchelf(pid=19237): Terminating (SIGINT) 08:48:07.334522 run patchelf(pid=19237): Terminated: ok {rc=0} 08:48:07.462799 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19234): Process ended prematurely: osmo-stp_10.42.42.5(pid=19234) [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19234)] [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:48:07.472073 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:48:07.499907 run osmo-hlr_10.42.42.2(pid=19231): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19231)] 08:48:07.549361 run osmo-hlr_10.42.42.2(pid=19231): stdout: | (launched: 2022-12-10_08:48:04.179733) 08:48:07.600421 run osmo-hlr_10.42.42.2(pid=19231): stderr: | 20221210084804379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084804379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084804379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084804379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084804379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084804379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084804392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084804402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084804402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084804402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:07.651936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19230): Terminating (SIGTERM) 08:48:07.693471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19233): Terminating (SIGTERM) 08:48:07.734854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19236): Terminating (SIGTERM) 08:48:07.776572 --- ParallelTerminationStrategy: PID 19230 died... 08:48:07.796516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19230): Terminated: ok {rc=0} 08:48:07.842214 --- ParallelTerminationStrategy: PID 19233 died... 08:48:07.861533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19233): Terminated: ok {rc=0} 08:48:07.907211 --- ParallelTerminationStrategy: PID 19236 died... 08:48:07.926566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19236): Terminated: ok {rc=0} 08:48:08.013780 bus /gobi_0: Setting Powered False 08:48:09.111486 bus /gobi_0: Setting Powered False 08:48:10.229097 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:48:11.478288 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:11.483798 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:48:11.517617 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:48:11.552096 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:48:11.604825 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:48:11.638624 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:48:11.672920 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:48:12.226767 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:48:12.231650 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.242600 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:48:12.311721 tst switch_tch_pdch.py: using LAC 27230 08:48:12.431341 tst switch_tch_pdch.py: using RAC 200 08:48:12.549357 tst switch_tch_pdch.py: using CellId 27230 08:48:12.666696 tst switch_tch_pdch.py: using BVCI 27231 08:48:12.775837 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.786719 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.797451 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.808326 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.819317 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.830362 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.841485 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:48:12.852354 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:48:12.969581 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:48:13.084307 tst switch_tch_pdch.py:51: start network... 08:48:13.285765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:13.728267 run create_hlr_db(pid=19241): Launched 08:48:13.842071 bus /gobi_6: Setting Powered False 08:48:14.902398 run create_hlr_db(pid=19241): Terminated: ok {rc=0} 08:48:15.298050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Launched 08:48:15.600063 run osmo-hlr_10.42.42.2(pid=19244): Launched 08:48:15.714675 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:16.257087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Launched 08:48:16.614854 run osmo-stp_10.42.42.5(pid=19247): Launched 08:48:16.756795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:48:17.430307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Launched 08:48:17.551764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:48:17.824202 run patchelf(pid=19250): Launched 08:48:18.000854 run osmo-stp_10.42.42.5(pid=19247): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] 08:48:18.135794 run osmo-stp_10.42.42.5(pid=19247): stdout: | (launched: 2022-12-10_08:48:16.549425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:18.272496 run osmo-stp_10.42.42.5(pid=19247): stderr: | 20221210084816950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084816950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084816950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084816950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084816951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084816951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084816951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:18.409742 run osmo-stp_10.42.42.5(pid=19247): stdout: | (launched: 2022-12-10_08:48:16.549425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:18.540614 run osmo-stp_10.42.42.5(pid=19247): stderr: | 20221210084816950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084816950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084816950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084816950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084816951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084816951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084816951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:18.695449 run patchelf(pid=19250): Terminating (SIGINT) 08:48:18.873943 run patchelf(pid=19250): Terminated: ok {rc=0} 08:48:19.002644 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19247): Process ended prematurely: osmo-stp_10.42.42.5(pid=19247) [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:48:19.011889 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 08:48:19.040230 run osmo-hlr_10.42.42.2(pid=19244): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19244)] 08:48:19.090272 run osmo-hlr_10.42.42.2(pid=19244): stdout: | (launched: 2022-12-10_08:48:15.541287) 08:48:19.141948 run osmo-hlr_10.42.42.2(pid=19244): stderr: | 20221210084815724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084815724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084815724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084815725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084815725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084815725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084815736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084815745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084815745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084815745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:19.194069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Terminating (SIGTERM) 08:48:19.235622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Terminating (SIGTERM) 08:48:19.277804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Terminating (SIGTERM) 08:48:19.319754 --- ParallelTerminationStrategy: PID 19243 died... 08:48:19.339462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19243): Terminated: ok {rc=0} 08:48:19.386051 --- ParallelTerminationStrategy: PID 19246 died... 08:48:19.405294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19246): Terminated: ok {rc=0} 08:48:19.451592 --- ParallelTerminationStrategy: PID 19249 died... 08:48:19.470735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19249): Terminated: ok {rc=0} 08:48:19.558472 bus /gobi_0: Setting Powered False 08:48:20.655262 bus /gobi_0: Setting Powered False 08:48:21.771555 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:48:23.028218 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:23.032302 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:48:23.066975 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:48:23.073949 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:48:23.127405 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:48:23.162108 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:48:23.169052 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:48:23.707853 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:48:23.713992 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:48:23.725600 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:48:23.773877 tst mo_mt_sms.py: using LAC 27231 08:48:23.893950 tst mo_mt_sms.py: using RAC 201 08:48:24.011492 tst mo_mt_sms.py: using CellId 27231 08:48:24.131470 tst mo_mt_sms.py: using BVCI 27232 08:48:24.241933 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:48:24.361526 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:48:24.479245 tst mo_mt_sms.py:9: start nitb and bts... 08:48:24.695805 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:48:25.343057 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19255): Launched 08:48:25.659070 run osmo-nitb_10.42.42.2(pid=19256): Launched 08:48:25.834590 run osmo-nitb_10.42.42.2(pid=19256): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19256)] 08:48:25.976844 run osmo-nitb_10.42.42.2(pid=19256): stdout: | (launched: 2022-12-10_08:48:25.601683) 08:48:26.120643 run osmo-nitb_10.42.42.2(pid=19256): stderr: | (launched: 2022-12-10_08:48:25.648872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:48:26.264812 run osmo-nitb_10.42.42.2(pid=19256): stdout: | (launched: 2022-12-10_08:48:25.601683) 08:48:26.402906 run osmo-nitb_10.42.42.2(pid=19256): stderr: | (launched: 2022-12-10_08:48:25.648872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19256) [trial-2372↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19256)] 08:48:26.778276 tst osmo-nitb_10.42.42.2(pid=19256): stdout: | (launched: 2022-12-10_08:48:25.601683) 08:48:26.906352 tst osmo-nitb_10.42.42.2(pid=19256): stderr: | (launched: 2022-12-10_08:48:25.648872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:48:27.056879 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19256) [trial-2372↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19256)] [trial-2372↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 08:48:27.065804 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 08:48:27.072688 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19255): Terminating (SIGTERM) 08:48:27.282793 --- ParallelTerminationStrategy: PID 19255 died... 08:48:27.304264 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19255): Terminated: ok {rc=0} 08:48:27.391352 bus /sierra_3: Setting Powered False 08:48:28.488858 bus /sierra_3: Setting Powered False 08:48:29.605247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:trx-sysmocell5000 --------------------------------------------------------------------- 08:48:30.801934 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:30.806620 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:48:30.841180 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:48:30.870225 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:48:30.943053 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:48:30.986063 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:48:31.014899 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:48:31.556688 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 08:48:31.565386 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:31.580259 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:48:31.646661 tst mo_mt_sms.py: using LAC 27232 08:48:31.815785 tst mo_mt_sms.py: using RAC 202 08:48:31.981382 tst mo_mt_sms.py: using CellId 27232 08:48:32.101610 tst mo_mt_sms.py: using BVCI 27233 08:48:32.247280 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:32.258827 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:32.270423 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:32.283219 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:32.297070 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:32.308406 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:48:32.430317 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:48:32.551333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:33.049767 run create_hlr_db(pid=19260): Launched 08:48:33.178649 bus /sierra_2: Setting Powered False 08:48:34.241826 run create_hlr_db(pid=19260): Terminated: ok {rc=0} 08:48:34.675438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Launched 08:48:34.978624 run osmo-hlr_10.42.42.2(pid=19263): Launched 08:48:35.092613 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:35.623457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Launched 08:48:35.926680 run osmo-stp_10.42.42.5(pid=19266): Launched 08:48:36.041124 run osmo-msc_10.42.42.6: Starting osmo-msc 08:48:36.586874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Launched 08:48:36.890179 run osmo-msc_10.42.42.6(pid=19269): Launched 08:48:37.057736 run osmo-stp_10.42.42.5(pid=19266): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] 08:48:37.185167 run osmo-stp_10.42.42.5(pid=19266): stdout: | (launched: 2022-12-10_08:48:35.867852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:37.312891 run osmo-stp_10.42.42.5(pid=19266): stderr: | 20221210084836041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084836041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084836042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084836042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084836042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084836042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084836043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:37.438069 run osmo-stp_10.42.42.5(pid=19266): stdout: | (launched: 2022-12-10_08:48:35.867852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:37.557861 run osmo-stp_10.42.42.5(pid=19266): stderr: | 20221210084836041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084836041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084836042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084836042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084836042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084836042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084836043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:37.700660 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19266): Process ended prematurely: osmo-stp_10.42.42.5(pid=19266) [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 08:48:37.708805 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 08:48:37.734663 run osmo-hlr_10.42.42.2(pid=19263): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19263)] 08:48:37.782635 run osmo-hlr_10.42.42.2(pid=19263): stdout: | (launched: 2022-12-10_08:48:34.919879) 08:48:37.831676 run osmo-hlr_10.42.42.2(pid=19263): stderr: | 20221210084835099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084835099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084835099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084835099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084835099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084835099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084835111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084835122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084835123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084835123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:37.900193 run osmo-msc_10.42.42.6(pid=19269): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19269)] 08:48:37.947699 run osmo-msc_10.42.42.6(pid=19269): stdout: | (launched: 2022-12-10_08:48:36.830934) 08:48:37.996736 run osmo-msc_10.42.42.6(pid=19269): stderr: | 20221210084837104 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084837104 DLGLOBAL DEBUG validating counter group 0x7f48a1980c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084837105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084837105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084837105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084837105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084837107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084837107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084837107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084837108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:48:38.046254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Terminating (SIGTERM) 08:48:38.085808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Terminating (SIGTERM) 08:48:38.125342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Terminating (SIGTERM) 08:48:38.165540 --- ParallelTerminationStrategy: PID 19262 died... 08:48:38.184388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19262): Terminated: ok {rc=0} 08:48:38.228304 --- ParallelTerminationStrategy: PID 19265 died... 08:48:38.246842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19265): Terminated: ok {rc=0} 08:48:38.290859 --- ParallelTerminationStrategy: PID 19268 died... 08:48:38.309362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19268): Terminated: ok {rc=0} 08:48:38.392209 bus /sierra_3: Setting Powered False 08:48:39.489923 bus /sierra_3: Setting Powered False 08:48:40.605771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:48:41.838190 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:41.842532 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:48:41.876688 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 08:48:41.883468 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:48:41.920429 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:48:41.955283 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 08:48:41.962209 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:48:42.481957 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:48:42.486924 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 08:48:42.498250 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:48:42.546428 tst assert_extension.py: using LAC 27233 08:48:42.666211 tst assert_extension.py: using RAC 203 08:48:42.785234 tst assert_extension.py: using CellId 27233 08:48:42.903767 tst assert_extension.py: using BVCI 27234 08:48:43.013362 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:48:43.131710 tst assert_extension.py:10: start nitb and bts... 08:48:43.345996 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:48:43.994060 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19274): Launched 08:48:44.311281 run osmo-nitb_10.42.42.2(pid=19275): Launched 08:48:44.487825 run osmo-nitb_10.42.42.2(pid=19275): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19275)] 08:48:44.630785 run osmo-nitb_10.42.42.2(pid=19275): stdout: | (launched: 2022-12-10_08:48:44.253167) 08:48:44.775598 run osmo-nitb_10.42.42.2(pid=19275): stderr: | (launched: 2022-12-10_08:48:44.301208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:48:44.919744 run osmo-nitb_10.42.42.2(pid=19275): stdout: | (launched: 2022-12-10_08:48:44.253167) 08:48:45.058858 run osmo-nitb_10.42.42.2(pid=19275): stderr: | (launched: 2022-12-10_08:48:44.301208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19275) [trial-2372↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19275)] 08:48:45.431531 tst osmo-nitb_10.42.42.2(pid=19275): stdout: | (launched: 2022-12-10_08:48:44.253167) 08:48:45.560378 tst osmo-nitb_10.42.42.2(pid=19275): stderr: | (launched: 2022-12-10_08:48:44.301208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:48:45.711682 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19275) [trial-2372↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19275)] [trial-2372↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 08:48:45.720595 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:48:45.727521 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19274): Terminating (SIGTERM) 08:48:45.937909 --- ParallelTerminationStrategy: PID 19274 died... 08:48:45.960421 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19274): Terminated: ok {rc=0} 08:48:46.054044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 08:48:47.248615 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:47.252611 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:48:47.287408 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:48:47.315039 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 08:48:47.353598 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:48:47.388344 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:48:47.416030 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 08:48:47.943508 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 08:48:47.949258 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:47.962932 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:48:48.014056 tst assert_extension.py: using LAC 27234 08:48:48.140374 tst assert_extension.py: using RAC 204 08:48:48.266260 tst assert_extension.py: using CellId 27234 08:48:48.389334 tst assert_extension.py: using BVCI 27235 08:48:48.504742 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:48.515899 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:48.527027 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:48.538061 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:48.548929 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:48:48.560009 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 08:48:48.674274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:49.142370 run create_hlr_db(pid=19279): Launched 08:48:49.256200 bus /sierra_2: Setting Powered False 08:48:50.316791 run create_hlr_db(pid=19279): Terminated: ok {rc=0} 08:48:50.758453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19281): Launched 08:48:51.080114 run osmo-hlr_10.42.42.2(pid=19282): Launched 08:48:51.201122 run osmo-stp_10.42.42.5: Starting osmo-stp 08:48:51.840451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19284): Launched 08:48:52.157863 run osmo-stp_10.42.42.5(pid=19285): Launched 08:48:52.277453 run osmo-msc_10.42.42.6: Starting osmo-msc 08:48:52.845400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19287): Launched 08:48:53.161253 run osmo-msc_10.42.42.6(pid=19288): Launched 08:48:53.335829 run osmo-stp_10.42.42.5(pid=19285): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19285)] 08:48:53.468380 run osmo-stp_10.42.42.5(pid=19285): stdout: | (launched: 2022-12-10_08:48:52.095555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:53.601327 run osmo-stp_10.42.42.5(pid=19285): stderr: | 20221210084852293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084852293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084852294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084852294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084852294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084852294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084852295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:53.733430 run osmo-stp_10.42.42.5(pid=19285): stdout: | (launched: 2022-12-10_08:48:52.095555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:48:53.858074 run osmo-stp_10.42.42.5(pid=19285): stderr: | 20221210084852293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084852293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084852294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084852294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084852294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084852294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084852295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:48:54.006934 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19285): Process ended prematurely: osmo-stp_10.42.42.5(pid=19285) [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19285)] [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py:17] 08:48:54.015765 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:48:54.042813 run osmo-hlr_10.42.42.2(pid=19282): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19282)] 08:48:54.092614 run osmo-hlr_10.42.42.2(pid=19282): stdout: | (launched: 2022-12-10_08:48:51.017628) 08:48:54.144088 run osmo-hlr_10.42.42.2(pid=19282): stderr: | 20221210084851220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084851220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084851220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084851220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084851220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084851220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084851233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084851241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084851242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084851242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:48:54.215120 run osmo-msc_10.42.42.6(pid=19288): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19288)] 08:48:54.264630 run osmo-msc_10.42.42.6(pid=19288): stdout: | (launched: 2022-12-10_08:48:53.100192) 08:48:54.316095 run osmo-msc_10.42.42.6(pid=19288): stderr: | 20221210084853423 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084853423 DLGLOBAL DEBUG validating counter group 0x7fc242ac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084853424 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084853424 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084853424 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084853424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084853426 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084853426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084853426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084853426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:48:54.367717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19281): Terminating (SIGTERM) 08:48:54.408782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19284): Terminating (SIGTERM) 08:48:54.450057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19287): Terminating (SIGTERM) 08:48:54.491396 --- ParallelTerminationStrategy: PID 19281 died... 08:48:54.510730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19281): Terminated: ok {rc=0} 08:48:54.556051 --- ParallelTerminationStrategy: PID 19284 died... 08:48:54.575216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19284): Terminated: ok {rc=0} 08:48:54.620311 --- ParallelTerminationStrategy: PID 19287 died... 08:48:54.639445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19287): Terminated: ok {rc=0} 08:48:54.725964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:48:55.934019 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:48:55.941269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:48:55.975612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:48:56.002760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:48:56.054830 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:48:56.089135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:48:56.116234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:48:56.669985 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:48:56.721444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:56.732900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:48:56.804222 tst mo_mt_call.py: using LAC 27235 08:48:56.929769 tst mo_mt_call.py: using RAC 205 08:48:57.049285 tst mo_mt_call.py: using CellId 27235 08:48:57.167965 tst mo_mt_call.py: using BVCI 27236 08:48:57.278844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:57.290129 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:57.301406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:57.312697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:57.324004 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:48:57.335156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:48:57.453659 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:48:57.576489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:48:58.070599 run create_hlr_db(pid=19293): Launched 08:48:58.200106 bus /sierra_2: Setting Powered False 08:48:59.263439 run create_hlr_db(pid=19293): Terminated: ok {rc=0} 08:48:59.707401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19295): Launched 08:49:00.023786 run osmo-hlr_10.42.42.2(pid=19296): Launched 08:49:00.144890 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:00.694747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19298): Launched 08:49:01.052158 run osmo-stp_10.42.42.5(pid=19299): Launched 08:49:01.335110 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:02.045933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19301): Launched 08:49:02.368507 run osmo-msc_10.42.42.6(pid=19302): Launched 08:49:02.539466 run osmo-stp_10.42.42.5(pid=19299): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19299)] 08:49:02.671343 run osmo-stp_10.42.42.5(pid=19299): stdout: | (launched: 2022-12-10_08:49:00.990439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:02.800243 run osmo-stp_10.42.42.5(pid=19299): stderr: | 20221210084901224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084901224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084901233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084901233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084901234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084901234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084901234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:02.925989 run osmo-stp_10.42.42.5(pid=19299): stdout: | (launched: 2022-12-10_08:49:00.990439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:03.045813 run osmo-stp_10.42.42.5(pid=19299): stderr: | 20221210084901224 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084901224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084901233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084901233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084901234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084901234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084901234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:03.189220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19299): Process ended prematurely: osmo-stp_10.42.42.5(pid=19299) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19299)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:49:03.198009 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 08:49:03.224262 run osmo-hlr_10.42.42.2(pid=19296): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19296)] 08:49:03.272263 run osmo-hlr_10.42.42.2(pid=19296): stdout: | (launched: 2022-12-10_08:48:59.966475) 08:49:03.321964 run osmo-hlr_10.42.42.2(pid=19296): stderr: | 20221210084900164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084900164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084900164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084900164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084900164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084900165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084900177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084900185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084900186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084900186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:03.390561 run osmo-msc_10.42.42.6(pid=19302): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19302)] 08:49:03.438236 run osmo-msc_10.42.42.6(pid=19302): stdout: | (launched: 2022-12-10_08:49:02.313326) 08:49:03.487536 run osmo-msc_10.42.42.6(pid=19302): stderr: | 20221210084902583 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084902583 DLGLOBAL DEBUG validating counter group 0x7fc1d93bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084902584 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084902584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084902584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084902584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084902586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084902586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084902586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084902586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:03.537412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19295): Terminating (SIGTERM) 08:49:03.576814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19298): Terminating (SIGTERM) 08:49:03.616168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19301): Terminating (SIGTERM) 08:49:03.655883 --- ParallelTerminationStrategy: PID 19295 died... 08:49:03.674675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19295): Terminated: ok {rc=0} 08:49:03.718543 --- ParallelTerminationStrategy: PID 19298 died... 08:49:03.736787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19298): Terminated: ok {rc=0} 08:49:03.780563 --- ParallelTerminationStrategy: PID 19301 died... 08:49:03.798920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19301): Terminated: ok {rc=0} 08:49:03.883727 bus /sierra_3: Setting Powered False 08:49:04.982867 bus /sierra_3: Setting Powered False 08:49:06.096426 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:49:07.243625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.255942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:49:07.329818 tst mo_mt_call_osmux.py: using LAC 27236 08:49:07.457495 tst mo_mt_call_osmux.py: using RAC 206 08:49:07.580606 tst mo_mt_call_osmux.py: using CellId 27236 08:49:07.700919 tst mo_mt_call_osmux.py: using BVCI 27237 08:49:07.810419 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.821790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.832730 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.843914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.855119 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:49:07.866326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:49:07.985207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:49:08.101764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:08.570591 run create_hlr_db(pid=19305): Launched 08:49:08.685392 bus /sierra_2: Setting Powered False 08:49:09.745268 run create_hlr_db(pid=19305): Terminated: ok {rc=0} 08:49:10.165160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19307): Launched 08:49:10.467441 run osmo-hlr_10.42.42.2(pid=19308): Launched 08:49:10.583197 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:11.100712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19310): Launched 08:49:11.401837 run osmo-stp_10.42.42.5(pid=19311): Launched 08:49:11.518469 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:12.062968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19313): Launched 08:49:12.362845 run osmo-msc_10.42.42.6(pid=19314): Launched 08:49:12.531710 run osmo-stp_10.42.42.5(pid=19311): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19311)] 08:49:12.659625 run osmo-stp_10.42.42.5(pid=19311): stdout: | (launched: 2022-12-10_08:49:11.347028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:12.787465 run osmo-stp_10.42.42.5(pid=19311): stderr: | 20221210084911517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084911517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084911517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084911518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084911518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084911518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084911518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:12.912791 run osmo-stp_10.42.42.5(pid=19311): stdout: | (launched: 2022-12-10_08:49:11.347028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:13.032323 run osmo-stp_10.42.42.5(pid=19311): stderr: | 20221210084911517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084911517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084911517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084911518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084911518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084911518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084911518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:13.175113 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19311): Process ended prematurely: osmo-stp_10.42.42.5(pid=19311) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19311)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:49:13.183899 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:49:13.209830 run osmo-hlr_10.42.42.2(pid=19308): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19308)] 08:49:13.257231 run osmo-hlr_10.42.42.2(pid=19308): stdout: | (launched: 2022-12-10_08:49:10.411987) 08:49:13.306284 run osmo-hlr_10.42.42.2(pid=19308): stderr: | 20221210084910586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084910586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084910586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084910586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084910586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084910586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084910598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084910607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084910607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084910607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:13.374091 run osmo-msc_10.42.42.6(pid=19314): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19314)] 08:49:13.421313 run osmo-msc_10.42.42.6(pid=19314): stdout: | (launched: 2022-12-10_08:49:12.308340) 08:49:13.469936 run osmo-msc_10.42.42.6(pid=19314): stderr: | 20221210084912578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084912578 DLGLOBAL DEBUG validating counter group 0x7f478b7e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084912578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084912578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084912578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084912579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084912580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084912581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084912581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084912581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:13.519107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19307): Terminating (SIGTERM) 08:49:13.558255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19310): Terminating (SIGTERM) 08:49:13.597372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19313): Terminating (SIGTERM) 08:49:13.637303 --- ParallelTerminationStrategy: PID 19307 died... 08:49:13.655974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19307): Terminated: ok {rc=0} 08:49:13.699781 --- ParallelTerminationStrategy: PID 19310 died... 08:49:13.718010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19310): Terminated: ok {rc=0} 08:49:13.761478 --- ParallelTerminationStrategy: PID 19313 died... 08:49:13.779745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19313): Terminated: ok {rc=0} 08:49:13.862953 bus /sierra_3: Setting Powered False 08:49:14.959898 bus /sierra_3: Setting Powered False 08:49:16.077970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:49:17.342558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:49:17.349720 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:49:17.384678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:49:17.412167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:49:17.465588 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:49:17.500776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:49:17.528232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:49:18.080652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:49:18.131817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.143559 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:49:18.214956 tst mo_mt_call.py: using LAC 27237 08:49:18.340888 tst mo_mt_call.py: using RAC 207 08:49:18.466536 tst mo_mt_call.py: using CellId 27237 08:49:18.593201 tst mo_mt_call.py: using BVCI 27238 08:49:18.711528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.723116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.734677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.746144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.757756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:18.769979 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:49:18.887657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:49:19.004811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:19.474879 run create_hlr_db(pid=19321): Launched 08:49:19.590364 bus /sierra_2: Setting Powered False 08:49:20.649522 run create_hlr_db(pid=19321): Terminated: ok {rc=0} 08:49:21.091411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19323): Launched 08:49:21.415965 run osmo-hlr_10.42.42.2(pid=19324): Launched 08:49:21.537644 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:22.093703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19326): Launched 08:49:22.416886 run osmo-stp_10.42.42.5(pid=19327): Launched 08:49:22.539949 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:23.128353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19329): Launched 08:49:23.452434 run osmo-msc_10.42.42.6(pid=19330): Launched 08:49:23.631485 run osmo-stp_10.42.42.5(pid=19327): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19327)] 08:49:23.766740 run osmo-stp_10.42.42.5(pid=19327): stdout: | (launched: 2022-12-10_08:49:22.353631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:23.901879 run osmo-stp_10.42.42.5(pid=19327): stderr: | 20221210084922551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084922551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084922552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084922552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084922553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084922553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084922553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:24.035875 run osmo-stp_10.42.42.5(pid=19327): stdout: | (launched: 2022-12-10_08:49:22.353631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:24.162757 run osmo-stp_10.42.42.5(pid=19327): stderr: | 20221210084922551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084922551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084922552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084922552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084922553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084922553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084922553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:24.315387 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19327): Process ended prematurely: osmo-stp_10.42.42.5(pid=19327) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19327)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:49:24.324666 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:49:24.352125 run osmo-hlr_10.42.42.2(pid=19324): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19324)] 08:49:24.401431 run osmo-hlr_10.42.42.2(pid=19324): stdout: | (launched: 2022-12-10_08:49:21.353318) 08:49:24.452504 run osmo-hlr_10.42.42.2(pid=19324): stderr: | 20221210084921554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084921554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084921554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084921554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084921554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084921554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084921567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084921575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084921575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084921575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:24.523589 run osmo-msc_10.42.42.6(pid=19330): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19330)] 08:49:24.572941 run osmo-msc_10.42.42.6(pid=19330): stdout: | (launched: 2022-12-10_08:49:23.388885) 08:49:24.623872 run osmo-msc_10.42.42.6(pid=19330): stderr: | 20221210084923719 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084923719 DLGLOBAL DEBUG validating counter group 0x7fe04a903c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084923719 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084923719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084923719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084923719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084923721 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084923721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084923722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084923722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:24.675063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19323): Terminating (SIGTERM) 08:49:24.715805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19326): Terminating (SIGTERM) 08:49:24.756608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19329): Terminating (SIGTERM) 08:49:24.798035 --- ParallelTerminationStrategy: PID 19323 died... 08:49:24.817578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19323): Terminated: ok {rc=0} 08:49:24.862828 --- ParallelTerminationStrategy: PID 19326 died... 08:49:24.882065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19326): Terminated: ok {rc=0} 08:49:24.927290 --- ParallelTerminationStrategy: PID 19329 died... 08:49:24.946465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19329): Terminated: ok {rc=0} 08:49:25.033183 bus /sierra_3: Setting Powered False 08:49:26.130367 bus /sierra_3: Setting Powered False 08:49:27.246798 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:49:28.393142 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:28.405352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:49:28.476803 tst mo_mt_call_osmux.py: using LAC 27238 08:49:28.603467 tst mo_mt_call_osmux.py: using RAC 208 08:49:28.724622 tst mo_mt_call_osmux.py: using CellId 27238 08:49:28.851991 tst mo_mt_call_osmux.py: using BVCI 27239 08:49:28.964582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:28.975790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:28.986689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:28.998234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:29.009490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:49:29.020608 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:49:29.136805 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:49:29.257488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:29.758608 run create_hlr_db(pid=19332): Launched 08:49:29.887419 bus /sierra_2: Setting Powered False 08:49:30.948649 run create_hlr_db(pid=19332): Terminated: ok {rc=0} 08:49:31.409735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19334): Launched 08:49:31.798967 run osmo-hlr_10.42.42.2(pid=19335): Launched 08:49:31.916443 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:32.606898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19337): Launched 08:49:32.932400 run osmo-stp_10.42.42.5(pid=19338): Launched 08:49:33.054035 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:33.638487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19340): Launched 08:49:33.962848 run osmo-msc_10.42.42.6(pid=19341): Launched 08:49:34.141010 run osmo-stp_10.42.42.5(pid=19338): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19338)] 08:49:34.279963 run osmo-stp_10.42.42.5(pid=19338): stdout: | (launched: 2022-12-10_08:49:32.868761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:34.417713 run osmo-stp_10.42.42.5(pid=19338): stderr: | 20221210084933067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084933067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084933067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084933068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084933068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084933068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084933068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:34.550871 run osmo-stp_10.42.42.5(pid=19338): stdout: | (launched: 2022-12-10_08:49:32.868761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:34.678092 run osmo-stp_10.42.42.5(pid=19338): stderr: | 20221210084933067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084933067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084933067 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084933068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084933068 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084933068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084933068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:34.830158 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19338): Process ended prematurely: osmo-stp_10.42.42.5(pid=19338) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19338)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:49:34.839564 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:49:34.866637 run osmo-hlr_10.42.42.2(pid=19335): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19335)] 08:49:34.916150 run osmo-hlr_10.42.42.2(pid=19335): stdout: | (launched: 2022-12-10_08:49:31.735149) 08:49:34.967294 run osmo-hlr_10.42.42.2(pid=19335): stderr: | 20221210084932106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084932107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084932107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084932107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084932107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084932107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084932120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084932137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084932138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084932138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:35.038690 run osmo-msc_10.42.42.6(pid=19341): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19341)] 08:49:35.088084 run osmo-msc_10.42.42.6(pid=19341): stdout: | (launched: 2022-12-10_08:49:33.899334) 08:49:35.139021 run osmo-msc_10.42.42.6(pid=19341): stderr: | 20221210084934226 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084934226 DLGLOBAL DEBUG validating counter group 0x7f494ecabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084934226 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084934227 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084934227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084934227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084934229 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084934229 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084934229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084934229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:35.190238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19334): Terminating (SIGTERM) 08:49:35.231069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19337): Terminating (SIGTERM) 08:49:35.272216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19340): Terminating (SIGTERM) 08:49:35.313916 --- ParallelTerminationStrategy: PID 19334 died... 08:49:35.333569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19334): Terminated: ok {rc=0} 08:49:35.379036 --- ParallelTerminationStrategy: PID 19337 died... 08:49:35.398308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19337): Terminated: ok {rc=0} 08:49:35.443516 --- ParallelTerminationStrategy: PID 19340 died... 08:49:35.462750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19340): Terminated: ok {rc=0} 08:49:35.548922 bus /sierra_3: Setting Powered False 08:49:36.645833 bus /sierra_3: Setting Powered False 08:49:37.761685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:49:39.014631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:49:39.021569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:49:39.055906 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:49:39.082954 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:49:39.135536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:49:39.169954 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:49:39.197175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:49:39.750742 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:49:39.801908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:39.813526 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:49:39.887736 tst mo_mt_call.py: using LAC 27239 08:49:40.006095 tst mo_mt_call.py: using RAC 209 08:49:40.127146 tst mo_mt_call.py: using CellId 27239 08:49:40.244621 tst mo_mt_call.py: using BVCI 27240 08:49:40.355076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:40.366439 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:40.377613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:40.389210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:40.400568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:40.411991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:49:40.530101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:49:40.647056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:41.116533 run create_hlr_db(pid=19346): Launched 08:49:41.231890 bus /sierra_2: Setting Powered False 08:49:42.292396 run create_hlr_db(pid=19346): Terminated: ok {rc=0} 08:49:42.712694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Launched 08:49:43.014187 run osmo-hlr_10.42.42.2(pid=19349): Launched 08:49:43.130375 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:43.663035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Launched 08:49:43.963057 run osmo-stp_10.42.42.5(pid=19352): Launched 08:49:44.079210 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:44.625694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Launched 08:49:44.927605 run osmo-msc_10.42.42.6(pid=19355): Launched 08:49:45.098031 run osmo-stp_10.42.42.5(pid=19352): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] 08:49:45.227079 run osmo-stp_10.42.42.5(pid=19352): stdout: | (launched: 2022-12-10_08:49:43.908381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:45.355310 run osmo-stp_10.42.42.5(pid=19352): stderr: | 20221210084944078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084944078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084944079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084944079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084944079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084944079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084944080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:45.481168 run osmo-stp_10.42.42.5(pid=19352): stdout: | (launched: 2022-12-10_08:49:43.908381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:45.601604 run osmo-stp_10.42.42.5(pid=19352): stderr: | 20221210084944078 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084944078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084944079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084944079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084944079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084944079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084944080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:45.745810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19352): Process ended prematurely: osmo-stp_10.42.42.5(pid=19352) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:49:45.754492 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:49:45.780655 run osmo-hlr_10.42.42.2(pid=19349): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19349)] 08:49:45.828426 run osmo-hlr_10.42.42.2(pid=19349): stdout: | (launched: 2022-12-10_08:49:42.959239) 08:49:45.894293 run osmo-hlr_10.42.42.2(pid=19349): stderr: | 20221210084943136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084943136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084943136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084943136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084943136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084943136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084943147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084943156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084943156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084943156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:45.988097 run osmo-msc_10.42.42.6(pid=19355): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19355)] 08:49:46.058073 run osmo-msc_10.42.42.6(pid=19355): stdout: | (launched: 2022-12-10_08:49:44.872497) 08:49:46.125253 run osmo-msc_10.42.42.6(pid=19355): stderr: | 20221210084945143 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084945144 DLGLOBAL DEBUG validating counter group 0x7fee41bd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084945144 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084945144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084945144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084945144 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084945146 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084945146 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084945147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084945147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:46.191816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Terminating (SIGTERM) 08:49:46.246637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Terminating (SIGTERM) 08:49:46.305280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Terminating (SIGTERM) 08:49:46.362675 --- ParallelTerminationStrategy: PID 19348 died... 08:49:46.388335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19348): Terminated: ok {rc=0} 08:49:46.437127 --- ParallelTerminationStrategy: PID 19351 died... 08:49:46.456487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19351): Terminated: ok {rc=0} 08:49:46.503544 --- ParallelTerminationStrategy: PID 19354 died... 08:49:46.522926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19354): Terminated: ok {rc=0} 08:49:46.609451 bus /sierra_3: Setting Powered False 08:49:47.705273 bus /sierra_3: Setting Powered False 08:49:48.818869 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:49:49.964228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:49.976030 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:49:50.046574 tst mo_mt_call_osmux.py: using LAC 27240 08:49:50.167138 tst mo_mt_call_osmux.py: using RAC 210 08:49:50.288079 tst mo_mt_call_osmux.py: using CellId 27240 08:49:50.416227 tst mo_mt_call_osmux.py: using BVCI 27241 08:49:50.532710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:50.544791 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:50.556468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:50.568044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:50.579935 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:49:50.591421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:49:50.706234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:49:50.822172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:49:51.293523 run create_hlr_db(pid=19357): Launched 08:49:51.410305 bus /sierra_2: Setting Powered False 08:49:52.470795 run create_hlr_db(pid=19357): Terminated: ok {rc=0} 08:49:52.911923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19359): Launched 08:49:53.219061 run osmo-hlr_10.42.42.2(pid=19360): Launched 08:49:53.335422 run osmo-stp_10.42.42.5: Starting osmo-stp 08:49:53.869989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19362): Launched 08:49:54.171426 run osmo-stp_10.42.42.5(pid=19363): Launched 08:49:54.286705 run osmo-msc_10.42.42.6: Starting osmo-msc 08:49:54.833291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19365): Launched 08:49:55.136207 run osmo-msc_10.42.42.6(pid=19366): Launched 08:49:55.306131 run osmo-stp_10.42.42.5(pid=19363): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19363)] 08:49:55.435614 run osmo-stp_10.42.42.5(pid=19363): stdout: | (launched: 2022-12-10_08:49:54.116690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:55.564422 run osmo-stp_10.42.42.5(pid=19363): stderr: | 20221210084954285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084954285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084954286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084954287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084954289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084954289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084954289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:55.690981 run osmo-stp_10.42.42.5(pid=19363): stdout: | (launched: 2022-12-10_08:49:54.116690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:49:55.811548 run osmo-stp_10.42.42.5(pid=19363): stderr: | 20221210084954285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210084954285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210084954286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210084954287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210084954289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210084954289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210084954289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:49:55.955658 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19363): Process ended prematurely: osmo-stp_10.42.42.5(pid=19363) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19363)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:49:55.964648 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:49:55.991634 run osmo-hlr_10.42.42.2(pid=19360): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19360)] 08:49:56.040206 run osmo-hlr_10.42.42.2(pid=19360): stdout: | (launched: 2022-12-10_08:49:53.164058) 08:49:56.089945 run osmo-hlr_10.42.42.2(pid=19360): stderr: | 20221210084953340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210084953340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210084953340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210084953340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210084953340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210084953340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210084953352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210084953360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210084953360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210084953360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:49:56.159037 run osmo-msc_10.42.42.6(pid=19366): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19366)] 08:49:56.207064 run osmo-msc_10.42.42.6(pid=19366): stdout: | (launched: 2022-12-10_08:49:55.080491) 08:49:56.256402 run osmo-msc_10.42.42.6(pid=19366): stderr: | 20221210084955354 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210084955354 DLGLOBAL DEBUG validating counter group 0x7fa2c2faec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210084955354 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210084955354 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210084955355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210084955355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210084955356 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210084955357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210084955357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210084955358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:49:56.306329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19359): Terminating (SIGTERM) 08:49:56.346128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19362): Terminating (SIGTERM) 08:49:56.386026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19365): Terminating (SIGTERM) 08:49:56.426135 --- ParallelTerminationStrategy: PID 19359 died... 08:49:56.445044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19359): Terminated: ok {rc=0} 08:49:56.489315 --- ParallelTerminationStrategy: PID 19362 died... 08:49:56.507820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19362): Terminated: ok {rc=0} 08:49:56.551896 --- ParallelTerminationStrategy: PID 19365 died... 08:49:56.570495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19365): Terminated: ok {rc=0} 08:49:56.655217 bus /sierra_3: Setting Powered False 08:49:57.754072 bus /sierra_3: Setting Powered False 08:49:58.866536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:50:00.119359 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:00.126366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:50:00.160746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:50:00.188443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:50:00.242448 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:50:00.277381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:50:00.305058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:50:00.877385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:50:00.934553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:00.947059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:50:01.018748 tst mo_mt_call.py: using LAC 27241 08:50:01.180918 tst mo_mt_call.py: using RAC 211 08:50:01.341327 tst mo_mt_call.py: using CellId 27241 08:50:01.466308 tst mo_mt_call.py: using BVCI 27242 08:50:01.587604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:01.599647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:01.611427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:01.623226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:01.635215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:01.647082 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:50:01.769555 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:50:01.898679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:02.463160 run create_hlr_db(pid=19374): Launched 08:50:02.592823 bus /sierra_2: Setting Powered False 08:50:03.656505 run create_hlr_db(pid=19374): Terminated: ok {rc=0} 08:50:04.091092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19376): Launched 08:50:04.394584 run osmo-hlr_10.42.42.2(pid=19377): Launched 08:50:04.509432 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:05.042805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19379): Launched 08:50:05.348590 run osmo-stp_10.42.42.5(pid=19380): Launched 08:50:05.464506 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:06.015163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Launched 08:50:06.321090 run osmo-msc_10.42.42.6(pid=19383): Launched 08:50:06.490411 run osmo-stp_10.42.42.5(pid=19380): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19380)] 08:50:06.619563 run osmo-stp_10.42.42.5(pid=19380): stdout: | (launched: 2022-12-10_08:50:05.289148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:06.748289 run osmo-stp_10.42.42.5(pid=19380): stderr: | 20221210085005461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085005462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085005462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085005462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085005464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085005465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085005465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:06.874771 run osmo-stp_10.42.42.5(pid=19380): stdout: | (launched: 2022-12-10_08:50:05.289148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:06.995279 run osmo-stp_10.42.42.5(pid=19380): stderr: | 20221210085005461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085005462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085005462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085005462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085005464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085005465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085005465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:07.139828 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19380): Process ended prematurely: osmo-stp_10.42.42.5(pid=19380) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19380)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:50:07.148770 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:50:07.175673 run osmo-hlr_10.42.42.2(pid=19377): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19377)] 08:50:07.223642 run osmo-hlr_10.42.42.2(pid=19377): stdout: | (launched: 2022-12-10_08:50:04.336350) 08:50:07.273233 run osmo-hlr_10.42.42.2(pid=19377): stderr: | 20221210085004518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085004518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085004518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085004518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085004518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085004518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085004533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085004541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085004541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085004541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:07.342084 run osmo-msc_10.42.42.6(pid=19383): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19383)] 08:50:07.389899 run osmo-msc_10.42.42.6(pid=19383): stdout: | (launched: 2022-12-10_08:50:06.262032) 08:50:07.438946 run osmo-msc_10.42.42.6(pid=19383): stderr: | 20221210085006538 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085006538 DLGLOBAL DEBUG validating counter group 0x7fe5823a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085006538 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085006538 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085006538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085006539 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085006541 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085006541 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085006541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085006541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:07.488695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19376): Terminating (SIGTERM) 08:50:07.528497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19379): Terminating (SIGTERM) 08:50:07.568417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Terminating (SIGTERM) 08:50:07.608446 --- ParallelTerminationStrategy: PID 19376 died... 08:50:07.627288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19376): Terminated: ok {rc=0} 08:50:07.671336 --- ParallelTerminationStrategy: PID 19379 died... 08:50:07.689748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19379): Terminated: ok {rc=0} 08:50:07.733672 --- ParallelTerminationStrategy: PID 19382 died... 08:50:07.752044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19382): Terminated: ok {rc=0} 08:50:07.837076 bus /sierra_3: Setting Powered False 08:50:08.934544 bus /sierra_3: Setting Powered False 08:50:10.046864 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:50:11.194344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.206809 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:50:11.281544 tst mo_mt_call_osmux.py: using LAC 27242 08:50:11.401465 tst mo_mt_call_osmux.py: using RAC 212 08:50:11.521301 tst mo_mt_call_osmux.py: using CellId 27242 08:50:11.640051 tst mo_mt_call_osmux.py: using BVCI 27243 08:50:11.749639 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.760840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.772038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.783408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.794689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:50:11.805985 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:50:11.921452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:50:12.038876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:12.540610 run create_hlr_db(pid=19385): Launched 08:50:12.670988 bus /sierra_2: Setting Powered False 08:50:13.735766 run create_hlr_db(pid=19385): Terminated: ok {rc=0} 08:50:14.184896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19387): Launched 08:50:14.509477 run osmo-hlr_10.42.42.2(pid=19388): Launched 08:50:14.631838 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:15.192651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19390): Launched 08:50:15.517306 run osmo-stp_10.42.42.5(pid=19391): Launched 08:50:15.640190 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:16.258980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19393): Launched 08:50:16.579471 run osmo-msc_10.42.42.6(pid=19394): Launched 08:50:16.836134 run osmo-stp_10.42.42.5(pid=19391): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19391)] 08:50:17.019677 run osmo-stp_10.42.42.5(pid=19391): stdout: | (launched: 2022-12-10_08:50:15.455335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:17.267721 run osmo-stp_10.42.42.5(pid=19391): stderr: | 20221210085015651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085015651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085015651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085015651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085015652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085015652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085015652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:17.400795 run osmo-stp_10.42.42.5(pid=19391): stdout: | (launched: 2022-12-10_08:50:15.455335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:17.522375 run osmo-stp_10.42.42.5(pid=19391): stderr: | 20221210085015651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085015651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085015651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085015651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085015652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085015652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085015652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:17.667139 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19391): Process ended prematurely: osmo-stp_10.42.42.5(pid=19391) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19391)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:50:17.676310 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:50:17.703564 run osmo-hlr_10.42.42.2(pid=19388): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19388)] 08:50:17.751762 run osmo-hlr_10.42.42.2(pid=19388): stdout: | (launched: 2022-12-10_08:50:14.446600) 08:50:17.801613 run osmo-hlr_10.42.42.2(pid=19388): stderr: | 20221210085014648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085014648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085014648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085014648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085014648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085014648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085014660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085014670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085014670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085014670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:17.870806 run osmo-msc_10.42.42.6(pid=19394): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19394)] 08:50:17.919120 run osmo-msc_10.42.42.6(pid=19394): stdout: | (launched: 2022-12-10_08:50:16.516841) 08:50:17.969155 run osmo-msc_10.42.42.6(pid=19394): stderr: | 20221210085017146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085017146 DLGLOBAL DEBUG validating counter group 0x7f3555dd0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085017146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085017146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085017147 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085017147 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085017148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085017153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085017153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085017153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:18.019271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19387): Terminating (SIGTERM) 08:50:18.059229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19390): Terminating (SIGTERM) 08:50:18.099283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19393): Terminating (SIGTERM) 08:50:18.139502 --- ParallelTerminationStrategy: PID 19387 died... 08:50:18.158368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19387): Terminated: ok {rc=0} 08:50:18.202651 --- ParallelTerminationStrategy: PID 19390 died... 08:50:18.221276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19390): Terminated: ok {rc=0} 08:50:18.265473 --- ParallelTerminationStrategy: PID 19393 died... 08:50:18.284002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19393): Terminated: ok {rc=0} 08:50:18.370510 bus /sierra_3: Setting Powered False 08:50:19.467433 bus /sierra_3: Setting Powered False 08:50:20.581338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:50:21.828557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:21.834890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:50:21.869461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:50:21.895785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:50:21.948680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:50:21.982226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:50:22.009113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:50:22.561998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:50:22.611400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:22.622725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:50:22.694046 tst mo_mt_call.py: using LAC 27243 08:50:22.814497 tst mo_mt_call.py: using RAC 213 08:50:22.934303 tst mo_mt_call.py: using CellId 27243 08:50:23.053849 tst mo_mt_call.py: using BVCI 27244 08:50:23.173836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:23.185469 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:23.196872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:23.208901 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:23.221118 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:23.232934 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:50:23.350169 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:50:23.465663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:23.936316 run create_hlr_db(pid=19399): Launched 08:50:24.053153 bus /sierra_2: Setting Powered False 08:50:25.113072 run create_hlr_db(pid=19399): Terminated: ok {rc=0} 08:50:25.554816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Launched 08:50:25.876312 run osmo-hlr_10.42.42.2(pid=19402): Launched 08:50:25.999022 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:26.553840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Launched 08:50:26.873672 run osmo-stp_10.42.42.5(pid=19405): Launched 08:50:26.996084 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:27.578335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Launched 08:50:27.898232 run osmo-msc_10.42.42.6(pid=19408): Launched 08:50:28.077193 run osmo-stp_10.42.42.5(pid=19405): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] 08:50:28.212393 run osmo-stp_10.42.42.5(pid=19405): stdout: | (launched: 2022-12-10_08:50:26.815586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:28.348453 run osmo-stp_10.42.42.5(pid=19405): stderr: | 20221210085027009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085027009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085027009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085027010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085027010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085027010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085027010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:28.483585 run osmo-stp_10.42.42.5(pid=19405): stdout: | (launched: 2022-12-10_08:50:26.815586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:28.611260 run osmo-stp_10.42.42.5(pid=19405): stderr: | 20221210085027009 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085027009 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085027009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085027010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085027010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085027010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085027010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:28.764251 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19405): Process ended prematurely: osmo-stp_10.42.42.5(pid=19405) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:50:28.773619 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:50:28.800776 run osmo-hlr_10.42.42.2(pid=19402): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19402)] 08:50:28.850232 run osmo-hlr_10.42.42.2(pid=19402): stdout: | (launched: 2022-12-10_08:50:25.818291) 08:50:28.901191 run osmo-hlr_10.42.42.2(pid=19402): stderr: | 20221210085026018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085026018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085026018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085026018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085026018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085026019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085026032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085026040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085026040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085026040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:28.972125 run osmo-msc_10.42.42.6(pid=19408): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19408)] 08:50:29.021351 run osmo-msc_10.42.42.6(pid=19408): stdout: | (launched: 2022-12-10_08:50:27.840214) 08:50:29.072441 run osmo-msc_10.42.42.6(pid=19408): stderr: | 20221210085028161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085028162 DLGLOBAL DEBUG validating counter group 0x7f6e4df53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085028162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085028162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085028162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085028162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085028164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085028164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085028164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085028164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:29.123794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Terminating (SIGTERM) 08:50:29.164824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Terminating (SIGTERM) 08:50:29.205920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Terminating (SIGTERM) 08:50:29.247369 --- ParallelTerminationStrategy: PID 19401 died... 08:50:29.266665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19401): Terminated: ok {rc=0} 08:50:29.312104 --- ParallelTerminationStrategy: PID 19404 died... 08:50:29.331542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19404): Terminated: ok {rc=0} 08:50:29.376831 --- ParallelTerminationStrategy: PID 19407 died... 08:50:29.396288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19407): Terminated: ok {rc=0} 08:50:29.482004 bus /sierra_3: Setting Powered False 08:50:30.578813 bus /sierra_3: Setting Powered False 08:50:31.705358 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:50:32.864695 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:32.877076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:50:32.949406 tst mo_mt_call_osmux.py: using LAC 27244 08:50:33.075478 tst mo_mt_call_osmux.py: using RAC 214 08:50:33.201747 tst mo_mt_call_osmux.py: using CellId 27244 08:50:33.328273 tst mo_mt_call_osmux.py: using BVCI 27245 08:50:33.441743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:33.453171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:33.464308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:33.476447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:33.489310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:50:33.500541 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:50:33.617459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:50:33.731667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:34.202593 run create_hlr_db(pid=19410): Launched 08:50:34.318004 bus /sierra_2: Setting Powered False 08:50:35.377972 run create_hlr_db(pid=19410): Terminated: ok {rc=0} 08:50:35.819281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19412): Launched 08:50:36.141495 run osmo-hlr_10.42.42.2(pid=19413): Launched 08:50:36.264841 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:36.823815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19415): Launched 08:50:37.143875 run osmo-stp_10.42.42.5(pid=19416): Launched 08:50:37.266836 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:37.850239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19418): Launched 08:50:38.171599 run osmo-msc_10.42.42.6(pid=19419): Launched 08:50:38.352061 run osmo-stp_10.42.42.5(pid=19416): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19416)] 08:50:38.487744 run osmo-stp_10.42.42.5(pid=19416): stdout: | (launched: 2022-12-10_08:50:37.085742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:38.623978 run osmo-stp_10.42.42.5(pid=19416): stderr: | 20221210085037276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085037276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085037276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085037277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085037277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085037277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085037278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:38.759449 run osmo-stp_10.42.42.5(pid=19416): stdout: | (launched: 2022-12-10_08:50:37.085742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:38.887368 run osmo-stp_10.42.42.5(pid=19416): stderr: | 20221210085037276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085037276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085037276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085037277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085037277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085037277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085037278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:39.040869 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19416): Process ended prematurely: osmo-stp_10.42.42.5(pid=19416) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19416)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:50:39.050611 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:50:39.078083 run osmo-hlr_10.42.42.2(pid=19413): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19413)] 08:50:39.128015 run osmo-hlr_10.42.42.2(pid=19413): stdout: | (launched: 2022-12-10_08:50:36.083473) 08:50:39.179918 run osmo-hlr_10.42.42.2(pid=19413): stderr: | 20221210085036282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085036282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085036282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085036282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085036283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085036283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085036296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085036306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085036306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085036307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:39.251638 run osmo-msc_10.42.42.6(pid=19419): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19419)] 08:50:39.301565 run osmo-msc_10.42.42.6(pid=19419): stdout: | (launched: 2022-12-10_08:50:38.113345) 08:50:39.353319 run osmo-msc_10.42.42.6(pid=19419): stderr: | 20221210085038434 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085038435 DLGLOBAL DEBUG validating counter group 0x7effd9840c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085038435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085038435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085038435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085038435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085038437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085038437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085038437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085038437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:39.405183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19412): Terminating (SIGTERM) 08:50:39.446275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19415): Terminating (SIGTERM) 08:50:39.488113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19418): Terminating (SIGTERM) 08:50:39.529677 --- ParallelTerminationStrategy: PID 19412 died... 08:50:39.549549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19412): Terminated: ok {rc=0} 08:50:39.595634 --- ParallelTerminationStrategy: PID 19415 died... 08:50:39.615048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19415): Terminated: ok {rc=0} 08:50:39.660624 --- ParallelTerminationStrategy: PID 19418 died... 08:50:39.680067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19418): Terminated: ok {rc=0} 08:50:39.766162 bus /sierra_3: Setting Powered False 08:50:40.863586 bus /sierra_3: Setting Powered False 08:50:41.980234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:50:43.243196 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:50:43.251219 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:50:43.285975 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:50:43.313193 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:50:43.364472 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:50:43.398912 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:50:43.425963 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:50:43.982528 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:50:44.033506 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.045388 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:50:44.115470 tst mo_mt_call.py: using LAC 27245 08:50:44.239738 tst mo_mt_call.py: using RAC 215 08:50:44.365217 tst mo_mt_call.py: using CellId 27245 08:50:44.490443 tst mo_mt_call.py: using BVCI 27246 08:50:44.607018 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.618723 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.630226 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.641785 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.653350 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:44.664840 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:44.780898 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:44.902381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:45.376841 run create_hlr_db(pid=19424): Launched 08:50:45.492729 bus /sierra_2: Setting Powered False 08:50:46.551296 run create_hlr_db(pid=19424): Terminated: ok {rc=0} 08:50:46.989855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19426): Launched 08:50:47.313066 run osmo-hlr_10.42.42.2(pid=19427): Launched 08:50:47.430461 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:47.967840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19429): Launched 08:50:48.272318 run osmo-stp_10.42.42.5(pid=19430): Launched 08:50:48.387887 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:48.936685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19432): Launched 08:50:49.242598 run osmo-msc_10.42.42.6(pid=19433): Launched 08:50:49.413340 run osmo-stp_10.42.42.5(pid=19430): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19430)] 08:50:49.545693 run osmo-stp_10.42.42.5(pid=19430): stdout: | (launched: 2022-12-10_08:50:48.213871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:49.674453 run osmo-stp_10.42.42.5(pid=19430): stderr: | 20221210085048388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085048388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085048389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085048389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085048390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085048390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085048390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:49.801330 run osmo-stp_10.42.42.5(pid=19430): stdout: | (launched: 2022-12-10_08:50:48.213871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:49.921731 run osmo-stp_10.42.42.5(pid=19430): stderr: | 20221210085048388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085048388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085048389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085048389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085048390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085048390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085048390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:50:50.065864 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19430): Process ended prematurely: osmo-stp_10.42.42.5(pid=19430) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19430)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:50:50.074795 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:50:50.101393 run osmo-hlr_10.42.42.2(pid=19427): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19427)] 08:50:50.149129 run osmo-hlr_10.42.42.2(pid=19427): stdout: | (launched: 2022-12-10_08:50:47.253496) 08:50:50.198102 run osmo-hlr_10.42.42.2(pid=19427): stderr: | 20221210085047435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085047435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085047435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085047435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085047435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085047435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085047447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085047455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085047455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085047455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:50:50.266449 run osmo-msc_10.42.42.6(pid=19433): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19433)] 08:50:50.313870 run osmo-msc_10.42.42.6(pid=19433): stdout: | (launched: 2022-12-10_08:50:49.183787) 08:50:50.362972 run osmo-msc_10.42.42.6(pid=19433): stderr: | 20221210085049459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085049459 DLGLOBAL DEBUG validating counter group 0x7f287b913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085049459 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085049459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085049460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085049460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085049462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085049462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085049462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085049462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:50:50.412483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19426): Terminating (SIGTERM) 08:50:50.451806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19429): Terminating (SIGTERM) 08:50:50.491244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19432): Terminating (SIGTERM) 08:50:50.531006 --- ParallelTerminationStrategy: PID 19426 died... 08:50:50.549924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19426): Terminated: ok {rc=0} 08:50:50.594173 --- ParallelTerminationStrategy: PID 19429 died... 08:50:50.612567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19429): Terminated: ok {rc=0} 08:50:50.656532 --- ParallelTerminationStrategy: PID 19432 died... 08:50:50.674968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19432): Terminated: ok {rc=0} 08:50:50.760420 bus /sierra_3: Setting Powered False 08:50:51.859319 bus /sierra_3: Setting Powered False 08:50:52.973959 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:50:54.119782 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.131722 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:50:54.202642 tst mo_mt_call_osmux.py: using LAC 27246 08:50:54.323650 tst mo_mt_call_osmux.py: using RAC 216 08:50:54.444334 tst mo_mt_call_osmux.py: using CellId 27246 08:50:54.565266 tst mo_mt_call_osmux.py: using BVCI 27247 08:50:54.675895 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.687326 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.698995 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.710588 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.722198 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:50:54.733620 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:54.852093 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:50:54.969960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:50:55.444370 run create_hlr_db(pid=19435): Launched 08:50:55.559227 bus /sierra_2: Setting Powered False 08:50:56.619270 run create_hlr_db(pid=19435): Terminated: ok {rc=0} 08:50:57.064370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19437): Launched 08:50:57.390227 run osmo-hlr_10.42.42.2(pid=19438): Launched 08:50:57.512840 run osmo-stp_10.42.42.5: Starting osmo-stp 08:50:58.072885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19440): Launched 08:50:58.398649 run osmo-stp_10.42.42.5(pid=19441): Launched 08:50:58.521270 run osmo-msc_10.42.42.6: Starting osmo-msc 08:50:59.109346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19443): Launched 08:50:59.434908 run osmo-msc_10.42.42.6(pid=19444): Launched 08:50:59.614768 run osmo-stp_10.42.42.5(pid=19441): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19441)] 08:50:59.750744 run osmo-stp_10.42.42.5(pid=19441): stdout: | (launched: 2022-12-10_08:50:58.335006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:50:59.887931 run osmo-stp_10.42.42.5(pid=19441): stderr: | 20221210085058533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085058533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085058533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085058534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085058534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085058534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085058534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:00.023433 run osmo-stp_10.42.42.5(pid=19441): stdout: | (launched: 2022-12-10_08:50:58.335006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:00.151733 run osmo-stp_10.42.42.5(pid=19441): stderr: | 20221210085058533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085058533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085058533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085058534 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085058534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085058534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085058534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:00.305327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19441): Process ended prematurely: osmo-stp_10.42.42.5(pid=19441) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19441)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:51:00.314957 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:51:00.343063 run osmo-hlr_10.42.42.2(pid=19438): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19438)] 08:51:00.393126 run osmo-hlr_10.42.42.2(pid=19438): stdout: | (launched: 2022-12-10_08:50:57.326117) 08:51:00.444816 run osmo-hlr_10.42.42.2(pid=19438): stderr: | 20221210085057532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085057532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085057532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085057532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085057532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085057532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085057544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085057553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085057553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085057553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:00.516748 run osmo-msc_10.42.42.6(pid=19444): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19444)] 08:51:00.566823 run osmo-msc_10.42.42.6(pid=19444): stdout: | (launched: 2022-12-10_08:50:59.371399) 08:51:00.618312 run osmo-msc_10.42.42.6(pid=19444): stderr: | 20221210085059699 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085059699 DLGLOBAL DEBUG validating counter group 0x7f4098061c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085059699 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085059699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085059700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085059700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085059702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085059702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085059702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085059702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:00.669990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19437): Terminating (SIGTERM) 08:51:00.711180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19440): Terminating (SIGTERM) 08:51:00.752798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19443): Terminating (SIGTERM) 08:51:00.794780 --- ParallelTerminationStrategy: PID 19437 died... 08:51:00.814574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19437): Terminated: ok {rc=0} 08:51:00.881317 --- ParallelTerminationStrategy: PID 19440 died... 08:51:00.901483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19440): Terminated: ok {rc=0} 08:51:00.949146 --- ParallelTerminationStrategy: PID 19443 died... 08:51:00.968774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19443): Terminated: ok {rc=0} 08:51:01.058825 bus /sierra_3: Setting Powered False 08:51:02.157683 bus /sierra_3: Setting Powered False 08:51:03.274532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:51:04.533481 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:04.539600 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:51:04.574527 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:51:04.602118 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:51:04.656225 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:51:04.691828 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:51:04.719132 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:51:05.269187 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:51:05.321193 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.333153 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:51:05.405397 tst mo_mt_call.py: using LAC 27247 08:51:05.533381 tst mo_mt_call.py: using RAC 217 08:51:05.661159 tst mo_mt_call.py: using CellId 27247 08:51:05.791360 tst mo_mt_call.py: using BVCI 27248 08:51:05.909367 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.920672 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.931921 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.943459 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.955029 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:05.966463 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:51:06.081754 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:51:06.202630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:06.702847 run create_hlr_db(pid=19449): Launched 08:51:06.832636 bus /sierra_2: Setting Powered False 08:51:07.896397 run create_hlr_db(pid=19449): Terminated: ok {rc=0} 08:51:08.328289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19451): Launched 08:51:08.631566 run osmo-hlr_10.42.42.2(pid=19452): Launched 08:51:08.748174 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:09.274309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19454): Launched 08:51:09.576201 run osmo-stp_10.42.42.5(pid=19455): Launched 08:51:09.693116 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:10.242128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19457): Launched 08:51:10.544700 run osmo-msc_10.42.42.6(pid=19458): Launched 08:51:10.715560 run osmo-stp_10.42.42.5(pid=19455): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19455)] 08:51:10.844666 run osmo-stp_10.42.42.5(pid=19455): stdout: | (launched: 2022-12-10_08:51:09.521484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:10.973340 run osmo-stp_10.42.42.5(pid=19455): stderr: | 20221210085109693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085109693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085109694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085109694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085109695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085109695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085109695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:11.099313 run osmo-stp_10.42.42.5(pid=19455): stdout: | (launched: 2022-12-10_08:51:09.521484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:11.219894 run osmo-stp_10.42.42.5(pid=19455): stderr: | 20221210085109693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085109693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085109694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085109694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085109695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085109695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085109695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:11.363740 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19455): Process ended prematurely: osmo-stp_10.42.42.5(pid=19455) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19455)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:51:11.372721 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:51:11.399127 run osmo-hlr_10.42.42.2(pid=19452): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19452)] 08:51:11.446522 run osmo-hlr_10.42.42.2(pid=19452): stdout: | (launched: 2022-12-10_08:51:08.576487) 08:51:11.495618 run osmo-hlr_10.42.42.2(pid=19452): stderr: | 20221210085108756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085108756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085108756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085108756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085108756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085108756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085108768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085108777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085108777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085108777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:11.563964 run osmo-msc_10.42.42.6(pid=19458): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19458)] 08:51:11.611335 run osmo-msc_10.42.42.6(pid=19458): stdout: | (launched: 2022-12-10_08:51:10.489751) 08:51:11.660159 run osmo-msc_10.42.42.6(pid=19458): stderr: | 20221210085110763 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085110763 DLGLOBAL DEBUG validating counter group 0x7f8535615c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085110764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085110764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085110764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085110764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085110766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085110767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085110767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085110767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:11.709672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19451): Terminating (SIGTERM) 08:51:11.749203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19454): Terminating (SIGTERM) 08:51:11.788778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19457): Terminating (SIGTERM) 08:51:11.828301 --- ParallelTerminationStrategy: PID 19451 died... 08:51:11.847095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19451): Terminated: ok {rc=0} 08:51:11.891244 --- ParallelTerminationStrategy: PID 19454 died... 08:51:11.909680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19454): Terminated: ok {rc=0} 08:51:11.953625 --- ParallelTerminationStrategy: PID 19457 died... 08:51:11.971810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19457): Terminated: ok {rc=0} 08:51:12.058154 bus /sierra_3: Setting Powered False 08:51:13.157756 bus /sierra_3: Setting Powered False 08:51:14.274164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:51:15.418378 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:15.430109 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:51:15.500347 tst mo_mt_call_osmux.py: using LAC 27248 08:51:15.619875 tst mo_mt_call_osmux.py: using RAC 218 08:51:15.739148 tst mo_mt_call_osmux.py: using CellId 27248 08:51:15.864708 tst mo_mt_call_osmux.py: using BVCI 27249 08:51:15.979120 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:15.991271 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:16.003057 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:16.015904 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:16.029964 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:51:16.041889 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:51:16.161584 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:51:16.311268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:16.842884 run create_hlr_db(pid=19460): Launched 08:51:16.999642 bus /sierra_2: Setting Powered False 08:51:18.062647 run create_hlr_db(pid=19460): Terminated: ok {rc=0} 08:51:18.509568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19462): Launched 08:51:18.828658 run osmo-hlr_10.42.42.2(pid=19463): Launched 08:51:18.950875 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:19.502590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19465): Launched 08:51:19.822453 run osmo-stp_10.42.42.5(pid=19466): Launched 08:51:19.945460 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:20.528074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19468): Launched 08:51:20.848900 run osmo-msc_10.42.42.6(pid=19469): Launched 08:51:21.028349 run osmo-stp_10.42.42.5(pid=19466): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19466)] 08:51:21.163894 run osmo-stp_10.42.42.5(pid=19466): stdout: | (launched: 2022-12-10_08:51:19.764271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:21.300466 run osmo-stp_10.42.42.5(pid=19466): stderr: | 20221210085119956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085119956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085119956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085119956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085119959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085119959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085119959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:21.436545 run osmo-stp_10.42.42.5(pid=19466): stdout: | (launched: 2022-12-10_08:51:19.764271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:21.564710 run osmo-stp_10.42.42.5(pid=19466): stderr: | 20221210085119956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085119956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085119956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085119956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085119959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085119959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085119959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:21.717892 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19466): Process ended prematurely: osmo-stp_10.42.42.5(pid=19466) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19466)] [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:51:21.727429 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:51:21.755092 run osmo-hlr_10.42.42.2(pid=19463): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19463)] 08:51:21.805690 run osmo-hlr_10.42.42.2(pid=19463): stdout: | (launched: 2022-12-10_08:51:18.771132) 08:51:21.857737 run osmo-hlr_10.42.42.2(pid=19463): stderr: | 20221210085118969 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085118969 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085118969 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085118969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085118969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085118969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085118981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085118989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085118989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085118989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:21.930457 run osmo-msc_10.42.42.6(pid=19469): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19469)] 08:51:21.980751 run osmo-msc_10.42.42.6(pid=19469): stdout: | (launched: 2022-12-10_08:51:20.790785) 08:51:22.032229 run osmo-msc_10.42.42.6(pid=19469): stderr: | 20221210085121114 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085121114 DLGLOBAL DEBUG validating counter group 0x7f251ed36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085121114 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085121114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085121114 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085121114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085121116 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085121116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085121117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085121117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:22.083779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19462): Terminating (SIGTERM) 08:51:22.125321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19465): Terminating (SIGTERM) 08:51:22.166855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19468): Terminating (SIGTERM) 08:51:22.208409 --- ParallelTerminationStrategy: PID 19462 died... 08:51:22.227891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19462): Terminated: ok {rc=0} 08:51:22.274062 --- ParallelTerminationStrategy: PID 19465 died... 08:51:22.293649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19465): Terminated: ok {rc=0} 08:51:22.339858 --- ParallelTerminationStrategy: PID 19468 died... 08:51:22.359399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19468): Terminated: ok {rc=0} 08:51:22.445810 bus /sierra_3: Setting Powered False 08:51:23.543698 bus /sierra_3: Setting Powered False 08:51:24.658544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 08:51:25.912703 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:25.917519 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:51:25.952424 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:51:25.979993 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:51:26.066627 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:51:26.101537 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:51:26.128857 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:51:26.715456 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 08:51:26.720821 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:26.732213 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:51:26.784913 tst emergency_mo_mt_call.py: using LAC 27249 08:51:26.913180 tst emergency_mo_mt_call.py: using RAC 219 08:51:27.036890 tst emergency_mo_mt_call.py: using CellId 27249 08:51:27.158381 tst emergency_mo_mt_call.py: using BVCI 27250 08:51:27.273497 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:27.285072 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:27.296271 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:27.307763 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:27.319119 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:27.330590 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:27.445930 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:27.565495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:28.057716 run create_hlr_db(pid=19474): Launched 08:51:28.185033 bus /sierra_2: Setting Powered False 08:51:29.246322 run create_hlr_db(pid=19474): Terminated: ok {rc=0} 08:51:29.674946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19476): Launched 08:51:29.975633 run osmo-hlr_10.42.42.2(pid=19477): Launched 08:51:30.088662 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:30.604380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19479): Launched 08:51:30.921745 run osmo-stp_10.42.42.5(pid=19480): Launched 08:51:31.159827 tst emergency_mo_mt_call.py: using MSISDN 7648 08:51:31.355121 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:31.953701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19482): Launched 08:51:32.281784 run osmo-msc_10.42.42.6(pid=19483): Launched 08:51:32.455295 run osmo-stp_10.42.42.5(pid=19480): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19480)] 08:51:32.583773 run osmo-stp_10.42.42.5(pid=19480): stdout: | (launched: 2022-12-10_08:51:30.846919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:32.710205 run osmo-stp_10.42.42.5(pid=19480): stderr: | 20221210085131072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085131072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085131072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085131073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085131073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085131073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085131073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:32.836233 run osmo-stp_10.42.42.5(pid=19480): stdout: | (launched: 2022-12-10_08:51:30.846919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:32.963249 run osmo-stp_10.42.42.5(pid=19480): stderr: | 20221210085131072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085131072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085131072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085131073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085131073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085131073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085131073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:33.113325 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19480): Process ended prematurely: osmo-stp_10.42.42.5(pid=19480) [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19480)] [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 08:51:33.122020 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 08:51:33.148866 run osmo-hlr_10.42.42.2(pid=19477): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19477)] 08:51:33.198777 run osmo-hlr_10.42.42.2(pid=19477): stdout: | (launched: 2022-12-10_08:51:29.917836) 08:51:33.250174 run osmo-hlr_10.42.42.2(pid=19477): stderr: | 20221210085130099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085130099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085130099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085130099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085130099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085130099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085130111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085130119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085130120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085130120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:33.321594 run osmo-msc_10.42.42.6(pid=19483): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19483)] 08:51:33.371751 run osmo-msc_10.42.42.6(pid=19483): stdout: | (launched: 2022-12-10_08:51:32.209239) 08:51:33.422830 run osmo-msc_10.42.42.6(pid=19483): stderr: | 20221210085132499 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085132499 DLGLOBAL DEBUG validating counter group 0x7fc270735c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085132499 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085132500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085132500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085132500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085132502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085132502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085132502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085132502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:33.474264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19476): Terminating (SIGTERM) 08:51:33.515306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19479): Terminating (SIGTERM) 08:51:33.556448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19482): Terminating (SIGTERM) 08:51:33.597996 --- ParallelTerminationStrategy: PID 19476 died... 08:51:33.617765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19476): Terminated: ok {rc=0} 08:51:33.663500 --- ParallelTerminationStrategy: PID 19479 died... 08:51:33.683006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19479): Terminated: ok {rc=0} 08:51:33.728668 --- ParallelTerminationStrategy: PID 19482 died... 08:51:33.748125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19482): Terminated: ok {rc=0} 08:51:33.834947 bus /sierra_3: Setting Powered False 08:51:34.934109 bus /sierra_3: Setting Powered False 08:51:36.049029 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 08:51:37.133512 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.144878 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:51:37.195820 tst emergency_preemptive_call.py: using LAC 27250 08:51:37.313376 tst emergency_preemptive_call.py: using RAC 220 08:51:37.429393 tst emergency_preemptive_call.py: using CellId 27250 08:51:37.546508 tst emergency_preemptive_call.py: using BVCI 27251 08:51:37.653559 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.664268 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.674884 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.685826 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.696589 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:51:37.707424 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:37.824406 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:37.941484 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:38.060917 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:38.177692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:38.673496 run create_hlr_db(pid=19485): Launched 08:51:38.802500 bus /sierra_2: Setting Powered False 08:51:39.865221 run create_hlr_db(pid=19485): Terminated: ok {rc=0} 08:51:40.295220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19487): Launched 08:51:40.595651 run osmo-hlr_10.42.42.2(pid=19488): Launched 08:51:40.708780 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:41.237917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19490): Launched 08:51:41.538420 run osmo-stp_10.42.42.5(pid=19491): Launched 08:51:41.661650 tst emergency_preemptive_call.py: using MSISDN 7649 08:51:41.827775 run osmo-msc_10.42.42.6: Starting osmo-msc 08:51:42.364056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19493): Launched 08:51:42.665312 run osmo-msc_10.42.42.6(pid=19494): Launched 08:51:42.831593 run osmo-stp_10.42.42.5(pid=19491): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19491)] 08:51:42.958491 run osmo-stp_10.42.42.5(pid=19491): stdout: | (launched: 2022-12-10_08:51:41.480068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:43.086017 run osmo-stp_10.42.42.5(pid=19491): stderr: | 20221210085141653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085141654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085141655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085141655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085141656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085141656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085141656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:43.210655 run osmo-stp_10.42.42.5(pid=19491): stdout: | (launched: 2022-12-10_08:51:41.480068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:51:43.329242 run osmo-stp_10.42.42.5(pid=19491): stderr: | 20221210085141653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085141654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085141655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085141655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085141656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085141656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085141656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:51:43.470824 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19491): Process ended prematurely: osmo-stp_10.42.42.5(pid=19491) [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19491)] [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 08:51:43.479162 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 08:51:43.505160 run osmo-hlr_10.42.42.2(pid=19488): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19488)] 08:51:43.553427 run osmo-hlr_10.42.42.2(pid=19488): stdout: | (launched: 2022-12-10_08:51:40.537797) 08:51:43.602763 run osmo-hlr_10.42.42.2(pid=19488): stderr: | 20221210085140718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085140718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085140718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085140718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085140718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085140718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085140736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085140745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085140745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085140745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:51:43.671634 run osmo-msc_10.42.42.6(pid=19494): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19494)] 08:51:43.719936 run osmo-msc_10.42.42.6(pid=19494): stdout: | (launched: 2022-12-10_08:51:42.606302) 08:51:43.769415 run osmo-msc_10.42.42.6(pid=19494): stderr: | 20221210085142882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085142882 DLGLOBAL DEBUG validating counter group 0x7f83da44dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085142882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085142882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085142882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085142883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085142885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085142885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085142885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085142886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:51:43.819188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19487): Terminating (SIGTERM) 08:51:43.858416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19490): Terminating (SIGTERM) 08:51:43.898005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19493): Terminating (SIGTERM) 08:51:43.937646 --- ParallelTerminationStrategy: PID 19487 died... 08:51:43.956522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19487): Terminated: ok {rc=0} 08:51:44.000756 --- ParallelTerminationStrategy: PID 19490 died... 08:51:44.019701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19490): Terminated: ok {rc=0} 08:51:44.063450 --- ParallelTerminationStrategy: PID 19493 died... 08:51:44.081979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19493): Terminated: ok {rc=0} 08:51:44.167284 bus /sierra_9: Setting Powered False 08:51:45.266294 bus /sierra_9: Setting Powered False 08:51:46.390751 bus /sierra_8: Setting Powered False 08:51:47.498869 bus /sierra_8: Setting Powered False 08:51:48.613321 bus /sierra_3: Setting Powered False 08:51:49.709603 bus /sierra_3: Setting Powered False 08:51:50.825531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 08:51:52.114435 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:51:52.119600 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 08:51:52.154901 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 08:51:52.193110 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 08:51:52.279520 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 08:51:52.312827 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 08:51:52.350923 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 08:51:52.942991 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 08:51:52.992715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.003475 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:51:53.052115 tst cs_paging_gprs_active.py: using LAC 27251 08:51:53.172870 tst cs_paging_gprs_active.py: using RAC 221 08:51:53.291872 tst cs_paging_gprs_active.py: using CellId 27251 08:51:53.411864 tst cs_paging_gprs_active.py: using BVCI 27252 08:51:53.523290 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.533999 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.544404 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.555206 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.565881 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.576485 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.587316 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.597951 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:51:53.608722 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:53.728510 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:51:53.846691 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:51:54.051885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:54.357520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19500): Launched 08:51:54.621908 run iperf3-srv_10.42.42.10(pid=19501): Launched 08:51:54.735886 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:51:54.939957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:51:55.244893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19502): Launched 08:51:55.509541 run iperf3-srv_10.42.42.10(pid=19503): Launched 08:51:55.623389 tst cs_paging_gprs_active.py:38: start network... 08:51:55.827778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:51:56.299398 run create_hlr_db(pid=19504): Launched 08:51:56.415589 bus /sierra_2: Setting Powered False 08:51:57.475740 run create_hlr_db(pid=19504): Terminated: ok {rc=0} 08:51:57.918082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19506): Launched 08:51:58.239952 run osmo-hlr_10.42.42.2(pid=19507): Launched 08:51:58.363605 run osmo-stp_10.42.42.5: Starting osmo-stp 08:51:58.921903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19509): Launched 08:51:59.243056 run osmo-stp_10.42.42.5(pid=19510): Launched 08:51:59.366681 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:51:59.922795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19512): Launched 08:52:00.045527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:00.318213 run patchelf(pid=19513): Launched 08:52:00.497767 run osmo-stp_10.42.42.5(pid=19510): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19510)] 08:52:00.633634 run osmo-stp_10.42.42.5(pid=19510): stdout: | (launched: 2022-12-10_08:51:59.184628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:00.771101 run osmo-stp_10.42.42.5(pid=19510): stderr: | 20221210085159377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085159377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085159378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085159378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085159380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085159380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085159380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:00.942019 run osmo-stp_10.42.42.5(pid=19510): stdout: | (launched: 2022-12-10_08:51:59.184628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:01.114633 run osmo-stp_10.42.42.5(pid=19510): stderr: | 20221210085159377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085159377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085159378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085159378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085159380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085159380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085159380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:01.278752 run patchelf(pid=19513): Terminating (SIGINT) 08:52:01.457820 run patchelf(pid=19513): Terminated: ok {rc=0} 08:52:01.587675 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19510): Process ended prematurely: osmo-stp_10.42.42.5(pid=19510) [trial-2372↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19510)] [trial-2372↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 08:52:01.598446 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:52:01.629164 run osmo-hlr_10.42.42.2(pid=19507): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19507)] 08:52:01.680421 run osmo-hlr_10.42.42.2(pid=19507): stdout: | (launched: 2022-12-10_08:51:58.181892) 08:52:01.734085 run osmo-hlr_10.42.42.2(pid=19507): stderr: | 20221210085158382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085158382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085158382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085158382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085158382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085158382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085158394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085158402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085158403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085158403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:01.788250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19500): Terminating (SIGTERM) 08:52:01.831392 run iperf3-srv_10.42.42.10(pid=19501): Terminating (SIGTERM) 08:52:01.874286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19502): Terminating (SIGTERM) 08:52:01.918205 run iperf3-srv_10.42.42.10(pid=19503): Terminating (SIGTERM) 08:52:01.960529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19506): Terminating (SIGTERM) 08:52:02.003111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19509): Terminating (SIGTERM) 08:52:02.047095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19512): Terminating (SIGTERM) 08:52:02.091591 --- ParallelTerminationStrategy: PID 19500 died... 08:52:02.112415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19500): Terminated: ok {rc=0} 08:52:02.161448 --- ParallelTerminationStrategy: PID 19501 died... 08:52:02.180620 run iperf3-srv_10.42.42.10(pid=19501): Terminated {rc=256} 08:52:02.227974 --- ParallelTerminationStrategy: PID 19502 died... 08:52:02.246424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19502): Terminated: ok {rc=0} 08:52:02.291370 --- ParallelTerminationStrategy: PID 19503 died... 08:52:02.309741 run iperf3-srv_10.42.42.10(pid=19503): Terminated {rc=256} 08:52:02.354973 --- ParallelTerminationStrategy: PID 19506 died... 08:52:02.373314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19506): Terminated: ok {rc=0} 08:52:02.418410 --- ParallelTerminationStrategy: PID 19509 died... 08:52:02.436678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19509): Terminated: ok {rc=0} 08:52:02.482318 --- ParallelTerminationStrategy: PID 19512 died... 08:52:02.500885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19512): Terminated: ok {rc=0} 08:52:02.588539 bus /gobi_0: Setting Powered False 08:52:03.687497 bus /gobi_0: Setting Powered False 08:52:04.801247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 08:52:05.949255 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:05.961081 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:52:06.014356 tst iperf3.py: using LAC 27252 08:52:06.143054 tst iperf3.py: using RAC 222 08:52:06.271786 tst iperf3.py: using CellId 27252 08:52:06.399836 tst iperf3.py: using BVCI 27253 08:52:06.517416 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.528651 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.539663 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.550727 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.561754 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.572635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.583824 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.594757 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:06.605826 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:06.725643 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:52:06.944028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:07.267374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Launched 08:52:07.546930 run iperf3-srv_10.42.42.10(pid=19515): Launched 08:52:07.667497 tst iperf3.py:8: start network... 08:52:07.884915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:08.386289 run create_hlr_db(pid=19516): Launched 08:52:08.517615 bus /gobi_6: Setting Powered False 08:52:09.581575 run create_hlr_db(pid=19516): Terminated: ok {rc=0} 08:52:10.013920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19518): Launched 08:52:10.316868 run osmo-hlr_10.42.42.2(pid=19519): Launched 08:52:10.432868 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:10.971435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19521): Launched 08:52:11.274617 run osmo-stp_10.42.42.5(pid=19522): Launched 08:52:11.391291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:11.919120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19524): Launched 08:52:12.034998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:12.293166 run patchelf(pid=19525): Launched 08:52:12.462477 run osmo-stp_10.42.42.5(pid=19522): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19522)] 08:52:12.591137 run osmo-stp_10.42.42.5(pid=19522): stdout: | (launched: 2022-12-10_08:52:11.219221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:12.721744 run osmo-stp_10.42.42.5(pid=19522): stderr: | 20221210085211391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085211391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085211391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085211392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085211392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085211392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085211392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:12.852306 run osmo-stp_10.42.42.5(pid=19522): stdout: | (launched: 2022-12-10_08:52:11.219221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:12.977366 run osmo-stp_10.42.42.5(pid=19522): stderr: | 20221210085211391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085211391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085211391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085211392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085211392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085211392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085211392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:13.125239 run patchelf(pid=19525): Terminating (SIGINT) 08:52:13.295849 run patchelf(pid=19525): Terminated: ok {rc=0} 08:52:13.419486 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19522): Process ended prematurely: osmo-stp_10.42.42.5(pid=19522) [trial-2372↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19522)] [trial-2372↪gprs:trx-sysmocell5000↪iperf3.py:8] 08:52:13.428797 tst iperf3.py:8: Test FAILED (7.5 sec) 08:52:13.456187 run osmo-hlr_10.42.42.2(pid=19519): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19519)] 08:52:13.504304 run osmo-hlr_10.42.42.2(pid=19519): stdout: | (launched: 2022-12-10_08:52:10.261597) 08:52:13.553855 run osmo-hlr_10.42.42.2(pid=19519): stderr: | 20221210085210436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085210437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085210437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085210437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085210437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085210437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085210454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085210464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085210464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085210464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:13.603421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Terminating (SIGTERM) 08:52:13.642867 run iperf3-srv_10.42.42.10(pid=19515): Terminating (SIGTERM) 08:52:13.682014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19518): Terminating (SIGTERM) 08:52:13.721506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19521): Terminating (SIGTERM) 08:52:13.761002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19524): Terminating (SIGTERM) 08:52:13.800764 --- ParallelTerminationStrategy: PID 19514 died... 08:52:13.819730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19514): Terminated: ok {rc=0} 08:52:13.863712 --- ParallelTerminationStrategy: PID 19515 died... 08:52:13.882024 run iperf3-srv_10.42.42.10(pid=19515): Terminated {rc=256} 08:52:13.925462 --- ParallelTerminationStrategy: PID 19518 died... 08:52:13.943608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19518): Terminated: ok {rc=0} 08:52:13.987368 --- ParallelTerminationStrategy: PID 19521 died... 08:52:14.005693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19521): Terminated: ok {rc=0} 08:52:14.049918 --- ParallelTerminationStrategy: PID 19524 died... 08:52:14.068211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19524): Terminated: ok {rc=0} 08:52:14.151020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 08:52:15.299308 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.311207 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:52:15.364919 tst iperf3m4.py: using LAC 27253 08:52:15.492660 tst iperf3m4.py: using RAC 223 08:52:15.618934 tst iperf3m4.py: using CellId 27253 08:52:15.745341 tst iperf3m4.py: using BVCI 27254 08:52:15.871327 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.886452 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.900534 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.912374 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.924544 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.936747 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.949207 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.961853 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:15.974333 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:16.101570 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:16.243444 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:16.386494 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:16.511655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:52:16.757623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:17.077701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Launched 08:52:17.353687 run iperf3-srv_10.42.42.10(pid=19528): Launched 08:52:17.467159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:52:17.671286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:17.975919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19529): Launched 08:52:18.239009 run iperf3-srv_10.42.42.10(pid=19530): Launched 08:52:18.353246 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:52:18.557111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:18.861574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19531): Launched 08:52:19.124630 run iperf3-srv_10.42.42.10(pid=19532): Launched 08:52:19.238030 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:52:19.441217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:19.745031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Launched 08:52:20.008886 run iperf3-srv_10.42.42.10(pid=19534): Launched 08:52:20.122370 tst iperf3m4.py:8: start network... 08:52:20.326256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:20.796768 run create_hlr_db(pid=19535): Launched 08:52:20.913727 bus /gobi_6: Setting Powered False 08:52:21.974068 run create_hlr_db(pid=19535): Terminated: ok {rc=0} 08:52:22.398334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Launched 08:52:22.702257 run osmo-hlr_10.42.42.2(pid=19538): Launched 08:52:22.819120 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:23.357953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Launched 08:52:23.661061 run osmo-stp_10.42.42.5(pid=19541): Launched 08:52:23.778176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:24.302668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Launched 08:52:24.418531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:24.675178 run patchelf(pid=19544): Launched 08:52:24.843707 run osmo-stp_10.42.42.5(pid=19541): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] 08:52:24.972201 run osmo-stp_10.42.42.5(pid=19541): stdout: | (launched: 2022-12-10_08:52:23.605576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:25.102386 run osmo-stp_10.42.42.5(pid=19541): stderr: | 20221210085223778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085223779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085223779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085223779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085223780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085223780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085223780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:25.232281 run osmo-stp_10.42.42.5(pid=19541): stdout: | (launched: 2022-12-10_08:52:23.605576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:25.356916 run osmo-stp_10.42.42.5(pid=19541): stderr: | 20221210085223778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085223779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085223779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085223779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085223780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085223780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085223780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:25.504289 run patchelf(pid=19544): Terminating (SIGINT) 08:52:25.674192 run patchelf(pid=19544): Terminated: ok {rc=0} 08:52:25.797095 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19541): Process ended prematurely: osmo-stp_10.42.42.5(pid=19541) [trial-2372↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] [trial-2372↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 08:52:25.806449 tst iperf3m4.py:8: Test FAILED (10.5 sec) 08:52:25.834035 run osmo-hlr_10.42.42.2(pid=19538): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19538)] 08:52:25.881787 run osmo-hlr_10.42.42.2(pid=19538): stdout: | (launched: 2022-12-10_08:52:22.646160) 08:52:25.930995 run osmo-hlr_10.42.42.2(pid=19538): stderr: | 20221210085222825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085222825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085222825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085222825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085222825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085222825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085222837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085222845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085222845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085222845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:25.980475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Terminating (SIGTERM) 08:52:26.019847 run iperf3-srv_10.42.42.10(pid=19528): Terminating (SIGTERM) 08:52:26.059568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19529): Terminating (SIGTERM) 08:52:26.099218 run iperf3-srv_10.42.42.10(pid=19530): Terminating (SIGTERM) 08:52:26.138914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19531): Terminating (SIGTERM) 08:52:26.178454 run iperf3-srv_10.42.42.10(pid=19532): Terminating (SIGTERM) 08:52:26.217705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Terminating (SIGTERM) 08:52:26.256902 run iperf3-srv_10.42.42.10(pid=19534): Terminating (SIGTERM) 08:52:26.296137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Terminating (SIGTERM) 08:52:26.335580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Terminating (SIGTERM) 08:52:26.374838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Terminating (SIGTERM) 08:52:26.414780 --- ParallelTerminationStrategy: PID 19527 died... 08:52:26.433827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19527): Terminated: ok {rc=0} 08:52:26.477965 --- ParallelTerminationStrategy: PID 19528 died... 08:52:26.496407 run iperf3-srv_10.42.42.10(pid=19528): Terminated {rc=256} 08:52:26.540570 --- ParallelTerminationStrategy: PID 19529 died... 08:52:26.559032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19529): Terminated: ok {rc=0} 08:52:26.603534 --- ParallelTerminationStrategy: PID 19530 died... 08:52:26.622037 run iperf3-srv_10.42.42.10(pid=19530): Terminated {rc=256} 08:52:26.666068 --- ParallelTerminationStrategy: PID 19531 died... 08:52:26.684595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19531): Terminated: ok {rc=0} 08:52:26.728602 --- ParallelTerminationStrategy: PID 19532 died... 08:52:26.747067 run iperf3-srv_10.42.42.10(pid=19532): Terminated {rc=256} 08:52:26.791186 --- ParallelTerminationStrategy: PID 19533 died... 08:52:26.810030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19533): Terminated: ok {rc=0} 08:52:26.854271 --- ParallelTerminationStrategy: PID 19534 died... 08:52:26.872706 run iperf3-srv_10.42.42.10(pid=19534): Terminated {rc=256} 08:52:26.917018 --- ParallelTerminationStrategy: PID 19537 died... 08:52:26.935603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19537): Terminated: ok {rc=0} 08:52:26.979852 --- ParallelTerminationStrategy: PID 19540 died... 08:52:26.998492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19540): Terminated: ok {rc=0} 08:52:27.042648 --- ParallelTerminationStrategy: PID 19543 died... 08:52:27.061224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19543): Terminated: ok {rc=0} 08:52:27.147042 bus /gobi_4: Setting Powered False 08:52:28.245061 bus /gobi_4: Setting Powered False 08:52:29.360102 bus /gobi_1: Setting Powered False 08:52:30.458687 bus /gobi_1: Setting Powered False 08:52:31.572060 bus /gobi_0: Setting Powered False 08:52:32.669537 bus /gobi_0: Setting Powered False 08:52:33.783541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 08:52:34.887031 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:34.898550 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:52:34.948717 tst ping.py: using LAC 27254 08:52:35.067910 tst ping.py: using RAC 224 08:52:35.186857 tst ping.py: using CellId 27254 08:52:35.304004 tst ping.py: using BVCI 27255 08:52:35.413167 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.423755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.434395 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.445269 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.455989 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.466670 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.477503 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:35.488306 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:35.605629 tst ping.py:19: start network... 08:52:35.820280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:36.296302 run create_hlr_db(pid=19548): Launched 08:52:36.410175 bus /gobi_6: Setting Powered False 08:52:37.468315 run create_hlr_db(pid=19548): Terminated: ok {rc=0} 08:52:37.902088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19550): Launched 08:52:38.217034 run osmo-hlr_10.42.42.2(pid=19551): Launched 08:52:38.337223 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:38.886687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19553): Launched 08:52:39.202034 run osmo-stp_10.42.42.5(pid=19554): Launched 08:52:39.322277 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:39.869157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19556): Launched 08:52:39.990049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:40.257242 run patchelf(pid=19557): Launched 08:52:40.434026 run osmo-stp_10.42.42.5(pid=19554): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19554)] 08:52:40.568870 run osmo-stp_10.42.42.5(pid=19554): stdout: | (launched: 2022-12-10_08:52:39.144600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:40.704720 run osmo-stp_10.42.42.5(pid=19554): stderr: | 20221210085239335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085239335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085239336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085239336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085239336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085239337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085239337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:40.840578 run osmo-stp_10.42.42.5(pid=19554): stdout: | (launched: 2022-12-10_08:52:39.144600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:40.971063 run osmo-stp_10.42.42.5(pid=19554): stderr: | 20221210085239335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085239335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085239336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085239336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085239336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085239337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085239337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:41.125284 run patchelf(pid=19557): Terminating (SIGINT) 08:52:41.302899 run patchelf(pid=19557): Terminated: ok {rc=0} 08:52:41.431019 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19554): Process ended prematurely: osmo-stp_10.42.42.5(pid=19554) [trial-2372↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19554)] [trial-2372↪gprs:trx-sysmocell5000↪ping.py:22] 08:52:41.440321 tst ping.py:22: Test FAILED (6.5 sec) 08:52:41.467997 run osmo-hlr_10.42.42.2(pid=19551): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19551)] 08:52:41.517527 run osmo-hlr_10.42.42.2(pid=19551): stdout: | (launched: 2022-12-10_08:52:38.159857) 08:52:41.568713 run osmo-hlr_10.42.42.2(pid=19551): stderr: | 20221210085238359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085238359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085238359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085238359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085238359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085238359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085238372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085238380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085238381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085238381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:41.620541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19550): Terminating (SIGTERM) 08:52:41.661935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19553): Terminating (SIGTERM) 08:52:41.703558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19556): Terminating (SIGTERM) 08:52:41.745591 --- ParallelTerminationStrategy: PID 19550 died... 08:52:41.765644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19550): Terminated: ok {rc=0} 08:52:41.812130 --- ParallelTerminationStrategy: PID 19553 died... 08:52:41.831819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19553): Terminated: ok {rc=0} 08:52:41.877998 --- ParallelTerminationStrategy: PID 19556 died... 08:52:41.897755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19556): Terminated: ok {rc=0} 08:52:41.985277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 08:52:43.073303 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.085501 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 08:52:43.141126 tst ping_idle_ping.py: using LAC 27255 08:52:43.265155 tst ping_idle_ping.py: using RAC 225 08:52:43.388580 tst ping_idle_ping.py: using CellId 27255 08:52:43.511709 tst ping_idle_ping.py: using BVCI 27256 08:52:43.622989 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.633962 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.644609 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.655630 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.666634 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.677560 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.688555 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 08:52:43.699422 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 08:52:43.816262 tst ping_idle_ping.py:24: start network... 08:52:44.031196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:44.527046 run create_hlr_db(pid=19558): Launched 08:52:44.655831 bus /gobi_6: Setting Powered False 08:52:45.719798 run create_hlr_db(pid=19558): Terminated: ok {rc=0} 08:52:46.186382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19560): Launched 08:52:46.578936 run osmo-hlr_10.42.42.2(pid=19561): Launched 08:52:46.822228 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:47.446343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19563): Launched 08:52:47.746219 run osmo-stp_10.42.42.5(pid=19564): Launched 08:52:47.860150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:48.376419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19566): Launched 08:52:48.490669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:52:48.744141 run patchelf(pid=19567): Launched 08:52:48.910087 run osmo-stp_10.42.42.5(pid=19564): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19564)] 08:52:49.036676 run osmo-stp_10.42.42.5(pid=19564): stdout: | (launched: 2022-12-10_08:52:47.691631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:49.164867 run osmo-stp_10.42.42.5(pid=19564): stderr: | 20221210085247861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085247861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085247862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085247862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085247863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085247863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085247863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:49.293184 run osmo-stp_10.42.42.5(pid=19564): stdout: | (launched: 2022-12-10_08:52:47.691631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:52:49.416258 run osmo-stp_10.42.42.5(pid=19564): stderr: | 20221210085247861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085247861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085247862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085247862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085247863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085247863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085247863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:52:49.561993 run patchelf(pid=19567): Terminating (SIGINT) 08:52:49.730685 run patchelf(pid=19567): Terminated: ok {rc=0} 08:52:49.852199 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19564): Process ended prematurely: osmo-stp_10.42.42.5(pid=19564) [trial-2372↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19564)] [trial-2372↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 08:52:49.861033 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:52:49.887877 run osmo-hlr_10.42.42.2(pid=19561): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19561)] 08:52:49.935842 run osmo-hlr_10.42.42.2(pid=19561): stdout: | (launched: 2022-12-10_08:52:46.514216) 08:52:49.985296 run osmo-hlr_10.42.42.2(pid=19561): stderr: | 20221210085246799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085246799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085246799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085246799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085246799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085246799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085246815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085246833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085246833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085246833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:52:50.035298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19560): Terminating (SIGTERM) 08:52:50.075110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19563): Terminating (SIGTERM) 08:52:50.114922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19566): Terminating (SIGTERM) 08:52:50.154613 --- ParallelTerminationStrategy: PID 19560 died... 08:52:50.173474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19560): Terminated: ok {rc=0} 08:52:50.217215 --- ParallelTerminationStrategy: PID 19563 died... 08:52:50.235595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19563): Terminated: ok {rc=0} 08:52:50.279482 --- ParallelTerminationStrategy: PID 19566 died... 08:52:50.297810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19566): Terminated: ok {rc=0} 08:52:50.382910 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 08:52:51.692121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:52:51.697748 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:52:51.732394 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:52:51.770538 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:52:51.856042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:52:51.889416 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:52:51.927516 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:52:52.523286 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:52:52.572438 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:52.583431 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:52:52.633634 tst cs_paging_gprs_active.py: using LAC 27256 08:52:52.762571 tst cs_paging_gprs_active.py: using RAC 226 08:52:52.891739 tst cs_paging_gprs_active.py: using CellId 27256 08:52:53.020509 tst cs_paging_gprs_active.py: using BVCI 27257 08:52:53.137968 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.149542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.160686 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.172029 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.183185 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.194526 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.205995 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.217226 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:52:53.228627 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:52:53.347809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:52:53.467534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:52:53.685837 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:54.015050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19571): Launched 08:52:54.299323 run iperf3-srv_10.42.42.10(pid=19572): Launched 08:52:54.420846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:52:54.639213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:52:54.968055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19573): Launched 08:52:55.252196 run iperf3-srv_10.42.42.10(pid=19574): Launched 08:52:55.372826 tst cs_paging_gprs_active.py:38: start network... 08:52:55.590603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:52:56.094936 run create_hlr_db(pid=19575): Launched 08:52:56.224692 bus /gobi_6: Setting Powered False 08:52:57.288444 run create_hlr_db(pid=19575): Terminated: ok {rc=0} 08:52:57.726163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19577): Launched 08:52:58.033699 run osmo-hlr_10.42.42.2(pid=19578): Launched 08:52:58.149724 run osmo-stp_10.42.42.5: Starting osmo-stp 08:52:58.692682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19580): Launched 08:52:59.000277 run osmo-stp_10.42.42.5(pid=19581): Launched 08:52:59.116257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:52:59.645548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19583): Launched 08:52:59.762179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:00.022484 run patchelf(pid=19584): Launched 08:53:00.190652 run osmo-stp_10.42.42.5(pid=19581): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19581)] 08:53:00.319528 run osmo-stp_10.42.42.5(pid=19581): stdout: | (launched: 2022-12-10_08:52:58.941232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:00.450267 run osmo-stp_10.42.42.5(pid=19581): stderr: | 20221210085259116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085259116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085259117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085259117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085259117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085259118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085259118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:00.580566 run osmo-stp_10.42.42.5(pid=19581): stdout: | (launched: 2022-12-10_08:52:58.941232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:00.706012 run osmo-stp_10.42.42.5(pid=19581): stderr: | 20221210085259116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085259116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085259117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085259117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085259117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085259118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085259118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:00.854641 run patchelf(pid=19584): Terminating (SIGINT) 08:53:01.029319 run patchelf(pid=19584): Terminated: ok {rc=0} 08:53:01.155445 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19581): Process ended prematurely: osmo-stp_10.42.42.5(pid=19581) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19581)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:53:01.165854 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:53:01.196103 run osmo-hlr_10.42.42.2(pid=19578): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19578)] 08:53:01.246160 run osmo-hlr_10.42.42.2(pid=19578): stdout: | (launched: 2022-12-10_08:52:57.974319) 08:53:01.297668 run osmo-hlr_10.42.42.2(pid=19578): stderr: | 20221210085258153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085258153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085258153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085258153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085258153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085258153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085258166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085258176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085258177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085258177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:01.349792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19571): Terminating (SIGTERM) 08:53:01.392232 run iperf3-srv_10.42.42.10(pid=19572): Terminating (SIGTERM) 08:53:01.436699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19573): Terminating (SIGTERM) 08:53:01.479550 run iperf3-srv_10.42.42.10(pid=19574): Terminating (SIGTERM) 08:53:01.524346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19577): Terminating (SIGTERM) 08:53:01.566618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19580): Terminating (SIGTERM) 08:53:01.607807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19583): Terminating (SIGTERM) 08:53:01.652405 --- ParallelTerminationStrategy: PID 19571 died... 08:53:01.671999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19571): Terminated: ok {rc=0} 08:53:01.718933 --- ParallelTerminationStrategy: PID 19572 died... 08:53:01.738142 run iperf3-srv_10.42.42.10(pid=19572): Terminated {rc=256} 08:53:01.784904 --- ParallelTerminationStrategy: PID 19573 died... 08:53:01.804261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19573): Terminated: ok {rc=0} 08:53:01.851087 --- ParallelTerminationStrategy: PID 19574 died... 08:53:01.870523 run iperf3-srv_10.42.42.10(pid=19574): Terminated {rc=256} 08:53:01.917249 --- ParallelTerminationStrategy: PID 19577 died... 08:53:01.936390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19577): Terminated: ok {rc=0} 08:53:01.983072 --- ParallelTerminationStrategy: PID 19580 died... 08:53:02.002384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19580): Terminated: ok {rc=0} 08:53:02.049006 --- ParallelTerminationStrategy: PID 19583 died... 08:53:02.068341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19583): Terminated: ok {rc=0} 08:53:02.153355 bus /gobi_0: Setting Powered False 08:53:03.249674 bus /gobi_0: Setting Powered False 08:53:04.364011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:53:05.512155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:05.524242 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:53:05.580351 tst iperf3.py: using LAC 27257 08:53:05.706352 tst iperf3.py: using RAC 227 08:53:05.834380 tst iperf3.py: using CellId 27257 08:53:05.960539 tst iperf3.py: using BVCI 27258 08:53:06.079246 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.090857 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.102100 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.113784 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.125349 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.137005 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.148657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.160207 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:06.172035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:06.290186 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:53:06.494750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:06.803497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19585): Launched 08:53:07.070122 run iperf3-srv_10.42.42.10(pid=19586): Launched 08:53:07.183196 tst iperf3.py:8: start network... 08:53:07.386106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:07.858446 run create_hlr_db(pid=19587): Launched 08:53:07.974937 bus /gobi_6: Setting Powered False 08:53:09.035431 run create_hlr_db(pid=19587): Terminated: ok {rc=0} 08:53:09.461407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19589): Launched 08:53:09.768066 run osmo-hlr_10.42.42.2(pid=19590): Launched 08:53:09.885103 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:10.427201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19592): Launched 08:53:10.735533 run osmo-stp_10.42.42.5(pid=19593): Launched 08:53:10.852146 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:53:11.380937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19595): Launched 08:53:11.497455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:11.757633 run patchelf(pid=19596): Launched 08:53:11.925949 run osmo-stp_10.42.42.5(pid=19593): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19593)] 08:53:12.054359 run osmo-stp_10.42.42.5(pid=19593): stdout: | (launched: 2022-12-10_08:53:10.675525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:12.184438 run osmo-stp_10.42.42.5(pid=19593): stderr: | 20221210085310850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085310851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085310851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085310851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085310852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085310852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085310852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:12.315052 run osmo-stp_10.42.42.5(pid=19593): stdout: | (launched: 2022-12-10_08:53:10.675525) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:12.439813 run osmo-stp_10.42.42.5(pid=19593): stderr: | 20221210085310850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085310851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085310851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085310851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085310852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085310852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085310852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:12.587740 run patchelf(pid=19596): Terminating (SIGINT) 08:53:12.757848 run patchelf(pid=19596): Terminated: ok {rc=0} 08:53:12.880603 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19593): Process ended prematurely: osmo-stp_10.42.42.5(pid=19593) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19593)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 08:53:12.890006 tst iperf3.py:8: Test FAILED (7.4 sec) 08:53:12.917408 run osmo-hlr_10.42.42.2(pid=19590): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19590)] 08:53:12.964831 run osmo-hlr_10.42.42.2(pid=19590): stdout: | (launched: 2022-12-10_08:53:09.708915) 08:53:13.014044 run osmo-hlr_10.42.42.2(pid=19590): stderr: | 20221210085309887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085309887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085309887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085309887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085309887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085309887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085309900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085309909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085309909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085309909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:13.063731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19585): Terminating (SIGTERM) 08:53:13.103681 run iperf3-srv_10.42.42.10(pid=19586): Terminating (SIGTERM) 08:53:13.143414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19589): Terminating (SIGTERM) 08:53:13.183086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19592): Terminating (SIGTERM) 08:53:13.222664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19595): Terminating (SIGTERM) 08:53:13.262352 --- ParallelTerminationStrategy: PID 19585 died... 08:53:13.281167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19585): Terminated: ok {rc=0} 08:53:13.325411 --- ParallelTerminationStrategy: PID 19586 died... 08:53:13.343750 run iperf3-srv_10.42.42.10(pid=19586): Terminated {rc=256} 08:53:13.388188 --- ParallelTerminationStrategy: PID 19589 died... 08:53:13.406470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19589): Terminated: ok {rc=0} 08:53:13.450242 --- ParallelTerminationStrategy: PID 19592 died... 08:53:13.468661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19592): Terminated: ok {rc=0} 08:53:13.512378 --- ParallelTerminationStrategy: PID 19595 died... 08:53:13.530934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19595): Terminated: ok {rc=0} 08:53:13.616449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:53:14.763047 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:14.774500 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:53:14.825461 tst iperf3m4.py: using LAC 27258 08:53:14.949460 tst iperf3m4.py: using RAC 228 08:53:15.070096 tst iperf3m4.py: using CellId 27258 08:53:15.188397 tst iperf3m4.py: using BVCI 27259 08:53:15.309297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.320882 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.332289 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.344353 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.356249 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.368164 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.380014 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.391923 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:15.404218 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:15.524473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:15.646318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:15.764554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:15.894777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:53:16.112484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:16.468304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Launched 08:53:16.803467 run iperf3-srv_10.42.42.10(pid=19631): Launched 08:53:17.012197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:53:17.306323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:17.730641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19664): Launched 08:53:18.169671 run iperf3-srv_10.42.42.10(pid=19688): Launched 08:53:18.328137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:53:18.588766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:18.990300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Launched 08:53:19.377694 run iperf3-srv_10.42.42.10(pid=19851): Launched 08:53:19.542113 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:53:19.768750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:20.105740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19882): Launched 08:53:20.405723 run iperf3-srv_10.42.42.10(pid=19883): Launched 08:53:20.528150 tst iperf3m4.py:8: start network... 08:53:20.737265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:21.228540 run create_hlr_db(pid=19884): Launched 08:53:21.385579 bus /gobi_6: Setting Powered False 08:53:22.446777 run create_hlr_db(pid=19884): Terminated: ok {rc=0} 08:53:22.919995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Launched 08:53:23.245639 run osmo-hlr_10.42.42.2(pid=19889): Launched 08:53:23.489060 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:24.230005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Launched 08:53:24.558340 run osmo-stp_10.42.42.5(pid=19892): Launched 08:53:24.801682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:53:25.521599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19894): Launched 08:53:25.654216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:25.943970 run patchelf(pid=19895): Launched 08:53:26.127664 run osmo-stp_10.42.42.5(pid=19892): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] 08:53:26.261703 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-10_08:53:24.491799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:26.399443 run osmo-stp_10.42.42.5(pid=19892): stderr: | 20221210085324839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085324839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085324839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085324840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085324840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085324840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085324840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:26.536399 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-10_08:53:24.491799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:26.668709 run osmo-stp_10.42.42.5(pid=19892): stderr: | 20221210085324839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085324839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085324839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085324840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085324840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085324840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085324840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:26.825224 run patchelf(pid=19895): Terminating (SIGINT) 08:53:27.003868 run patchelf(pid=19895): Terminated: ok {rc=0} 08:53:27.133353 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 08:53:27.143916 tst iperf3m4.py:8: Test FAILED (12.4 sec) 08:53:27.175641 run osmo-hlr_10.42.42.2(pid=19889): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19889)] 08:53:27.226853 run osmo-hlr_10.42.42.2(pid=19889): stdout: | (launched: 2022-12-10_08:53:23.179747) 08:53:27.279620 run osmo-hlr_10.42.42.2(pid=19889): stderr: | 20221210085323521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085323521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085323521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085323521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085323521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085323521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085323541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085323553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085323554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085323554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:27.334153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Terminating (SIGTERM) 08:53:27.377761 run iperf3-srv_10.42.42.10(pid=19631): Terminating (SIGTERM) 08:53:27.422744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19664): Terminating (SIGTERM) 08:53:27.466139 run iperf3-srv_10.42.42.10(pid=19688): Terminating (SIGTERM) 08:53:27.512925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Terminating (SIGTERM) 08:53:27.556653 run iperf3-srv_10.42.42.10(pid=19851): Terminating (SIGTERM) 08:53:27.602349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19882): Terminating (SIGTERM) 08:53:27.646037 run iperf3-srv_10.42.42.10(pid=19883): Terminating (SIGTERM) 08:53:27.692255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminating (SIGTERM) 08:53:27.737545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminating (SIGTERM) 08:53:27.782541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19894): Terminating (SIGTERM) 08:53:27.829241 --- ParallelTerminationStrategy: PID 19607 died... 08:53:27.849462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19607): Terminated: ok {rc=0} 08:53:27.899208 --- ParallelTerminationStrategy: PID 19631 died... 08:53:27.920233 run iperf3-srv_10.42.42.10(pid=19631): Terminated {rc=256} 08:53:27.967940 --- ParallelTerminationStrategy: PID 19664 died... 08:53:27.987631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19664): Terminated: ok {rc=0} 08:53:28.035309 --- ParallelTerminationStrategy: PID 19688 died... 08:53:28.054968 run iperf3-srv_10.42.42.10(pid=19688): Terminated {rc=256} 08:53:28.102723 --- ParallelTerminationStrategy: PID 19787 died... 08:53:28.123294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19787): Terminated: ok {rc=0} 08:53:28.171508 --- ParallelTerminationStrategy: PID 19851 died... 08:53:28.191493 run iperf3-srv_10.42.42.10(pid=19851): Terminated {rc=256} 08:53:28.239018 --- ParallelTerminationStrategy: PID 19882 died... 08:53:28.258689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19882): Terminated: ok {rc=0} 08:53:28.307353 --- ParallelTerminationStrategy: PID 19883 died... 08:53:28.327058 run iperf3-srv_10.42.42.10(pid=19883): Terminated {rc=256} 08:53:28.375024 --- ParallelTerminationStrategy: PID 19888 died... 08:53:28.394735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminated: ok {rc=0} 08:53:28.442786 --- ParallelTerminationStrategy: PID 19891 died... 08:53:28.462643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminated: ok {rc=0} 08:53:28.511090 --- ParallelTerminationStrategy: PID 19894 died... 08:53:28.530747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19894): Terminated: ok {rc=0} 08:53:28.620651 bus /gobi_4: Setting Powered False 08:53:29.721743 bus /gobi_4: Setting Powered False 08:53:30.846936 bus /gobi_1: Setting Powered False 08:53:31.995414 bus /gobi_1: Setting Powered False 08:53:33.126903 bus /gobi_0: Setting Powered False 08:53:34.230720 bus /gobi_0: Setting Powered False 08:53:35.353663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 08:53:36.459142 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:36.471961 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:53:36.528280 tst ping.py: using LAC 27259 08:53:36.649094 tst ping.py: using RAC 229 08:53:36.772765 tst ping.py: using CellId 27259 08:53:36.895630 tst ping.py: using BVCI 27260 08:53:37.010664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.023418 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.035293 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.049624 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.061377 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.074044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.088581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:37.101831 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:37.221339 tst ping.py:19: start network... 08:53:37.429754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:37.922863 run create_hlr_db(pid=19896): Launched 08:53:38.080586 bus /gobi_6: Setting Powered False 08:53:39.140636 run create_hlr_db(pid=19896): Terminated: ok {rc=0} 08:53:39.575999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19898): Launched 08:53:39.877445 run osmo-hlr_10.42.42.2(pid=19899): Launched 08:53:39.992905 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:40.516324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19901): Launched 08:53:40.816518 run osmo-stp_10.42.42.5(pid=19902): Launched 08:53:40.930140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:53:41.447150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19904): Launched 08:53:41.561241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:41.816198 run patchelf(pid=19905): Launched 08:53:41.982388 run osmo-stp_10.42.42.5(pid=19902): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19902)] 08:53:42.109088 run osmo-stp_10.42.42.5(pid=19902): stdout: | (launched: 2022-12-10_08:53:40.759159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:42.237113 run osmo-stp_10.42.42.5(pid=19902): stderr: | 20221210085340931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085340931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085340931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085340932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085340932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085340932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085340932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:42.365335 run osmo-stp_10.42.42.5(pid=19902): stdout: | (launched: 2022-12-10_08:53:40.759159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:42.488155 run osmo-stp_10.42.42.5(pid=19902): stderr: | 20221210085340931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085340931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085340931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085340932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085340932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085340932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085340932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:42.633483 run patchelf(pid=19905): Terminating (SIGINT) 08:53:42.801430 run patchelf(pid=19905): Terminated: ok {rc=0} 08:53:42.923061 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19902): Process ended prematurely: osmo-stp_10.42.42.5(pid=19902) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19902)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 08:53:42.931903 tst ping.py:22: Test FAILED (6.5 sec) 08:53:42.958522 run osmo-hlr_10.42.42.2(pid=19899): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19899)] 08:53:43.006440 run osmo-hlr_10.42.42.2(pid=19899): stdout: | (launched: 2022-12-10_08:53:39.820059) 08:53:43.055548 run osmo-hlr_10.42.42.2(pid=19899): stderr: | 20221210085339998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085339998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085339998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085339998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085339998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085339998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085340011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085340020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085340020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085340020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:43.105187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19898): Terminating (SIGTERM) 08:53:43.145075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19901): Terminating (SIGTERM) 08:53:43.184781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19904): Terminating (SIGTERM) 08:53:43.224505 --- ParallelTerminationStrategy: PID 19898 died... 08:53:43.243401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19898): Terminated: ok {rc=0} 08:53:43.287409 --- ParallelTerminationStrategy: PID 19901 died... 08:53:43.305689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19901): Terminated: ok {rc=0} 08:53:43.349432 --- ParallelTerminationStrategy: PID 19904 died... 08:53:43.367869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19904): Terminated: ok {rc=0} 08:53:43.453345 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:53:44.540335 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:44.552343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:53:44.604742 tst ping_idle_ping.py: using LAC 27260 08:53:44.723872 tst ping_idle_ping.py: using RAC 230 08:53:44.844703 tst ping_idle_ping.py: using CellId 27260 08:53:44.961125 tst ping_idle_ping.py: using BVCI 27261 08:53:45.070144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.081205 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.091876 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.102955 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.113867 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.124694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.135859 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:53:45.146894 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:53:45.265100 tst ping_idle_ping.py:24: start network... 08:53:45.480926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:45.992328 run create_hlr_db(pid=19906): Launched 08:53:46.135043 bus /gobi_6: Setting Powered False 08:53:47.197789 run create_hlr_db(pid=19906): Terminated: ok {rc=0} 08:53:47.625578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19908): Launched 08:53:47.927971 run osmo-hlr_10.42.42.2(pid=19909): Launched 08:53:48.041937 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:48.558687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19911): Launched 08:53:48.858907 run osmo-stp_10.42.42.5(pid=19912): Launched 08:53:48.973246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:53:49.493825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19914): Launched 08:53:49.608311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:53:49.866068 run patchelf(pid=19915): Launched 08:53:50.032772 run osmo-stp_10.42.42.5(pid=19912): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19912)] 08:53:50.159633 run osmo-stp_10.42.42.5(pid=19912): stdout: | (launched: 2022-12-10_08:53:48.801348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:50.288023 run osmo-stp_10.42.42.5(pid=19912): stderr: | 20221210085348973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085348973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085348973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085348973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085348974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085348974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085348974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:50.416183 run osmo-stp_10.42.42.5(pid=19912): stdout: | (launched: 2022-12-10_08:53:48.801348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:53:50.539333 run osmo-stp_10.42.42.5(pid=19912): stderr: | 20221210085348973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085348973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085348973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085348973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085348974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085348974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085348974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:53:50.684866 run patchelf(pid=19915): Terminating (SIGINT) 08:53:50.853241 run patchelf(pid=19915): Terminated: ok {rc=0} 08:53:50.974488 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19912): Process ended prematurely: osmo-stp_10.42.42.5(pid=19912) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19912)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 08:53:50.983353 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 08:53:51.012044 run osmo-hlr_10.42.42.2(pid=19909): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19909)] 08:53:51.062301 run osmo-hlr_10.42.42.2(pid=19909): stdout: | (launched: 2022-12-10_08:53:47.869967) 08:53:51.113974 run osmo-hlr_10.42.42.2(pid=19909): stderr: | 20221210085348047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085348047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085348047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085348047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085348047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085348047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085348059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085348068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085348069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085348069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:53:51.166017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19908): Terminating (SIGTERM) 08:53:51.207988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19911): Terminating (SIGTERM) 08:53:51.250263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19914): Terminating (SIGTERM) 08:53:51.292365 --- ParallelTerminationStrategy: PID 19908 died... 08:53:51.312287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19908): Terminated: ok {rc=0} 08:53:51.359226 --- ParallelTerminationStrategy: PID 19911 died... 08:53:51.378410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19911): Terminated: ok {rc=0} 08:53:51.425691 --- ParallelTerminationStrategy: PID 19914 died... 08:53:51.445188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19914): Terminated: ok {rc=0} 08:53:51.533899 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:53:52.852168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:53:52.859107 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:53:52.893707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:53:52.932397 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:53:53.017180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:53:53.050979 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:53:53.089291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:53:53.691120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:53:53.741873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:53.752885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:53:53.822042 tst cs_paging_gprs_active.py: using LAC 27261 08:53:53.954251 tst cs_paging_gprs_active.py: using RAC 231 08:53:54.080843 tst cs_paging_gprs_active.py: using CellId 27261 08:53:54.205804 tst cs_paging_gprs_active.py: using BVCI 27262 08:53:54.323731 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.335298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.346800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.358746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.370733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.382664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.394581 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.406401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:53:54.418812 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:53:54.539439 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:53:54.655840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:53:54.861198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:55.166676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19920): Launched 08:53:55.430746 run iperf3-srv_10.42.42.10(pid=19921): Launched 08:53:55.545225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:53:55.750115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:53:56.055571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19922): Launched 08:53:56.320792 run iperf3-srv_10.42.42.10(pid=19923): Launched 08:53:56.435227 tst cs_paging_gprs_active.py:38: start network... 08:53:56.639335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:53:57.112298 run create_hlr_db(pid=19924): Launched 08:53:57.229979 bus /gobi_6: Setting Powered False 08:53:58.290786 run create_hlr_db(pid=19924): Terminated: ok {rc=0} 08:53:58.733371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19926): Launched 08:53:59.055782 run osmo-hlr_10.42.42.2(pid=19927): Launched 08:53:59.179399 run osmo-stp_10.42.42.5: Starting osmo-stp 08:53:59.737346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19929): Launched 08:54:00.057398 run osmo-stp_10.42.42.5(pid=19930): Launched 08:54:00.180542 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:00.737886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19932): Launched 08:54:00.874973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:01.143741 run patchelf(pid=19933): Launched 08:54:01.330936 run osmo-stp_10.42.42.5(pid=19930): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19930)] 08:54:01.464218 run osmo-stp_10.42.42.5(pid=19930): stdout: | (launched: 2022-12-10_08:53:59.999441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:01.600309 run osmo-stp_10.42.42.5(pid=19930): stderr: | 20221210085400191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085400191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085400191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085400191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085400192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085400192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085400192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:01.737678 run osmo-stp_10.42.42.5(pid=19930): stdout: | (launched: 2022-12-10_08:53:59.999441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:01.866900 run osmo-stp_10.42.42.5(pid=19930): stderr: | 20221210085400191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085400191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085400191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085400191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085400192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085400192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085400192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:02.020895 run patchelf(pid=19933): Terminating (SIGINT) 08:54:02.203200 run patchelf(pid=19933): Terminated: ok {rc=0} 08:54:02.333240 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19930): Process ended prematurely: osmo-stp_10.42.42.5(pid=19930) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19930)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:54:02.343505 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:54:02.371749 run osmo-hlr_10.42.42.2(pid=19927): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19927)] 08:54:02.421873 run osmo-hlr_10.42.42.2(pid=19927): stdout: | (launched: 2022-12-10_08:53:58.997295) 08:54:02.473513 run osmo-hlr_10.42.42.2(pid=19927): stderr: | 20221210085359197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085359197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085359197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085359197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085359197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085359197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085359208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085359216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085359216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085359216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:02.525215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19920): Terminating (SIGTERM) 08:54:02.566288 run iperf3-srv_10.42.42.10(pid=19921): Terminating (SIGTERM) 08:54:02.607432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19922): Terminating (SIGTERM) 08:54:02.648651 run iperf3-srv_10.42.42.10(pid=19923): Terminating (SIGTERM) 08:54:02.689756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19926): Terminating (SIGTERM) 08:54:02.730865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19929): Terminating (SIGTERM) 08:54:02.772062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19932): Terminating (SIGTERM) 08:54:02.813422 --- ParallelTerminationStrategy: PID 19920 died... 08:54:02.833096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19920): Terminated: ok {rc=0} 08:54:02.878918 --- ParallelTerminationStrategy: PID 19921 died... 08:54:02.898209 run iperf3-srv_10.42.42.10(pid=19921): Terminated {rc=256} 08:54:02.943495 --- ParallelTerminationStrategy: PID 19922 died... 08:54:02.962830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19922): Terminated: ok {rc=0} 08:54:03.008262 --- ParallelTerminationStrategy: PID 19923 died... 08:54:03.027499 run iperf3-srv_10.42.42.10(pid=19923): Terminated {rc=256} 08:54:03.072709 --- ParallelTerminationStrategy: PID 19926 died... 08:54:03.092429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19926): Terminated: ok {rc=0} 08:54:03.138193 --- ParallelTerminationStrategy: PID 19929 died... 08:54:03.157631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19929): Terminated: ok {rc=0} 08:54:03.202913 --- ParallelTerminationStrategy: PID 19932 died... 08:54:03.222299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19932): Terminated: ok {rc=0} 08:54:03.309311 bus /gobi_0: Setting Powered False 08:54:04.407906 bus /gobi_0: Setting Powered False 08:54:05.523206 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:54:06.671889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:06.684062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:54:06.759424 tst iperf3.py: using LAC 27262 08:54:06.886285 tst iperf3.py: using RAC 232 08:54:07.013096 tst iperf3.py: using CellId 27262 08:54:07.140267 tst iperf3.py: using BVCI 27263 08:54:07.258183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.269633 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.280742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.292003 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.303174 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.314497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.325835 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.336873 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:07.348279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:07.470406 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:54:07.688917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:08.011571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19934): Launched 08:54:08.290617 run iperf3-srv_10.42.42.10(pid=19935): Launched 08:54:08.411314 tst iperf3.py:8: start network... 08:54:08.629507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:09.129655 run create_hlr_db(pid=19936): Launched 08:54:09.262767 bus /gobi_6: Setting Powered False 08:54:10.326694 run create_hlr_db(pid=19936): Terminated: ok {rc=0} 08:54:10.760101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Launched 08:54:11.064934 run osmo-hlr_10.42.42.2(pid=19939): Launched 08:54:11.182441 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:11.721538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Launched 08:54:12.024161 run osmo-stp_10.42.42.5(pid=19942): Launched 08:54:12.140908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:12.666093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19944): Launched 08:54:12.782183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:13.039592 run patchelf(pid=19945): Launched 08:54:13.208547 run osmo-stp_10.42.42.5(pid=19942): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] 08:54:13.337116 run osmo-stp_10.42.42.5(pid=19942): stdout: | (launched: 2022-12-10_08:54:11.969086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:13.467829 run osmo-stp_10.42.42.5(pid=19942): stderr: | 20221210085412140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085412140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085412141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085412141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085412142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085412142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085412142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:13.598530 run osmo-stp_10.42.42.5(pid=19942): stdout: | (launched: 2022-12-10_08:54:11.969086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:13.723440 run osmo-stp_10.42.42.5(pid=19942): stderr: | 20221210085412140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085412140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085412141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085412141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085412142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085412142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085412142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:13.871425 run patchelf(pid=19945): Terminating (SIGINT) 08:54:14.042006 run patchelf(pid=19945): Terminated: ok {rc=0} 08:54:14.165416 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19942): Process ended prematurely: osmo-stp_10.42.42.5(pid=19942) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 08:54:14.174796 tst iperf3.py:8: Test FAILED (7.5 sec) 08:54:14.202236 run osmo-hlr_10.42.42.2(pid=19939): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19939)] 08:54:14.250095 run osmo-hlr_10.42.42.2(pid=19939): stdout: | (launched: 2022-12-10_08:54:11.009652) 08:54:14.299602 run osmo-hlr_10.42.42.2(pid=19939): stderr: | 20221210085411188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085411188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085411188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085411188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085411188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085411188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085411201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085411209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085411209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085411209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:14.350199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19934): Terminating (SIGTERM) 08:54:14.389889 run iperf3-srv_10.42.42.10(pid=19935): Terminating (SIGTERM) 08:54:14.429514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Terminating (SIGTERM) 08:54:14.469300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Terminating (SIGTERM) 08:54:14.509016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19944): Terminating (SIGTERM) 08:54:14.548846 --- ParallelTerminationStrategy: PID 19934 died... 08:54:14.567631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19934): Terminated: ok {rc=0} 08:54:14.612008 --- ParallelTerminationStrategy: PID 19935 died... 08:54:14.630506 run iperf3-srv_10.42.42.10(pid=19935): Terminated {rc=256} 08:54:14.674625 --- ParallelTerminationStrategy: PID 19938 died... 08:54:14.693316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Terminated: ok {rc=0} 08:54:14.737308 --- ParallelTerminationStrategy: PID 19941 died... 08:54:14.755834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Terminated: ok {rc=0} 08:54:14.799976 --- ParallelTerminationStrategy: PID 19944 died... 08:54:14.818621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19944): Terminated: ok {rc=0} 08:54:14.904266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:54:16.060751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.073540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:54:16.147926 tst iperf3m4.py: using LAC 27263 08:54:16.270984 tst iperf3m4.py: using RAC 233 08:54:16.430573 tst iperf3m4.py: using CellId 27263 08:54:16.556048 tst iperf3m4.py: using BVCI 27264 08:54:16.700659 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.712765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.724878 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.738048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.749797 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.762208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.775582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.788023 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:16.800002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:16.923669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:17.088550 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:17.209544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:17.328862 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:54:17.535147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:17.840747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Launched 08:54:18.105805 run iperf3-srv_10.42.42.10(pid=19948): Launched 08:54:18.227449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:54:18.446771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:18.771781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Launched 08:54:19.051986 run iperf3-srv_10.42.42.10(pid=19950): Launched 08:54:19.173129 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:54:19.391709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:19.716755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19951): Launched 08:54:19.997165 run iperf3-srv_10.42.42.10(pid=19952): Launched 08:54:20.118496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:54:20.336511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:20.661313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19953): Launched 08:54:20.941170 run iperf3-srv_10.42.42.10(pid=19954): Launched 08:54:21.062245 tst iperf3m4.py:8: start network... 08:54:21.281155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:21.783669 run create_hlr_db(pid=19955): Launched 08:54:21.914259 bus /gobi_6: Setting Powered False 08:54:22.977883 run create_hlr_db(pid=19955): Terminated: ok {rc=0} 08:54:23.427511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19957): Launched 08:54:23.750308 run osmo-hlr_10.42.42.2(pid=19958): Launched 08:54:23.873742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:24.430632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19960): Launched 08:54:24.753558 run osmo-stp_10.42.42.5(pid=19961): Launched 08:54:24.877389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:25.436456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19963): Launched 08:54:25.559638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:25.832837 run patchelf(pid=19964): Launched 08:54:26.012377 run osmo-stp_10.42.42.5(pid=19961): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19961)] 08:54:26.149397 run osmo-stp_10.42.42.5(pid=19961): stdout: | (launched: 2022-12-10_08:54:24.695169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:26.288097 run osmo-stp_10.42.42.5(pid=19961): stderr: | 20221210085424890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085424890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085424890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085424890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085424891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085424891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085424891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:26.426949 run osmo-stp_10.42.42.5(pid=19961): stdout: | (launched: 2022-12-10_08:54:24.695169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:26.560272 run osmo-stp_10.42.42.5(pid=19961): stderr: | 20221210085424890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085424890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085424890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085424890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085424891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085424891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085424891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:26.717975 run patchelf(pid=19964): Terminating (SIGINT) 08:54:26.898939 run patchelf(pid=19964): Terminated: ok {rc=0} 08:54:27.029772 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19961): Process ended prematurely: osmo-stp_10.42.42.5(pid=19961) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19961)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:54:27.039830 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:54:27.068520 run osmo-hlr_10.42.42.2(pid=19958): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19958)] 08:54:27.118301 run osmo-hlr_10.42.42.2(pid=19958): stdout: | (launched: 2022-12-10_08:54:23.691823) 08:54:27.169867 run osmo-hlr_10.42.42.2(pid=19958): stderr: | 20221210085423891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085423891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085423891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085423891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085423892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085423892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085423903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085423913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085423913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085423913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:27.221814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Terminating (SIGTERM) 08:54:27.263729 run iperf3-srv_10.42.42.10(pid=19948): Terminating (SIGTERM) 08:54:27.306228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Terminating (SIGTERM) 08:54:27.348207 run iperf3-srv_10.42.42.10(pid=19950): Terminating (SIGTERM) 08:54:27.390140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19951): Terminating (SIGTERM) 08:54:27.432420 run iperf3-srv_10.42.42.10(pid=19952): Terminating (SIGTERM) 08:54:27.474378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19953): Terminating (SIGTERM) 08:54:27.516833 run iperf3-srv_10.42.42.10(pid=19954): Terminating (SIGTERM) 08:54:27.558717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19957): Terminating (SIGTERM) 08:54:27.600600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19960): Terminating (SIGTERM) 08:54:27.642509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19963): Terminating (SIGTERM) 08:54:27.684596 --- ParallelTerminationStrategy: PID 19947 died... 08:54:27.704618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19947): Terminated: ok {rc=0} 08:54:27.751053 --- ParallelTerminationStrategy: PID 19948 died... 08:54:27.770550 run iperf3-srv_10.42.42.10(pid=19948): Terminated {rc=256} 08:54:27.816459 --- ParallelTerminationStrategy: PID 19949 died... 08:54:27.835956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19949): Terminated: ok {rc=0} 08:54:27.882263 --- ParallelTerminationStrategy: PID 19950 died... 08:54:27.901708 run iperf3-srv_10.42.42.10(pid=19950): Terminated {rc=256} 08:54:27.947550 --- ParallelTerminationStrategy: PID 19951 died... 08:54:27.967012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19951): Terminated: ok {rc=0} 08:54:28.013116 --- ParallelTerminationStrategy: PID 19952 died... 08:54:28.032433 run iperf3-srv_10.42.42.10(pid=19952): Terminated {rc=256} 08:54:28.078192 --- ParallelTerminationStrategy: PID 19953 died... 08:54:28.097829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19953): Terminated: ok {rc=0} 08:54:28.144000 --- ParallelTerminationStrategy: PID 19954 died... 08:54:28.163471 run iperf3-srv_10.42.42.10(pid=19954): Terminated {rc=256} 08:54:28.209265 --- ParallelTerminationStrategy: PID 19957 died... 08:54:28.228639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19957): Terminated: ok {rc=0} 08:54:28.274674 --- ParallelTerminationStrategy: PID 19960 died... 08:54:28.294182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19960): Terminated: ok {rc=0} 08:54:28.340247 --- ParallelTerminationStrategy: PID 19963 died... 08:54:28.359805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19963): Terminated: ok {rc=0} 08:54:28.446398 bus /gobi_4: Setting Powered False 08:54:29.545031 bus /gobi_4: Setting Powered False 08:54:30.661225 bus /gobi_1: Setting Powered False 08:54:31.753935 bus /gobi_1: Setting Powered False 08:54:32.867227 bus /gobi_0: Setting Powered False 08:54:33.961360 bus /gobi_0: Setting Powered False 08:54:35.075355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:54:36.177813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.189396 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:54:36.264845 tst ping.py: using LAC 27264 08:54:36.381778 tst ping.py: using RAC 234 08:54:36.497968 tst ping.py: using CellId 27264 08:54:36.614142 tst ping.py: using BVCI 27265 08:54:36.724535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.735511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.746448 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.757547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.768477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.779481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.790570 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:36.801556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:36.916206 tst ping.py:19: start network... 08:54:37.129136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:37.619116 run create_hlr_db(pid=19965): Launched 08:54:37.747135 bus /gobi_6: Setting Powered False 08:54:38.809845 run create_hlr_db(pid=19965): Terminated: ok {rc=0} 08:54:39.235463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19967): Launched 08:54:39.533020 run osmo-hlr_10.42.42.2(pid=19968): Launched 08:54:39.647394 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:40.181153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19970): Launched 08:54:40.478404 run osmo-stp_10.42.42.5(pid=19971): Launched 08:54:40.592623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:41.109047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19973): Launched 08:54:41.231510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:41.500354 run patchelf(pid=19974): Launched 08:54:41.676534 run osmo-stp_10.42.42.5(pid=19971): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19971)] 08:54:41.810459 run osmo-stp_10.42.42.5(pid=19971): stdout: | (launched: 2022-12-10_08:54:40.423911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:41.946045 run osmo-stp_10.42.42.5(pid=19971): stderr: | 20221210085440592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085440592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085440593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085440593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085440595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085440596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085440596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:42.081599 run osmo-stp_10.42.42.5(pid=19971): stdout: | (launched: 2022-12-10_08:54:40.423911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:42.211793 run osmo-stp_10.42.42.5(pid=19971): stderr: | 20221210085440592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085440592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085440593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085440593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085440595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085440596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085440596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:42.366184 run patchelf(pid=19974): Terminating (SIGINT) 08:54:42.544258 run patchelf(pid=19974): Terminated: ok {rc=0} 08:54:42.672421 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19971): Process ended prematurely: osmo-stp_10.42.42.5(pid=19971) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19971)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 08:54:42.681662 tst ping.py:22: Test FAILED (6.5 sec) 08:54:42.709233 run osmo-hlr_10.42.42.2(pid=19968): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19968)] 08:54:42.759227 run osmo-hlr_10.42.42.2(pid=19968): stdout: | (launched: 2022-12-10_08:54:39.478809) 08:54:42.810863 run osmo-hlr_10.42.42.2(pid=19968): stderr: | 20221210085439651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085439651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085439652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085439652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085439652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085439652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085439664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085439673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085439674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085439674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:42.862845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19967): Terminating (SIGTERM) 08:54:42.904393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19970): Terminating (SIGTERM) 08:54:42.946186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19973): Terminating (SIGTERM) 08:54:42.987977 --- ParallelTerminationStrategy: PID 19967 died... 08:54:43.007933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19967): Terminated: ok {rc=0} 08:54:43.053909 --- ParallelTerminationStrategy: PID 19970 died... 08:54:43.073477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19970): Terminated: ok {rc=0} 08:54:43.119164 --- ParallelTerminationStrategy: PID 19973 died... 08:54:43.138527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19973): Terminated: ok {rc=0} 08:54:43.225255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:54:44.312232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.324244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:54:44.397446 tst ping_idle_ping.py: using LAC 27265 08:54:44.527575 tst ping_idle_ping.py: using RAC 235 08:54:44.651833 tst ping_idle_ping.py: using CellId 27265 08:54:44.775607 tst ping_idle_ping.py: using BVCI 27266 08:54:44.890933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.902523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.913818 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.925054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.936182 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.947442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.958790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:54:44.970071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:54:45.089257 tst ping_idle_ping.py:24: start network... 08:54:45.304599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:45.804462 run create_hlr_db(pid=19975): Launched 08:54:45.971868 bus /gobi_6: Setting Powered False 08:54:47.034640 run create_hlr_db(pid=19975): Terminated: ok {rc=0} 08:54:47.491417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Launched 08:54:47.790769 run osmo-hlr_10.42.42.2(pid=19978): Launched 08:54:47.905742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:48.424672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Launched 08:54:48.722792 run osmo-stp_10.42.42.5(pid=19981): Launched 08:54:48.836894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:54:49.351258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19983): Launched 08:54:49.466217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:54:49.718147 run patchelf(pid=19984): Launched 08:54:49.884823 run osmo-stp_10.42.42.5(pid=19981): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] 08:54:50.011783 run osmo-stp_10.42.42.5(pid=19981): stdout: | (launched: 2022-12-10_08:54:48.668496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:50.139950 run osmo-stp_10.42.42.5(pid=19981): stderr: | 20221210085448839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085448839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085448839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085448839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085448840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085448840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085448840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:50.268699 run osmo-stp_10.42.42.5(pid=19981): stdout: | (launched: 2022-12-10_08:54:48.668496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:54:50.391854 run osmo-stp_10.42.42.5(pid=19981): stderr: | 20221210085448839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085448839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085448839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085448839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085448840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085448840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085448840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:54:50.537586 run patchelf(pid=19984): Terminating (SIGINT) 08:54:50.705798 run patchelf(pid=19984): Terminated: ok {rc=0} 08:54:50.827151 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19981): Process ended prematurely: osmo-stp_10.42.42.5(pid=19981) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:54:50.836071 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:54:50.862498 run osmo-hlr_10.42.42.2(pid=19978): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19978)] 08:54:50.909896 run osmo-hlr_10.42.42.2(pid=19978): stdout: | (launched: 2022-12-10_08:54:47.736392) 08:54:50.959375 run osmo-hlr_10.42.42.2(pid=19978): stderr: | 20221210085447915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085447915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085447915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085447915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085447915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085447915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085447928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085447938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085447938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085447938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:54:51.008673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Terminating (SIGTERM) 08:54:51.048655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Terminating (SIGTERM) 08:54:51.088883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19983): Terminating (SIGTERM) 08:54:51.128853 --- ParallelTerminationStrategy: PID 19977 died... 08:54:51.147616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19977): Terminated: ok {rc=0} 08:54:51.191947 --- ParallelTerminationStrategy: PID 19980 died... 08:54:51.210378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19980): Terminated: ok {rc=0} 08:54:51.257750 --- ParallelTerminationStrategy: PID 19983 died... 08:54:51.276830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19983): Terminated: ok {rc=0} 08:54:51.363379 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:54:52.666870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:54:52.675127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:54:52.710153 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 08:54:52.749534 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 08:54:52.839025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:54:52.873890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 08:54:52.913319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 08:54:53.513430 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 08:54:53.565186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:53.576553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:54:53.648860 tst cs_paging_gprs_active.py: using LAC 27266 08:54:53.777238 tst cs_paging_gprs_active.py: using RAC 236 08:54:53.903314 tst cs_paging_gprs_active.py: using CellId 27266 08:54:54.024421 tst cs_paging_gprs_active.py: using BVCI 27267 08:54:54.137530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.148637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.159652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.171124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.182598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.193962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.205326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.216416 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:54:54.227733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:54:54.346567 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:54:54.464134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:54:54.682526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:55.009283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19991): Launched 08:54:55.295753 run iperf3-srv_10.42.42.10(pid=19992): Launched 08:54:55.417090 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:54:55.636265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:54:55.965088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Launched 08:54:56.250976 run iperf3-srv_10.42.42.10(pid=19994): Launched 08:54:56.371680 tst cs_paging_gprs_active.py:38: start network... 08:54:56.590244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:54:57.094637 run create_hlr_db(pid=19995): Launched 08:54:57.225866 bus /gobi_6: Setting Powered False 08:54:58.289300 run create_hlr_db(pid=19995): Terminated: ok {rc=0} 08:54:58.725779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19997): Launched 08:54:59.032892 run osmo-hlr_10.42.42.2(pid=19998): Launched 08:54:59.148791 run osmo-stp_10.42.42.5: Starting osmo-stp 08:54:59.688781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20000): Launched 08:54:59.996124 run osmo-stp_10.42.42.5(pid=20001): Launched 08:55:00.111567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:00.638453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20003): Launched 08:55:00.754263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:01.053647 run patchelf(pid=20004): Launched 08:55:01.271072 run osmo-stp_10.42.42.5(pid=20001): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20001)] 08:55:01.426461 run osmo-stp_10.42.42.5(pid=20001): stdout: | (launched: 2022-12-10_08:54:59.936775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:01.570662 run osmo-stp_10.42.42.5(pid=20001): stderr: | 20221210085500112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085500112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085500112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085500113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085500113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085500113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085500113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:01.713655 run osmo-stp_10.42.42.5(pid=20001): stdout: | (launched: 2022-12-10_08:54:59.936775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:01.850011 run osmo-stp_10.42.42.5(pid=20001): stderr: | 20221210085500112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085500112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085500112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085500113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085500113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085500113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085500113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:02.012075 run patchelf(pid=20004): Terminating (SIGINT) 08:55:02.197894 run patchelf(pid=20004): Terminated: ok {rc=0} 08:55:02.330358 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20001): Process ended prematurely: osmo-stp_10.42.42.5(pid=20001) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20001)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 08:55:02.340696 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 08:55:02.369318 run osmo-hlr_10.42.42.2(pid=19998): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19998)] 08:55:02.419589 run osmo-hlr_10.42.42.2(pid=19998): stdout: | (launched: 2022-12-10_08:54:58.974151) 08:55:02.471783 run osmo-hlr_10.42.42.2(pid=19998): stderr: | 20221210085459153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085459153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085459153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085459153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085459153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085459153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085459165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085459175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085459175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085459175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:02.524184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19991): Terminating (SIGTERM) 08:55:02.566112 run iperf3-srv_10.42.42.10(pid=19992): Terminating (SIGTERM) 08:55:02.607747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminating (SIGTERM) 08:55:02.649407 run iperf3-srv_10.42.42.10(pid=19994): Terminating (SIGTERM) 08:55:02.691117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19997): Terminating (SIGTERM) 08:55:02.732753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20000): Terminating (SIGTERM) 08:55:02.774549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20003): Terminating (SIGTERM) 08:55:02.816377 --- ParallelTerminationStrategy: PID 19991 died... 08:55:02.836276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19991): Terminated: ok {rc=0} 08:55:02.882478 --- ParallelTerminationStrategy: PID 19992 died... 08:55:02.901840 run iperf3-srv_10.42.42.10(pid=19992): Terminated {rc=256} 08:55:02.947482 --- ParallelTerminationStrategy: PID 19993 died... 08:55:02.966983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19993): Terminated: ok {rc=0} 08:55:03.013193 --- ParallelTerminationStrategy: PID 19994 died... 08:55:03.032498 run iperf3-srv_10.42.42.10(pid=19994): Terminated {rc=256} 08:55:03.078204 --- ParallelTerminationStrategy: PID 19997 died... 08:55:03.097683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19997): Terminated: ok {rc=0} 08:55:03.143342 --- ParallelTerminationStrategy: PID 20000 died... 08:55:03.162821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20000): Terminated: ok {rc=0} 08:55:03.208502 --- ParallelTerminationStrategy: PID 20003 died... 08:55:03.227784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20003): Terminated: ok {rc=0} 08:55:03.314819 bus /gobi_0: Setting Powered False 08:55:04.413115 bus /gobi_0: Setting Powered False 08:55:05.526929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 08:55:06.674448 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:06.686646 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:55:06.761946 tst iperf3.py: using LAC 27267 08:55:06.882778 tst iperf3.py: using RAC 237 08:55:07.005209 tst iperf3.py: using CellId 27267 08:55:07.126416 tst iperf3.py: using BVCI 27268 08:55:07.238968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.249968 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.260775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.271831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.282786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.293815 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.305090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.316336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:07.327442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:07.444920 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:07.651866 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:07.962496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Launched 08:55:08.231762 run iperf3-srv_10.42.42.10(pid=20009): Launched 08:55:08.346611 tst iperf3.py:8: start network... 08:55:08.551152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:09.027392 run create_hlr_db(pid=20010): Launched 08:55:09.143879 bus /gobi_6: Setting Powered False 08:55:10.203553 run create_hlr_db(pid=20010): Terminated: ok {rc=0} 08:55:10.650151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Launched 08:55:10.976268 run osmo-hlr_10.42.42.2(pid=20013): Launched 08:55:11.099735 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:11.661163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Launched 08:55:11.985411 run osmo-stp_10.42.42.5(pid=20016): Launched 08:55:12.108698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:12.674518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Launched 08:55:12.797773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:13.074934 run patchelf(pid=20019): Launched 08:55:13.253486 run osmo-stp_10.42.42.5(pid=20016): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] 08:55:13.389551 run osmo-stp_10.42.42.5(pid=20016): stdout: | (launched: 2022-12-10_08:55:11.923279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:13.527696 run osmo-stp_10.42.42.5(pid=20016): stderr: | 20221210085512118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085512118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085512118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085512119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085512119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085512120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085512120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:13.665893 run osmo-stp_10.42.42.5(pid=20016): stdout: | (launched: 2022-12-10_08:55:11.923279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:13.798343 run osmo-stp_10.42.42.5(pid=20016): stderr: | 20221210085512118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085512118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085512118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085512119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085512119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085512120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085512120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:13.954788 run patchelf(pid=20019): Terminating (SIGINT) 08:55:14.135192 run patchelf(pid=20019): Terminated: ok {rc=0} 08:55:14.265447 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20016): Process ended prematurely: osmo-stp_10.42.42.5(pid=20016) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 08:55:14.275252 tst iperf3.py:8: Test FAILED (7.6 sec) 08:55:14.303379 run osmo-hlr_10.42.42.2(pid=20013): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20013)] 08:55:14.352643 run osmo-hlr_10.42.42.2(pid=20013): stdout: | (launched: 2022-12-10_08:55:10.913300) 08:55:14.403639 run osmo-hlr_10.42.42.2(pid=20013): stderr: | 20221210085511115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085511115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085511115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085511115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085511115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085511115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085511130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085511140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085511140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085511140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:14.454874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Terminating (SIGTERM) 08:55:14.496414 run iperf3-srv_10.42.42.10(pid=20009): Terminating (SIGTERM) 08:55:14.537694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Terminating (SIGTERM) 08:55:14.578813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Terminating (SIGTERM) 08:55:14.620153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Terminating (SIGTERM) 08:55:14.662063 --- ParallelTerminationStrategy: PID 20008 died... 08:55:14.681876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20008): Terminated: ok {rc=0} 08:55:14.727944 --- ParallelTerminationStrategy: PID 20009 died... 08:55:14.747464 run iperf3-srv_10.42.42.10(pid=20009): Terminated {rc=256} 08:55:14.793227 --- ParallelTerminationStrategy: PID 20012 died... 08:55:14.812316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20012): Terminated: ok {rc=0} 08:55:14.858016 --- ParallelTerminationStrategy: PID 20015 died... 08:55:14.877374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20015): Terminated: ok {rc=0} 08:55:14.922750 --- ParallelTerminationStrategy: PID 20018 died... 08:55:14.942035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20018): Terminated: ok {rc=0} 08:55:15.029873 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 08:55:16.203877 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.219009 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:55:16.308272 tst iperf3m4.py: using LAC 27268 08:55:16.441196 tst iperf3m4.py: using RAC 238 08:55:16.593738 tst iperf3m4.py: using CellId 27268 08:55:16.744577 tst iperf3m4.py: using BVCI 27269 08:55:16.865928 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.877889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.889858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.902851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.915450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.927344 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.939891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.952185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:16.964836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:17.091841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:17.230621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:17.352340 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:17.471735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:55:17.691924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:18.022645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20020): Launched 08:55:18.307987 run iperf3-srv_10.42.42.10(pid=20021): Launched 08:55:18.429706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:55:18.648314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:18.977219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20022): Launched 08:55:19.262756 run iperf3-srv_10.42.42.10(pid=20023): Launched 08:55:19.384167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:55:19.601687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:19.930119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20024): Launched 08:55:20.214718 run iperf3-srv_10.42.42.10(pid=20025): Launched 08:55:20.335449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:55:20.553183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:55:20.882788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20026): Launched 08:55:21.167351 run iperf3-srv_10.42.42.10(pid=20027): Launched 08:55:21.288045 tst iperf3m4.py:8: start network... 08:55:21.505191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:22.010747 run create_hlr_db(pid=20028): Launched 08:55:22.140438 bus /gobi_6: Setting Powered False 08:55:23.203612 run create_hlr_db(pid=20028): Terminated: ok {rc=0} 08:55:23.640105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Launched 08:55:23.948533 run osmo-hlr_10.42.42.2(pid=20031): Launched 08:55:24.073451 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:24.639269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Launched 08:55:24.965168 run osmo-stp_10.42.42.5(pid=20034): Launched 08:55:25.087638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:25.648445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Launched 08:55:25.771265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:26.047790 run patchelf(pid=20037): Launched 08:55:26.226349 run osmo-stp_10.42.42.5(pid=20034): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] 08:55:26.362325 run osmo-stp_10.42.42.5(pid=20034): stdout: | (launched: 2022-12-10_08:55:24.901907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:26.500005 run osmo-stp_10.42.42.5(pid=20034): stderr: | 20221210085525098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085525098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085525099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085525099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085525099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085525099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085525100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:26.637582 run osmo-stp_10.42.42.5(pid=20034): stdout: | (launched: 2022-12-10_08:55:24.901907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:26.769746 run osmo-stp_10.42.42.5(pid=20034): stderr: | 20221210085525098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085525098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085525099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085525099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085525099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085525099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085525100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:26.926197 run patchelf(pid=20037): Terminating (SIGINT) 08:55:27.106359 run patchelf(pid=20037): Terminated: ok {rc=0} 08:55:27.236145 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20034): Process ended prematurely: osmo-stp_10.42.42.5(pid=20034) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 08:55:27.246287 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:55:27.274630 run osmo-hlr_10.42.42.2(pid=20031): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20031)] 08:55:27.324180 run osmo-hlr_10.42.42.2(pid=20031): stdout: | (launched: 2022-12-10_08:55:23.889064) 08:55:27.375047 run osmo-hlr_10.42.42.2(pid=20031): stderr: | 20221210085524086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085524086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085524086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085524086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085524086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085524086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085524099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085524107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085524107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085524108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:27.426161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20020): Terminating (SIGTERM) 08:55:27.467680 run iperf3-srv_10.42.42.10(pid=20021): Terminating (SIGTERM) 08:55:27.508697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20022): Terminating (SIGTERM) 08:55:27.549928 run iperf3-srv_10.42.42.10(pid=20023): Terminating (SIGTERM) 08:55:27.590948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20024): Terminating (SIGTERM) 08:55:27.632057 run iperf3-srv_10.42.42.10(pid=20025): Terminating (SIGTERM) 08:55:27.672809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20026): Terminating (SIGTERM) 08:55:27.714559 run iperf3-srv_10.42.42.10(pid=20027): Terminating (SIGTERM) 08:55:27.755629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Terminating (SIGTERM) 08:55:27.796928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Terminating (SIGTERM) 08:55:27.838095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Terminating (SIGTERM) 08:55:27.879317 --- ParallelTerminationStrategy: PID 20020 died... 08:55:27.899100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20020): Terminated: ok {rc=0} 08:55:27.945337 --- ParallelTerminationStrategy: PID 20021 died... 08:55:27.964491 run iperf3-srv_10.42.42.10(pid=20021): Terminated {rc=256} 08:55:28.009726 --- ParallelTerminationStrategy: PID 20022 died... 08:55:28.029015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20022): Terminated: ok {rc=0} 08:55:28.074769 --- ParallelTerminationStrategy: PID 20023 died... 08:55:28.094141 run iperf3-srv_10.42.42.10(pid=20023): Terminated {rc=256} 08:55:28.139505 --- ParallelTerminationStrategy: PID 20024 died... 08:55:28.158790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20024): Terminated: ok {rc=0} 08:55:28.204582 --- ParallelTerminationStrategy: PID 20025 died... 08:55:28.224017 run iperf3-srv_10.42.42.10(pid=20025): Terminated {rc=256} 08:55:28.269426 --- ParallelTerminationStrategy: PID 20026 died... 08:55:28.288669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20026): Terminated: ok {rc=0} 08:55:28.334449 --- ParallelTerminationStrategy: PID 20027 died... 08:55:28.353765 run iperf3-srv_10.42.42.10(pid=20027): Terminated {rc=256} 08:55:28.399088 --- ParallelTerminationStrategy: PID 20030 died... 08:55:28.418503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20030): Terminated: ok {rc=0} 08:55:28.464284 --- ParallelTerminationStrategy: PID 20033 died... 08:55:28.483642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20033): Terminated: ok {rc=0} 08:55:28.529445 --- ParallelTerminationStrategy: PID 20036 died... 08:55:28.548822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20036): Terminated: ok {rc=0} 08:55:28.635137 bus /gobi_4: Setting Powered False 08:55:29.735612 bus /gobi_4: Setting Powered False 08:55:30.862468 bus /gobi_1: Setting Powered False 08:55:31.969551 bus /gobi_1: Setting Powered False 08:55:33.096060 bus /gobi_0: Setting Powered False 08:55:34.194805 bus /gobi_0: Setting Powered False 08:55:35.311361 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 08:55:36.414707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:36.426510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:55:36.496912 tst ping.py: using LAC 27269 08:55:36.613360 tst ping.py: using RAC 239 08:55:36.733332 tst ping.py: using CellId 27269 08:55:36.852051 tst ping.py: using BVCI 27270 08:55:36.960065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:36.971370 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:36.982423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:36.993609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:37.004532 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:37.015817 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:37.027186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:37.038425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:37.152433 tst ping.py:19: start network... 08:55:37.352076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:37.817779 run create_hlr_db(pid=20038): Launched 08:55:37.931261 bus /gobi_6: Setting Powered False 08:55:38.990911 run create_hlr_db(pid=20038): Terminated: ok {rc=0} 08:55:39.430591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Launched 08:55:39.751607 run osmo-hlr_10.42.42.2(pid=20041): Launched 08:55:39.873336 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:40.429498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Launched 08:55:40.749721 run osmo-stp_10.42.42.5(pid=20044): Launched 08:55:40.870080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:41.419580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20046): Launched 08:55:41.540657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:41.811897 run patchelf(pid=20047): Launched 08:55:41.988183 run osmo-stp_10.42.42.5(pid=20044): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] 08:55:42.122265 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-10_08:55:40.687247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:42.257532 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221210085540884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085540884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085540884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085540884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085540885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085540885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085540885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:42.393139 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-10_08:55:40.687247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:42.523308 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221210085540884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085540884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085540884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085540884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085540885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085540885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085540885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:42.677174 run patchelf(pid=20047): Terminating (SIGINT) 08:55:42.854682 run patchelf(pid=20047): Terminated: ok {rc=0} 08:55:42.982404 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 08:55:42.991705 tst ping.py:22: Test FAILED (6.6 sec) 08:55:43.019208 run osmo-hlr_10.42.42.2(pid=20041): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20041)] 08:55:43.068555 run osmo-hlr_10.42.42.2(pid=20041): stdout: | (launched: 2022-12-10_08:55:39.689286) 08:55:43.119469 run osmo-hlr_10.42.42.2(pid=20041): stderr: | 20221210085539892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085539892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085539892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085539892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085539892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085539892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085539904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085539913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085539913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085539913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:43.170751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminating (SIGTERM) 08:55:43.212120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminating (SIGTERM) 08:55:43.253566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20046): Terminating (SIGTERM) 08:55:43.295133 --- ParallelTerminationStrategy: PID 20040 died... 08:55:43.315074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminated: ok {rc=0} 08:55:43.361123 --- ParallelTerminationStrategy: PID 20043 died... 08:55:43.380560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminated: ok {rc=0} 08:55:43.426216 --- ParallelTerminationStrategy: PID 20046 died... 08:55:43.445368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20046): Terminated: ok {rc=0} 08:55:43.532202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 08:55:44.618213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:44.630725 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:55:44.709644 tst ping_idle_ping.py: using LAC 27270 08:55:44.828063 tst ping_idle_ping.py: using RAC 240 08:55:44.944178 tst ping_idle_ping.py: using CellId 27270 08:55:45.060334 tst ping_idle_ping.py: using BVCI 27271 08:55:45.169624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.180692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.191729 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.203496 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.215146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.226884 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.238563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 08:55:45.251058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 08:55:45.371296 tst ping_idle_ping.py:24: start network... 08:55:45.585841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:46.103245 run create_hlr_db(pid=20048): Launched 08:55:46.263040 bus /gobi_6: Setting Powered False 08:55:47.322158 run create_hlr_db(pid=20048): Terminated: ok {rc=0} 08:55:47.828634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Launched 08:55:48.149359 run osmo-hlr_10.42.42.2(pid=20051): Launched 08:55:48.270849 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:48.826417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Launched 08:55:49.146617 run osmo-stp_10.42.42.5(pid=20054): Launched 08:55:49.267141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:49.819827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Launched 08:55:49.942025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:50.215392 run patchelf(pid=20057): Launched 08:55:50.392242 run osmo-stp_10.42.42.5(pid=20054): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] 08:55:50.527255 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-10_08:55:49.084737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:50.663245 run osmo-stp_10.42.42.5(pid=20054): stderr: | 20221210085549278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085549278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085549279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085549279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085549279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085549279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085549280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:50.799422 run osmo-stp_10.42.42.5(pid=20054): stdout: | (launched: 2022-12-10_08:55:49.084737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:50.930190 run osmo-stp_10.42.42.5(pid=20054): stderr: | 20221210085549278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085549278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085549279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085549279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085549279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085549279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085549280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:51.084893 run patchelf(pid=20057): Terminating (SIGINT) 08:55:51.263347 run patchelf(pid=20057): Terminated: ok {rc=0} 08:55:51.391857 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 08:55:51.401246 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:55:51.428752 run osmo-hlr_10.42.42.2(pid=20051): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20051)] 08:55:51.478759 run osmo-hlr_10.42.42.2(pid=20051): stdout: | (launched: 2022-12-10_08:55:48.088025) 08:55:51.529980 run osmo-hlr_10.42.42.2(pid=20051): stderr: | 20221210085548287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085548287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085548287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085548287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085548287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085548287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085548299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085548308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085548309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085548309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:55:51.581599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminating (SIGTERM) 08:55:51.623676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminating (SIGTERM) 08:55:51.665579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Terminating (SIGTERM) 08:55:51.707535 --- ParallelTerminationStrategy: PID 20050 died... 08:55:51.727310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20050): Terminated: ok {rc=0} 08:55:51.773413 --- ParallelTerminationStrategy: PID 20053 died... 08:55:51.792716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20053): Terminated: ok {rc=0} 08:55:51.838801 --- ParallelTerminationStrategy: PID 20056 died... 08:55:51.858124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20056): Terminated: ok {rc=0} 08:55:51.946764 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:55:53.258104 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:55:53.265708 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:55:53.301085 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:55:53.336557 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:55:53.390575 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:55:53.425161 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:55:53.460651 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:55:54.022861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:55:54.028399 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.040344 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:55:54.111947 tst switch_tch_pdch.py: using LAC 27271 08:55:54.243130 tst switch_tch_pdch.py: using RAC 241 08:55:54.366195 tst switch_tch_pdch.py: using CellId 27271 08:55:54.489453 tst switch_tch_pdch.py: using BVCI 27272 08:55:54.604415 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.616165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.627706 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.639471 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.651092 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.662846 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.674737 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:55:54.686449 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:54.803086 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:55:54.922089 tst switch_tch_pdch.py:51: start network... 08:55:55.122421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:55:55.585264 run create_hlr_db(pid=20061): Launched 08:55:55.700727 bus /gobi_6: Setting Powered False 08:55:56.761079 run create_hlr_db(pid=20061): Terminated: ok {rc=0} 08:55:57.177988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20063): Launched 08:55:57.476460 run osmo-hlr_10.42.42.2(pid=20064): Launched 08:55:57.591698 run osmo-stp_10.42.42.5: Starting osmo-stp 08:55:58.118421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20066): Launched 08:55:58.414312 run osmo-stp_10.42.42.5(pid=20067): Launched 08:55:58.528025 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:55:59.041688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20069): Launched 08:55:59.155257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:55:59.406423 run patchelf(pid=20070): Launched 08:55:59.571801 run osmo-stp_10.42.42.5(pid=20067): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20067)] 08:55:59.697707 run osmo-stp_10.42.42.5(pid=20067): stdout: | (launched: 2022-12-10_08:55:58.360435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:55:59.824899 run osmo-stp_10.42.42.5(pid=20067): stderr: | 20221210085558529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085558529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085558530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085558530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085558530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085558530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085558531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:55:59.952254 run osmo-stp_10.42.42.5(pid=20067): stdout: | (launched: 2022-12-10_08:55:58.360435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:00.074782 run osmo-stp_10.42.42.5(pid=20067): stderr: | 20221210085558529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085558529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085558530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085558530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085558530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085558530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085558531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:00.219235 run patchelf(pid=20070): Terminating (SIGINT) 08:56:00.386070 run patchelf(pid=20070): Terminated: ok {rc=0} 08:56:00.506333 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20067): Process ended prematurely: osmo-stp_10.42.42.5(pid=20067) [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20067)] [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:56:00.515027 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 08:56:00.541562 run osmo-hlr_10.42.42.2(pid=20064): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20064)] 08:56:00.588529 run osmo-hlr_10.42.42.2(pid=20064): stdout: | (launched: 2022-12-10_08:55:57.421989) 08:56:00.637260 run osmo-hlr_10.42.42.2(pid=20064): stderr: | 20221210085557599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085557599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085557599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085557599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085557599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085557600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085557610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085557619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085557619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085557619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:00.686451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20063): Terminating (SIGTERM) 08:56:00.725700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20066): Terminating (SIGTERM) 08:56:00.764820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20069): Terminating (SIGTERM) 08:56:00.804136 --- ParallelTerminationStrategy: PID 20063 died... 08:56:00.822926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20063): Terminated: ok {rc=0} 08:56:00.879195 --- ParallelTerminationStrategy: PID 20066 died... 08:56:00.900671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20066): Terminated: ok {rc=0} 08:56:00.950075 --- ParallelTerminationStrategy: PID 20069 died... 08:56:00.968989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20069): Terminated: ok {rc=0} 08:56:01.053530 bus /gobi_0: Setting Powered False 08:56:02.156225 bus /gobi_0: Setting Powered False 08:56:03.274333 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 08:56:04.525094 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:04.531202 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 08:56:04.565923 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 08:56:04.600280 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 08:56:04.652740 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 08:56:04.686416 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 08:56:04.720649 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 08:56:05.278038 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 08:56:05.282994 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.294010 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 08:56:05.364426 tst switch_tch_pdch.py: using LAC 27272 08:56:05.481176 tst switch_tch_pdch.py: using RAC 242 08:56:05.597573 tst switch_tch_pdch.py: using CellId 27272 08:56:05.716887 tst switch_tch_pdch.py: using BVCI 27273 08:56:05.826544 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.837582 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.848353 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.859396 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.870462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.881638 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.892716 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 08:56:05.903780 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:56:06.021733 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 08:56:06.139689 tst switch_tch_pdch.py:51: start network... 08:56:06.339866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:06.782532 run create_hlr_db(pid=20074): Launched 08:56:06.896191 bus /gobi_6: Setting Powered False 08:56:07.956103 run create_hlr_db(pid=20074): Terminated: ok {rc=0} 08:56:08.353286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Launched 08:56:08.656073 run osmo-hlr_10.42.42.2(pid=20077): Launched 08:56:08.771116 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:09.262342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Launched 08:56:09.562229 run osmo-stp_10.42.42.5(pid=20080): Launched 08:56:09.675267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:56:10.166801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Launched 08:56:10.280191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:56:10.535774 run patchelf(pid=20083): Launched 08:56:10.701939 run osmo-stp_10.42.42.5(pid=20080): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] 08:56:10.828343 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-10_08:56:09.504208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:10.956173 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221210085609676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085609676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085609676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085609676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085609677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085609677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085609677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:11.083954 run osmo-stp_10.42.42.5(pid=20080): stdout: | (launched: 2022-12-10_08:56:09.504208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:11.206282 run osmo-stp_10.42.42.5(pid=20080): stderr: | 20221210085609676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085609676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085609676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085609676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085609677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085609677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085609677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:11.351249 run patchelf(pid=20083): Terminating (SIGINT) 08:56:11.518991 run patchelf(pid=20083): Terminated: ok {rc=0} 08:56:11.639791 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 08:56:11.648477 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 08:56:11.675234 run osmo-hlr_10.42.42.2(pid=20077): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20077)] 08:56:11.722619 run osmo-hlr_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-10_08:56:08.598138) 08:56:11.771330 run osmo-hlr_10.42.42.2(pid=20077): stderr: | 20221210085608779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085608779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085608779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085608779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085608779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085608779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085608791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085608800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085608800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085608800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:11.820206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminating (SIGTERM) 08:56:11.859446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminating (SIGTERM) 08:56:11.899112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminating (SIGTERM) 08:56:11.938551 --- ParallelTerminationStrategy: PID 20076 died... 08:56:11.957536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20076): Terminated: ok {rc=0} 08:56:12.001271 --- ParallelTerminationStrategy: PID 20079 died... 08:56:12.019358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20079): Terminated: ok {rc=0} 08:56:12.062933 --- ParallelTerminationStrategy: PID 20082 died... 08:56:12.081213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20082): Terminated: ok {rc=0} 08:56:12.166941 bus /gobi_0: Setting Powered False 08:56:13.266158 bus /gobi_0: Setting Powered False 08:56:14.378210 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:trx-umtrx --------------------------------------------------------------------- 08:56:15.635482 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:15.639648 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:56:15.673426 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 08:56:15.680313 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 08:56:15.733416 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:56:15.767220 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 08:56:15.774483 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 08:56:16.308548 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 08:56:16.315157 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 08:56:16.327106 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 08:56:16.380235 tst mo_mt_sms.py: using LAC 27273 08:56:16.526741 tst mo_mt_sms.py: using RAC 243 08:56:16.653202 tst mo_mt_sms.py: using CellId 27273 08:56:16.777917 tst mo_mt_sms.py: using BVCI 27274 08:56:16.890993 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:56:17.009215 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:56:17.147302 tst mo_mt_sms.py:9: start nitb and bts... 08:56:17.367321 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:56:18.013116 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20087): Launched 08:56:18.329378 run osmo-nitb_10.42.42.2(pid=20088): Launched 08:56:18.504355 run osmo-nitb_10.42.42.2(pid=20088): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20088)] 08:56:18.646592 run osmo-nitb_10.42.42.2(pid=20088): stdout: | (launched: 2022-12-10_08:56:18.272134) 08:56:18.790010 run osmo-nitb_10.42.42.2(pid=20088): stderr: | (launched: 2022-12-10_08:56:18.319435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:56:18.933433 run osmo-nitb_10.42.42.2(pid=20088): stdout: | (launched: 2022-12-10_08:56:18.272134) 08:56:19.071436 run osmo-nitb_10.42.42.2(pid=20088): stderr: | (launched: 2022-12-10_08:56:18.319435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20088) [trial-2372↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20088)] 08:56:19.448548 tst osmo-nitb_10.42.42.2(pid=20088): stdout: | (launched: 2022-12-10_08:56:18.272134) 08:56:19.576761 tst osmo-nitb_10.42.42.2(pid=20088): stderr: | (launched: 2022-12-10_08:56:18.319435) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:56:19.727699 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20088) [trial-2372↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20088)] [trial-2372↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 08:56:19.736643 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 08:56:19.743462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20087): Terminating (SIGTERM) 08:56:19.955158 --- ParallelTerminationStrategy: PID 20087 died... 08:56:19.976323 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20087): Terminated: ok {rc=0} 08:56:20.063683 bus /sierra_3: Setting Powered False 08:56:21.161856 bus /sierra_3: Setting Powered False 08:56:22.278365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:trx-umtrx --------------------------------------------------------------------- 08:56:23.478961 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:23.483243 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:56:23.516937 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:56:23.544406 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 08:56:23.595429 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:56:23.628518 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:56:23.655842 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 08:56:24.204676 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 08:56:24.209811 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.220701 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 08:56:24.268167 tst mo_mt_sms.py: using LAC 27274 08:56:24.385934 tst mo_mt_sms.py: using RAC 244 08:56:24.504545 tst mo_mt_sms.py: using CellId 27274 08:56:24.620400 tst mo_mt_sms.py: using BVCI 27275 08:56:24.729127 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.739532 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.750434 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.761193 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.771811 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:24.782589 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:56:24.900297 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 08:56:25.016476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:25.481723 run create_hlr_db(pid=20094): Launched 08:56:25.595890 bus /sierra_2: Setting Powered False 08:56:26.655006 run create_hlr_db(pid=20094): Terminated: ok {rc=0} 08:56:27.092686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20096): Launched 08:56:27.412608 run osmo-hlr_10.42.42.2(pid=20097): Launched 08:56:27.533920 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:28.067326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20099): Launched 08:56:28.368860 run osmo-stp_10.42.42.5(pid=20100): Launched 08:56:28.483354 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:29.025503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20102): Launched 08:56:29.326717 run osmo-msc_10.42.42.6(pid=20103): Launched 08:56:29.494095 run osmo-stp_10.42.42.5(pid=20100): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20100)] 08:56:29.621429 run osmo-stp_10.42.42.5(pid=20100): stdout: | (launched: 2022-12-10_08:56:28.311275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:29.748560 run osmo-stp_10.42.42.5(pid=20100): stderr: | 20221210085628481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085628481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085628481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085628482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085628484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085628484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085628484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:29.872755 run osmo-stp_10.42.42.5(pid=20100): stdout: | (launched: 2022-12-10_08:56:28.311275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:29.990879 run osmo-stp_10.42.42.5(pid=20100): stderr: | 20221210085628481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085628481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085628481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085628482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085628484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085628484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085628484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:30.132766 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20100): Process ended prematurely: osmo-stp_10.42.42.5(pid=20100) [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20100)] [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py:16] 08:56:30.141129 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 08:56:30.167176 run osmo-hlr_10.42.42.2(pid=20097): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20097)] 08:56:30.214969 run osmo-hlr_10.42.42.2(pid=20097): stdout: | (launched: 2022-12-10_08:56:27.350040) 08:56:30.264309 run osmo-hlr_10.42.42.2(pid=20097): stderr: | 20221210085627553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085627553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085627553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085627553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085627553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085627553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085627567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085627576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085627576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085627577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:30.332810 run osmo-msc_10.42.42.6(pid=20103): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20103)] 08:56:30.380156 run osmo-msc_10.42.42.6(pid=20103): stdout: | (launched: 2022-12-10_08:56:29.268051) 08:56:30.429085 run osmo-msc_10.42.42.6(pid=20103): stderr: | 20221210085629543 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085629544 DLGLOBAL DEBUG validating counter group 0x7f00d02d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085629544 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085629544 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085629544 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085629544 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085629546 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085629546 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085629546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085629547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:30.478374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20096): Terminating (SIGTERM) 08:56:30.517762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20099): Terminating (SIGTERM) 08:56:30.557199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20102): Terminating (SIGTERM) 08:56:30.596767 --- ParallelTerminationStrategy: PID 20096 died... 08:56:30.615530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20096): Terminated: ok {rc=0} 08:56:30.659115 --- ParallelTerminationStrategy: PID 20099 died... 08:56:30.677365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20099): Terminated: ok {rc=0} 08:56:30.720749 --- ParallelTerminationStrategy: PID 20102 died... 08:56:30.739028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20102): Terminated: ok {rc=0} 08:56:30.823287 bus /sierra_3: Setting Powered False 08:56:31.930957 bus /sierra_3: Setting Powered False 08:56:33.047089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 08:56:34.279403 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:34.284505 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:56:34.318434 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 08:56:34.325107 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 08:56:34.359758 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:56:34.392838 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 08:56:34.399685 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 08:56:34.918495 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 08:56:34.923572 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 08:56:34.934415 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 08:56:34.985911 tst assert_extension.py: using LAC 27275 08:56:35.103744 tst assert_extension.py: using RAC 245 08:56:35.220188 tst assert_extension.py: using CellId 27275 08:56:35.335732 tst assert_extension.py: using BVCI 27276 08:56:35.443389 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 08:56:35.561392 tst assert_extension.py:10: start nitb and bts... 08:56:35.774217 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:56:36.420325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20108): Launched 08:56:36.736200 run osmo-nitb_10.42.42.2(pid=20109): Launched 08:56:36.910718 run osmo-nitb_10.42.42.2(pid=20109): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20109)] 08:56:37.052175 run osmo-nitb_10.42.42.2(pid=20109): stdout: | (launched: 2022-12-10_08:56:36.679137) 08:56:37.195271 run osmo-nitb_10.42.42.2(pid=20109): stderr: | (launched: 2022-12-10_08:56:36.726284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:56:37.338378 run osmo-nitb_10.42.42.2(pid=20109): stdout: | (launched: 2022-12-10_08:56:36.679137) 08:56:37.475805 run osmo-nitb_10.42.42.2(pid=20109): stderr: | (launched: 2022-12-10_08:56:36.726284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20109) [trial-2372↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20109)] 08:56:37.854759 tst osmo-nitb_10.42.42.2(pid=20109): stdout: | (launched: 2022-12-10_08:56:36.679137) 08:56:37.982494 tst osmo-nitb_10.42.42.2(pid=20109): stderr: | (launched: 2022-12-10_08:56:36.726284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:56:38.133020 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20109) [trial-2372↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20109)] [trial-2372↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 08:56:38.141873 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:56:38.148620 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20108): Terminating (SIGTERM) 08:56:38.358721 --- ParallelTerminationStrategy: PID 20108 died... 08:56:38.380238 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20108): Terminated: ok {rc=0} 08:56:38.467110 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:trx-umtrx --------------------------------------------------------------------- 08:56:39.644655 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:39.648745 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:56:39.681944 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:56:39.709344 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 08:56:39.745272 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:56:39.778559 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:56:39.806009 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 08:56:40.335418 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 08:56:40.340822 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.352446 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 08:56:40.400584 tst assert_extension.py: using LAC 27276 08:56:40.525136 tst assert_extension.py: using RAC 246 08:56:40.650870 tst assert_extension.py: using CellId 27276 08:56:40.776515 tst assert_extension.py: using BVCI 27277 08:56:40.891232 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.902444 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.913594 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.924612 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.935666 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:56:40.946823 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 08:56:41.061722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:41.528825 run create_hlr_db(pid=20113): Launched 08:56:41.643996 bus /sierra_2: Setting Powered False 08:56:42.703159 run create_hlr_db(pid=20113): Terminated: ok {rc=0} 08:56:43.143042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Launched 08:56:43.465166 run osmo-hlr_10.42.42.2(pid=20116): Launched 08:56:43.587188 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:44.142632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Launched 08:56:44.464093 run osmo-stp_10.42.42.5(pid=20119): Launched 08:56:44.585823 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:45.162150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Launched 08:56:45.481654 run osmo-msc_10.42.42.6(pid=20122): Launched 08:56:45.658628 run osmo-stp_10.42.42.5(pid=20119): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] 08:56:45.793500 run osmo-stp_10.42.42.5(pid=20119): stdout: | (launched: 2022-12-10_08:56:44.401532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:46.035439 run osmo-stp_10.42.42.5(pid=20119): stderr: | 20221210085644599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085644599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085644599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085644600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085644600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085644600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085644600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:46.176609 run osmo-stp_10.42.42.5(pid=20119): stdout: | (launched: 2022-12-10_08:56:44.401532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:46.299639 run osmo-stp_10.42.42.5(pid=20119): stderr: | 20221210085644599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085644599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085644599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085644600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085644600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085644600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085644600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:46.447295 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20119): Process ended prematurely: osmo-stp_10.42.42.5(pid=20119) [trial-2372↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] [trial-2372↪ussd:trx-umtrx↪assert_extension.py:17] 08:56:46.456771 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:56:46.485862 run osmo-hlr_10.42.42.2(pid=20116): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20116)] 08:56:46.537337 run osmo-hlr_10.42.42.2(pid=20116): stdout: | (launched: 2022-12-10_08:56:43.401840) 08:56:46.589146 run osmo-hlr_10.42.42.2(pid=20116): stderr: | 20221210085643606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085643606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085643606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085643606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085643606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085643606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085643616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085643625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085643625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085643625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:46.660206 run osmo-msc_10.42.42.6(pid=20122): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20122)] 08:56:46.710601 run osmo-msc_10.42.42.6(pid=20122): stdout: | (launched: 2022-12-10_08:56:45.419700) 08:56:46.763017 run osmo-msc_10.42.42.6(pid=20122): stderr: | 20221210085645746 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085645746 DLGLOBAL DEBUG validating counter group 0x7f9dbbcc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085645746 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085645746 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085645746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085645746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085645748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085645748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085645749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085645749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:46.815297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Terminating (SIGTERM) 08:56:46.858102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Terminating (SIGTERM) 08:56:46.902358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Terminating (SIGTERM) 08:56:46.947838 --- ParallelTerminationStrategy: PID 20115 died... 08:56:46.967986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20115): Terminated: ok {rc=0} 08:56:47.016533 --- ParallelTerminationStrategy: PID 20118 died... 08:56:47.035619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20118): Terminated: ok {rc=0} 08:56:47.082471 --- ParallelTerminationStrategy: PID 20121 died... 08:56:47.101817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20121): Terminated: ok {rc=0} 08:56:47.189796 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:56:48.400229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:56:48.407172 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:56:48.440717 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:56:48.467209 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:56:48.519452 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:56:48.552763 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:56:48.579088 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:56:49.128460 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:56:49.178251 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.189326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:56:49.257265 tst mo_mt_call.py: using LAC 27277 08:56:49.378312 tst mo_mt_call.py: using RAC 247 08:56:49.497767 tst mo_mt_call.py: using CellId 27277 08:56:49.619452 tst mo_mt_call.py: using BVCI 27278 08:56:49.739024 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.750782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.762371 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.774654 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.786830 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:49.798882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:56:49.916607 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:56:50.036175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:56:50.509113 run create_hlr_db(pid=20127): Launched 08:56:50.625473 bus /sierra_2: Setting Powered False 08:56:51.685679 run create_hlr_db(pid=20127): Terminated: ok {rc=0} 08:56:52.127153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20129): Launched 08:56:52.449635 run osmo-hlr_10.42.42.2(pid=20130): Launched 08:56:52.573946 run osmo-stp_10.42.42.5: Starting osmo-stp 08:56:53.132321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20132): Launched 08:56:53.454675 run osmo-stp_10.42.42.5(pid=20133): Launched 08:56:53.579177 run osmo-msc_10.42.42.6: Starting osmo-msc 08:56:54.164034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20135): Launched 08:56:54.486708 run osmo-msc_10.42.42.6(pid=20136): Launched 08:56:54.668897 run osmo-stp_10.42.42.5(pid=20133): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20133)] 08:56:54.805992 run osmo-stp_10.42.42.5(pid=20133): stdout: | (launched: 2022-12-10_08:56:53.396283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:54.942694 run osmo-stp_10.42.42.5(pid=20133): stderr: | 20221210085653589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085653589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085653590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085653590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085653590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085653591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085653591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:55.080028 run osmo-stp_10.42.42.5(pid=20133): stdout: | (launched: 2022-12-10_08:56:53.396283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:56:55.208829 run osmo-stp_10.42.42.5(pid=20133): stderr: | 20221210085653589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085653589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085653590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085653590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085653590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085653591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085653591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:56:55.362921 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20133): Process ended prematurely: osmo-stp_10.42.42.5(pid=20133) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20133)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:56:55.372382 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:56:55.399973 run osmo-hlr_10.42.42.2(pid=20130): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20130)] 08:56:55.449899 run osmo-hlr_10.42.42.2(pid=20130): stdout: | (launched: 2022-12-10_08:56:52.391221) 08:56:55.501419 run osmo-hlr_10.42.42.2(pid=20130): stderr: | 20221210085652588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085652588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085652588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085652588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085652588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085652588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085652600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085652608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085652609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085652609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:56:55.573650 run osmo-msc_10.42.42.6(pid=20136): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20136)] 08:56:55.623581 run osmo-msc_10.42.42.6(pid=20136): stdout: | (launched: 2022-12-10_08:56:54.427750) 08:56:55.675139 run osmo-msc_10.42.42.6(pid=20136): stderr: | 20221210085654749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085654749 DLGLOBAL DEBUG validating counter group 0x7f2f89959c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085654749 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085654750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085654750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085654750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085654751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085654752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085654752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085654752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:56:55.726934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20129): Terminating (SIGTERM) 08:56:55.768354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20132): Terminating (SIGTERM) 08:56:55.809958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20135): Terminating (SIGTERM) 08:56:55.851713 --- ParallelTerminationStrategy: PID 20129 died... 08:56:55.871508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20129): Terminated: ok {rc=0} 08:56:55.917451 --- ParallelTerminationStrategy: PID 20132 died... 08:56:55.936626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20132): Terminated: ok {rc=0} 08:56:55.982486 --- ParallelTerminationStrategy: PID 20135 died... 08:56:56.002311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20135): Terminated: ok {rc=0} 08:56:56.089999 bus /sierra_3: Setting Powered False 08:56:57.188405 bus /sierra_3: Setting Powered False 08:56:58.304841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:56:59.453332 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:56:59.465604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:56:59.537143 tst mo_mt_call_osmux.py: using LAC 27278 08:56:59.665655 tst mo_mt_call_osmux.py: using RAC 248 08:56:59.793947 tst mo_mt_call_osmux.py: using CellId 27278 08:56:59.924248 tst mo_mt_call_osmux.py: using BVCI 27279 08:57:00.043380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:57:00.054994 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:57:00.066486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:57:00.078082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:57:00.089735 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:57:00.101211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:57:00.218050 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:57:00.338061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:00.844159 run create_hlr_db(pid=20138): Launched 08:57:01.030837 bus /sierra_2: Setting Powered False 08:57:02.089462 run create_hlr_db(pid=20138): Terminated: ok {rc=0} 08:57:02.519632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Launched 08:57:02.822604 run osmo-hlr_10.42.42.2(pid=20141): Launched 08:57:02.938729 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:03.474930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Launched 08:57:03.778149 run osmo-stp_10.42.42.5(pid=20144): Launched 08:57:03.894305 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:04.443700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20146): Launched 08:57:04.748088 run osmo-msc_10.42.42.6(pid=20147): Launched 08:57:04.918243 run osmo-stp_10.42.42.5(pid=20144): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] 08:57:05.047334 run osmo-stp_10.42.42.5(pid=20144): stdout: | (launched: 2022-12-10_08:57:03.723223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:05.176764 run osmo-stp_10.42.42.5(pid=20144): stderr: | 20221210085703892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085703892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085703893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085703893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085703894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085703894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085703894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:05.303661 run osmo-stp_10.42.42.5(pid=20144): stdout: | (launched: 2022-12-10_08:57:03.723223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:05.424350 run osmo-stp_10.42.42.5(pid=20144): stderr: | 20221210085703892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085703892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085703893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085703893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085703894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085703894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085703894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:05.569341 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20144): Process ended prematurely: osmo-stp_10.42.42.5(pid=20144) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:57:05.578454 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 08:57:05.605120 run osmo-hlr_10.42.42.2(pid=20141): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20141)] 08:57:05.652864 run osmo-hlr_10.42.42.2(pid=20141): stdout: | (launched: 2022-12-10_08:57:02.767848) 08:57:05.702156 run osmo-hlr_10.42.42.2(pid=20141): stderr: | 20221210085702943 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085702943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085702943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085702943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085702943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085702943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085702955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085702964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085702965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085702965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:05.770644 run osmo-msc_10.42.42.6(pid=20147): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20147)] 08:57:05.817955 run osmo-msc_10.42.42.6(pid=20147): stdout: | (launched: 2022-12-10_08:57:04.692435) 08:57:05.866856 run osmo-msc_10.42.42.6(pid=20147): stderr: | 20221210085704965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085704965 DLGLOBAL DEBUG validating counter group 0x7f3d3ad88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085704965 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085704965 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085704966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085704966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085704968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085704969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085704969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085704969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:57:05.916347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Terminating (SIGTERM) 08:57:05.955706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Terminating (SIGTERM) 08:57:05.995039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20146): Terminating (SIGTERM) 08:57:06.034762 --- ParallelTerminationStrategy: PID 20140 died... 08:57:06.053506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20140): Terminated: ok {rc=0} 08:57:06.097680 --- ParallelTerminationStrategy: PID 20143 died... 08:57:06.116085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20143): Terminated: ok {rc=0} 08:57:06.160083 --- ParallelTerminationStrategy: PID 20146 died... 08:57:06.178527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20146): Terminated: ok {rc=0} 08:57:06.265149 bus /sierra_3: Setting Powered False 08:57:07.360127 bus /sierra_3: Setting Powered False 08:57:08.475073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:57:09.724896 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:09.731394 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:57:09.764367 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:57:09.790720 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:57:09.840363 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:57:09.872689 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:57:09.898975 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:57:10.451358 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:57:10.500185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:10.511268 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:57:10.580461 tst mo_mt_call.py: using LAC 27279 08:57:10.699868 tst mo_mt_call.py: using RAC 249 08:57:10.818764 tst mo_mt_call.py: using CellId 27279 08:57:10.938011 tst mo_mt_call.py: using BVCI 27280 08:57:11.050347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:11.061570 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:11.072465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:11.083554 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:11.094755 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:11.105922 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:57:11.224102 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:57:11.343888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:11.848124 run create_hlr_db(pid=20152): Launched 08:57:11.978392 bus /sierra_2: Setting Powered False 08:57:13.041784 run create_hlr_db(pid=20152): Terminated: ok {rc=0} 08:57:13.477362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Launched 08:57:13.784587 run osmo-hlr_10.42.42.2(pid=20155): Launched 08:57:13.901361 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:14.440864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Launched 08:57:14.749065 run osmo-stp_10.42.42.5(pid=20158): Launched 08:57:14.865799 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:15.419209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Launched 08:57:15.725399 run osmo-msc_10.42.42.6(pid=20161): Launched 08:57:15.898887 run osmo-stp_10.42.42.5(pid=20158): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] 08:57:16.164854 run osmo-stp_10.42.42.5(pid=20158): stdout: | (launched: 2022-12-10_08:57:14.689407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:16.419981 run osmo-stp_10.42.42.5(pid=20158): stderr: | 20221210085714863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085714863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085714864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085714864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085714865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085714865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085714865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:16.559693 run osmo-stp_10.42.42.5(pid=20158): stdout: | (launched: 2022-12-10_08:57:14.689407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:16.692589 run osmo-stp_10.42.42.5(pid=20158): stderr: | 20221210085714863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085714863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085714864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085714864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085714865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085714865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085714865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:16.851174 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20158): Process ended prematurely: osmo-stp_10.42.42.5(pid=20158) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:57:16.861093 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:57:16.890194 run osmo-hlr_10.42.42.2(pid=20155): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20155)] 08:57:16.942256 run osmo-hlr_10.42.42.2(pid=20155): stdout: | (launched: 2022-12-10_08:57:13.725509) 08:57:16.995926 run osmo-hlr_10.42.42.2(pid=20155): stderr: | 20221210085713905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085713905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085713905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085713905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085713905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085713905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085713918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085713926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085713927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085713927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:17.068805 run osmo-msc_10.42.42.6(pid=20161): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20161)] 08:57:17.119473 run osmo-msc_10.42.42.6(pid=20161): stdout: | (launched: 2022-12-10_08:57:15.666871) 08:57:17.173323 run osmo-msc_10.42.42.6(pid=20161): stderr: | 20221210085716092 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085716093 DLGLOBAL DEBUG validating counter group 0x7f9082d02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085716093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085716093 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085716093 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085716093 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085716095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085716095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085716095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085716096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:57:17.225732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Terminating (SIGTERM) 08:57:17.268367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Terminating (SIGTERM) 08:57:17.312383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Terminating (SIGTERM) 08:57:17.356338 --- ParallelTerminationStrategy: PID 20154 died... 08:57:17.376117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20154): Terminated: ok {rc=0} 08:57:17.422293 --- ParallelTerminationStrategy: PID 20157 died... 08:57:17.441617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20157): Terminated: ok {rc=0} 08:57:17.487333 --- ParallelTerminationStrategy: PID 20160 died... 08:57:17.506756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20160): Terminated: ok {rc=0} 08:57:17.593434 bus /sierra_3: Setting Powered False 08:57:18.692785 bus /sierra_3: Setting Powered False 08:57:19.807749 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:57:20.956293 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:20.968474 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:57:21.039854 tst mo_mt_call_osmux.py: using LAC 27280 08:57:21.167577 tst mo_mt_call_osmux.py: using RAC 250 08:57:21.294089 tst mo_mt_call_osmux.py: using CellId 27280 08:57:21.421955 tst mo_mt_call_osmux.py: using BVCI 27281 08:57:21.539557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:21.551182 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:21.562520 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:21.574045 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:21.585592 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:57:21.597037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:57:21.713947 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:57:21.833834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:22.340909 run create_hlr_db(pid=20163): Launched 08:57:22.471846 bus /sierra_2: Setting Powered False 08:57:23.537295 run create_hlr_db(pid=20163): Terminated: ok {rc=0} 08:57:23.974451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Launched 08:57:24.281693 run osmo-hlr_10.42.42.2(pid=20166): Launched 08:57:24.398482 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:24.961937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Launched 08:57:25.287970 run osmo-stp_10.42.42.5(pid=20169): Launched 08:57:25.410041 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:26.000353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20171): Launched 08:57:26.325580 run osmo-msc_10.42.42.6(pid=20172): Launched 08:57:26.505488 run osmo-stp_10.42.42.5(pid=20169): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] 08:57:26.641976 run osmo-stp_10.42.42.5(pid=20169): stdout: | (launched: 2022-12-10_08:57:25.224897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:26.778775 run osmo-stp_10.42.42.5(pid=20169): stderr: | 20221210085725421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085725421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085725421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085725422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085725422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085725422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085725422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:26.913864 run osmo-stp_10.42.42.5(pid=20169): stdout: | (launched: 2022-12-10_08:57:25.224897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:27.042062 run osmo-stp_10.42.42.5(pid=20169): stderr: | 20221210085725421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085725421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085725421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085725422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085725422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085725422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085725422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:27.195565 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20169): Process ended prematurely: osmo-stp_10.42.42.5(pid=20169) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:57:27.205153 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:57:27.232505 run osmo-hlr_10.42.42.2(pid=20166): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20166)] 08:57:27.281842 run osmo-hlr_10.42.42.2(pid=20166): stdout: | (launched: 2022-12-10_08:57:24.222614) 08:57:27.333193 run osmo-hlr_10.42.42.2(pid=20166): stderr: | 20221210085724401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085724402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085724402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085724402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085724402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085724402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085724414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085724424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085724425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085724425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:27.404301 run osmo-msc_10.42.42.6(pid=20172): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20172)] 08:57:27.453422 run osmo-msc_10.42.42.6(pid=20172): stdout: | (launched: 2022-12-10_08:57:26.263001) 08:57:27.504294 run osmo-msc_10.42.42.6(pid=20172): stderr: | 20221210085726587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085726587 DLGLOBAL DEBUG validating counter group 0x7fc2ada2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085726587 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085726587 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085726587 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085726587 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085726589 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085726590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085726590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085726590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:57:27.555844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Terminating (SIGTERM) 08:57:27.596763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Terminating (SIGTERM) 08:57:27.637724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20171): Terminating (SIGTERM) 08:57:27.679104 --- ParallelTerminationStrategy: PID 20165 died... 08:57:27.698742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Terminated: ok {rc=0} 08:57:27.744320 --- ParallelTerminationStrategy: PID 20168 died... 08:57:27.763582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Terminated: ok {rc=0} 08:57:27.809345 --- ParallelTerminationStrategy: PID 20171 died... 08:57:27.828492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20171): Terminated: ok {rc=0} 08:57:27.914682 bus /sierra_3: Setting Powered False 08:57:29.011193 bus /sierra_3: Setting Powered False 08:57:30.125743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:57:31.404202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:31.415025 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:57:31.458624 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:57:31.491698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:57:31.552343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:57:31.586898 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:57:31.615558 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:57:32.189493 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:57:32.248792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.261065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:57:32.330697 tst mo_mt_call.py: using LAC 27281 08:57:32.450700 tst mo_mt_call.py: using RAC 251 08:57:32.572876 tst mo_mt_call.py: using CellId 27281 08:57:32.697767 tst mo_mt_call.py: using BVCI 27282 08:57:32.810267 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.821473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.832446 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.843729 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.854934 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:32.866159 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:57:32.982666 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:57:33.099443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:33.571078 run create_hlr_db(pid=20177): Launched 08:57:33.686382 bus /sierra_2: Setting Powered False 08:57:34.746313 run create_hlr_db(pid=20177): Terminated: ok {rc=0} 08:57:35.187595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Launched 08:57:35.509094 run osmo-hlr_10.42.42.2(pid=20180): Launched 08:57:35.634374 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:36.181023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Launched 08:57:36.485318 run osmo-stp_10.42.42.5(pid=20185): Launched 08:57:36.602773 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:37.152338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20187): Launched 08:57:37.455621 run osmo-msc_10.42.42.6(pid=20188): Launched 08:57:37.627780 run osmo-stp_10.42.42.5(pid=20185): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] 08:57:37.757231 run osmo-stp_10.42.42.5(pid=20185): stdout: | (launched: 2022-12-10_08:57:36.429826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:37.886699 run osmo-stp_10.42.42.5(pid=20185): stderr: | 20221210085736599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085736599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085736599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085736600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085736602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085736602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085736602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:38.014505 run osmo-stp_10.42.42.5(pid=20185): stdout: | (launched: 2022-12-10_08:57:36.429826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:38.135711 run osmo-stp_10.42.42.5(pid=20185): stderr: | 20221210085736599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085736599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085736599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085736600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085736602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085736602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085736602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:38.280364 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20185): Process ended prematurely: osmo-stp_10.42.42.5(pid=20185) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:57:38.289238 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:57:38.315489 run osmo-hlr_10.42.42.2(pid=20180): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20180)] 08:57:38.363497 run osmo-hlr_10.42.42.2(pid=20180): stdout: | (launched: 2022-12-10_08:57:35.451011) 08:57:38.412514 run osmo-hlr_10.42.42.2(pid=20180): stderr: | 20221210085735650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085735650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085735650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085735650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085735650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085735650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085735663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085735673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085735674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085735674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:38.480728 run osmo-msc_10.42.42.6(pid=20188): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20188)] 08:57:38.528074 run osmo-msc_10.42.42.6(pid=20188): stdout: | (launched: 2022-12-10_08:57:37.400402) 08:57:38.577168 run osmo-msc_10.42.42.6(pid=20188): stderr: | 20221210085737672 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085737672 DLGLOBAL DEBUG validating counter group 0x7fd5b2a79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085737672 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085737672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085737672 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085737672 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085737676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085737677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085737677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085737677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:57:38.626361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminating (SIGTERM) 08:57:38.665650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Terminating (SIGTERM) 08:57:38.705024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20187): Terminating (SIGTERM) 08:57:38.744553 --- ParallelTerminationStrategy: PID 20179 died... 08:57:38.763218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminated: ok {rc=0} 08:57:38.807280 --- ParallelTerminationStrategy: PID 20184 died... 08:57:38.825717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20184): Terminated: ok {rc=0} 08:57:38.869237 --- ParallelTerminationStrategy: PID 20187 died... 08:57:38.887418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20187): Terminated: ok {rc=0} 08:57:38.971832 bus /sierra_3: Setting Powered False 08:57:40.072653 bus /sierra_3: Setting Powered False 08:57:41.186360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:57:42.333749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.345945 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:57:42.416817 tst mo_mt_call_osmux.py: using LAC 27282 08:57:42.543665 tst mo_mt_call_osmux.py: using RAC 252 08:57:42.669417 tst mo_mt_call_osmux.py: using CellId 27282 08:57:42.800030 tst mo_mt_call_osmux.py: using BVCI 27283 08:57:42.918834 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.930550 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.942111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.953701 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.965297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:57:42.976744 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:57:43.098380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:57:43.216518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:43.718873 run create_hlr_db(pid=20190): Launched 08:57:43.849461 bus /sierra_2: Setting Powered False 08:57:44.913590 run create_hlr_db(pid=20190): Terminated: ok {rc=0} 08:57:45.346982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Launched 08:57:45.651338 run osmo-hlr_10.42.42.2(pid=20193): Launched 08:57:45.769174 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:46.455409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Launched 08:57:46.806935 run osmo-stp_10.42.42.5(pid=20196): Launched 08:57:46.964744 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:47.705349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20198): Launched 08:57:48.026763 run osmo-msc_10.42.42.6(pid=20199): Launched 08:57:48.205660 run osmo-stp_10.42.42.5(pid=20196): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] 08:57:48.340499 run osmo-stp_10.42.42.5(pid=20196): stdout: | (launched: 2022-12-10_08:57:46.739139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:48.475635 run osmo-stp_10.42.42.5(pid=20196): stderr: | 20221210085747162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085747162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085747162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085747163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085747167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085747171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085747171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:48.611394 run osmo-stp_10.42.42.5(pid=20196): stdout: | (launched: 2022-12-10_08:57:46.739139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:48.739489 run osmo-stp_10.42.42.5(pid=20196): stderr: | 20221210085747162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085747162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085747162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085747163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085747167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085747171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085747171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:48.893365 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20196): Process ended prematurely: osmo-stp_10.42.42.5(pid=20196) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:57:48.902912 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 08:57:48.930436 run osmo-hlr_10.42.42.2(pid=20193): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20193)] 08:57:48.979772 run osmo-hlr_10.42.42.2(pid=20193): stdout: | (launched: 2022-12-10_08:57:45.596276) 08:57:49.030798 run osmo-hlr_10.42.42.2(pid=20193): stderr: | 20221210085745773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085745773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085745773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085745773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085745773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085745773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085745786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085745795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085745795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085745795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:57:49.102165 run osmo-msc_10.42.42.6(pid=20199): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20199)] 08:57:49.151253 run osmo-msc_10.42.42.6(pid=20199): stdout: | (launched: 2022-12-10_08:57:47.968403) 08:57:49.201966 run osmo-msc_10.42.42.6(pid=20199): stderr: | 20221210085748290 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085748290 DLGLOBAL DEBUG validating counter group 0x7fc5dc8acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085748290 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085748290 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085748290 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085748291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085748294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085748295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085748295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085748295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:57:49.253113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Terminating (SIGTERM) 08:57:49.293889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Terminating (SIGTERM) 08:57:49.334983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20198): Terminating (SIGTERM) 08:57:49.376537 --- ParallelTerminationStrategy: PID 20192 died... 08:57:49.396172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Terminated: ok {rc=0} 08:57:49.441560 --- ParallelTerminationStrategy: PID 20195 died... 08:57:49.460509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Terminated: ok {rc=0} 08:57:49.505733 --- ParallelTerminationStrategy: PID 20198 died... 08:57:49.524910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20198): Terminated: ok {rc=0} 08:57:49.611687 bus /sierra_3: Setting Powered False 08:57:50.710290 bus /sierra_3: Setting Powered False 08:57:51.825334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 08:57:53.071220 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:57:53.077680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 08:57:53.110458 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 08:57:53.136909 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 08:57:53.189335 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 08:57:53.222335 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 08:57:53.248697 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 08:57:53.796795 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 08:57:53.845893 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:53.856799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:57:53.923885 tst mo_mt_call.py: using LAC 27283 08:57:54.043485 tst mo_mt_call.py: using RAC 253 08:57:54.164550 tst mo_mt_call.py: using CellId 27283 08:57:54.284796 tst mo_mt_call.py: using BVCI 27284 08:57:54.395531 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:54.406652 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:54.417588 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:54.428569 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:54.439676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:57:54.450735 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:57:54.569877 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:57:54.690974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:57:55.168092 run create_hlr_db(pid=20204): Launched 08:57:55.284022 bus /sierra_2: Setting Powered False 08:57:56.344670 run create_hlr_db(pid=20204): Terminated: ok {rc=0} 08:57:56.791838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20206): Launched 08:57:57.120547 run osmo-hlr_10.42.42.2(pid=20207): Launched 08:57:57.244070 run osmo-stp_10.42.42.5: Starting osmo-stp 08:57:57.804998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20209): Launched 08:57:58.130657 run osmo-stp_10.42.42.5(pid=20210): Launched 08:57:58.254509 run osmo-msc_10.42.42.6: Starting osmo-msc 08:57:58.847073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20212): Launched 08:57:59.174524 run osmo-msc_10.42.42.6(pid=20213): Launched 08:57:59.355796 run osmo-stp_10.42.42.5(pid=20210): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20210)] 08:57:59.492865 run osmo-stp_10.42.42.5(pid=20210): stdout: | (launched: 2022-12-10_08:57:58.068422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:59.632506 run osmo-stp_10.42.42.5(pid=20210): stderr: | 20221210085758263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085758264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085758264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085758264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085758265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085758265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085758265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:57:59.767711 run osmo-stp_10.42.42.5(pid=20210): stdout: | (launched: 2022-12-10_08:57:58.068422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:57:59.896185 run osmo-stp_10.42.42.5(pid=20210): stderr: | 20221210085758263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085758264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085758264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085758264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085758265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085758265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085758265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:00.049838 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20210): Process ended prematurely: osmo-stp_10.42.42.5(pid=20210) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20210)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 08:58:00.059292 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:58:00.086805 run osmo-hlr_10.42.42.2(pid=20207): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20207)] 08:58:00.136353 run osmo-hlr_10.42.42.2(pid=20207): stdout: | (launched: 2022-12-10_08:57:57.056253) 08:58:00.187925 run osmo-hlr_10.42.42.2(pid=20207): stderr: | 20221210085757259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085757259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085757259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085757259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085757259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085757259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085757283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085757293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085757293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085757294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:00.259452 run osmo-msc_10.42.42.6(pid=20213): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20213)] 08:58:00.309321 run osmo-msc_10.42.42.6(pid=20213): stdout: | (launched: 2022-12-10_08:57:59.111603) 08:58:00.361105 run osmo-msc_10.42.42.6(pid=20213): stderr: | 20221210085759435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085759435 DLGLOBAL DEBUG validating counter group 0x7fa0ef8aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085759435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085759435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085759436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085759436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085759439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085759440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085759440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085759440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:00.412885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20206): Terminating (SIGTERM) 08:58:00.454115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20209): Terminating (SIGTERM) 08:58:00.495131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20212): Terminating (SIGTERM) 08:58:00.536747 --- ParallelTerminationStrategy: PID 20206 died... 08:58:00.556663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20206): Terminated: ok {rc=0} 08:58:00.602306 --- ParallelTerminationStrategy: PID 20209 died... 08:58:00.621466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20209): Terminated: ok {rc=0} 08:58:00.666773 --- ParallelTerminationStrategy: PID 20212 died... 08:58:00.686043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20212): Terminated: ok {rc=0} 08:58:00.772389 bus /sierra_3: Setting Powered False 08:58:01.872772 bus /sierra_3: Setting Powered False 08:58:02.995113 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 08:58:04.141289 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.153144 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 08:58:04.223362 tst mo_mt_call_osmux.py: using LAC 27284 08:58:04.345988 tst mo_mt_call_osmux.py: using RAC 254 08:58:04.468074 tst mo_mt_call_osmux.py: using CellId 27284 08:58:04.597466 tst mo_mt_call_osmux.py: using BVCI 27285 08:58:04.717899 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.729828 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.741423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.752641 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.764202 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 08:58:04.775500 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:58:04.891268 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 08:58:05.010700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:05.490228 run create_hlr_db(pid=20215): Launched 08:58:05.607122 bus /sierra_2: Setting Powered False 08:58:06.667135 run create_hlr_db(pid=20215): Terminated: ok {rc=0} 08:58:07.113467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20217): Launched 08:58:07.440344 run osmo-hlr_10.42.42.2(pid=20218): Launched 08:58:07.564113 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:08.127026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20220): Launched 08:58:08.454044 run osmo-stp_10.42.42.5(pid=20221): Launched 08:58:08.577542 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:09.164813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20223): Launched 08:58:09.490541 run osmo-msc_10.42.42.6(pid=20224): Launched 08:58:09.671374 run osmo-stp_10.42.42.5(pid=20221): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20221)] 08:58:09.807813 run osmo-stp_10.42.42.5(pid=20221): stdout: | (launched: 2022-12-10_08:58:08.390254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:09.943814 run osmo-stp_10.42.42.5(pid=20221): stderr: | 20221210085808588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085808588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085808588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085808589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085808589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085808589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085808589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:10.079016 run osmo-stp_10.42.42.5(pid=20221): stdout: | (launched: 2022-12-10_08:58:08.390254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:10.206972 run osmo-stp_10.42.42.5(pid=20221): stderr: | 20221210085808588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085808588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085808588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085808589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085808589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085808589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085808589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:10.360218 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20221): Process ended prematurely: osmo-stp_10.42.42.5(pid=20221) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20221)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 08:58:10.369588 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:58:10.396914 run osmo-hlr_10.42.42.2(pid=20218): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20218)] 08:58:10.446043 run osmo-hlr_10.42.42.2(pid=20218): stdout: | (launched: 2022-12-10_08:58:07.376564) 08:58:10.496717 run osmo-hlr_10.42.42.2(pid=20218): stderr: | 20221210085807579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085807579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085807579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085807579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085807579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085807579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085807591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085807600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085807600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085807600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:10.568248 run osmo-msc_10.42.42.6(pid=20224): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20224)] 08:58:10.617627 run osmo-msc_10.42.42.6(pid=20224): stdout: | (launched: 2022-12-10_08:58:09.426945) 08:58:10.668205 run osmo-msc_10.42.42.6(pid=20224): stderr: | 20221210085809753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085809754 DLGLOBAL DEBUG validating counter group 0x7fa3c3aabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085809754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085809754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085809754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085809754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085809757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085809758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085809758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085809758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:10.718994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20217): Terminating (SIGTERM) 08:58:10.759988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20220): Terminating (SIGTERM) 08:58:10.801119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20223): Terminating (SIGTERM) 08:58:10.842733 --- ParallelTerminationStrategy: PID 20217 died... 08:58:10.862368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20217): Terminated: ok {rc=0} 08:58:10.907839 --- ParallelTerminationStrategy: PID 20220 died... 08:58:10.927110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20220): Terminated: ok {rc=0} 08:58:10.972144 --- ParallelTerminationStrategy: PID 20223 died... 08:58:10.991456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20223): Terminated: ok {rc=0} 08:58:11.077103 bus /sierra_3: Setting Powered False 08:58:12.173626 bus /sierra_3: Setting Powered False 08:58:13.288453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:58:14.542867 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:14.550209 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:58:14.584045 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:58:14.611763 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:58:14.663203 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:58:14.697091 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:58:14.725235 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:58:15.279051 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:58:15.331313 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:15.343068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:58:15.412405 tst mo_mt_call.py: using LAC 27285 08:58:15.545099 tst mo_mt_call.py: using RAC 255 08:58:15.672590 tst mo_mt_call.py: using CellId 27285 08:58:15.800822 tst mo_mt_call.py: using BVCI 27286 08:58:15.952501 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:15.964879 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:15.978295 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:15.991245 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:16.003141 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:16.016337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:58:16.141652 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:58:16.291806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:16.901430 run create_hlr_db(pid=20229): Launched 08:58:17.058894 bus /sierra_2: Setting Powered False 08:58:18.122529 run create_hlr_db(pid=20229): Terminated: ok {rc=0} 08:58:18.557508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Launched 08:58:18.860900 run osmo-hlr_10.42.42.2(pid=20232): Launched 08:58:18.977427 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:19.500378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Launched 08:58:19.804855 run osmo-stp_10.42.42.5(pid=20235): Launched 08:58:19.922101 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:20.473095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20238): Launched 08:58:20.778114 run osmo-msc_10.42.42.6(pid=20239): Launched 08:58:20.949088 run osmo-stp_10.42.42.5(pid=20235): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] 08:58:21.078141 run osmo-stp_10.42.42.5(pid=20235): stdout: | (launched: 2022-12-10_08:58:19.749287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:21.207333 run osmo-stp_10.42.42.5(pid=20235): stderr: | 20221210085819919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085819919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085819920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085819920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085819920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085819921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085819921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:21.334628 run osmo-stp_10.42.42.5(pid=20235): stdout: | (launched: 2022-12-10_08:58:19.749287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:21.455945 run osmo-stp_10.42.42.5(pid=20235): stderr: | 20221210085819919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085819919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085819920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085819920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085819920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085819921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085819921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:21.601116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20235): Process ended prematurely: osmo-stp_10.42.42.5(pid=20235) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:58:21.609980 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:58:21.636284 run osmo-hlr_10.42.42.2(pid=20232): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20232)] 08:58:21.683531 run osmo-hlr_10.42.42.2(pid=20232): stdout: | (launched: 2022-12-10_08:58:18.805923) 08:58:21.732355 run osmo-hlr_10.42.42.2(pid=20232): stderr: | 20221210085818983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085818983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085818983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085818983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085818983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085818983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085818995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085819004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085819005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085819005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:21.800719 run osmo-msc_10.42.42.6(pid=20239): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20239)] 08:58:21.848303 run osmo-msc_10.42.42.6(pid=20239): stdout: | (launched: 2022-12-10_08:58:20.722373) 08:58:21.897737 run osmo-msc_10.42.42.6(pid=20239): stderr: | 20221210085820992 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085820992 DLGLOBAL DEBUG validating counter group 0x7efde57a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085820992 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085820992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085820992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085820993 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085820994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085820995 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085820995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085820995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:21.946991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Terminating (SIGTERM) 08:58:21.986263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Terminating (SIGTERM) 08:58:22.025421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20238): Terminating (SIGTERM) 08:58:22.065749 --- ParallelTerminationStrategy: PID 20231 died... 08:58:22.084541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20231): Terminated: ok {rc=0} 08:58:22.128163 --- ParallelTerminationStrategy: PID 20234 died... 08:58:22.146671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20234): Terminated: ok {rc=0} 08:58:22.190367 --- ParallelTerminationStrategy: PID 20238 died... 08:58:22.208653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20238): Terminated: ok {rc=0} 08:58:22.293444 bus /sierra_3: Setting Powered False 08:58:23.393289 bus /sierra_3: Setting Powered False 08:58:24.508272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:58:25.655184 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:25.666977 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:58:25.736047 tst mo_mt_call_osmux.py: using LAC 27286 08:58:25.855626 tst mo_mt_call_osmux.py: using RAC 1 08:58:25.976661 tst mo_mt_call_osmux.py: using CellId 27286 08:58:26.096234 tst mo_mt_call_osmux.py: using BVCI 27287 08:58:26.208715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:26.219771 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:26.230631 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:26.241677 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:26.252843 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:58:26.263938 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:58:26.382555 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:58:26.500580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:26.973153 run create_hlr_db(pid=20241): Launched 08:58:27.088840 bus /sierra_2: Setting Powered False 08:58:28.148535 run create_hlr_db(pid=20241): Terminated: ok {rc=0} 08:58:28.590019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Launched 08:58:28.912877 run osmo-hlr_10.42.42.2(pid=20244): Launched 08:58:29.037084 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:29.594258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Launched 08:58:29.915974 run osmo-stp_10.42.42.5(pid=20247): Launched 08:58:30.039159 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:30.624030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Launched 08:58:30.983629 run osmo-msc_10.42.42.6(pid=20250): Launched 08:58:31.310760 run osmo-stp_10.42.42.5(pid=20247): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] 08:58:31.577821 run osmo-stp_10.42.42.5(pid=20247): stdout: | (launched: 2022-12-10_08:58:29.857488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:31.844761 run osmo-stp_10.42.42.5(pid=20247): stderr: | 20221210085830050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085830050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085830050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085830051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085830051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085830051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085830051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:32.014513 run osmo-stp_10.42.42.5(pid=20247): stdout: | (launched: 2022-12-10_08:58:29.857488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:32.142153 run osmo-stp_10.42.42.5(pid=20247): stderr: | 20221210085830050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085830050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085830050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085830051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085830051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085830051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085830051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:32.291249 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20247): Process ended prematurely: osmo-stp_10.42.42.5(pid=20247) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:58:32.300735 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 08:58:32.329361 run osmo-hlr_10.42.42.2(pid=20244): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20244)] 08:58:32.378839 run osmo-hlr_10.42.42.2(pid=20244): stdout: | (launched: 2022-12-10_08:58:28.854369) 08:58:32.429255 run osmo-hlr_10.42.42.2(pid=20244): stderr: | 20221210085829055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085829055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085829055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085829055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085829055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085829055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085829087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085829097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085829097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085829097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:32.499574 run osmo-msc_10.42.42.6(pid=20250): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20250)] 08:58:32.548406 run osmo-msc_10.42.42.6(pid=20250): stdout: | (launched: 2022-12-10_08:58:30.898799) 08:58:32.598792 run osmo-msc_10.42.42.6(pid=20250): stderr: | 20221210085831495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085831495 DLGLOBAL DEBUG validating counter group 0x7f42b81afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085831495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085831495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085831495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085831495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085831497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085831498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085831498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085831498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:32.649332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Terminating (SIGTERM) 08:58:32.689493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Terminating (SIGTERM) 08:58:32.730391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Terminating (SIGTERM) 08:58:32.771383 --- ParallelTerminationStrategy: PID 20243 died... 08:58:32.790429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Terminated: ok {rc=0} 08:58:32.836023 --- ParallelTerminationStrategy: PID 20246 died... 08:58:32.854835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Terminated: ok {rc=0} 08:58:32.900056 --- ParallelTerminationStrategy: PID 20249 died... 08:58:32.918887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Terminated: ok {rc=0} 08:58:33.005559 bus /sierra_3: Setting Powered False 08:58:34.104153 bus /sierra_3: Setting Powered False 08:58:35.219930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:58:36.472046 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:36.478466 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:58:36.511730 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:58:36.538603 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:58:36.590906 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:58:36.623538 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:58:36.650211 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:58:37.200012 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:58:37.249226 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.260792 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:58:37.330653 tst mo_mt_call.py: using LAC 27287 08:58:37.450256 tst mo_mt_call.py: using RAC 2 08:58:37.572071 tst mo_mt_call.py: using CellId 27287 08:58:37.693112 tst mo_mt_call.py: using BVCI 27288 08:58:37.805503 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.816519 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.827504 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.838642 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.849966 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:37.861080 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:37.980417 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:38.100441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:38.607559 run create_hlr_db(pid=20255): Launched 08:58:38.739400 bus /sierra_2: Setting Powered False 08:58:39.803782 run create_hlr_db(pid=20255): Terminated: ok {rc=0} 08:58:40.240660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20257): Launched 08:58:40.570626 run osmo-hlr_10.42.42.2(pid=20258): Launched 08:58:40.694275 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:41.256016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20260): Launched 08:58:41.584310 run osmo-stp_10.42.42.5(pid=20261): Launched 08:58:41.707252 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:42.293696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20263): Launched 08:58:42.620722 run osmo-msc_10.42.42.6(pid=20264): Launched 08:58:42.801604 run osmo-stp_10.42.42.5(pid=20261): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20261)] 08:58:42.937960 run osmo-stp_10.42.42.5(pid=20261): stdout: | (launched: 2022-12-10_08:58:41.519909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:43.075246 run osmo-stp_10.42.42.5(pid=20261): stderr: | 20221210085841716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085841716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085841717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085841717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085841717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085841718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085841718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:43.211216 run osmo-stp_10.42.42.5(pid=20261): stdout: | (launched: 2022-12-10_08:58:41.519909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:43.340482 run osmo-stp_10.42.42.5(pid=20261): stderr: | 20221210085841716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085841716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085841717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085841717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085841717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085841718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085841718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:43.494732 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20261): Process ended prematurely: osmo-stp_10.42.42.5(pid=20261) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20261)] [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:58:43.504167 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:58:43.532203 run osmo-hlr_10.42.42.2(pid=20258): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20258)] 08:58:43.582479 run osmo-hlr_10.42.42.2(pid=20258): stdout: | (launched: 2022-12-10_08:58:40.506801) 08:58:43.634076 run osmo-hlr_10.42.42.2(pid=20258): stderr: | 20221210085840710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085840710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085840710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085840710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085840710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085840710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085840722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085840731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085840731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085840731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:43.705941 run osmo-msc_10.42.42.6(pid=20264): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20264)] 08:58:43.755697 run osmo-msc_10.42.42.6(pid=20264): stdout: | (launched: 2022-12-10_08:58:42.557709) 08:58:43.806645 run osmo-msc_10.42.42.6(pid=20264): stderr: | 20221210085842882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085842882 DLGLOBAL DEBUG validating counter group 0x7fcd6b2f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085842882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085842882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085842882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085842883 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085842884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085842885 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085842885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085842885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:43.858101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20257): Terminating (SIGTERM) 08:58:43.899488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20260): Terminating (SIGTERM) 08:58:43.940902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20263): Terminating (SIGTERM) 08:58:43.982671 --- ParallelTerminationStrategy: PID 20257 died... 08:58:44.002548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20257): Terminated: ok {rc=0} 08:58:44.048651 --- ParallelTerminationStrategy: PID 20260 died... 08:58:44.068177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20260): Terminated: ok {rc=0} 08:58:44.113988 --- ParallelTerminationStrategy: PID 20263 died... 08:58:44.133526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20263): Terminated: ok {rc=0} 08:58:44.220920 bus /sierra_3: Setting Powered False 08:58:45.318716 bus /sierra_3: Setting Powered False 08:58:46.433145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:58:47.582950 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:47.595411 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:58:47.667361 tst mo_mt_call_osmux.py: using LAC 27288 08:58:47.788166 tst mo_mt_call_osmux.py: using RAC 3 08:58:47.909652 tst mo_mt_call_osmux.py: using CellId 27288 08:58:48.031188 tst mo_mt_call_osmux.py: using BVCI 27289 08:58:48.143725 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:48.155104 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:48.166345 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:48.178260 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:48.189688 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:58:48.201202 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:48.320368 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:58:48.437693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:48.914426 run create_hlr_db(pid=20266): Launched 08:58:49.029733 bus /sierra_2: Setting Powered False 08:58:50.091381 run create_hlr_db(pid=20266): Terminated: ok {rc=0} 08:58:50.518359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Launched 08:58:50.825660 run osmo-hlr_10.42.42.2(pid=20269): Launched 08:58:50.942391 run osmo-stp_10.42.42.5: Starting osmo-stp 08:58:51.482390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Launched 08:58:51.790652 run osmo-stp_10.42.42.5(pid=20272): Launched 08:58:51.907979 run osmo-msc_10.42.42.6: Starting osmo-msc 08:58:52.461770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Launched 08:58:52.768755 run osmo-msc_10.42.42.6(pid=20275): Launched 08:58:52.939742 run osmo-stp_10.42.42.5(pid=20272): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] 08:58:53.069479 run osmo-stp_10.42.42.5(pid=20272): stdout: | (launched: 2022-12-10_08:58:51.730997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:53.199069 run osmo-stp_10.42.42.5(pid=20272): stderr: | 20221210085851902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085851902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085851902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085851903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085851905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085851905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085851905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:53.326178 run osmo-stp_10.42.42.5(pid=20272): stdout: | (launched: 2022-12-10_08:58:51.730997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:58:53.448138 run osmo-stp_10.42.42.5(pid=20272): stderr: | 20221210085851902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085851902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085851902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085851903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085851905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085851905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085851905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:58:53.593325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20272): Process ended prematurely: osmo-stp_10.42.42.5(pid=20272) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:58:53.602340 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:58:53.628817 run osmo-hlr_10.42.42.2(pid=20269): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20269)] 08:58:53.676634 run osmo-hlr_10.42.42.2(pid=20269): stdout: | (launched: 2022-12-10_08:58:50.766742) 08:58:53.725825 run osmo-hlr_10.42.42.2(pid=20269): stderr: | 20221210085850944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085850945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085850945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085850945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085850945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085850945 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085850957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085850966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085850966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085850966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:58:53.794397 run osmo-msc_10.42.42.6(pid=20275): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20275)] 08:58:53.841809 run osmo-msc_10.42.42.6(pid=20275): stdout: | (launched: 2022-12-10_08:58:52.709326) 08:58:53.890710 run osmo-msc_10.42.42.6(pid=20275): stderr: | 20221210085852987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085852988 DLGLOBAL DEBUG validating counter group 0x7f707d4e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085852988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085852988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085852988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085852988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085852990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085852990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085852991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085852991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:58:53.939754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Terminating (SIGTERM) 08:58:53.979273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Terminating (SIGTERM) 08:58:54.018649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Terminating (SIGTERM) 08:58:54.058473 --- ParallelTerminationStrategy: PID 20268 died... 08:58:54.077310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Terminated: ok {rc=0} 08:58:54.121335 --- ParallelTerminationStrategy: PID 20271 died... 08:58:54.139645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Terminated: ok {rc=0} 08:58:54.183751 --- ParallelTerminationStrategy: PID 20274 died... 08:58:54.202252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Terminated: ok {rc=0} 08:58:54.287714 bus /sierra_3: Setting Powered False 08:58:55.385060 bus /sierra_3: Setting Powered False 08:58:56.498670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 08:58:57.744751 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:58:57.750461 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 08:58:57.782801 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 08:58:57.809602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 08:58:57.862059 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 08:58:57.895235 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 08:58:57.921546 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 08:58:58.470232 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 08:58:58.519054 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:58.530078 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:58:58.601115 tst mo_mt_call.py: using LAC 27289 08:58:58.722464 tst mo_mt_call.py: using RAC 4 08:58:58.841369 tst mo_mt_call.py: using CellId 27289 08:58:58.962712 tst mo_mt_call.py: using BVCI 27290 08:58:59.074753 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:59.085649 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:59.096242 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:59.107255 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:59.118305 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:58:59.129170 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:58:59.246385 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:58:59.367486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:58:59.869148 run create_hlr_db(pid=20281): Launched 08:59:00.000268 bus /sierra_2: Setting Powered False 08:59:01.065504 run create_hlr_db(pid=20281): Terminated: ok {rc=0} 08:59:01.517762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20283): Launched 08:59:01.873783 run osmo-hlr_10.42.42.2(pid=20284): Launched 08:59:02.107853 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:02.665230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20286): Launched 08:59:02.986130 run osmo-stp_10.42.42.5(pid=20287): Launched 08:59:03.109399 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:03.693707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20289): Launched 08:59:04.015436 run osmo-msc_10.42.42.6(pid=20290): Launched 08:59:04.194882 run osmo-stp_10.42.42.5(pid=20287): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20287)] 08:59:04.331287 run osmo-stp_10.42.42.5(pid=20287): stdout: | (launched: 2022-12-10_08:59:02.927804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:04.467350 run osmo-stp_10.42.42.5(pid=20287): stderr: | 20221210085903120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085903121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085903121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085903121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085903122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085903122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085903122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:04.602692 run osmo-stp_10.42.42.5(pid=20287): stdout: | (launched: 2022-12-10_08:59:02.927804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:04.731187 run osmo-stp_10.42.42.5(pid=20287): stderr: | 20221210085903120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085903121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085903121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085903121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085903122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085903122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085903122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:04.884816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20287): Process ended prematurely: osmo-stp_10.42.42.5(pid=20287) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20287)] [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 08:59:04.894370 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:59:04.921923 run osmo-hlr_10.42.42.2(pid=20284): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20284)] 08:59:04.971543 run osmo-hlr_10.42.42.2(pid=20284): stdout: | (launched: 2022-12-10_08:59:01.801359) 08:59:05.022685 run osmo-hlr_10.42.42.2(pid=20284): stderr: | 20221210085902031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085902031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085902031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085902031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085902031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085902031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085902045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085902061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085902062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085902062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:05.093885 run osmo-msc_10.42.42.6(pid=20290): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20290)] 08:59:05.143240 run osmo-msc_10.42.42.6(pid=20290): stdout: | (launched: 2022-12-10_08:59:03.956936) 08:59:05.194172 run osmo-msc_10.42.42.6(pid=20290): stderr: | 20221210085904281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085904282 DLGLOBAL DEBUG validating counter group 0x7f7158e7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085904282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085904282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085904282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085904282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085904284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085904284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085904284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085904284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:05.245480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20283): Terminating (SIGTERM) 08:59:05.286264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20286): Terminating (SIGTERM) 08:59:05.327357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20289): Terminating (SIGTERM) 08:59:05.368667 --- ParallelTerminationStrategy: PID 20283 died... 08:59:05.388358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20283): Terminated: ok {rc=0} 08:59:05.434373 --- ParallelTerminationStrategy: PID 20286 died... 08:59:05.453897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20286): Terminated: ok {rc=0} 08:59:05.499867 --- ParallelTerminationStrategy: PID 20289 died... 08:59:05.519378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20289): Terminated: ok {rc=0} 08:59:05.605851 bus /sierra_3: Setting Powered False 08:59:06.705029 bus /sierra_3: Setting Powered False 08:59:07.822064 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 08:59:08.967560 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:08.979064 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 08:59:09.086030 tst mo_mt_call_osmux.py: using LAC 27290 08:59:09.205465 tst mo_mt_call_osmux.py: using RAC 5 08:59:09.333518 tst mo_mt_call_osmux.py: using CellId 27290 08:59:09.460006 tst mo_mt_call_osmux.py: using BVCI 27291 08:59:09.579453 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:09.591094 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:09.602507 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:09.614144 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:09.625911 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 08:59:09.637341 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:59:09.755836 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 08:59:09.873969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:10.348237 run create_hlr_db(pid=20292): Launched 08:59:10.465596 bus /sierra_2: Setting Powered False 08:59:11.526943 run create_hlr_db(pid=20292): Terminated: ok {rc=0} 08:59:11.970328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Launched 08:59:12.292340 run osmo-hlr_10.42.42.2(pid=20295): Launched 08:59:12.416084 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:12.972372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Launched 08:59:13.295077 run osmo-stp_10.42.42.5(pid=20298): Launched 08:59:13.418945 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:14.010553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Launched 08:59:14.334548 run osmo-msc_10.42.42.6(pid=20301): Launched 08:59:14.515016 run osmo-stp_10.42.42.5(pid=20298): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] 08:59:14.651824 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-10_08:59:13.236266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:14.788448 run osmo-stp_10.42.42.5(pid=20298): stderr: | 20221210085913430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085913430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085913431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085913431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085913432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085913432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085913432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:14.923996 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-10_08:59:13.236266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:15.053318 run osmo-stp_10.42.42.5(pid=20298): stderr: | 20221210085913430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085913430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085913431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085913431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085913432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085913432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085913432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:15.207812 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 08:59:15.217440 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:59:15.245418 run osmo-hlr_10.42.42.2(pid=20295): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20295)] 08:59:15.295697 run osmo-hlr_10.42.42.2(pid=20295): stdout: | (launched: 2022-12-10_08:59:12.233839) 08:59:15.347597 run osmo-hlr_10.42.42.2(pid=20295): stderr: | 20221210085912433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085912433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085912433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085912433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085912433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085912433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085912451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085912460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085912460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085912460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:15.419514 run osmo-msc_10.42.42.6(pid=20301): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20301)] 08:59:15.469605 run osmo-msc_10.42.42.6(pid=20301): stdout: | (launched: 2022-12-10_08:59:14.274889) 08:59:15.521083 run osmo-msc_10.42.42.6(pid=20301): stderr: | 20221210085914599 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085914599 DLGLOBAL DEBUG validating counter group 0x7fcccb744c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085914599 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085914600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085914600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085914600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085914602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085914602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085914602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085914602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:15.573041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminating (SIGTERM) 08:59:15.615197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminating (SIGTERM) 08:59:15.656632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Terminating (SIGTERM) 08:59:15.698533 --- ParallelTerminationStrategy: PID 20294 died... 08:59:15.718395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminated: ok {rc=0} 08:59:15.764808 --- ParallelTerminationStrategy: PID 20297 died... 08:59:15.784351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminated: ok {rc=0} 08:59:15.829996 --- ParallelTerminationStrategy: PID 20300 died... 08:59:15.849882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Terminated: ok {rc=0} 08:59:15.942475 bus /sierra_3: Setting Powered False 08:59:17.058934 bus /sierra_3: Setting Powered False 08:59:18.183390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:59:19.434501 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:19.440875 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:59:19.473982 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:59:19.501299 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:59:19.553885 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:59:19.587602 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:59:19.615385 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:59:20.169349 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:59:20.220902 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.232715 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:20.285106 tst mo_mt_call.py: using LAC 27291 08:59:20.413475 tst mo_mt_call.py: using RAC 6 08:59:20.543360 tst mo_mt_call.py: using CellId 27291 08:59:20.672647 tst mo_mt_call.py: using BVCI 27292 08:59:20.790445 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.802233 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.813834 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.825392 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.836866 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:20.848450 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:59:20.963850 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:59:21.083301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:21.591151 run create_hlr_db(pid=20307): Launched 08:59:21.722692 bus /sierra_2: Setting Powered False 08:59:22.786315 run create_hlr_db(pid=20307): Terminated: ok {rc=0} 08:59:23.238130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Launched 08:59:23.565215 run osmo-hlr_10.42.42.2(pid=20310): Launched 08:59:23.689817 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:24.250909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Launched 08:59:24.577591 run osmo-stp_10.42.42.5(pid=20313): Launched 08:59:24.701026 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:25.291871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Launched 08:59:25.619591 run osmo-msc_10.42.42.6(pid=20316): Launched 08:59:25.800334 run osmo-stp_10.42.42.5(pid=20313): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] 08:59:25.935952 run osmo-stp_10.42.42.5(pid=20313): stdout: | (launched: 2022-12-10_08:59:24.514939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:26.072121 run osmo-stp_10.42.42.5(pid=20313): stderr: | 20221210085924713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085924713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085924713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085924713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085924714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085924714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085924714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:26.207789 run osmo-stp_10.42.42.5(pid=20313): stdout: | (launched: 2022-12-10_08:59:24.514939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:26.336537 run osmo-stp_10.42.42.5(pid=20313): stderr: | 20221210085924713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085924713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085924713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085924713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085924714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085924714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085924714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:26.490755 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20313): Process ended prematurely: osmo-stp_10.42.42.5(pid=20313) [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:59:26.500170 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:59:26.527819 run osmo-hlr_10.42.42.2(pid=20310): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20310)] 08:59:26.577424 run osmo-hlr_10.42.42.2(pid=20310): stdout: | (launched: 2022-12-10_08:59:23.502170) 08:59:26.628849 run osmo-hlr_10.42.42.2(pid=20310): stderr: | 20221210085923706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085923706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085923706 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085923706 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085923706 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085923706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085923718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085923726 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085923726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085923726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:26.700343 run osmo-msc_10.42.42.6(pid=20316): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20316)] 08:59:26.749318 run osmo-msc_10.42.42.6(pid=20316): stdout: | (launched: 2022-12-10_08:59:25.555827) 08:59:26.800009 run osmo-msc_10.42.42.6(pid=20316): stderr: | 20221210085925883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085925883 DLGLOBAL DEBUG validating counter group 0x7fa8ac636c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085925883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085925883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085925883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085925884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085925885 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085925886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085925886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085925886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:26.850825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Terminating (SIGTERM) 08:59:26.891868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Terminating (SIGTERM) 08:59:26.933099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Terminating (SIGTERM) 08:59:26.974756 --- ParallelTerminationStrategy: PID 20309 died... 08:59:26.994162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20309): Terminated: ok {rc=0} 08:59:27.039875 --- ParallelTerminationStrategy: PID 20312 died... 08:59:27.059219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20312): Terminated: ok {rc=0} 08:59:27.104845 --- ParallelTerminationStrategy: PID 20315 died... 08:59:27.124266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20315): Terminated: ok {rc=0} 08:59:27.211150 bus /sierra_3: Setting Powered False 08:59:28.310238 bus /sierra_3: Setting Powered False 08:59:29.425352 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:59:30.573156 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:30.585963 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:59:30.639661 tst mo_mt_call_osmux.py: using LAC 27292 08:59:30.768460 tst mo_mt_call_osmux.py: using RAC 7 08:59:30.920842 tst mo_mt_call_osmux.py: using CellId 27292 08:59:31.062035 tst mo_mt_call_osmux.py: using BVCI 27293 08:59:31.178940 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:31.191199 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:31.203286 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:31.217886 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:31.231254 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:59:31.243461 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:59:31.367564 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:59:31.512665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:32.039624 run create_hlr_db(pid=20319): Launched 08:59:32.183953 bus /sierra_2: Setting Powered False 08:59:33.247192 run create_hlr_db(pid=20319): Terminated: ok {rc=0} 08:59:33.701279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Launched 08:59:34.030274 run osmo-hlr_10.42.42.2(pid=20322): Launched 08:59:34.153845 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:34.719214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Launched 08:59:35.047277 run osmo-stp_10.42.42.5(pid=20325): Launched 08:59:35.171076 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:35.763465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Launched 08:59:36.089581 run osmo-msc_10.42.42.6(pid=20328): Launched 08:59:36.270329 run osmo-stp_10.42.42.5(pid=20325): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] 08:59:36.407095 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-10_08:59:34.983147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:36.543862 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221210085935182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085935182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085935183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085935183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085935184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085935184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085935184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:36.680723 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-10_08:59:34.983147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:36.809877 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221210085935182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085935182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085935183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085935183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085935184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085935184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085935184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:36.964737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:59:36.974368 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:59:37.002013 run osmo-hlr_10.42.42.2(pid=20322): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20322)] 08:59:37.052017 run osmo-hlr_10.42.42.2(pid=20322): stdout: | (launched: 2022-12-10_08:59:33.966499) 08:59:37.103696 run osmo-hlr_10.42.42.2(pid=20322): stderr: | 20221210085934172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085934172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085934172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085934172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085934172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085934172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085934185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085934193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085934193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085934193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:37.175376 run osmo-msc_10.42.42.6(pid=20328): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20328)] 08:59:37.224777 run osmo-msc_10.42.42.6(pid=20328): stdout: | (launched: 2022-12-10_08:59:36.027156) 08:59:37.275662 run osmo-msc_10.42.42.6(pid=20328): stderr: | 20221210085936355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085936356 DLGLOBAL DEBUG validating counter group 0x7f6652dc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085936356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085936356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085936356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085936356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085936358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085936358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085936358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085936358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:37.327126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminating (SIGTERM) 08:59:37.368057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminating (SIGTERM) 08:59:37.409259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminating (SIGTERM) 08:59:37.450903 --- ParallelTerminationStrategy: PID 20321 died... 08:59:37.470695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminated: ok {rc=0} 08:59:37.516681 --- ParallelTerminationStrategy: PID 20324 died... 08:59:37.536092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminated: ok {rc=0} 08:59:37.581727 --- ParallelTerminationStrategy: PID 20327 died... 08:59:37.601505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminated: ok {rc=0} 08:59:37.687330 bus /sierra_3: Setting Powered False 08:59:38.785815 bus /sierra_3: Setting Powered False 08:59:39.900881 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:trx-umtrx --------------------------------------------------------------------- 08:59:41.153157 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:59:41.157347 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 08:59:41.189838 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:59:41.216510 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 08:59:41.307709 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 08:59:41.340357 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:59:41.366979 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 08:59:41.948343 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 08:59:41.954257 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:41.965442 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 08:59:42.013916 tst emergency_mo_mt_call.py: using LAC 27293 08:59:42.140867 tst emergency_mo_mt_call.py: using RAC 8 08:59:42.265378 tst emergency_mo_mt_call.py: using CellId 27293 08:59:42.390425 tst emergency_mo_mt_call.py: using BVCI 27294 08:59:42.507298 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:42.518625 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:42.529805 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:42.541032 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:42.552165 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:42.563187 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:42.682541 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:42.802985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:43.296434 run create_hlr_db(pid=20333): Launched 08:59:43.425719 bus /sierra_2: Setting Powered False 08:59:44.489565 run create_hlr_db(pid=20333): Terminated: ok {rc=0} 08:59:44.933311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Launched 08:59:45.251069 run osmo-hlr_10.42.42.2(pid=20336): Launched 08:59:45.371958 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:45.921896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Launched 08:59:46.267256 run osmo-stp_10.42.42.5(pid=20339): Launched 08:59:46.552147 tst emergency_mo_mt_call.py: using MSISDN 7650 08:59:46.871108 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:47.464511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Launched 08:59:47.767074 run osmo-msc_10.42.42.6(pid=20346): Launched 08:59:47.936065 run osmo-stp_10.42.42.5(pid=20339): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] 08:59:48.063691 run osmo-stp_10.42.42.5(pid=20339): stdout: | (launched: 2022-12-10_08:59:46.199464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:48.191783 run osmo-stp_10.42.42.5(pid=20339): stderr: | 20221210085946663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085946673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085946673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085946674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085946674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085946674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085946674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:48.317727 run osmo-stp_10.42.42.5(pid=20339): stdout: | (launched: 2022-12-10_08:59:46.199464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:48.437854 run osmo-stp_10.42.42.5(pid=20339): stderr: | 20221210085946663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085946673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085946673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085946674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085946674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085946674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085946674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:48.581343 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20339): Process ended prematurely: osmo-stp_10.42.42.5(pid=20339) [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 08:59:48.589469 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 08:59:48.616195 run osmo-hlr_10.42.42.2(pid=20336): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20336)] 08:59:48.664120 run osmo-hlr_10.42.42.2(pid=20336): stdout: | (launched: 2022-12-10_08:59:45.193026) 08:59:48.713389 run osmo-hlr_10.42.42.2(pid=20336): stderr: | 20221210085945393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085945393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085945393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085945393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085945393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085945393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085945406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085945414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085945414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085945415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:48.781784 run osmo-msc_10.42.42.6(pid=20346): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20346)] 08:59:48.829719 run osmo-msc_10.42.42.6(pid=20346): stdout: | (launched: 2022-12-10_08:59:47.711857) 08:59:48.878967 run osmo-msc_10.42.42.6(pid=20346): stderr: | 20221210085947984 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085947984 DLGLOBAL DEBUG validating counter group 0x7f5f1f4f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085947984 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085947984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085947984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085947985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085947987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085947987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085947987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085947987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:48.928588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Terminating (SIGTERM) 08:59:48.968132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Terminating (SIGTERM) 08:59:49.007739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Terminating (SIGTERM) 08:59:49.047556 --- ParallelTerminationStrategy: PID 20335 died... 08:59:49.066267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20335): Terminated: ok {rc=0} 08:59:49.110923 --- ParallelTerminationStrategy: PID 20338 died... 08:59:49.129217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20338): Terminated: ok {rc=0} 08:59:49.173714 --- ParallelTerminationStrategy: PID 20345 died... 08:59:49.191936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20345): Terminated: ok {rc=0} 08:59:49.278305 bus /sierra_3: Setting Powered False 08:59:50.376587 bus /sierra_3: Setting Powered False 08:59:51.489633 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 08:59:52.574501 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:52.586366 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 08:59:52.636789 tst emergency_preemptive_call.py: using LAC 27294 08:59:52.759975 tst emergency_preemptive_call.py: using RAC 9 08:59:52.886490 tst emergency_preemptive_call.py: using CellId 27294 08:59:53.011270 tst emergency_preemptive_call.py: using BVCI 27295 08:59:53.127098 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:53.138228 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:53.149190 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:53.160045 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:53.170928 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 08:59:53.181840 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:53.295873 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:53.415782 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:53.531044 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 08:59:53.644265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:59:54.110522 run create_hlr_db(pid=20348): Launched 08:59:54.225676 bus /sierra_2: Setting Powered False 08:59:55.285921 run create_hlr_db(pid=20348): Terminated: ok {rc=0} 08:59:55.723497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20350): Launched 08:59:56.042161 run osmo-hlr_10.42.42.2(pid=20351): Launched 08:59:56.162812 run osmo-stp_10.42.42.5: Starting osmo-stp 08:59:56.718422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20353): Launched 08:59:57.036639 run osmo-stp_10.42.42.5(pid=20354): Launched 08:59:57.168422 tst emergency_preemptive_call.py: using MSISDN 7651 08:59:57.332708 run osmo-msc_10.42.42.6: Starting osmo-msc 08:59:57.905689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20356): Launched 08:59:58.223513 run osmo-msc_10.42.42.6(pid=20357): Launched 08:59:58.400855 run osmo-stp_10.42.42.5(pid=20354): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20354)] 08:59:58.535293 run osmo-stp_10.42.42.5(pid=20354): stdout: | (launched: 2022-12-10_08:59:56.978770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:58.670690 run osmo-stp_10.42.42.5(pid=20354): stderr: | 20221210085957171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085957171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085957171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085957172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085957172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085957172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085957172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:58.805170 run osmo-stp_10.42.42.5(pid=20354): stdout: | (launched: 2022-12-10_08:59:56.978770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:59:58.931816 run osmo-stp_10.42.42.5(pid=20354): stderr: | 20221210085957171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210085957171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210085957171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210085957172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210085957172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210085957172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210085957172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:59:59.083134 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20354): Process ended prematurely: osmo-stp_10.42.42.5(pid=20354) [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20354)] [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 08:59:59.091915 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 08:59:59.119587 run osmo-hlr_10.42.42.2(pid=20351): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20351)] 08:59:59.169579 run osmo-hlr_10.42.42.2(pid=20351): stdout: | (launched: 2022-12-10_08:59:55.984288) 08:59:59.221097 run osmo-hlr_10.42.42.2(pid=20351): stderr: | 20221210085956182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210085956182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210085956182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210085956182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210085956182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210085956182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210085956194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210085956202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210085956203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210085956203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:59:59.292859 run osmo-msc_10.42.42.6(pid=20357): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20357)] 08:59:59.342708 run osmo-msc_10.42.42.6(pid=20357): stdout: | (launched: 2022-12-10_08:59:58.165663) 08:59:59.393940 run osmo-msc_10.42.42.6(pid=20357): stderr: | 20221210085958486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210085958486 DLGLOBAL DEBUG validating counter group 0x7f65dd795c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210085958486 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210085958486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210085958486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210085958487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210085958488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210085958489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210085958489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210085958489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:59:59.445669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20350): Terminating (SIGTERM) 08:59:59.487167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20353): Terminating (SIGTERM) 08:59:59.528653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20356): Terminating (SIGTERM) 08:59:59.570567 --- ParallelTerminationStrategy: PID 20350 died... 08:59:59.590141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20350): Terminated: ok {rc=0} 08:59:59.635882 --- ParallelTerminationStrategy: PID 20353 died... 08:59:59.655551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20353): Terminated: ok {rc=0} 08:59:59.701119 --- ParallelTerminationStrategy: PID 20356 died... 08:59:59.720444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20356): Terminated: ok {rc=0} 08:59:59.806338 bus /sierra_9: Setting Powered False 09:00:00.924317 bus /sierra_9: Setting Powered False 09:00:02.066488 bus /sierra_8: Setting Powered False 09:00:03.181381 bus /sierra_8: Setting Powered False 09:00:04.295977 bus /sierra_3: Setting Powered False 09:00:05.393075 bus /sierra_3: Setting Powered False 09:00:06.508453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx --------------------------------------------------------------------- 09:00:07.787624 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:00:07.792141 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 09:00:07.825368 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 09:00:07.864563 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 09:00:07.956537 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 09:00:07.991006 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 09:00:08.030545 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 09:00:08.617913 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 09:00:08.669406 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:08.679971 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:00:08.729105 tst cs_paging_gprs_active.py: using LAC 27295 09:00:08.850540 tst cs_paging_gprs_active.py: using RAC 10 09:00:08.970184 tst cs_paging_gprs_active.py: using CellId 27295 09:00:09.090013 tst cs_paging_gprs_active.py: using BVCI 27296 09:00:09.202628 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.213276 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.223665 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.234444 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.245231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.255815 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.266785 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.277618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:09.288220 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:09.408891 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:09.527495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:00:09.749109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:10.079238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Launched 09:00:10.365388 run iperf3-srv_10.42.42.10(pid=20405): Launched 09:00:10.486833 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:00:10.707134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:11.035909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Launched 09:00:11.321411 run iperf3-srv_10.42.42.10(pid=20407): Launched 09:00:11.442443 tst cs_paging_gprs_active.py:38: start network... 09:00:11.662430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:12.171532 run create_hlr_db(pid=20408): Launched 09:00:12.295749 bus /sierra_2: Setting Powered False 09:00:13.359875 run create_hlr_db(pid=20408): Terminated: ok {rc=0} 09:00:13.799833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20411): Launched 09:00:14.110553 run osmo-hlr_10.42.42.2(pid=20412): Launched 09:00:14.227466 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:14.756653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20414): Launched 09:00:15.065919 run osmo-stp_10.42.42.5(pid=20415): Launched 09:00:15.182636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:15.711493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20417): Launched 09:00:15.830176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:16.125869 run patchelf(pid=20418): Launched 09:00:16.327456 run osmo-stp_10.42.42.5(pid=20415): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20415)] 09:00:16.468819 run osmo-stp_10.42.42.5(pid=20415): stdout: | (launched: 2022-12-10_09:00:15.006614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:16.612471 run osmo-stp_10.42.42.5(pid=20415): stderr: | 20221210090015180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090015180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090015180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090015181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090015181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090015181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090015181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:16.755382 run osmo-stp_10.42.42.5(pid=20415): stdout: | (launched: 2022-12-10_09:00:15.006614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:16.892880 run osmo-stp_10.42.42.5(pid=20415): stderr: | 20221210090015180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090015180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090015180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090015181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090015181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090015181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090015181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:17.055278 run patchelf(pid=20418): Terminating (SIGINT) 09:00:17.243206 run patchelf(pid=20418): Terminated: ok {rc=0} 09:00:17.374119 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20415): Process ended prematurely: osmo-stp_10.42.42.5(pid=20415) [trial-2372↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20415)] [trial-2372↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 09:00:17.384184 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:00:17.412631 run osmo-hlr_10.42.42.2(pid=20412): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20412)] 09:00:17.462465 run osmo-hlr_10.42.42.2(pid=20412): stdout: | (launched: 2022-12-10_09:00:14.050997) 09:00:17.514109 run osmo-hlr_10.42.42.2(pid=20412): stderr: | 20221210090014231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090014231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090014231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090014231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090014231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090014231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090014244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090014253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090014253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090014253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:17.565892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminating (SIGTERM) 09:00:17.607812 run iperf3-srv_10.42.42.10(pid=20405): Terminating (SIGTERM) 09:00:17.649289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminating (SIGTERM) 09:00:17.690860 run iperf3-srv_10.42.42.10(pid=20407): Terminating (SIGTERM) 09:00:17.732029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20411): Terminating (SIGTERM) 09:00:17.773460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20414): Terminating (SIGTERM) 09:00:17.814608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20417): Terminating (SIGTERM) 09:00:17.856767 --- ParallelTerminationStrategy: PID 20404 died... 09:00:17.876781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminated: ok {rc=0} 09:00:17.922923 --- ParallelTerminationStrategy: PID 20405 died... 09:00:17.942476 run iperf3-srv_10.42.42.10(pid=20405): Terminated {rc=256} 09:00:17.988088 --- ParallelTerminationStrategy: PID 20406 died... 09:00:18.007440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminated: ok {rc=0} 09:00:18.053477 --- ParallelTerminationStrategy: PID 20407 died... 09:00:18.073312 run iperf3-srv_10.42.42.10(pid=20407): Terminated {rc=256} 09:00:18.119074 --- ParallelTerminationStrategy: PID 20411 died... 09:00:18.138549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20411): Terminated: ok {rc=0} 09:00:18.184216 --- ParallelTerminationStrategy: PID 20414 died... 09:00:18.203718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20414): Terminated: ok {rc=0} 09:00:18.249885 --- ParallelTerminationStrategy: PID 20417 died... 09:00:18.269578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20417): Terminated: ok {rc=0} 09:00:18.356877 bus /gobi_0: Setting Powered False 09:00:19.454603 bus /gobi_0: Setting Powered False 09:00:20.569795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx iperf3.py ---------------------------------------------- 09:00:21.719088 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:21.730860 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:00:21.783072 tst iperf3.py: using LAC 27296 09:00:21.913230 tst iperf3.py: using RAC 11 09:00:22.043312 tst iperf3.py: using CellId 27296 09:00:22.173721 tst iperf3.py: using BVCI 27297 09:00:22.288402 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.299270 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.309956 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.321231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.332234 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.343464 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.355163 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.366390 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:22.377892 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:22.493396 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:00:22.701354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:23.012779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Launched 09:00:23.283161 run iperf3-srv_10.42.42.10(pid=20420): Launched 09:00:23.398477 tst iperf3.py:8: start network... 09:00:23.605599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:24.083346 run create_hlr_db(pid=20421): Launched 09:00:24.201352 bus /gobi_6: Setting Powered False 09:00:25.262041 run create_hlr_db(pid=20421): Terminated: ok {rc=0} 09:00:25.711610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20423): Launched 09:00:26.039899 run osmo-hlr_10.42.42.2(pid=20424): Launched 09:00:26.165084 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:26.729151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20426): Launched 09:00:27.056494 run osmo-stp_10.42.42.5(pid=20427): Launched 09:00:27.185567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:27.749996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20429): Launched 09:00:27.873651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:28.152902 run patchelf(pid=20430): Launched 09:00:28.333881 run osmo-stp_10.42.42.5(pid=20427): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20427)] 09:00:28.471488 run osmo-stp_10.42.42.5(pid=20427): stdout: | (launched: 2022-12-10_09:00:26.993141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:28.610758 run osmo-stp_10.42.42.5(pid=20427): stderr: | 20221210090027189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090027190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090027190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090027190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090027191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090027191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090027191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:28.750567 run osmo-stp_10.42.42.5(pid=20427): stdout: | (launched: 2022-12-10_09:00:26.993141) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:28.883998 run osmo-stp_10.42.42.5(pid=20427): stderr: | 20221210090027189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090027190 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090027190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090027190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090027191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090027191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090027191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:29.042059 run patchelf(pid=20430): Terminating (SIGINT) 09:00:29.223684 run patchelf(pid=20430): Terminated: ok {rc=0} 09:00:29.354726 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20427): Process ended prematurely: osmo-stp_10.42.42.5(pid=20427) [trial-2372↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20427)] [trial-2372↪gprs:trx-umtrx↪iperf3.py:8] 09:00:29.364480 tst iperf3.py:8: Test FAILED (7.7 sec) 09:00:29.392422 run osmo-hlr_10.42.42.2(pid=20424): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20424)] 09:00:29.441710 run osmo-hlr_10.42.42.2(pid=20424): stdout: | (launched: 2022-12-10_09:00:25.976065) 09:00:29.492509 run osmo-hlr_10.42.42.2(pid=20424): stderr: | 20221210090026179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090026179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090026179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090026179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090026179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090026179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090026191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090026202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090026202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090026202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:29.543813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Terminating (SIGTERM) 09:00:29.585461 run iperf3-srv_10.42.42.10(pid=20420): Terminating (SIGTERM) 09:00:29.627355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20423): Terminating (SIGTERM) 09:00:29.668899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20426): Terminating (SIGTERM) 09:00:29.710436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20429): Terminating (SIGTERM) 09:00:29.752292 --- ParallelTerminationStrategy: PID 20419 died... 09:00:29.772237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20419): Terminated: ok {rc=0} 09:00:29.818357 --- ParallelTerminationStrategy: PID 20420 died... 09:00:29.837847 run iperf3-srv_10.42.42.10(pid=20420): Terminated {rc=256} 09:00:29.883541 --- ParallelTerminationStrategy: PID 20423 died... 09:00:29.902844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20423): Terminated: ok {rc=0} 09:00:29.948699 --- ParallelTerminationStrategy: PID 20426 died... 09:00:29.968348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20426): Terminated: ok {rc=0} 09:00:30.014331 --- ParallelTerminationStrategy: PID 20429 died... 09:00:30.033831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20429): Terminated: ok {rc=0} 09:00:30.120280 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 09:00:31.289203 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.301368 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:00:31.351672 tst iperf3m4.py: using LAC 27297 09:00:31.480139 tst iperf3m4.py: using RAC 12 09:00:31.609360 tst iperf3m4.py: using CellId 27297 09:00:31.738432 tst iperf3m4.py: using BVCI 27298 09:00:31.860307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.872251 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.883918 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.895389 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.906709 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.918032 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.929677 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.940916 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:31.952385 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:32.096071 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:32.222874 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:32.341894 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:32.461911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:00:32.682991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:33.014011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Launched 09:00:33.302205 run iperf3-srv_10.42.42.10(pid=20432): Launched 09:00:33.423881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:00:33.643479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:33.973338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Launched 09:00:34.259392 run iperf3-srv_10.42.42.10(pid=20434): Launched 09:00:34.380885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:00:34.600167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:34.930217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20435): Launched 09:00:35.218643 run iperf3-srv_10.42.42.10(pid=20436): Launched 09:00:35.340224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:00:35.559355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:00:35.891160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20437): Launched 09:00:36.177431 run iperf3-srv_10.42.42.10(pid=20438): Launched 09:00:36.299418 tst iperf3m4.py:8: start network... 09:00:36.518419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:37.027212 run create_hlr_db(pid=20439): Launched 09:00:37.158198 bus /gobi_6: Setting Powered False 09:00:38.222654 run create_hlr_db(pid=20439): Terminated: ok {rc=0} 09:00:38.661954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20441): Launched 09:00:38.970510 run osmo-hlr_10.42.42.2(pid=20442): Launched 09:00:39.087208 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:39.640506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20444): Launched 09:00:39.950908 run osmo-stp_10.42.42.5(pid=20445): Launched 09:00:40.068360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:40.600922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20447): Launched 09:00:40.718151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:40.979852 run patchelf(pid=20448): Launched 09:00:41.150510 run osmo-stp_10.42.42.5(pid=20445): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20445)] 09:00:41.280131 run osmo-stp_10.42.42.5(pid=20445): stdout: | (launched: 2022-12-10_09:00:39.890991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:41.411389 run osmo-stp_10.42.42.5(pid=20445): stderr: | 20221210090040065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090040065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090040065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090040066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090040066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090040066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090040066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:41.542759 run osmo-stp_10.42.42.5(pid=20445): stdout: | (launched: 2022-12-10_09:00:39.890991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:41.668880 run osmo-stp_10.42.42.5(pid=20445): stderr: | 20221210090040065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090040065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090040065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090040066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090040066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090040066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090040066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:41.818417 run patchelf(pid=20448): Terminating (SIGINT) 09:00:41.990401 run patchelf(pid=20448): Terminated: ok {rc=0} 09:00:42.114640 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20445): Process ended prematurely: osmo-stp_10.42.42.5(pid=20445) [trial-2372↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20445)] [trial-2372↪gprs:trx-umtrx↪iperf3m4.py:8] 09:00:42.123843 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:00:42.151575 run osmo-hlr_10.42.42.2(pid=20442): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20442)] 09:00:42.199244 run osmo-hlr_10.42.42.2(pid=20442): stdout: | (launched: 2022-12-10_09:00:38.911612) 09:00:42.248316 run osmo-hlr_10.42.42.2(pid=20442): stderr: | 20221210090039092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090039092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090039092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090039092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090039092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090039092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090039105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090039114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090039114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090039114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:42.298041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Terminating (SIGTERM) 09:00:42.337450 run iperf3-srv_10.42.42.10(pid=20432): Terminating (SIGTERM) 09:00:42.377028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Terminating (SIGTERM) 09:00:42.416707 run iperf3-srv_10.42.42.10(pid=20434): Terminating (SIGTERM) 09:00:42.456418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20435): Terminating (SIGTERM) 09:00:42.496144 run iperf3-srv_10.42.42.10(pid=20436): Terminating (SIGTERM) 09:00:42.535461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20437): Terminating (SIGTERM) 09:00:42.575027 run iperf3-srv_10.42.42.10(pid=20438): Terminating (SIGTERM) 09:00:42.614483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20441): Terminating (SIGTERM) 09:00:42.654163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20444): Terminating (SIGTERM) 09:00:42.693648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20447): Terminating (SIGTERM) 09:00:42.733414 --- ParallelTerminationStrategy: PID 20431 died... 09:00:42.752235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Terminated: ok {rc=0} 09:00:42.796596 --- ParallelTerminationStrategy: PID 20432 died... 09:00:42.815032 run iperf3-srv_10.42.42.10(pid=20432): Terminated {rc=256} 09:00:42.858662 --- ParallelTerminationStrategy: PID 20433 died... 09:00:42.877056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20433): Terminated: ok {rc=0} 09:00:42.920682 --- ParallelTerminationStrategy: PID 20434 died... 09:00:42.939014 run iperf3-srv_10.42.42.10(pid=20434): Terminated {rc=256} 09:00:42.982259 --- ParallelTerminationStrategy: PID 20435 died... 09:00:43.000576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20435): Terminated: ok {rc=0} 09:00:43.044176 --- ParallelTerminationStrategy: PID 20436 died... 09:00:43.062550 run iperf3-srv_10.42.42.10(pid=20436): Terminated {rc=256} 09:00:43.106161 --- ParallelTerminationStrategy: PID 20437 died... 09:00:43.124683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20437): Terminated: ok {rc=0} 09:00:43.168418 --- ParallelTerminationStrategy: PID 20438 died... 09:00:43.186921 run iperf3-srv_10.42.42.10(pid=20438): Terminated {rc=256} 09:00:43.230437 --- ParallelTerminationStrategy: PID 20441 died... 09:00:43.248675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20441): Terminated: ok {rc=0} 09:00:43.292485 --- ParallelTerminationStrategy: PID 20444 died... 09:00:43.310992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20444): Terminated: ok {rc=0} 09:00:43.354659 --- ParallelTerminationStrategy: PID 20447 died... 09:00:43.373138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20447): Terminated: ok {rc=0} 09:00:43.455752 bus /gobi_4: Setting Powered False 09:00:44.553573 bus /gobi_4: Setting Powered False 09:00:45.668467 bus /gobi_1: Setting Powered False 09:00:46.771817 bus /gobi_1: Setting Powered False 09:00:47.890397 bus /gobi_0: Setting Powered False 09:00:48.988564 bus /gobi_0: Setting Powered False 09:00:50.104335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx ping.py ---------------------------------------------- 09:00:51.204490 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.215663 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:00:51.265264 tst ping.py: using LAC 27298 09:00:51.385093 tst ping.py: using RAC 13 09:00:51.511863 tst ping.py: using CellId 27298 09:00:51.637825 tst ping.py: using BVCI 27299 09:00:51.756273 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.767462 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.778610 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.789872 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.800863 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.812074 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.823141 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:51.834199 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:51.949088 tst ping.py:19: start network... 09:00:52.150369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:00:52.618535 run create_hlr_db(pid=20449): Launched 09:00:52.733811 bus /gobi_6: Setting Powered False 09:00:53.793877 run create_hlr_db(pid=20449): Terminated: ok {rc=0} 09:00:54.215966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20451): Launched 09:00:54.518674 run osmo-hlr_10.42.42.2(pid=20452): Launched 09:00:54.632858 run osmo-stp_10.42.42.5: Starting osmo-stp 09:00:55.169299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20454): Launched 09:00:55.473115 run osmo-stp_10.42.42.5(pid=20455): Launched 09:00:55.588455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:00:56.111518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20457): Launched 09:00:56.226985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:00:56.485349 run patchelf(pid=20458): Launched 09:00:56.653605 run osmo-stp_10.42.42.5(pid=20455): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20455)] 09:00:56.781749 run osmo-stp_10.42.42.5(pid=20455): stdout: | (launched: 2022-12-10_09:00:55.414036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:56.910636 run osmo-stp_10.42.42.5(pid=20455): stderr: | 20221210090055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090055587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090055588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090055588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090055589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:57.040173 run osmo-stp_10.42.42.5(pid=20455): stdout: | (launched: 2022-12-10_09:00:55.414036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:00:57.164329 run osmo-stp_10.42.42.5(pid=20455): stderr: | 20221210090055587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090055587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090055588 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090055588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090055588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090055589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090055589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:00:57.311248 run patchelf(pid=20458): Terminating (SIGINT) 09:00:57.480338 run patchelf(pid=20458): Terminated: ok {rc=0} 09:00:57.602443 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20455): Process ended prematurely: osmo-stp_10.42.42.5(pid=20455) [trial-2372↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20455)] [trial-2372↪gprs:trx-umtrx↪ping.py:22] 09:00:57.611329 tst ping.py:22: Test FAILED (6.4 sec) 09:00:57.638239 run osmo-hlr_10.42.42.2(pid=20452): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20452)] 09:00:57.685553 run osmo-hlr_10.42.42.2(pid=20452): stdout: | (launched: 2022-12-10_09:00:54.460335) 09:00:57.734503 run osmo-hlr_10.42.42.2(pid=20452): stderr: | 20221210090054639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090054639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090054639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090054639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090054639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090054639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090054650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090054658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090054658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090054659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:00:57.783919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20451): Terminating (SIGTERM) 09:00:57.823284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20454): Terminating (SIGTERM) 09:00:57.862622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20457): Terminating (SIGTERM) 09:00:57.902341 --- ParallelTerminationStrategy: PID 20451 died... 09:00:57.921287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20451): Terminated: ok {rc=0} 09:00:57.965477 --- ParallelTerminationStrategy: PID 20454 died... 09:00:57.984011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20454): Terminated: ok {rc=0} 09:00:58.028043 --- ParallelTerminationStrategy: PID 20457 died... 09:00:58.046559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20457): Terminated: ok {rc=0} 09:00:58.131925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 09:00:59.218489 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.229779 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 09:00:59.279688 tst ping_idle_ping.py: using LAC 27299 09:00:59.400829 tst ping_idle_ping.py: using RAC 14 09:00:59.528029 tst ping_idle_ping.py: using CellId 27299 09:00:59.656480 tst ping_idle_ping.py: using BVCI 27300 09:00:59.775194 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.786485 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.797678 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.808836 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.820131 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.831131 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.842287 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 09:00:59.853429 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 09:00:59.968597 tst ping_idle_ping.py:24: start network... 09:01:00.170812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:00.643822 run create_hlr_db(pid=20459): Launched 09:01:00.759611 bus /gobi_6: Setting Powered False 09:01:01.827662 run create_hlr_db(pid=20459): Terminated: ok {rc=0} 09:01:02.279204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20461): Launched 09:01:02.600552 run osmo-hlr_10.42.42.2(pid=20462): Launched 09:01:02.716510 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:03.254939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20464): Launched 09:01:03.558598 run osmo-stp_10.42.42.5(pid=20465): Launched 09:01:03.673408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:01:04.197159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20467): Launched 09:01:04.311642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:01:04.570211 run patchelf(pid=20468): Launched 09:01:04.737766 run osmo-stp_10.42.42.5(pid=20465): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20465)] 09:01:04.865093 run osmo-stp_10.42.42.5(pid=20465): stdout: | (launched: 2022-12-10_09:01:03.500232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:04.993795 run osmo-stp_10.42.42.5(pid=20465): stderr: | 20221210090103673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090103673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090103673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090103674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090103676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090103676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090103676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:05.123272 run osmo-stp_10.42.42.5(pid=20465): stdout: | (launched: 2022-12-10_09:01:03.500232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:05.247054 run osmo-stp_10.42.42.5(pid=20465): stderr: | 20221210090103673 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090103673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090103673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090103674 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090103676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090103676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090103676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:05.393980 run patchelf(pid=20468): Terminating (SIGINT) 09:01:05.563342 run patchelf(pid=20468): Terminated: ok {rc=0} 09:01:05.685217 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20465): Process ended prematurely: osmo-stp_10.42.42.5(pid=20465) [trial-2372↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20465)] [trial-2372↪gprs:trx-umtrx↪ping_idle_ping.py:27] 09:01:05.693924 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:01:05.720690 run osmo-hlr_10.42.42.2(pid=20462): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20462)] 09:01:05.768020 run osmo-hlr_10.42.42.2(pid=20462): stdout: | (launched: 2022-12-10_09:01:02.540102) 09:01:05.816910 run osmo-hlr_10.42.42.2(pid=20462): stderr: | 20221210090102718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090102718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090102718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090102718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090102718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090102718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090102730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090102739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090102739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090102739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:05.866320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20461): Terminating (SIGTERM) 09:01:05.905931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20464): Terminating (SIGTERM) 09:01:05.945485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20467): Terminating (SIGTERM) 09:01:05.985324 --- ParallelTerminationStrategy: PID 20461 died... 09:01:06.004212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20461): Terminated: ok {rc=0} 09:01:06.048107 --- ParallelTerminationStrategy: PID 20464 died... 09:01:06.066547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20464): Terminated: ok {rc=0} 09:01:06.110270 --- ParallelTerminationStrategy: PID 20467 died... 09:01:06.128716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20467): Terminated: ok {rc=0} 09:01:06.215219 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 09:01:07.510938 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:01:07.516002 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:01:07.548341 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:01:07.586704 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:01:07.674308 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:01:07.706736 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:01:07.745197 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:01:08.337226 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:01:08.386994 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.397891 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:01:08.447064 tst cs_paging_gprs_active.py: using LAC 27300 09:01:08.570624 tst cs_paging_gprs_active.py: using RAC 15 09:01:08.693334 tst cs_paging_gprs_active.py: using CellId 27300 09:01:08.814703 tst cs_paging_gprs_active.py: using BVCI 27301 09:01:08.934718 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.946311 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.957632 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.969106 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.980397 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:08.991807 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:09.003417 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:09.014779 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:09.026326 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:09.143947 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:09.262985 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:01:09.485042 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:09.813153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Launched 09:01:10.096527 run iperf3-srv_10.42.42.10(pid=20473): Launched 09:01:10.219183 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:01:10.440053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:10.768559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Launched 09:01:11.052031 run iperf3-srv_10.42.42.10(pid=20475): Launched 09:01:11.174403 tst cs_paging_gprs_active.py:38: start network... 09:01:11.394820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:11.901232 run create_hlr_db(pid=20476): Launched 09:01:12.033388 bus /gobi_6: Setting Powered False 09:01:13.098072 run create_hlr_db(pid=20476): Terminated: ok {rc=0} 09:01:13.550410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Launched 09:01:13.876111 run osmo-hlr_10.42.42.2(pid=20479): Launched 09:01:14.000728 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:14.546948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Launched 09:01:14.853261 run osmo-stp_10.42.42.5(pid=20482): Launched 09:01:14.970117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:01:15.497487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Launched 09:01:15.614974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:01:15.874720 run patchelf(pid=20485): Launched 09:01:16.096343 run osmo-stp_10.42.42.5(pid=20482): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] 09:01:16.231614 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-10_09:01:14.797221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:16.365915 run osmo-stp_10.42.42.5(pid=20482): stderr: | 20221210090114967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090114968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090114968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090114968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090114970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090114971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090114971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:16.500845 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-10_09:01:14.797221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:16.629844 run osmo-stp_10.42.42.5(pid=20482): stderr: | 20221210090114967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090114968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090114968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090114968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090114970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090114971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090114971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:16.781685 run patchelf(pid=20485): Terminating (SIGINT) 09:01:16.957577 run patchelf(pid=20485): Terminated: ok {rc=0} 09:01:17.084222 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:01:17.094371 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:01:17.123169 run osmo-hlr_10.42.42.2(pid=20479): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20479)] 09:01:17.171638 run osmo-hlr_10.42.42.2(pid=20479): stdout: | (launched: 2022-12-10_09:01:13.816910) 09:01:17.221831 run osmo-hlr_10.42.42.2(pid=20479): stderr: | 20221210090114018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090114018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090114018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090114018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090114018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090114019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090114031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090114039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090114039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090114039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:17.273040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminating (SIGTERM) 09:01:17.313151 run iperf3-srv_10.42.42.10(pid=20473): Terminating (SIGTERM) 09:01:17.353338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminating (SIGTERM) 09:01:17.394359 run iperf3-srv_10.42.42.10(pid=20475): Terminating (SIGTERM) 09:01:17.434689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminating (SIGTERM) 09:01:17.474987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminating (SIGTERM) 09:01:17.514899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminating (SIGTERM) 09:01:17.555153 --- ParallelTerminationStrategy: PID 20472 died... 09:01:17.574315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminated: ok {rc=0} 09:01:17.619118 --- ParallelTerminationStrategy: PID 20473 died... 09:01:17.637748 run iperf3-srv_10.42.42.10(pid=20473): Terminated {rc=256} 09:01:17.682113 --- ParallelTerminationStrategy: PID 20474 died... 09:01:17.700829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminated: ok {rc=0} 09:01:17.745233 --- ParallelTerminationStrategy: PID 20475 died... 09:01:17.763703 run iperf3-srv_10.42.42.10(pid=20475): Terminated {rc=256} 09:01:17.808294 --- ParallelTerminationStrategy: PID 20478 died... 09:01:17.827060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminated: ok {rc=0} 09:01:17.871704 --- ParallelTerminationStrategy: PID 20481 died... 09:01:17.890465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminated: ok {rc=0} 09:01:17.935109 --- ParallelTerminationStrategy: PID 20484 died... 09:01:17.953884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminated: ok {rc=0} 09:01:18.039993 bus /gobi_0: Setting Powered False 09:01:19.138065 bus /gobi_0: Setting Powered False 09:01:20.250561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:01:21.399151 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:21.410981 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:01:21.470561 tst iperf3.py: using LAC 27301 09:01:21.599982 tst iperf3.py: using RAC 16 09:01:21.728490 tst iperf3.py: using CellId 27301 09:01:21.856369 tst iperf3.py: using BVCI 27302 09:01:21.975489 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:21.986900 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:21.998025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.009246 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.020230 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.031257 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.042504 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.053539 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:22.064763 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:22.182948 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:01:22.390100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:22.700069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Launched 09:01:22.966347 run iperf3-srv_10.42.42.10(pid=20487): Launched 09:01:23.081195 tst iperf3.py:8: start network... 09:01:23.287069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:23.798263 run create_hlr_db(pid=20488): Launched 09:01:23.929670 bus /gobi_6: Setting Powered False 09:01:24.993313 run create_hlr_db(pid=20488): Terminated: ok {rc=0} 09:01:25.444506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Launched 09:01:25.769478 run osmo-hlr_10.42.42.2(pid=20491): Launched 09:01:25.890763 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:26.458122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Launched 09:01:26.782470 run osmo-stp_10.42.42.5(pid=20494): Launched 09:01:26.906007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:01:27.465514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Launched 09:01:27.589022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:01:27.863614 run patchelf(pid=20497): Launched 09:01:28.043331 run osmo-stp_10.42.42.5(pid=20494): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] 09:01:28.180093 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-10_09:01:26.723714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:28.318645 run osmo-stp_10.42.42.5(pid=20494): stderr: | 20221210090126916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090126916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090126917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090126917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090126918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090126918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090126918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:28.457271 run osmo-stp_10.42.42.5(pid=20494): stdout: | (launched: 2022-12-10_09:01:26.723714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:28.590003 run osmo-stp_10.42.42.5(pid=20494): stderr: | 20221210090126916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090126916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090126917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090126917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090126918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090126918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090126918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:28.748316 run patchelf(pid=20497): Terminating (SIGINT) 09:01:28.929433 run patchelf(pid=20497): Terminated: ok {rc=0} 09:01:29.060112 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 09:01:29.070090 tst iperf3.py:8: Test FAILED (7.7 sec) 09:01:29.098193 run osmo-hlr_10.42.42.2(pid=20491): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20491)] 09:01:29.147689 run osmo-hlr_10.42.42.2(pid=20491): stdout: | (launched: 2022-12-10_09:01:25.710758) 09:01:29.198556 run osmo-hlr_10.42.42.2(pid=20491): stderr: | 20221210090125887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090125887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090125887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090125887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090125887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090125887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090125899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090125908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090125908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090125908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:29.249848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Terminating (SIGTERM) 09:01:29.291034 run iperf3-srv_10.42.42.10(pid=20487): Terminating (SIGTERM) 09:01:29.332200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminating (SIGTERM) 09:01:29.373751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminating (SIGTERM) 09:01:29.414787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminating (SIGTERM) 09:01:29.456149 --- ParallelTerminationStrategy: PID 20486 died... 09:01:29.475908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20486): Terminated: ok {rc=0} 09:01:29.523048 --- ParallelTerminationStrategy: PID 20487 died... 09:01:29.542353 run iperf3-srv_10.42.42.10(pid=20487): Terminated {rc=256} 09:01:29.587609 --- ParallelTerminationStrategy: PID 20490 died... 09:01:29.606895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20490): Terminated: ok {rc=0} 09:01:29.652525 --- ParallelTerminationStrategy: PID 20493 died... 09:01:29.671858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20493): Terminated: ok {rc=0} 09:01:29.717377 --- ParallelTerminationStrategy: PID 20496 died... 09:01:29.736608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20496): Terminated: ok {rc=0} 09:01:29.822347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:01:31.005920 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.018765 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:01:31.070375 tst iperf3m4.py: using LAC 27302 09:01:31.193059 tst iperf3m4.py: using RAC 17 09:01:31.331803 tst iperf3m4.py: using CellId 27302 09:01:31.461164 tst iperf3m4.py: using BVCI 27303 09:01:31.602697 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.614894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.627639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.640735 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.652487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.666565 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.679370 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.691300 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:31.705138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:31.831285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:31.978194 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:32.100254 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:32.240888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:01:32.464305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:32.793104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Launched 09:01:33.076180 run iperf3-srv_10.42.42.10(pid=20499): Launched 09:01:33.198521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:01:33.418639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:33.732293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Launched 09:01:34.000727 run iperf3-srv_10.42.42.10(pid=20501): Launched 09:01:34.116125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:01:34.322955 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:34.631563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Launched 09:01:34.901410 run iperf3-srv_10.42.42.10(pid=20503): Launched 09:01:35.017103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:01:35.223887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:01:35.533249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Launched 09:01:35.801447 run iperf3-srv_10.42.42.10(pid=20505): Launched 09:01:35.916919 tst iperf3m4.py:8: start network... 09:01:36.123693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:36.603838 run create_hlr_db(pid=20506): Launched 09:01:36.722113 bus /gobi_6: Setting Powered False 09:01:37.783177 run create_hlr_db(pid=20506): Terminated: ok {rc=0} 09:01:38.229899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Launched 09:01:38.537434 run osmo-hlr_10.42.42.2(pid=20509): Launched 09:01:38.655671 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:39.197242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Launched 09:01:39.505363 run osmo-stp_10.42.42.5(pid=20512): Launched 09:01:39.624029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:01:40.157533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Launched 09:01:40.275013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:01:40.535314 run patchelf(pid=20515): Launched 09:01:40.706883 run osmo-stp_10.42.42.5(pid=20512): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] 09:01:40.837390 run osmo-stp_10.42.42.5(pid=20512): stdout: | (launched: 2022-12-10_09:01:39.448682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:40.969538 run osmo-stp_10.42.42.5(pid=20512): stderr: | 20221210090139621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090139621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090139622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090139622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090139622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090139623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090139623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:41.102015 run osmo-stp_10.42.42.5(pid=20512): stdout: | (launched: 2022-12-10_09:01:39.448682) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:41.228529 run osmo-stp_10.42.42.5(pid=20512): stderr: | 20221210090139621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090139621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090139622 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090139622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090139622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090139623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090139623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:41.378575 run patchelf(pid=20515): Terminating (SIGINT) 09:01:41.551219 run patchelf(pid=20515): Terminated: ok {rc=0} 09:01:41.676212 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20512): Process ended prematurely: osmo-stp_10.42.42.5(pid=20512) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 09:01:41.685926 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:01:41.713803 run osmo-hlr_10.42.42.2(pid=20509): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20509)] 09:01:41.762203 run osmo-hlr_10.42.42.2(pid=20509): stdout: | (launched: 2022-12-10_09:01:38.481436) 09:01:41.811700 run osmo-hlr_10.42.42.2(pid=20509): stderr: | 20221210090138661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090138661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090138661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090138661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090138661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090138661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090138673 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090138682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090138682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090138682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:41.861650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Terminating (SIGTERM) 09:01:41.901519 run iperf3-srv_10.42.42.10(pid=20499): Terminating (SIGTERM) 09:01:41.941061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Terminating (SIGTERM) 09:01:41.980828 run iperf3-srv_10.42.42.10(pid=20501): Terminating (SIGTERM) 09:01:42.020369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Terminating (SIGTERM) 09:01:42.059930 run iperf3-srv_10.42.42.10(pid=20503): Terminating (SIGTERM) 09:01:42.099347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Terminating (SIGTERM) 09:01:42.139214 run iperf3-srv_10.42.42.10(pid=20505): Terminating (SIGTERM) 09:01:42.178713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Terminating (SIGTERM) 09:01:42.218546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Terminating (SIGTERM) 09:01:42.258193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Terminating (SIGTERM) 09:01:42.298247 --- ParallelTerminationStrategy: PID 20498 died... 09:01:42.317254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20498): Terminated: ok {rc=0} 09:01:42.362499 --- ParallelTerminationStrategy: PID 20499 died... 09:01:42.381072 run iperf3-srv_10.42.42.10(pid=20499): Terminated {rc=256} 09:01:42.425197 --- ParallelTerminationStrategy: PID 20500 died... 09:01:42.443565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20500): Terminated: ok {rc=0} 09:01:42.487775 --- ParallelTerminationStrategy: PID 20501 died... 09:01:42.506214 run iperf3-srv_10.42.42.10(pid=20501): Terminated {rc=256} 09:01:42.549969 --- ParallelTerminationStrategy: PID 20502 died... 09:01:42.568432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20502): Terminated: ok {rc=0} 09:01:42.612398 --- ParallelTerminationStrategy: PID 20503 died... 09:01:42.631192 run iperf3-srv_10.42.42.10(pid=20503): Terminated {rc=256} 09:01:42.675260 --- ParallelTerminationStrategy: PID 20504 died... 09:01:42.693864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20504): Terminated: ok {rc=0} 09:01:42.737814 --- ParallelTerminationStrategy: PID 20505 died... 09:01:42.756476 run iperf3-srv_10.42.42.10(pid=20505): Terminated {rc=256} 09:01:42.800292 --- ParallelTerminationStrategy: PID 20508 died... 09:01:42.818977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20508): Terminated: ok {rc=0} 09:01:42.863187 --- ParallelTerminationStrategy: PID 20511 died... 09:01:42.882182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20511): Terminated: ok {rc=0} 09:01:42.925910 --- ParallelTerminationStrategy: PID 20514 died... 09:01:42.944539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20514): Terminated: ok {rc=0} 09:01:43.027155 bus /gobi_4: Setting Powered False 09:01:44.125090 bus /gobi_4: Setting Powered False 09:01:45.240389 bus /gobi_1: Setting Powered False 09:01:46.351359 bus /gobi_1: Setting Powered False 09:01:47.470468 bus /gobi_0: Setting Powered False 09:01:48.567846 bus /gobi_0: Setting Powered False 09:01:49.685383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 09:01:50.784813 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:50.796521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:01:50.849795 tst ping.py: using LAC 27303 09:01:50.968377 tst ping.py: using RAC 18 09:01:51.085241 tst ping.py: using CellId 27303 09:01:51.202442 tst ping.py: using BVCI 27304 09:01:51.311887 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.322883 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.333775 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.344859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.355588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.366827 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.378342 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:51.389473 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:51.507798 tst ping.py:19: start network... 09:01:51.724046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:01:52.219756 run create_hlr_db(pid=20516): Launched 09:01:52.351024 bus /gobi_6: Setting Powered False 09:01:53.414239 run create_hlr_db(pid=20516): Terminated: ok {rc=0} 09:01:53.845482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Launched 09:01:54.146579 run osmo-hlr_10.42.42.2(pid=20519): Launched 09:01:54.261781 run osmo-stp_10.42.42.5: Starting osmo-stp 09:01:54.782228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Launched 09:01:55.081528 run osmo-stp_10.42.42.5(pid=20522): Launched 09:01:55.196573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:01:55.716310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Launched 09:01:55.831941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:01:56.086042 run patchelf(pid=20525): Launched 09:01:56.253273 run osmo-stp_10.42.42.5(pid=20522): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] 09:01:56.380504 run osmo-stp_10.42.42.5(pid=20522): stdout: | (launched: 2022-12-10_09:01:55.026651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:56.509482 run osmo-stp_10.42.42.5(pid=20522): stderr: | 20221210090155199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090155199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090155200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090155200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090155201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090155201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090155201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:56.638469 run osmo-stp_10.42.42.5(pid=20522): stdout: | (launched: 2022-12-10_09:01:55.026651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:01:56.762330 run osmo-stp_10.42.42.5(pid=20522): stderr: | 20221210090155199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090155199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090155200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090155200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090155201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090155201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090155201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:01:56.909489 run patchelf(pid=20525): Terminating (SIGINT) 09:01:57.078091 run patchelf(pid=20525): Terminated: ok {rc=0} 09:01:57.199621 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20522): Process ended prematurely: osmo-stp_10.42.42.5(pid=20522) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 09:01:57.208472 tst ping.py:22: Test FAILED (6.4 sec) 09:01:57.235543 run osmo-hlr_10.42.42.2(pid=20519): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20519)] 09:01:57.282981 run osmo-hlr_10.42.42.2(pid=20519): stdout: | (launched: 2022-12-10_09:01:54.091725) 09:01:57.331798 run osmo-hlr_10.42.42.2(pid=20519): stderr: | 20221210090154268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090154268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090154268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090154268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090154268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090154268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090154281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090154290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090154290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090154290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:01:57.381370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Terminating (SIGTERM) 09:01:57.420937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Terminating (SIGTERM) 09:01:57.460915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Terminating (SIGTERM) 09:01:57.501466 --- ParallelTerminationStrategy: PID 20518 died... 09:01:57.520588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20518): Terminated: ok {rc=0} 09:01:57.565130 --- ParallelTerminationStrategy: PID 20521 died... 09:01:57.583811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20521): Terminated: ok {rc=0} 09:01:57.628118 --- ParallelTerminationStrategy: PID 20524 died... 09:01:57.646681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20524): Terminated: ok {rc=0} 09:01:57.732292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:01:58.818945 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:58.830630 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:01:58.881197 tst ping_idle_ping.py: using LAC 27304 09:01:59.002724 tst ping_idle_ping.py: using RAC 19 09:01:59.128720 tst ping_idle_ping.py: using CellId 27304 09:01:59.254712 tst ping_idle_ping.py: using BVCI 27305 09:01:59.372318 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.383779 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.394990 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.406192 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.417243 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.428310 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.439672 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:01:59.450918 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:01:59.567660 tst ping_idle_ping.py:24: start network... 09:01:59.770803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:00.241731 run create_hlr_db(pid=20526): Launched 09:02:00.357539 bus /gobi_6: Setting Powered False 09:02:01.416717 run create_hlr_db(pid=20526): Terminated: ok {rc=0} 09:02:01.855481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Launched 09:02:02.176280 run osmo-hlr_10.42.42.2(pid=20529): Launched 09:02:02.316811 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:02.899062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Launched 09:02:03.226502 run osmo-stp_10.42.42.5(pid=20532): Launched 09:02:03.376877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:03.957781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Launched 09:02:04.082319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:04.353804 run patchelf(pid=20535): Launched 09:02:04.532748 run osmo-stp_10.42.42.5(pid=20532): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] 09:02:04.668860 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-10_09:02:03.166560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:04.806457 run osmo-stp_10.42.42.5(pid=20532): stderr: | 20221210090203361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090203361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090203361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090203362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090203362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090203362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090203362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:04.944365 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-10_09:02:03.166560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:05.076490 run osmo-stp_10.42.42.5(pid=20532): stderr: | 20221210090203361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090203361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090203361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090203362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090203362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090203362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090203362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:05.232824 run patchelf(pid=20535): Terminating (SIGINT) 09:02:05.414915 run patchelf(pid=20535): Terminated: ok {rc=0} 09:02:05.544411 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 09:02:05.553943 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:02:05.581487 run osmo-hlr_10.42.42.2(pid=20529): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20529)] 09:02:05.631078 run osmo-hlr_10.42.42.2(pid=20529): stdout: | (launched: 2022-12-10_09:02:02.108942) 09:02:05.682455 run osmo-hlr_10.42.42.2(pid=20529): stderr: | 20221210090202326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090202326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090202326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090202326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090202326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090202326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090202338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090202347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090202347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090202348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:05.734161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminating (SIGTERM) 09:02:05.775442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminating (SIGTERM) 09:02:05.816717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminating (SIGTERM) 09:02:05.858349 --- ParallelTerminationStrategy: PID 20528 died... 09:02:05.878080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminated: ok {rc=0} 09:02:05.923633 --- ParallelTerminationStrategy: PID 20531 died... 09:02:05.942936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminated: ok {rc=0} 09:02:05.988490 --- ParallelTerminationStrategy: PID 20534 died... 09:02:06.007898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminated: ok {rc=0} 09:02:06.095029 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:02:07.401495 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:02:07.407756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:02:07.440725 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:02:07.480023 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:02:07.570923 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:02:07.605044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:02:07.644102 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:02:08.239020 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:02:08.292100 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.303379 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:02:08.374226 tst cs_paging_gprs_active.py: using LAC 27305 09:02:08.497079 tst cs_paging_gprs_active.py: using RAC 20 09:02:08.617650 tst cs_paging_gprs_active.py: using CellId 27305 09:02:08.747372 tst cs_paging_gprs_active.py: using BVCI 27306 09:02:08.867948 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.879228 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.890448 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.901614 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.912582 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.923756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.934958 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.946288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:08.957736 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:09.072941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:09.193819 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:02:09.414982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:09.747025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Launched 09:02:10.034510 run iperf3-srv_10.42.42.10(pid=20540): Launched 09:02:10.156045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:02:10.376443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:10.707847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Launched 09:02:10.995448 run iperf3-srv_10.42.42.10(pid=20542): Launched 09:02:11.117115 tst cs_paging_gprs_active.py:38: start network... 09:02:11.336795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:11.847742 run create_hlr_db(pid=20543): Launched 09:02:11.980113 bus /gobi_6: Setting Powered False 09:02:13.045612 run create_hlr_db(pid=20543): Terminated: ok {rc=0} 09:02:13.505655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20545): Launched 09:02:13.837441 run osmo-hlr_10.42.42.2(pid=20546): Launched 09:02:13.961521 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:14.531863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20548): Launched 09:02:14.863373 run osmo-stp_10.42.42.5(pid=20549): Launched 09:02:14.988248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:15.556821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20551): Launched 09:02:15.681907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:15.979982 run patchelf(pid=20552): Launched 09:02:16.210296 run osmo-stp_10.42.42.5(pid=20549): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20549)] 09:02:16.388169 run osmo-stp_10.42.42.5(pid=20549): stdout: | (launched: 2022-12-10_09:02:14.799124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:16.567925 run osmo-stp_10.42.42.5(pid=20549): stderr: | 20221210090214995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090214995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090214995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090214996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090214997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090214997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090214997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:16.749864 run osmo-stp_10.42.42.5(pid=20549): stdout: | (launched: 2022-12-10_09:02:14.799124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:16.892099 run osmo-stp_10.42.42.5(pid=20549): stderr: | 20221210090214995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090214995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090214995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090214996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090214997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090214997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090214997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:17.055327 run patchelf(pid=20552): Terminating (SIGINT) 09:02:17.246148 run patchelf(pid=20552): Terminated: ok {rc=0} 09:02:17.378796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20549): Process ended prematurely: osmo-stp_10.42.42.5(pid=20549) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20549)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:02:17.388712 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 09:02:17.416898 run osmo-hlr_10.42.42.2(pid=20546): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20546)] 09:02:17.466530 run osmo-hlr_10.42.42.2(pid=20546): stdout: | (launched: 2022-12-10_09:02:13.773502) 09:02:17.517930 run osmo-hlr_10.42.42.2(pid=20546): stderr: | 20221210090213975 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090213975 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090213975 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090213975 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090213975 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090213975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090213988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090213997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090213997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090213998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:17.569722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Terminating (SIGTERM) 09:02:17.610878 run iperf3-srv_10.42.42.10(pid=20540): Terminating (SIGTERM) 09:02:17.651987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Terminating (SIGTERM) 09:02:17.693661 run iperf3-srv_10.42.42.10(pid=20542): Terminating (SIGTERM) 09:02:17.734890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20545): Terminating (SIGTERM) 09:02:17.775998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20548): Terminating (SIGTERM) 09:02:17.817249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20551): Terminating (SIGTERM) 09:02:17.858785 --- ParallelTerminationStrategy: PID 20539 died... 09:02:17.878622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20539): Terminated: ok {rc=0} 09:02:17.924219 --- ParallelTerminationStrategy: PID 20540 died... 09:02:17.943540 run iperf3-srv_10.42.42.10(pid=20540): Terminated {rc=256} 09:02:17.989074 --- ParallelTerminationStrategy: PID 20541 died... 09:02:18.008434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20541): Terminated: ok {rc=0} 09:02:18.053875 --- ParallelTerminationStrategy: PID 20542 died... 09:02:18.073210 run iperf3-srv_10.42.42.10(pid=20542): Terminated {rc=256} 09:02:18.118587 --- ParallelTerminationStrategy: PID 20545 died... 09:02:18.138298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20545): Terminated: ok {rc=0} 09:02:18.183861 --- ParallelTerminationStrategy: PID 20548 died... 09:02:18.203184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20548): Terminated: ok {rc=0} 09:02:18.248598 --- ParallelTerminationStrategy: PID 20551 died... 09:02:18.268039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20551): Terminated: ok {rc=0} 09:02:18.354613 bus /gobi_0: Setting Powered False 09:02:19.453542 bus /gobi_0: Setting Powered False 09:02:20.568583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:02:21.717783 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:21.729658 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:02:21.803593 tst iperf3.py: using LAC 27306 09:02:21.924622 tst iperf3.py: using RAC 21 09:02:22.043952 tst iperf3.py: using CellId 27306 09:02:22.162249 tst iperf3.py: using BVCI 27307 09:02:22.273976 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.284724 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.295464 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.306361 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.317130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.328011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.338921 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.349755 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:22.361203 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:22.482562 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:02:22.704804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:23.036909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Launched 09:02:23.324644 run iperf3-srv_10.42.42.10(pid=20554): Launched 09:02:23.446422 tst iperf3.py:8: start network... 09:02:23.665806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:24.173541 run create_hlr_db(pid=20555): Launched 09:02:24.305795 bus /gobi_6: Setting Powered False 09:02:25.369875 run create_hlr_db(pid=20555): Terminated: ok {rc=0} 09:02:25.811015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Launched 09:02:26.121843 run osmo-hlr_10.42.42.2(pid=20558): Launched 09:02:26.239770 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:26.872626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Launched 09:02:27.175006 run osmo-stp_10.42.42.5(pid=20561): Launched 09:02:27.289589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:27.812076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Launched 09:02:27.926567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:28.185069 run patchelf(pid=20564): Launched 09:02:28.351520 run osmo-stp_10.42.42.5(pid=20561): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] 09:02:28.478549 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-10_09:02:27.116905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:28.607229 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221210090227291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090227291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090227292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090227292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090227293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090227293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090227293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:28.735853 run osmo-stp_10.42.42.5(pid=20561): stdout: | (launched: 2022-12-10_09:02:27.116905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:28.859540 run osmo-stp_10.42.42.5(pid=20561): stderr: | 20221210090227291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090227291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090227292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090227292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090227293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090227293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090227293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:29.005879 run patchelf(pid=20564): Terminating (SIGINT) 09:02:29.175134 run patchelf(pid=20564): Terminated: ok {rc=0} 09:02:29.296847 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 09:02:29.306204 tst iperf3.py:8: Test FAILED (7.6 sec) 09:02:29.333376 run osmo-hlr_10.42.42.2(pid=20558): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20558)] 09:02:29.380260 run osmo-hlr_10.42.42.2(pid=20558): stdout: | (launched: 2022-12-10_09:02:26.061876) 09:02:29.428768 run osmo-hlr_10.42.42.2(pid=20558): stderr: | 20221210090226241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090226242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090226242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090226242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090226242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090226242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090226259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090226269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090226269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090226269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:29.477692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Terminating (SIGTERM) 09:02:29.516799 run iperf3-srv_10.42.42.10(pid=20554): Terminating (SIGTERM) 09:02:29.555815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminating (SIGTERM) 09:02:29.594759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminating (SIGTERM) 09:02:29.633804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminating (SIGTERM) 09:02:29.673049 --- ParallelTerminationStrategy: PID 20553 died... 09:02:29.691610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20553): Terminated: ok {rc=0} 09:02:29.734994 --- ParallelTerminationStrategy: PID 20554 died... 09:02:29.753173 run iperf3-srv_10.42.42.10(pid=20554): Terminated {rc=256} 09:02:29.797092 --- ParallelTerminationStrategy: PID 20557 died... 09:02:29.815673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20557): Terminated: ok {rc=0} 09:02:29.859333 --- ParallelTerminationStrategy: PID 20560 died... 09:02:29.877509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20560): Terminated: ok {rc=0} 09:02:29.920812 --- ParallelTerminationStrategy: PID 20563 died... 09:02:29.939396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20563): Terminated: ok {rc=0} 09:02:30.024121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:02:31.174137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.186484 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:02:31.258617 tst iperf3m4.py: using LAC 27307 09:02:31.390841 tst iperf3m4.py: using RAC 22 09:02:31.517437 tst iperf3m4.py: using CellId 27307 09:02:31.681156 tst iperf3m4.py: using BVCI 27308 09:02:31.793125 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.805600 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.816899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.828899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.840782 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.853004 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.864995 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.876669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:31.889203 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:32.030554 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:32.154129 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:32.279149 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:32.397511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:02:32.601136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:32.907976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20565): Launched 09:02:33.189800 run iperf3-srv_10.42.42.10(pid=20566): Launched 09:02:33.309193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:02:33.523629 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:33.849545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Launched 09:02:34.129758 run iperf3-srv_10.42.42.10(pid=20568): Launched 09:02:34.248712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:02:34.463428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:34.788030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20569): Launched 09:02:35.070221 run iperf3-srv_10.42.42.10(pid=20570): Launched 09:02:35.189435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:02:35.403745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:02:35.729013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20571): Launched 09:02:36.012327 run iperf3-srv_10.42.42.10(pid=20573): Launched 09:02:36.131788 tst iperf3m4.py:8: start network... 09:02:36.346300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:36.850241 run create_hlr_db(pid=20574): Launched 09:02:36.979549 bus /gobi_6: Setting Powered False 09:02:38.042674 run create_hlr_db(pid=20574): Terminated: ok {rc=0} 09:02:38.492389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Launched 09:02:38.816743 run osmo-hlr_10.42.42.2(pid=20577): Launched 09:02:38.938835 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:39.498393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Launched 09:02:39.821919 run osmo-stp_10.42.42.5(pid=20580): Launched 09:02:39.943614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:40.499480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Launched 09:02:40.620520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:40.894220 run patchelf(pid=20583): Launched 09:02:41.070575 run osmo-stp_10.42.42.5(pid=20580): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] 09:02:41.207335 run osmo-stp_10.42.42.5(pid=20580): stdout: | (launched: 2022-12-10_09:02:39.758725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:41.344695 run osmo-stp_10.42.42.5(pid=20580): stderr: | 20221210090239956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090239956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090239956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090239957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090239957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090239957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090239957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:41.481699 run osmo-stp_10.42.42.5(pid=20580): stdout: | (launched: 2022-12-10_09:02:39.758725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:41.612929 run osmo-stp_10.42.42.5(pid=20580): stderr: | 20221210090239956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090239956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090239956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090239957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090239957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090239957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090239957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:41.768866 run patchelf(pid=20583): Terminating (SIGINT) 09:02:41.948011 run patchelf(pid=20583): Terminated: ok {rc=0} 09:02:42.077063 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20580): Process ended prematurely: osmo-stp_10.42.42.5(pid=20580) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:02:42.087095 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:02:42.115644 run osmo-hlr_10.42.42.2(pid=20577): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20577)] 09:02:42.165603 run osmo-hlr_10.42.42.2(pid=20577): stdout: | (launched: 2022-12-10_09:02:38.753567) 09:02:42.217288 run osmo-hlr_10.42.42.2(pid=20577): stderr: | 20221210090238957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090238957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090238957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090238957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090238957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090238957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090238969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090238978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090238978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090238978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:42.269469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20565): Terminating (SIGTERM) 09:02:42.311028 run iperf3-srv_10.42.42.10(pid=20566): Terminating (SIGTERM) 09:02:42.352503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Terminating (SIGTERM) 09:02:42.393873 run iperf3-srv_10.42.42.10(pid=20568): Terminating (SIGTERM) 09:02:42.435129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20569): Terminating (SIGTERM) 09:02:42.476378 run iperf3-srv_10.42.42.10(pid=20570): Terminating (SIGTERM) 09:02:42.517656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20571): Terminating (SIGTERM) 09:02:42.558903 run iperf3-srv_10.42.42.10(pid=20573): Terminating (SIGTERM) 09:02:42.599920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Terminating (SIGTERM) 09:02:42.641344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Terminating (SIGTERM) 09:02:42.682961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Terminating (SIGTERM) 09:02:42.724511 --- ParallelTerminationStrategy: PID 20565 died... 09:02:42.744419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20565): Terminated: ok {rc=0} 09:02:42.789972 --- ParallelTerminationStrategy: PID 20566 died... 09:02:42.809166 run iperf3-srv_10.42.42.10(pid=20566): Terminated {rc=256} 09:02:42.854245 --- ParallelTerminationStrategy: PID 20567 died... 09:02:42.873352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20567): Terminated: ok {rc=0} 09:02:42.918439 --- ParallelTerminationStrategy: PID 20568 died... 09:02:42.937558 run iperf3-srv_10.42.42.10(pid=20568): Terminated {rc=256} 09:02:42.982708 --- ParallelTerminationStrategy: PID 20569 died... 09:02:43.001925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20569): Terminated: ok {rc=0} 09:02:43.047273 --- ParallelTerminationStrategy: PID 20570 died... 09:02:43.066411 run iperf3-srv_10.42.42.10(pid=20570): Terminated {rc=256} 09:02:43.111463 --- ParallelTerminationStrategy: PID 20571 died... 09:02:43.130747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20571): Terminated: ok {rc=0} 09:02:43.175922 --- ParallelTerminationStrategy: PID 20573 died... 09:02:43.195124 run iperf3-srv_10.42.42.10(pid=20573): Terminated {rc=256} 09:02:43.240504 --- ParallelTerminationStrategy: PID 20576 died... 09:02:43.259738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20576): Terminated: ok {rc=0} 09:02:43.305073 --- ParallelTerminationStrategy: PID 20579 died... 09:02:43.324297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20579): Terminated: ok {rc=0} 09:02:43.369534 --- ParallelTerminationStrategy: PID 20582 died... 09:02:43.388751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20582): Terminated: ok {rc=0} 09:02:43.474456 bus /gobi_4: Setting Powered False 09:02:44.572745 bus /gobi_4: Setting Powered False 09:02:45.688010 bus /gobi_1: Setting Powered False 09:02:46.788667 bus /gobi_1: Setting Powered False 09:02:47.911866 bus /gobi_0: Setting Powered False 09:02:49.009691 bus /gobi_0: Setting Powered False 09:02:50.125528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:02:51.227999 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.239786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:02:51.310548 tst ping.py: using LAC 27308 09:02:51.429291 tst ping.py: using RAC 23 09:02:51.547781 tst ping.py: using CellId 27308 09:02:51.666745 tst ping.py: using BVCI 27309 09:02:51.784052 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.795389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.806717 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.818562 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.830300 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.842910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.854423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:51.866092 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:02:51.983500 tst ping.py:19: start network... 09:02:52.182999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:02:52.649274 run create_hlr_db(pid=20584): Launched 09:02:52.762924 bus /gobi_6: Setting Powered False 09:02:53.822574 run create_hlr_db(pid=20584): Terminated: ok {rc=0} 09:02:54.257935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Launched 09:02:54.576702 run osmo-hlr_10.42.42.2(pid=20587): Launched 09:02:54.698445 run osmo-stp_10.42.42.5: Starting osmo-stp 09:02:55.248078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Launched 09:02:55.567023 run osmo-stp_10.42.42.5(pid=20590): Launched 09:02:55.687407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:02:56.236015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Launched 09:02:56.355776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:02:56.626329 run patchelf(pid=20593): Launched 09:02:56.801292 run osmo-stp_10.42.42.5(pid=20590): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] 09:02:56.933713 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-10_09:02:55.504285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:57.067514 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221210090255699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090255699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090255699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090255700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090255702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090255702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090255702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:57.201882 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-10_09:02:55.504285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:02:57.330717 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221210090255699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090255699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090255699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090255700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090255702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090255702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090255702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:02:57.483326 run patchelf(pid=20593): Terminating (SIGINT) 09:02:57.658986 run patchelf(pid=20593): Terminated: ok {rc=0} 09:02:57.786082 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 09:02:57.795403 tst ping.py:22: Test FAILED (6.6 sec) 09:02:57.822891 run osmo-hlr_10.42.42.2(pid=20587): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20587)] 09:02:57.872368 run osmo-hlr_10.42.42.2(pid=20587): stdout: | (launched: 2022-12-10_09:02:54.514099) 09:02:57.923756 run osmo-hlr_10.42.42.2(pid=20587): stderr: | 20221210090254716 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090254716 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090254716 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090254716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090254716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090254716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090254728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090254736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090254736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090254736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:02:57.975504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminating (SIGTERM) 09:02:58.016790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminating (SIGTERM) 09:02:58.058356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminating (SIGTERM) 09:02:58.100047 --- ParallelTerminationStrategy: PID 20586 died... 09:02:58.119813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminated: ok {rc=0} 09:02:58.165352 --- ParallelTerminationStrategy: PID 20589 died... 09:02:58.184479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminated: ok {rc=0} 09:02:58.229780 --- ParallelTerminationStrategy: PID 20592 died... 09:02:58.248890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20592): Terminated: ok {rc=0} 09:02:58.335471 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:02:59.423556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:02:59.435796 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:02:59.510595 tst ping_idle_ping.py: using LAC 27309 09:02:59.634972 tst ping_idle_ping.py: using RAC 24 09:02:59.758567 tst ping_idle_ping.py: using CellId 27309 09:02:59.881677 tst ping_idle_ping.py: using BVCI 27310 09:02:59.997366 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.008612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.019817 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.030991 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.042121 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.053292 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.064436 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:03:00.075544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:03:00.190070 tst ping_idle_ping.py:24: start network... 09:03:00.390743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:00.863966 run create_hlr_db(pid=20594): Launched 09:03:01.007245 bus /gobi_6: Setting Powered False 09:03:02.069314 run create_hlr_db(pid=20594): Terminated: ok {rc=0} 09:03:02.517316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Launched 09:03:02.835450 run osmo-hlr_10.42.42.2(pid=20598): Launched 09:03:02.954426 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:03.503255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Launched 09:03:03.824467 run osmo-stp_10.42.42.5(pid=20601): Launched 09:03:03.944461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:04.494544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20603): Launched 09:03:04.614681 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:04.886904 run patchelf(pid=20604): Launched 09:03:05.061693 run osmo-stp_10.42.42.5(pid=20601): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] 09:03:05.195384 run osmo-stp_10.42.42.5(pid=20601): stdout: | (launched: 2022-12-10_09:03:03.761509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:05.330863 run osmo-stp_10.42.42.5(pid=20601): stderr: | 20221210090303956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090303956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090303956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090303957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090303957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090303957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090303957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:05.465603 run osmo-stp_10.42.42.5(pid=20601): stdout: | (launched: 2022-12-10_09:03:03.761509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:05.595217 run osmo-stp_10.42.42.5(pid=20601): stderr: | 20221210090303956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090303956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090303956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090303957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090303957 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090303957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090303957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:05.748737 run patchelf(pid=20604): Terminating (SIGINT) 09:03:05.926400 run patchelf(pid=20604): Terminated: ok {rc=0} 09:03:06.054496 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20601): Process ended prematurely: osmo-stp_10.42.42.5(pid=20601) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:03:06.063830 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:03:06.091308 run osmo-hlr_10.42.42.2(pid=20598): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20598)] 09:03:06.140494 run osmo-hlr_10.42.42.2(pid=20598): stdout: | (launched: 2022-12-10_09:03:02.774277) 09:03:06.191503 run osmo-hlr_10.42.42.2(pid=20598): stderr: | 20221210090302973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090302973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090302973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090302973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090302973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090302973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090302986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090302994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090302995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090302995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:06.242844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Terminating (SIGTERM) 09:03:06.283921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Terminating (SIGTERM) 09:03:06.325170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20603): Terminating (SIGTERM) 09:03:06.366410 --- ParallelTerminationStrategy: PID 20597 died... 09:03:06.386099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Terminated: ok {rc=0} 09:03:06.431824 --- ParallelTerminationStrategy: PID 20600 died... 09:03:06.451014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Terminated: ok {rc=0} 09:03:06.496297 --- ParallelTerminationStrategy: PID 20603 died... 09:03:06.515492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20603): Terminated: ok {rc=0} 09:03:06.602252 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:03:07.910885 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:03:07.917518 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:03:07.950583 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:03:07.990167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:03:08.076940 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:03:08.110286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:03:08.149620 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:03:08.743166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:03:08.792197 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:08.803224 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:08.871490 tst cs_paging_gprs_active.py: using LAC 27310 09:03:08.988244 tst cs_paging_gprs_active.py: using RAC 25 09:03:09.105393 tst cs_paging_gprs_active.py: using CellId 27310 09:03:09.221933 tst cs_paging_gprs_active.py: using BVCI 27311 09:03:09.333593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.344641 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.355341 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.366907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.377900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.388901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.400070 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.411097 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:09.422569 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:09.540468 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:09.664918 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:03:09.883734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:10.206333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Launched 09:03:10.484737 run iperf3-srv_10.42.42.10(pid=20609): Launched 09:03:10.605559 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:03:10.822413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:11.144122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Launched 09:03:11.422803 run iperf3-srv_10.42.42.10(pid=20611): Launched 09:03:11.543887 tst cs_paging_gprs_active.py:38: start network... 09:03:11.760943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:12.259742 run create_hlr_db(pid=20612): Launched 09:03:12.390295 bus /gobi_6: Setting Powered False 09:03:13.454246 run create_hlr_db(pid=20612): Terminated: ok {rc=0} 09:03:13.901947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20614): Launched 09:03:14.221625 run osmo-hlr_10.42.42.2(pid=20615): Launched 09:03:14.343741 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:14.898168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20617): Launched 09:03:15.216660 run osmo-stp_10.42.42.5(pid=20618): Launched 09:03:15.338130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:15.893248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20620): Launched 09:03:16.041133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:16.354456 run patchelf(pid=20621): Launched 09:03:16.536111 run osmo-stp_10.42.42.5(pid=20618): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20618)] 09:03:16.671270 run osmo-stp_10.42.42.5(pid=20618): stdout: | (launched: 2022-12-10_09:03:15.158518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:16.807543 run osmo-stp_10.42.42.5(pid=20618): stderr: | 20221210090315351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090315351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090315351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090315352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090315352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090315352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090315352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:16.941376 run osmo-stp_10.42.42.5(pid=20618): stdout: | (launched: 2022-12-10_09:03:15.158518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:17.074186 run osmo-stp_10.42.42.5(pid=20618): stderr: | 20221210090315351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090315351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090315351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090315352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090315352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090315352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090315352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:17.227271 run patchelf(pid=20621): Terminating (SIGINT) 09:03:17.399593 run patchelf(pid=20621): Terminated: ok {rc=0} 09:03:17.523641 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20618): Process ended prematurely: osmo-stp_10.42.42.5(pid=20618) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20618)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:03:17.533324 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:03:17.560525 run osmo-hlr_10.42.42.2(pid=20615): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20615)] 09:03:17.608476 run osmo-hlr_10.42.42.2(pid=20615): stdout: | (launched: 2022-12-10_09:03:14.163407) 09:03:17.657926 run osmo-hlr_10.42.42.2(pid=20615): stderr: | 20221210090314361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090314361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090314361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090314361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090314361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090314361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090314374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090314382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090314382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090314382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:17.707701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Terminating (SIGTERM) 09:03:17.746986 run iperf3-srv_10.42.42.10(pid=20609): Terminating (SIGTERM) 09:03:17.786833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Terminating (SIGTERM) 09:03:17.826448 run iperf3-srv_10.42.42.10(pid=20611): Terminating (SIGTERM) 09:03:17.866049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20614): Terminating (SIGTERM) 09:03:17.905795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20617): Terminating (SIGTERM) 09:03:17.945592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20620): Terminating (SIGTERM) 09:03:17.985570 --- ParallelTerminationStrategy: PID 20608 died... 09:03:18.004378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20608): Terminated: ok {rc=0} 09:03:18.048591 --- ParallelTerminationStrategy: PID 20609 died... 09:03:18.067107 run iperf3-srv_10.42.42.10(pid=20609): Terminated {rc=256} 09:03:18.111105 --- ParallelTerminationStrategy: PID 20610 died... 09:03:18.129578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20610): Terminated: ok {rc=0} 09:03:18.173692 --- ParallelTerminationStrategy: PID 20611 died... 09:03:18.192148 run iperf3-srv_10.42.42.10(pid=20611): Terminated {rc=256} 09:03:18.236720 --- ParallelTerminationStrategy: PID 20614 died... 09:03:18.255228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20614): Terminated: ok {rc=0} 09:03:18.299536 --- ParallelTerminationStrategy: PID 20617 died... 09:03:18.318241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20617): Terminated: ok {rc=0} 09:03:18.362876 --- ParallelTerminationStrategy: PID 20620 died... 09:03:18.381393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20620): Terminated: ok {rc=0} 09:03:18.466989 bus /gobi_0: Setting Powered False 09:03:19.565864 bus /gobi_0: Setting Powered False 09:03:20.680374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:03:21.824641 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:21.836152 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:21.905693 tst iperf3.py: using LAC 27311 09:03:22.033166 tst iperf3.py: using RAC 26 09:03:22.160811 tst iperf3.py: using CellId 27311 09:03:22.286671 tst iperf3.py: using BVCI 27312 09:03:22.404615 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.415986 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.427146 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.438298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.449355 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.460498 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.471736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.482849 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:22.494086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:22.609297 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:03:22.826684 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:23.148344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20622): Launched 09:03:23.426081 run iperf3-srv_10.42.42.10(pid=20623): Launched 09:03:23.546612 tst iperf3.py:8: start network... 09:03:23.764069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:24.261229 run create_hlr_db(pid=20624): Launched 09:03:24.391441 bus /gobi_6: Setting Powered False 09:03:25.454392 run create_hlr_db(pid=20624): Terminated: ok {rc=0} 09:03:25.886378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Launched 09:03:26.187763 run osmo-hlr_10.42.42.2(pid=20627): Launched 09:03:26.303969 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:26.841821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Launched 09:03:27.144372 run osmo-stp_10.42.42.5(pid=20630): Launched 09:03:27.260186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:27.784303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20632): Launched 09:03:27.899774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:28.156113 run patchelf(pid=20633): Launched 09:03:28.324403 run osmo-stp_10.42.42.5(pid=20630): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] 09:03:28.452454 run osmo-stp_10.42.42.5(pid=20630): stdout: | (launched: 2022-12-10_09:03:27.089176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:28.581943 run osmo-stp_10.42.42.5(pid=20630): stderr: | 20221210090327261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090327261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090327261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090327262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090327262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090327262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090327262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:28.711746 run osmo-stp_10.42.42.5(pid=20630): stdout: | (launched: 2022-12-10_09:03:27.089176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:28.836063 run osmo-stp_10.42.42.5(pid=20630): stderr: | 20221210090327261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090327261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090327261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090327262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090327262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090327262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090327262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:28.983492 run patchelf(pid=20633): Terminating (SIGINT) 09:03:29.153640 run patchelf(pid=20633): Terminated: ok {rc=0} 09:03:29.276408 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20630): Process ended prematurely: osmo-stp_10.42.42.5(pid=20630) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 09:03:29.285757 tst iperf3.py:8: Test FAILED (7.5 sec) 09:03:29.312762 run osmo-hlr_10.42.42.2(pid=20627): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20627)] 09:03:29.360384 run osmo-hlr_10.42.42.2(pid=20627): stdout: | (launched: 2022-12-10_09:03:26.133092) 09:03:29.410198 run osmo-hlr_10.42.42.2(pid=20627): stderr: | 20221210090326310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090326310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090326310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090326310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090326310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090326310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090326323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090326332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090326332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090326332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:29.459880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20622): Terminating (SIGTERM) 09:03:29.499540 run iperf3-srv_10.42.42.10(pid=20623): Terminating (SIGTERM) 09:03:29.539100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Terminating (SIGTERM) 09:03:29.578916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Terminating (SIGTERM) 09:03:29.618804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20632): Terminating (SIGTERM) 09:03:29.658857 --- ParallelTerminationStrategy: PID 20622 died... 09:03:29.677888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20622): Terminated: ok {rc=0} 09:03:29.722293 --- ParallelTerminationStrategy: PID 20623 died... 09:03:29.740692 run iperf3-srv_10.42.42.10(pid=20623): Terminated {rc=256} 09:03:29.784750 --- ParallelTerminationStrategy: PID 20626 died... 09:03:29.803255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20626): Terminated: ok {rc=0} 09:03:29.847057 --- ParallelTerminationStrategy: PID 20629 died... 09:03:29.865493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20629): Terminated: ok {rc=0} 09:03:29.909380 --- ParallelTerminationStrategy: PID 20632 died... 09:03:29.927832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20632): Terminated: ok {rc=0} 09:03:30.013496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:03:31.160332 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.172824 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:31.245308 tst iperf3m4.py: using LAC 27312 09:03:31.376576 tst iperf3m4.py: using RAC 27 09:03:31.506810 tst iperf3m4.py: using CellId 27312 09:03:31.638320 tst iperf3m4.py: using BVCI 27313 09:03:31.786603 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.800120 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.814618 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.829601 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.845648 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.861442 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.876831 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.892696 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:31.908886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:32.029449 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:32.172910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:32.302207 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:32.421287 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:03:32.624575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:32.927871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20634): Launched 09:03:33.190482 run iperf3-srv_10.42.42.10(pid=20635): Launched 09:03:33.303479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:03:33.506510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:33.811503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20636): Launched 09:03:34.074270 run iperf3-srv_10.42.42.10(pid=20637): Launched 09:03:34.187458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:03:34.389810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:34.693537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20638): Launched 09:03:34.956041 run iperf3-srv_10.42.42.10(pid=20639): Launched 09:03:35.069161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:03:35.271572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:03:35.574051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20640): Launched 09:03:35.837050 run iperf3-srv_10.42.42.10(pid=20641): Launched 09:03:35.950250 tst iperf3m4.py:8: start network... 09:03:36.153392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:36.622375 run create_hlr_db(pid=20642): Launched 09:03:36.737838 bus /gobi_6: Setting Powered False 09:03:37.797447 run create_hlr_db(pid=20642): Terminated: ok {rc=0} 09:03:38.237068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Launched 09:03:38.556941 run osmo-hlr_10.42.42.2(pid=20645): Launched 09:03:38.680870 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:39.238794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Launched 09:03:39.558946 run osmo-stp_10.42.42.5(pid=20648): Launched 09:03:39.683134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:40.241446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20650): Launched 09:03:40.363273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:40.634127 run patchelf(pid=20651): Launched 09:03:40.812275 run osmo-stp_10.42.42.5(pid=20648): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] 09:03:40.947711 run osmo-stp_10.42.42.5(pid=20648): stdout: | (launched: 2022-12-10_09:03:39.500505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:41.084738 run osmo-stp_10.42.42.5(pid=20648): stderr: | 20221210090339693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090339693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090339694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090339694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090339695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090339695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090339695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:41.221884 run osmo-stp_10.42.42.5(pid=20648): stdout: | (launched: 2022-12-10_09:03:39.500505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:41.353645 run osmo-stp_10.42.42.5(pid=20648): stderr: | 20221210090339693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090339693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090339694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090339694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090339695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090339695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090339695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:41.509659 run patchelf(pid=20651): Terminating (SIGINT) 09:03:41.690093 run patchelf(pid=20651): Terminated: ok {rc=0} 09:03:41.820654 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20648): Process ended prematurely: osmo-stp_10.42.42.5(pid=20648) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:03:41.830703 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:03:41.858761 run osmo-hlr_10.42.42.2(pid=20645): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20645)] 09:03:41.908356 run osmo-hlr_10.42.42.2(pid=20645): stdout: | (launched: 2022-12-10_09:03:38.498593) 09:03:41.959556 run osmo-hlr_10.42.42.2(pid=20645): stderr: | 20221210090338698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090338699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090338699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090338699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090338699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090338699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090338711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090338720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090338720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090338720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:42.011075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20634): Terminating (SIGTERM) 09:03:42.052451 run iperf3-srv_10.42.42.10(pid=20635): Terminating (SIGTERM) 09:03:42.094026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20636): Terminating (SIGTERM) 09:03:42.135289 run iperf3-srv_10.42.42.10(pid=20637): Terminating (SIGTERM) 09:03:42.176471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20638): Terminating (SIGTERM) 09:03:42.217932 run iperf3-srv_10.42.42.10(pid=20639): Terminating (SIGTERM) 09:03:42.259158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20640): Terminating (SIGTERM) 09:03:42.300513 run iperf3-srv_10.42.42.10(pid=20641): Terminating (SIGTERM) 09:03:42.341792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Terminating (SIGTERM) 09:03:42.383106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Terminating (SIGTERM) 09:03:42.424362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20650): Terminating (SIGTERM) 09:03:42.466113 --- ParallelTerminationStrategy: PID 20634 died... 09:03:42.485750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20634): Terminated: ok {rc=0} 09:03:42.531428 --- ParallelTerminationStrategy: PID 20635 died... 09:03:42.550747 run iperf3-srv_10.42.42.10(pid=20635): Terminated {rc=256} 09:03:42.596311 --- ParallelTerminationStrategy: PID 20636 died... 09:03:42.615559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20636): Terminated: ok {rc=0} 09:03:42.661349 --- ParallelTerminationStrategy: PID 20637 died... 09:03:42.680849 run iperf3-srv_10.42.42.10(pid=20637): Terminated {rc=256} 09:03:42.726833 --- ParallelTerminationStrategy: PID 20638 died... 09:03:42.746066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20638): Terminated: ok {rc=0} 09:03:42.791789 --- ParallelTerminationStrategy: PID 20639 died... 09:03:42.811158 run iperf3-srv_10.42.42.10(pid=20639): Terminated {rc=256} 09:03:42.856716 --- ParallelTerminationStrategy: PID 20640 died... 09:03:42.876052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20640): Terminated: ok {rc=0} 09:03:42.921740 --- ParallelTerminationStrategy: PID 20641 died... 09:03:42.941094 run iperf3-srv_10.42.42.10(pid=20641): Terminated {rc=256} 09:03:42.986651 --- ParallelTerminationStrategy: PID 20644 died... 09:03:43.006089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20644): Terminated: ok {rc=0} 09:03:43.051742 --- ParallelTerminationStrategy: PID 20647 died... 09:03:43.071076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20647): Terminated: ok {rc=0} 09:03:43.116838 --- ParallelTerminationStrategy: PID 20650 died... 09:03:43.136526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20650): Terminated: ok {rc=0} 09:03:43.222298 bus /gobi_4: Setting Powered False 09:03:44.319970 bus /gobi_4: Setting Powered False 09:03:45.434378 bus /gobi_1: Setting Powered False 09:03:46.529169 bus /gobi_1: Setting Powered False 09:03:47.643374 bus /gobi_0: Setting Powered False 09:03:48.741807 bus /gobi_0: Setting Powered False 09:03:49.857022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:03:50.958966 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:50.970809 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:51.044511 tst ping.py: using LAC 27313 09:03:51.167589 tst ping.py: using RAC 28 09:03:51.289396 tst ping.py: using CellId 27313 09:03:51.411220 tst ping.py: using BVCI 27314 09:03:51.525447 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.536683 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.547926 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.559096 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.570244 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.581466 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.592662 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:51.603821 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:51.722622 tst ping.py:19: start network... 09:03:51.934276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:03:52.421286 run create_hlr_db(pid=20652): Launched 09:03:52.548371 bus /gobi_6: Setting Powered False 09:03:53.611509 run create_hlr_db(pid=20652): Terminated: ok {rc=0} 09:03:54.035233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20654): Launched 09:03:54.331166 run osmo-hlr_10.42.42.2(pid=20655): Launched 09:03:54.444783 run osmo-stp_10.42.42.5: Starting osmo-stp 09:03:54.974759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20657): Launched 09:03:55.268758 run osmo-stp_10.42.42.5(pid=20658): Launched 09:03:55.381560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:03:55.892591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20660): Launched 09:03:56.006742 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:03:56.258282 run patchelf(pid=20661): Launched 09:03:56.423352 run osmo-stp_10.42.42.5(pid=20658): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20658)] 09:03:56.549547 run osmo-stp_10.42.42.5(pid=20658): stdout: | (launched: 2022-12-10_09:03:55.214814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:56.677253 run osmo-stp_10.42.42.5(pid=20658): stderr: | 20221210090355384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090355384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090355384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090355384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090355385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090355385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090355385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:56.805540 run osmo-stp_10.42.42.5(pid=20658): stdout: | (launched: 2022-12-10_09:03:55.214814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:03:56.927727 run osmo-stp_10.42.42.5(pid=20658): stderr: | 20221210090355384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090355384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090355384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090355384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090355385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090355385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090355385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:03:57.072578 run patchelf(pid=20661): Terminating (SIGINT) 09:03:57.240444 run patchelf(pid=20661): Terminated: ok {rc=0} 09:03:57.360766 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20658): Process ended prematurely: osmo-stp_10.42.42.5(pid=20658) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20658)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 09:03:57.369571 tst ping.py:22: Test FAILED (6.4 sec) 09:03:57.396458 run osmo-hlr_10.42.42.2(pid=20655): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20655)] 09:03:57.443411 run osmo-hlr_10.42.42.2(pid=20655): stdout: | (launched: 2022-12-10_09:03:54.276875) 09:03:57.492095 run osmo-hlr_10.42.42.2(pid=20655): stderr: | 20221210090354452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090354452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090354452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090354452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090354452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090354452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090354464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090354473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090354473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090354473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:03:57.541311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20654): Terminating (SIGTERM) 09:03:57.580856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20657): Terminating (SIGTERM) 09:03:57.620536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20660): Terminating (SIGTERM) 09:03:57.660404 --- ParallelTerminationStrategy: PID 20654 died... 09:03:57.679312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20654): Terminated: ok {rc=0} 09:03:57.723343 --- ParallelTerminationStrategy: PID 20657 died... 09:03:57.741849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20657): Terminated: ok {rc=0} 09:03:57.786142 --- ParallelTerminationStrategy: PID 20660 died... 09:03:57.805022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20660): Terminated: ok {rc=0} 09:03:57.888033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:03:58.973211 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:58.985613 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:03:59.060646 tst ping_idle_ping.py: using LAC 27314 09:03:59.186276 tst ping_idle_ping.py: using RAC 29 09:03:59.310877 tst ping_idle_ping.py: using CellId 27314 09:03:59.439637 tst ping_idle_ping.py: using BVCI 27315 09:03:59.556514 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.567923 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.579234 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.590447 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.601548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.612657 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.623927 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:03:59.635171 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:03:59.755710 tst ping_idle_ping.py:24: start network... 09:03:59.970115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:00.458297 run create_hlr_db(pid=20662): Launched 09:04:00.586235 bus /gobi_6: Setting Powered False 09:04:01.662384 run create_hlr_db(pid=20662): Terminated: ok {rc=0} 09:04:02.100096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Launched 09:04:02.449416 run osmo-hlr_10.42.42.2(pid=20665): Launched 09:04:02.569302 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:03.118830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Launched 09:04:03.418302 run osmo-stp_10.42.42.5(pid=20668): Launched 09:04:03.531764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:04.047654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20670): Launched 09:04:04.161839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:04.414378 run patchelf(pid=20671): Launched 09:04:04.580396 run osmo-stp_10.42.42.5(pid=20668): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] 09:04:04.707076 run osmo-stp_10.42.42.5(pid=20668): stdout: | (launched: 2022-12-10_09:04:03.364095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:04.835407 run osmo-stp_10.42.42.5(pid=20668): stderr: | 20221210090403533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090403533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090403533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090403533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090403534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090403534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090403534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:04.963991 run osmo-stp_10.42.42.5(pid=20668): stdout: | (launched: 2022-12-10_09:04:03.364095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:05.087530 run osmo-stp_10.42.42.5(pid=20668): stderr: | 20221210090403533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090403533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090403533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090403533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090403534 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090403534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090403534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:05.233606 run patchelf(pid=20671): Terminating (SIGINT) 09:04:05.402081 run patchelf(pid=20671): Terminated: ok {rc=0} 09:04:05.523949 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20668): Process ended prematurely: osmo-stp_10.42.42.5(pid=20668) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:04:05.533026 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:04:05.560083 run osmo-hlr_10.42.42.2(pid=20665): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20665)] 09:04:05.607369 run osmo-hlr_10.42.42.2(pid=20665): stdout: | (launched: 2022-12-10_09:04:02.392052) 09:04:05.656682 run osmo-hlr_10.42.42.2(pid=20665): stderr: | 20221210090402591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090402591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090402591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090402591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090402591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090402591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090402603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090402611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090402612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090402612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:05.706446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Terminating (SIGTERM) 09:04:05.746090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Terminating (SIGTERM) 09:04:05.785774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20670): Terminating (SIGTERM) 09:04:05.825763 --- ParallelTerminationStrategy: PID 20664 died... 09:04:05.844725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Terminated: ok {rc=0} 09:04:05.889315 --- ParallelTerminationStrategy: PID 20667 died... 09:04:05.907807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Terminated: ok {rc=0} 09:04:05.952015 --- ParallelTerminationStrategy: PID 20670 died... 09:04:05.970681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20670): Terminated: ok {rc=0} 09:04:06.055947 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:04:07.355682 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:04:07.362295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:04:07.395475 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:04:07.433860 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:04:07.520011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:04:07.552396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:04:07.590747 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:04:08.196038 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:04:08.245701 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.256838 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:08.309824 tst cs_paging_gprs_active.py: using LAC 27315 09:04:08.429764 tst cs_paging_gprs_active.py: using RAC 30 09:04:08.549316 tst cs_paging_gprs_active.py: using CellId 27315 09:04:08.675817 tst cs_paging_gprs_active.py: using BVCI 27316 09:04:08.792707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.804311 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.815774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.827245 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.838773 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.850208 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.861748 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.873136 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:08.884805 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:09.004706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:09.121135 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:04:09.325818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:09.634508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20675): Launched 09:04:09.902289 run iperf3-srv_10.42.42.10(pid=20676): Launched 09:04:10.016027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:04:10.219698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:10.527465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20677): Launched 09:04:10.794093 run iperf3-srv_10.42.42.10(pid=20678): Launched 09:04:10.907899 tst cs_paging_gprs_active.py:38: start network... 09:04:11.111117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:11.585536 run create_hlr_db(pid=20679): Launched 09:04:11.702213 bus /gobi_6: Setting Powered False 09:04:12.762602 run create_hlr_db(pid=20679): Terminated: ok {rc=0} 09:04:13.221976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20681): Launched 09:04:13.548784 run osmo-hlr_10.42.42.2(pid=20682): Launched 09:04:13.672631 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:14.234495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20684): Launched 09:04:14.560649 run osmo-stp_10.42.42.5(pid=20685): Launched 09:04:14.684064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:15.244155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20687): Launched 09:04:15.366709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:15.642438 run patchelf(pid=20688): Launched 09:04:15.821254 run osmo-stp_10.42.42.5(pid=20685): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20685)] 09:04:15.994907 run osmo-stp_10.42.42.5(pid=20685): stdout: | (launched: 2022-12-10_09:04:14.496728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:16.162160 run osmo-stp_10.42.42.5(pid=20685): stderr: | 20221210090414694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090414694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090414695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090414695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090414696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090414696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090414696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:16.303312 run osmo-stp_10.42.42.5(pid=20685): stdout: | (launched: 2022-12-10_09:04:14.496728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:16.434857 run osmo-stp_10.42.42.5(pid=20685): stderr: | 20221210090414694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090414694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090414695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090414695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090414696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090414696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090414696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:16.588491 run patchelf(pid=20688): Terminating (SIGINT) 09:04:16.766853 run patchelf(pid=20688): Terminated: ok {rc=0} 09:04:16.909945 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20685): Process ended prematurely: osmo-stp_10.42.42.5(pid=20685) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20685)] [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:04:16.924729 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:04:16.959399 run osmo-hlr_10.42.42.2(pid=20682): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20682)] 09:04:17.023131 run osmo-hlr_10.42.42.2(pid=20682): stdout: | (launched: 2022-12-10_09:04:13.485130) 09:04:17.085729 run osmo-hlr_10.42.42.2(pid=20682): stderr: | 20221210090413688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090413688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090413688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090413689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090413689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090413689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090413702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090413710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090413710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090413710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:17.142259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20675): Terminating (SIGTERM) 09:04:17.185168 run iperf3-srv_10.42.42.10(pid=20676): Terminating (SIGTERM) 09:04:17.238569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20677): Terminating (SIGTERM) 09:04:17.280429 run iperf3-srv_10.42.42.10(pid=20678): Terminating (SIGTERM) 09:04:17.322096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20681): Terminating (SIGTERM) 09:04:17.362514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20684): Terminating (SIGTERM) 09:04:17.402724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20687): Terminating (SIGTERM) 09:04:17.443226 --- ParallelTerminationStrategy: PID 20675 died... 09:04:17.461778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20675): Terminated: ok {rc=0} 09:04:17.507145 --- ParallelTerminationStrategy: PID 20676 died... 09:04:17.525718 run iperf3-srv_10.42.42.10(pid=20676): Terminated {rc=256} 09:04:17.570980 --- ParallelTerminationStrategy: PID 20677 died... 09:04:17.589531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20677): Terminated: ok {rc=0} 09:04:17.634663 --- ParallelTerminationStrategy: PID 20678 died... 09:04:17.653159 run iperf3-srv_10.42.42.10(pid=20678): Terminated {rc=256} 09:04:17.698068 --- ParallelTerminationStrategy: PID 20681 died... 09:04:17.716626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20681): Terminated: ok {rc=0} 09:04:17.761863 --- ParallelTerminationStrategy: PID 20684 died... 09:04:17.780456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20684): Terminated: ok {rc=0} 09:04:17.825738 --- ParallelTerminationStrategy: PID 20687 died... 09:04:17.844240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20687): Terminated: ok {rc=0} 09:04:17.930469 bus /gobi_0: Setting Powered False 09:04:19.029328 bus /gobi_0: Setting Powered False 09:04:20.145050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:04:21.290291 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.302214 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:21.356412 tst iperf3.py: using LAC 27316 09:04:21.475297 tst iperf3.py: using RAC 31 09:04:21.597371 tst iperf3.py: using CellId 27316 09:04:21.716850 tst iperf3.py: using BVCI 27317 09:04:21.834761 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.846445 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.858186 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.869716 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.881147 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.893310 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.904760 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.916200 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:21.927817 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:22.047720 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:22.265815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:22.592936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20689): Launched 09:04:22.876830 run iperf3-srv_10.42.42.10(pid=20690): Launched 09:04:22.996925 tst iperf3.py:8: start network... 09:04:23.214057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:23.716771 run create_hlr_db(pid=20691): Launched 09:04:23.846618 bus /gobi_6: Setting Powered False 09:04:24.909943 run create_hlr_db(pid=20691): Terminated: ok {rc=0} 09:04:25.344235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20693): Launched 09:04:25.650905 run osmo-hlr_10.42.42.2(pid=20694): Launched 09:04:25.768560 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:26.307564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20696): Launched 09:04:26.613594 run osmo-stp_10.42.42.5(pid=20697): Launched 09:04:26.729903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:27.261676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20699): Launched 09:04:27.377615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:27.637510 run patchelf(pid=20700): Launched 09:04:27.806159 run osmo-stp_10.42.42.5(pid=20697): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20697)] 09:04:27.934826 run osmo-stp_10.42.42.5(pid=20697): stdout: | (launched: 2022-12-10_09:04:26.554185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:28.065476 run osmo-stp_10.42.42.5(pid=20697): stderr: | 20221210090426728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090426728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090426728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090426729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090426729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090426729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090426729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:28.195808 run osmo-stp_10.42.42.5(pid=20697): stdout: | (launched: 2022-12-10_09:04:26.554185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:28.320561 run osmo-stp_10.42.42.5(pid=20697): stderr: | 20221210090426728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090426728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090426728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090426729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090426729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090426729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090426729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:28.468436 run patchelf(pid=20700): Terminating (SIGINT) 09:04:28.639553 run patchelf(pid=20700): Terminated: ok {rc=0} 09:04:28.763131 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20697): Process ended prematurely: osmo-stp_10.42.42.5(pid=20697) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20697)] [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:04:28.772364 tst iperf3.py:8: Test FAILED (7.5 sec) 09:04:28.799411 run osmo-hlr_10.42.42.2(pid=20694): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20694)] 09:04:28.847624 run osmo-hlr_10.42.42.2(pid=20694): stdout: | (launched: 2022-12-10_09:04:25.592323) 09:04:28.896778 run osmo-hlr_10.42.42.2(pid=20694): stderr: | 20221210090425769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090425769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090425769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090425769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090425769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090425769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090425781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090425789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090425789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090425789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:28.946498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20689): Terminating (SIGTERM) 09:04:28.986157 run iperf3-srv_10.42.42.10(pid=20690): Terminating (SIGTERM) 09:04:29.025708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20693): Terminating (SIGTERM) 09:04:29.065499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20696): Terminating (SIGTERM) 09:04:29.105258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20699): Terminating (SIGTERM) 09:04:29.144939 --- ParallelTerminationStrategy: PID 20689 died... 09:04:29.163741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20689): Terminated: ok {rc=0} 09:04:29.207658 --- ParallelTerminationStrategy: PID 20690 died... 09:04:29.225980 run iperf3-srv_10.42.42.10(pid=20690): Terminated {rc=256} 09:04:29.269473 --- ParallelTerminationStrategy: PID 20693 died... 09:04:29.287774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20693): Terminated: ok {rc=0} 09:04:29.331372 --- ParallelTerminationStrategy: PID 20696 died... 09:04:29.349866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20696): Terminated: ok {rc=0} 09:04:29.393660 --- ParallelTerminationStrategy: PID 20699 died... 09:04:29.411932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20699): Terminated: ok {rc=0} 09:04:29.495520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:04:30.642951 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:30.655321 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:30.709648 tst iperf3m4.py: using LAC 27317 09:04:30.838270 tst iperf3m4.py: using RAC 32 09:04:30.988529 tst iperf3m4.py: using CellId 27317 09:04:31.125105 tst iperf3m4.py: using BVCI 27318 09:04:31.240348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.252067 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.263488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.276006 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.290384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.303661 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.315945 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.328713 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:31.343392 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:31.463703 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:31.589202 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:31.713168 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:31.845782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:04:32.068317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:32.387666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20701): Launched 09:04:32.655651 run iperf3-srv_10.42.42.10(pid=20702): Launched 09:04:32.770069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:04:32.974078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:33.282936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20703): Launched 09:04:33.550212 run iperf3-srv_10.42.42.10(pid=20704): Launched 09:04:33.664102 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:04:33.867758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:34.176584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20705): Launched 09:04:34.444058 run iperf3-srv_10.42.42.10(pid=20706): Launched 09:04:34.557735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:04:34.761268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:04:35.069953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20707): Launched 09:04:35.337368 run iperf3-srv_10.42.42.10(pid=20708): Launched 09:04:35.451364 tst iperf3m4.py:8: start network... 09:04:35.654722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:36.129939 run create_hlr_db(pid=20709): Launched 09:04:36.246163 bus /gobi_6: Setting Powered False 09:04:37.306195 run create_hlr_db(pid=20709): Terminated: ok {rc=0} 09:04:37.733813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20711): Launched 09:04:38.041358 run osmo-hlr_10.42.42.2(pid=20712): Launched 09:04:38.158818 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:38.686157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20714): Launched 09:04:38.992552 run osmo-stp_10.42.42.5(pid=20715): Launched 09:04:39.108832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:39.638042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20717): Launched 09:04:39.754172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:40.014846 run patchelf(pid=20718): Launched 09:04:40.184305 run osmo-stp_10.42.42.5(pid=20715): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20715)] 09:04:40.313226 run osmo-stp_10.42.42.5(pid=20715): stdout: | (launched: 2022-12-10_09:04:38.933300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:40.443160 run osmo-stp_10.42.42.5(pid=20715): stderr: | 20221210090439108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090439108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090439108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090439109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090439109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090439109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090439109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:40.573405 run osmo-stp_10.42.42.5(pid=20715): stdout: | (launched: 2022-12-10_09:04:38.933300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:40.698593 run osmo-stp_10.42.42.5(pid=20715): stderr: | 20221210090439108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090439108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090439108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090439109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090439109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090439109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090439109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:40.846975 run patchelf(pid=20718): Terminating (SIGINT) 09:04:41.016935 run patchelf(pid=20718): Terminated: ok {rc=0} 09:04:41.140216 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20715): Process ended prematurely: osmo-stp_10.42.42.5(pid=20715) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20715)] [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:04:41.149681 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:04:41.177259 run osmo-hlr_10.42.42.2(pid=20712): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20712)] 09:04:41.224544 run osmo-hlr_10.42.42.2(pid=20712): stdout: | (launched: 2022-12-10_09:04:37.982021) 09:04:41.273567 run osmo-hlr_10.42.42.2(pid=20712): stderr: | 20221210090438164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090438164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090438164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090438164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090438164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090438164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090438180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090438189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090438189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090438189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:41.322827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20701): Terminating (SIGTERM) 09:04:41.362218 run iperf3-srv_10.42.42.10(pid=20702): Terminating (SIGTERM) 09:04:41.401309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20703): Terminating (SIGTERM) 09:04:41.440542 run iperf3-srv_10.42.42.10(pid=20704): Terminating (SIGTERM) 09:04:41.479570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20705): Terminating (SIGTERM) 09:04:41.518836 run iperf3-srv_10.42.42.10(pid=20706): Terminating (SIGTERM) 09:04:41.557927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20707): Terminating (SIGTERM) 09:04:41.597115 run iperf3-srv_10.42.42.10(pid=20708): Terminating (SIGTERM) 09:04:41.636474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20711): Terminating (SIGTERM) 09:04:41.675366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20714): Terminating (SIGTERM) 09:04:41.714194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20717): Terminating (SIGTERM) 09:04:41.753246 --- ParallelTerminationStrategy: PID 20701 died... 09:04:41.772007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20701): Terminated: ok {rc=0} 09:04:41.815695 --- ParallelTerminationStrategy: PID 20702 died... 09:04:41.833838 run iperf3-srv_10.42.42.10(pid=20702): Terminated {rc=256} 09:04:41.877325 --- ParallelTerminationStrategy: PID 20703 died... 09:04:41.895828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20703): Terminated: ok {rc=0} 09:04:41.939536 --- ParallelTerminationStrategy: PID 20704 died... 09:04:41.957761 run iperf3-srv_10.42.42.10(pid=20704): Terminated {rc=256} 09:04:42.001467 --- ParallelTerminationStrategy: PID 20705 died... 09:04:42.019700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20705): Terminated: ok {rc=0} 09:04:42.063595 --- ParallelTerminationStrategy: PID 20706 died... 09:04:42.081845 run iperf3-srv_10.42.42.10(pid=20706): Terminated {rc=256} 09:04:42.125231 --- ParallelTerminationStrategy: PID 20707 died... 09:04:42.143494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20707): Terminated: ok {rc=0} 09:04:42.187470 --- ParallelTerminationStrategy: PID 20708 died... 09:04:42.205753 run iperf3-srv_10.42.42.10(pid=20708): Terminated {rc=256} 09:04:42.248915 --- ParallelTerminationStrategy: PID 20711 died... 09:04:42.267616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20711): Terminated: ok {rc=0} 09:04:42.311100 --- ParallelTerminationStrategy: PID 20714 died... 09:04:42.329510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20714): Terminated: ok {rc=0} 09:04:42.373173 --- ParallelTerminationStrategy: PID 20717 died... 09:04:42.391450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20717): Terminated: ok {rc=0} 09:04:42.476233 bus /gobi_4: Setting Powered False 09:04:43.575179 bus /gobi_4: Setting Powered False 09:04:44.690343 bus /gobi_1: Setting Powered False 09:04:45.788461 bus /gobi_1: Setting Powered False 09:04:46.916400 bus /gobi_0: Setting Powered False 09:04:48.015040 bus /gobi_0: Setting Powered False 09:04:49.131357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:04:50.233598 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.246167 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:50.299433 tst ping.py: using LAC 27318 09:04:50.425086 tst ping.py: using RAC 33 09:04:50.550278 tst ping.py: using CellId 27318 09:04:50.675847 tst ping.py: using BVCI 27319 09:04:50.791080 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.802927 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.814448 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.826006 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.838083 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.849808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.861670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:50.873182 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:50.991253 tst ping.py:19: start network... 09:04:51.202945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:51.694255 run create_hlr_db(pid=20721): Launched 09:04:51.821730 bus /gobi_6: Setting Powered False 09:04:52.884186 run create_hlr_db(pid=20721): Terminated: ok {rc=0} 09:04:53.312367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20723): Launched 09:04:53.614817 run osmo-hlr_10.42.42.2(pid=20724): Launched 09:04:53.729144 run osmo-stp_10.42.42.5: Starting osmo-stp 09:04:54.263019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20726): Launched 09:04:54.564638 run osmo-stp_10.42.42.5(pid=20727): Launched 09:04:54.678497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:04:55.195404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20729): Launched 09:04:55.309667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:04:55.566130 run patchelf(pid=20730): Launched 09:04:55.732062 run osmo-stp_10.42.42.5(pid=20727): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20727)] 09:04:55.858591 run osmo-stp_10.42.42.5(pid=20727): stdout: | (launched: 2022-12-10_09:04:54.506232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:55.986251 run osmo-stp_10.42.42.5(pid=20727): stderr: | 20221210090454680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090454680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090454680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090454681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090454681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090454681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090454681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:56.114087 run osmo-stp_10.42.42.5(pid=20727): stdout: | (launched: 2022-12-10_09:04:54.506232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:04:56.236237 run osmo-stp_10.42.42.5(pid=20727): stderr: | 20221210090454680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090454680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090454680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090454681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090454681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090454681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090454681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:04:56.381850 run patchelf(pid=20730): Terminating (SIGINT) 09:04:56.549347 run patchelf(pid=20730): Terminated: ok {rc=0} 09:04:56.670893 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20727): Process ended prematurely: osmo-stp_10.42.42.5(pid=20727) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20727)] [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:04:56.679629 tst ping.py:22: Test FAILED (6.4 sec) 09:04:56.706037 run osmo-hlr_10.42.42.2(pid=20724): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20724)] 09:04:56.753380 run osmo-hlr_10.42.42.2(pid=20724): stdout: | (launched: 2022-12-10_09:04:53.555614) 09:04:56.802105 run osmo-hlr_10.42.42.2(pid=20724): stderr: | 20221210090453735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090453735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090453735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090453735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090453735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090453735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090453747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090453755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090453756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090453756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:04:56.851393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20723): Terminating (SIGTERM) 09:04:56.890769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20726): Terminating (SIGTERM) 09:04:56.930146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20729): Terminating (SIGTERM) 09:04:56.969675 --- ParallelTerminationStrategy: PID 20723 died... 09:04:56.988327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20723): Terminated: ok {rc=0} 09:04:57.032035 --- ParallelTerminationStrategy: PID 20726 died... 09:04:57.050365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20726): Terminated: ok {rc=0} 09:04:57.093838 --- ParallelTerminationStrategy: PID 20729 died... 09:04:57.112267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20729): Terminated: ok {rc=0} 09:04:57.194875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:04:58.280321 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.293332 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:04:58.349520 tst ping_idle_ping.py: using LAC 27319 09:04:58.479014 tst ping_idle_ping.py: using RAC 34 09:04:58.597084 tst ping_idle_ping.py: using CellId 27319 09:04:58.713393 tst ping_idle_ping.py: using BVCI 27320 09:04:58.824133 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.835648 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.846916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.858493 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.869851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.881140 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.892381 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:04:58.903584 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:04:59.018112 tst ping_idle_ping.py:24: start network... 09:04:59.232057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:04:59.731228 run create_hlr_db(pid=20731): Launched 09:04:59.860021 bus /gobi_6: Setting Powered False 09:05:00.932361 run create_hlr_db(pid=20731): Terminated: ok {rc=0} 09:05:01.442767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20733): Launched 09:05:01.765815 run osmo-hlr_10.42.42.2(pid=20734): Launched 09:05:01.896253 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:02.603350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20739): Launched 09:05:02.907258 run osmo-stp_10.42.42.5(pid=20740): Launched 09:05:03.022329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:03.541815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20742): Launched 09:05:03.656782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:03.913111 run patchelf(pid=20743): Launched 09:05:04.079445 run osmo-stp_10.42.42.5(pid=20740): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20740)] 09:05:04.206507 run osmo-stp_10.42.42.5(pid=20740): stdout: | (launched: 2022-12-10_09:05:02.848933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:04.335130 run osmo-stp_10.42.42.5(pid=20740): stderr: | 20221210090503020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090503021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090503021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090503021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090503022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090503022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090503022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:04.464542 run osmo-stp_10.42.42.5(pid=20740): stdout: | (launched: 2022-12-10_09:05:02.848933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:04.587714 run osmo-stp_10.42.42.5(pid=20740): stderr: | 20221210090503020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090503021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090503021 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090503021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090503022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090503022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090503022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:04.733699 run patchelf(pid=20743): Terminating (SIGINT) 09:05:04.901862 run patchelf(pid=20743): Terminated: ok {rc=0} 09:05:05.023068 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20740): Process ended prematurely: osmo-stp_10.42.42.5(pid=20740) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20740)] [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:05:05.031790 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:05:05.058763 run osmo-hlr_10.42.42.2(pid=20734): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20734)] 09:05:05.106661 run osmo-hlr_10.42.42.2(pid=20734): stdout: | (launched: 2022-12-10_09:05:01.699021) 09:05:05.155844 run osmo-hlr_10.42.42.2(pid=20734): stderr: | 20221210090502030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090502030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090502030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090502030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090502030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090502030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090502049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090502070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090502071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090502071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:05.205649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20733): Terminating (SIGTERM) 09:05:05.245422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20739): Terminating (SIGTERM) 09:05:05.285062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20742): Terminating (SIGTERM) 09:05:05.324994 --- ParallelTerminationStrategy: PID 20733 died... 09:05:05.343831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20733): Terminated: ok {rc=0} 09:05:05.387796 --- ParallelTerminationStrategy: PID 20739 died... 09:05:05.406290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20739): Terminated: ok {rc=0} 09:05:05.450412 --- ParallelTerminationStrategy: PID 20742 died... 09:05:05.468882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20742): Terminated: ok {rc=0} 09:05:05.554334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:05:06.863386 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:06.870124 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:05:06.903618 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:05:06.938141 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:05:06.990202 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:05:07.022553 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:05:07.056817 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:05:07.623937 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:05:07.628793 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:07.639984 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:05:07.706733 tst switch_tch_pdch.py: using LAC 27320 09:05:07.822779 tst switch_tch_pdch.py: using RAC 35 09:05:07.937720 tst switch_tch_pdch.py: using CellId 27320 09:05:08.052288 tst switch_tch_pdch.py: using BVCI 27321 09:05:08.159900 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.171021 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.181958 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.193195 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.204278 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.215432 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.227078 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:05:08.238321 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:05:08.356522 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:05:08.474918 tst switch_tch_pdch.py:51: start network... 09:05:08.674451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:09.134881 run create_hlr_db(pid=20748): Launched 09:05:09.247802 bus /gobi_6: Setting Powered False 09:05:10.307552 run create_hlr_db(pid=20748): Terminated: ok {rc=0} 09:05:10.739359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20750): Launched 09:05:11.053721 run osmo-hlr_10.42.42.2(pid=20751): Launched 09:05:11.173770 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:11.715875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20753): Launched 09:05:12.029713 run osmo-stp_10.42.42.5(pid=20754): Launched 09:05:12.149658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:12.693296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20756): Launched 09:05:12.813440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:13.079124 run patchelf(pid=20757): Launched 09:05:13.253495 run osmo-stp_10.42.42.5(pid=20754): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20754)] 09:05:13.386909 run osmo-stp_10.42.42.5(pid=20754): stdout: | (launched: 2022-12-10_09:05:11.972672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:13.521527 run osmo-stp_10.42.42.5(pid=20754): stderr: | 20221210090512164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090512164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090512164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090512165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090512165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090512165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090512165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:13.656401 run osmo-stp_10.42.42.5(pid=20754): stdout: | (launched: 2022-12-10_09:05:11.972672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:13.786325 run osmo-stp_10.42.42.5(pid=20754): stderr: | 20221210090512164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090512164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090512164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090512165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090512165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090512165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090512165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:13.939674 run patchelf(pid=20757): Terminating (SIGINT) 09:05:14.116171 run patchelf(pid=20757): Terminated: ok {rc=0} 09:05:14.243135 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20754): Process ended prematurely: osmo-stp_10.42.42.5(pid=20754) [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20754)] [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:05:14.252433 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:05:14.279756 run osmo-hlr_10.42.42.2(pid=20751): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20751)] 09:05:14.329060 run osmo-hlr_10.42.42.2(pid=20751): stdout: | (launched: 2022-12-10_09:05:10.996667) 09:05:14.380088 run osmo-hlr_10.42.42.2(pid=20751): stderr: | 20221210090511191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090511191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090511191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090511191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090511191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090511191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090511204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090511212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090511212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090511212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:14.432094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20750): Terminating (SIGTERM) 09:05:14.473562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20753): Terminating (SIGTERM) 09:05:14.514885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20756): Terminating (SIGTERM) 09:05:14.556421 --- ParallelTerminationStrategy: PID 20750 died... 09:05:14.576090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20750): Terminated: ok {rc=0} 09:05:14.622014 --- ParallelTerminationStrategy: PID 20753 died... 09:05:14.641201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20753): Terminated: ok {rc=0} 09:05:14.686673 --- ParallelTerminationStrategy: PID 20756 died... 09:05:14.705821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20756): Terminated: ok {rc=0} 09:05:14.792812 bus /gobi_0: Setting Powered False 09:05:15.907376 bus /gobi_0: Setting Powered False 09:05:17.038521 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:05:18.296432 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:18.302072 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:05:18.334760 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:05:18.369115 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:05:18.422659 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:05:18.456507 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:05:18.490681 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:05:19.043455 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:05:19.048463 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.059325 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:05:19.127959 tst switch_tch_pdch.py: using LAC 27321 09:05:19.243970 tst switch_tch_pdch.py: using RAC 36 09:05:19.364628 tst switch_tch_pdch.py: using CellId 27321 09:05:19.480612 tst switch_tch_pdch.py: using BVCI 27322 09:05:19.588412 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.599308 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.609979 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.620919 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.631792 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.642758 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.653765 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:05:19.664754 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:05:19.784901 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:05:19.904650 tst switch_tch_pdch.py:51: start network... 09:05:20.116794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:20.581792 run create_hlr_db(pid=20762): Launched 09:05:20.709819 bus /gobi_6: Setting Powered False 09:05:21.772438 run create_hlr_db(pid=20762): Terminated: ok {rc=0} 09:05:22.172602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Launched 09:05:22.471834 run osmo-hlr_10.42.42.2(pid=20765): Launched 09:05:22.585090 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:23.085120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Launched 09:05:23.385270 run osmo-stp_10.42.42.5(pid=20768): Launched 09:05:23.498723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:05:23.989472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Launched 09:05:24.103628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:05:24.357770 run patchelf(pid=20771): Launched 09:05:24.522685 run osmo-stp_10.42.42.5(pid=20768): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] 09:05:24.648277 run osmo-stp_10.42.42.5(pid=20768): stdout: | (launched: 2022-12-10_09:05:23.327033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:24.775197 run osmo-stp_10.42.42.5(pid=20768): stderr: | 20221210090523501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090523501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090523502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090523502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090523502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090523503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090523503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:24.902538 run osmo-stp_10.42.42.5(pid=20768): stdout: | (launched: 2022-12-10_09:05:23.327033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:25.024345 run osmo-stp_10.42.42.5(pid=20768): stderr: | 20221210090523501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090523501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090523502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090523502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090523502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090523503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090523503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:25.168574 run patchelf(pid=20771): Terminating (SIGINT) 09:05:25.335212 run patchelf(pid=20771): Terminated: ok {rc=0} 09:05:25.455037 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20768): Process ended prematurely: osmo-stp_10.42.42.5(pid=20768) [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:05:25.463676 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 09:05:25.490137 run osmo-hlr_10.42.42.2(pid=20765): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20765)] 09:05:25.537429 run osmo-hlr_10.42.42.2(pid=20765): stdout: | (launched: 2022-12-10_09:05:22.414456) 09:05:25.586562 run osmo-hlr_10.42.42.2(pid=20765): stderr: | 20221210090522593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090522593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090522593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090522594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090522594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090522594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090522606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090522615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090522616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090522616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:25.636140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Terminating (SIGTERM) 09:05:25.675462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Terminating (SIGTERM) 09:05:25.714731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Terminating (SIGTERM) 09:05:25.753975 --- ParallelTerminationStrategy: PID 20764 died... 09:05:25.772722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20764): Terminated: ok {rc=0} 09:05:25.816702 --- ParallelTerminationStrategy: PID 20767 died... 09:05:25.834791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20767): Terminated: ok {rc=0} 09:05:25.878336 --- ParallelTerminationStrategy: PID 20770 died... 09:05:25.896925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20770): Terminated: ok {rc=0} 09:05:25.981347 bus /gobi_0: Setting Powered False 09:05:27.081512 bus /gobi_0: Setting Powered False 09:05:28.194390 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:trx-lms --------------------------------------------------------------------- 09:05:29.448082 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:29.452041 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:05:29.486894 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:05:29.493823 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:05:29.546296 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:05:29.579524 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:05:29.586323 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:05:30.125033 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:05:30.129910 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 09:05:30.140355 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 09:05:30.186625 tst mo_mt_sms.py: using LAC 27322 09:05:30.300900 tst mo_mt_sms.py: using RAC 37 09:05:30.415897 tst mo_mt_sms.py: using CellId 27322 09:05:30.530618 tst mo_mt_sms.py: using BVCI 27323 09:05:30.638101 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:05:30.755693 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 09:05:30.899689 tst mo_mt_sms.py:9: start nitb and bts... 09:05:31.113647 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:05:31.782292 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20775): Launched 09:05:32.111156 run osmo-nitb_10.42.42.2(pid=20776): Launched 09:05:32.277706 run osmo-nitb_10.42.42.2(pid=20776): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20776)] 09:05:32.412122 run osmo-nitb_10.42.42.2(pid=20776): stdout: | (launched: 2022-12-10_09:05:32.046822) 09:05:32.547354 run osmo-nitb_10.42.42.2(pid=20776): stderr: | (launched: 2022-12-10_09:05:32.094823) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:05:32.682969 run osmo-nitb_10.42.42.2(pid=20776): stdout: | (launched: 2022-12-10_09:05:32.046822) 09:05:32.812854 run osmo-nitb_10.42.42.2(pid=20776): stderr: | (launched: 2022-12-10_09:05:32.094823) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20776): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20776) [trial-2372↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20776)] 09:05:33.224938 tst osmo-nitb_10.42.42.2(pid=20776): stdout: | (launched: 2022-12-10_09:05:32.046822) 09:05:33.345221 tst osmo-nitb_10.42.42.2(pid=20776): stderr: | (launched: 2022-12-10_09:05:32.094823) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:05:33.486694 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20776): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20776) [trial-2372↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20776)] [trial-2372↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 09:05:33.495105 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 09:05:33.501790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20775): Terminating (SIGTERM) 09:05:33.712268 --- ParallelTerminationStrategy: PID 20775 died... 09:05:33.732467 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20775): Terminated: ok {rc=0} 09:05:33.818899 bus /sierra_3: Setting Powered False 09:05:34.917398 bus /sierra_3: Setting Powered False 09:05:36.033976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:trx-lms --------------------------------------------------------------------- 09:05:37.229740 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:37.234973 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 09:05:37.268424 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:05:37.295882 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 09:05:37.348307 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 09:05:37.382151 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:05:37.409375 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 09:05:37.957602 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 09:05:37.962653 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:37.973631 tst sms:trx-lms: Using 1 x bts (candidates: 1) 09:05:38.028393 tst mo_mt_sms.py: using LAC 27323 09:05:38.156202 tst mo_mt_sms.py: using RAC 38 09:05:38.279694 tst mo_mt_sms.py: using CellId 27323 09:05:38.401272 tst mo_mt_sms.py: using BVCI 27324 09:05:38.513579 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:38.524098 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:38.534693 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:38.546093 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:38.557552 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:38.568787 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:05:38.687216 tst sms:trx-lms: Using 1 x modem (candidates: 2) 09:05:38.809877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:39.300575 run create_hlr_db(pid=20780): Launched 09:05:39.427785 bus /sierra_2: Setting Powered False 09:05:40.489815 run create_hlr_db(pid=20780): Terminated: ok {rc=0} 09:05:40.916385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Launched 09:05:41.217825 run osmo-hlr_10.42.42.2(pid=20783): Launched 09:05:41.331383 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:41.856669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Launched 09:05:42.154609 run osmo-stp_10.42.42.5(pid=20786): Launched 09:05:42.266543 run osmo-msc_10.42.42.6: Starting osmo-msc 09:05:42.806097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20788): Launched 09:05:43.104890 run osmo-msc_10.42.42.6(pid=20789): Launched 09:05:43.270770 run osmo-stp_10.42.42.5(pid=20786): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] 09:05:43.397405 run osmo-stp_10.42.42.5(pid=20786): stdout: | (launched: 2022-12-10_09:05:42.097603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:43.523834 run osmo-stp_10.42.42.5(pid=20786): stderr: | 20221210090542271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090542271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090542272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090542272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090542273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090542273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090542273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:43.647663 run osmo-stp_10.42.42.5(pid=20786): stdout: | (launched: 2022-12-10_09:05:42.097603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:43.765495 run osmo-stp_10.42.42.5(pid=20786): stderr: | 20221210090542271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090542271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090542272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090542272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090542273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090542273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090542273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:43.906407 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20786): Process ended prematurely: osmo-stp_10.42.42.5(pid=20786) [trial-2372↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] [trial-2372↪sms:trx-lms↪mo_mt_sms.py:16] 09:05:43.914415 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:05:43.940194 run osmo-hlr_10.42.42.2(pid=20783): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20783)] 09:05:43.987869 run osmo-hlr_10.42.42.2(pid=20783): stdout: | (launched: 2022-12-10_09:05:41.159057) 09:05:44.036714 run osmo-hlr_10.42.42.2(pid=20783): stderr: | 20221210090541338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090541338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090541338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090541338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090541339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090541339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090541352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090541361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090541361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090541361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:05:44.104751 run osmo-msc_10.42.42.6(pid=20789): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20789)] 09:05:44.152068 run osmo-msc_10.42.42.6(pid=20789): stdout: | (launched: 2022-12-10_09:05:43.046898) 09:05:44.200743 run osmo-msc_10.42.42.6(pid=20789): stderr: | 20221210090543321 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090543321 DLGLOBAL DEBUG validating counter group 0x7f0f82c0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090543321 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090543322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090543322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090543322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090543324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090543325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090543325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090543325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:05:44.249998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Terminating (SIGTERM) 09:05:44.289139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Terminating (SIGTERM) 09:05:44.328369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20788): Terminating (SIGTERM) 09:05:44.367907 --- ParallelTerminationStrategy: PID 20782 died... 09:05:44.386629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20782): Terminated: ok {rc=0} 09:05:44.430233 --- ParallelTerminationStrategy: PID 20785 died... 09:05:44.448299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20785): Terminated: ok {rc=0} 09:05:44.491687 --- ParallelTerminationStrategy: PID 20788 died... 09:05:44.509930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20788): Terminated: ok {rc=0} 09:05:44.591992 bus /sierra_3: Setting Powered False 09:05:45.688434 bus /sierra_3: Setting Powered False 09:05:46.809806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-lms --------------------------------------------------------------------- 09:05:48.048251 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:48.052320 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:05:48.086487 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 09:05:48.093529 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:05:48.129129 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:05:48.162723 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 09:05:48.169745 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:05:48.689830 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 09:05:48.695153 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 09:05:48.706732 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 09:05:48.755054 tst assert_extension.py: using LAC 27324 09:05:48.880596 tst assert_extension.py: using RAC 39 09:05:49.003480 tst assert_extension.py: using CellId 27324 09:05:49.126490 tst assert_extension.py: using BVCI 27325 09:05:49.240456 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 09:05:49.354179 tst assert_extension.py:10: start nitb and bts... 09:05:49.553148 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:05:50.160330 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20794): Launched 09:05:50.456451 run osmo-nitb_10.42.42.2(pid=20795): Launched 09:05:50.620886 run osmo-nitb_10.42.42.2(pid=20795): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20795)] 09:05:50.754742 run osmo-nitb_10.42.42.2(pid=20795): stdout: | (launched: 2022-12-10_09:05:50.402468) 09:05:50.890149 run osmo-nitb_10.42.42.2(pid=20795): stderr: | (launched: 2022-12-10_09:05:50.446680) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:05:51.024835 run osmo-nitb_10.42.42.2(pid=20795): stdout: | (launched: 2022-12-10_09:05:50.402468) 09:05:51.154545 run osmo-nitb_10.42.42.2(pid=20795): stderr: | (launched: 2022-12-10_09:05:50.446680) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20795) [trial-2372↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20795)] 09:05:51.568231 tst osmo-nitb_10.42.42.2(pid=20795): stdout: | (launched: 2022-12-10_09:05:50.402468) 09:05:51.687705 tst osmo-nitb_10.42.42.2(pid=20795): stderr: | (launched: 2022-12-10_09:05:50.446680) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:05:51.828777 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20795) [trial-2372↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20795)] [trial-2372↪nitb_ussd:trx-lms↪assert_extension.py:12] 09:05:51.837085 tst assert_extension.py:12: Test FAILED (3.1 sec) 09:05:51.843497 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20794): Terminating (SIGTERM) 09:05:52.052855 --- ParallelTerminationStrategy: PID 20794 died... 09:05:52.073069 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20794): Terminated: ok {rc=0} 09:05:52.158508 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:trx-lms --------------------------------------------------------------------- 09:05:53.336424 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:05:53.340427 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 09:05:53.374162 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:05:53.400627 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 09:05:53.436101 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 09:05:53.470906 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:05:53.498521 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 09:05:54.022953 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:trx-lms assert_extension.py ---------------------------------------------- 09:05:54.028697 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.039697 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 09:05:54.086902 tst assert_extension.py: using LAC 27325 09:05:54.202956 tst assert_extension.py: using RAC 40 09:05:54.320836 tst assert_extension.py: using CellId 27325 09:05:54.437121 tst assert_extension.py: using BVCI 27326 09:05:54.544469 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.554933 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.565291 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.575776 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.586464 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 09:05:54.596913 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 09:05:54.715037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:05:55.178910 run create_hlr_db(pid=20799): Launched 09:05:55.292014 bus /sierra_2: Setting Powered False 09:05:56.351519 run create_hlr_db(pid=20799): Terminated: ok {rc=0} 09:05:56.789564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Launched 09:05:57.110258 run osmo-hlr_10.42.42.2(pid=20802): Launched 09:05:57.230490 run osmo-stp_10.42.42.5: Starting osmo-stp 09:05:57.782522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Launched 09:05:58.100001 run osmo-stp_10.42.42.5(pid=20805): Launched 09:05:58.219437 run osmo-msc_10.42.42.6: Starting osmo-msc 09:05:58.794150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Launched 09:05:59.112698 run osmo-msc_10.42.42.6(pid=20808): Launched 09:05:59.287813 run osmo-stp_10.42.42.5(pid=20805): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] 09:05:59.421397 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-10_09:05:58.038737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:59.554641 run osmo-stp_10.42.42.5(pid=20805): stderr: | 20221210090558234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090558235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090558235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090558235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090558236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090558236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090558236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:59.687360 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-10_09:05:58.038737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:05:59.813367 run osmo-stp_10.42.42.5(pid=20805): stderr: | 20221210090558234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090558235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090558235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090558235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090558236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090558236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090558236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:05:59.963310 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2372↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] [trial-2372↪ussd:trx-lms↪assert_extension.py:17] 09:05:59.972158 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:05:59.999314 run osmo-hlr_10.42.42.2(pid=20802): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20802)] 09:06:00.049070 run osmo-hlr_10.42.42.2(pid=20802): stdout: | (launched: 2022-12-10_09:05:57.047388) 09:06:00.100288 run osmo-hlr_10.42.42.2(pid=20802): stderr: | 20221210090557248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090557248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090557249 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090557249 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090557249 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090557249 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090557261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090557271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090557271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090557271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:00.171527 run osmo-msc_10.42.42.6(pid=20808): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20808)] 09:06:00.221199 run osmo-msc_10.42.42.6(pid=20808): stdout: | (launched: 2022-12-10_09:05:59.051413) 09:06:00.272366 run osmo-msc_10.42.42.6(pid=20808): stderr: | 20221210090559375 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090559375 DLGLOBAL DEBUG validating counter group 0x7fd6a6086c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090559375 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090559375 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090559376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090559376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090559379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090559380 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090559380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090559380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:00.323915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminating (SIGTERM) 09:06:00.365299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminating (SIGTERM) 09:06:00.406408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Terminating (SIGTERM) 09:06:00.447971 --- ParallelTerminationStrategy: PID 20801 died... 09:06:00.467844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminated: ok {rc=0} 09:06:00.513832 --- ParallelTerminationStrategy: PID 20804 died... 09:06:00.533280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminated: ok {rc=0} 09:06:00.578919 --- ParallelTerminationStrategy: PID 20807 died... 09:06:00.598400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Terminated: ok {rc=0} 09:06:00.685487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:06:01.915926 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:01.926614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:06:01.973166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:06:02.007088 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:06:02.066156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:06:02.102956 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:06:02.133747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:06:02.678387 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:06:02.729810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:02.740901 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:06:02.808722 tst mo_mt_call.py: using LAC 27326 09:06:02.926293 tst mo_mt_call.py: using RAC 41 09:06:03.046325 tst mo_mt_call.py: using CellId 27326 09:06:03.165949 tst mo_mt_call.py: using BVCI 27327 09:06:03.278413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:03.289464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:03.300283 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:03.311415 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:03.322503 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:03.333555 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:06:03.452589 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:06:03.572517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:04.071559 run create_hlr_db(pid=20813): Launched 09:06:04.202367 bus /sierra_2: Setting Powered False 09:06:05.265923 run create_hlr_db(pid=20813): Terminated: ok {rc=0} 09:06:05.695444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Launched 09:06:05.997108 run osmo-hlr_10.42.42.2(pid=20816): Launched 09:06:06.113179 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:06.667250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Launched 09:06:06.987671 run osmo-stp_10.42.42.5(pid=20819): Launched 09:06:07.110335 run osmo-msc_10.42.42.6: Starting osmo-msc 09:06:07.690151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Launched 09:06:08.009222 run osmo-msc_10.42.42.6(pid=20822): Launched 09:06:08.187554 run osmo-stp_10.42.42.5(pid=20819): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] 09:06:08.327188 run osmo-stp_10.42.42.5(pid=20819): stdout: | (launched: 2022-12-10_09:06:06.929797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:08.463129 run osmo-stp_10.42.42.5(pid=20819): stderr: | 20221210090607122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090607122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090607122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090607123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090607123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090607123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090607123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:08.597986 run osmo-stp_10.42.42.5(pid=20819): stdout: | (launched: 2022-12-10_09:06:06.929797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:08.725292 run osmo-stp_10.42.42.5(pid=20819): stderr: | 20221210090607122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090607122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090607122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090607123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090607123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090607123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090607123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:08.878577 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20819): Process ended prematurely: osmo-stp_10.42.42.5(pid=20819) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:06:08.887887 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:06:08.915030 run osmo-hlr_10.42.42.2(pid=20816): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20816)] 09:06:08.964229 run osmo-hlr_10.42.42.2(pid=20816): stdout: | (launched: 2022-12-10_09:06:05.941744) 09:06:09.015549 run osmo-hlr_10.42.42.2(pid=20816): stderr: | 20221210090606119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090606119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090606119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090606119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090606119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090606119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090606131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090606140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090606141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090606141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:09.086664 run osmo-msc_10.42.42.6(pid=20822): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20822)] 09:06:09.135980 run osmo-msc_10.42.42.6(pid=20822): stdout: | (launched: 2022-12-10_09:06:07.951131) 09:06:09.186933 run osmo-msc_10.42.42.6(pid=20822): stderr: | 20221210090608271 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090608271 DLGLOBAL DEBUG validating counter group 0x7efce47e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090608271 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090608271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090608272 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090608272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090608273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090608274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090608274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090608274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:09.238098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Terminating (SIGTERM) 09:06:09.279020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Terminating (SIGTERM) 09:06:09.320025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Terminating (SIGTERM) 09:06:09.361434 --- ParallelTerminationStrategy: PID 20815 died... 09:06:09.380915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20815): Terminated: ok {rc=0} 09:06:09.426598 --- ParallelTerminationStrategy: PID 20818 died... 09:06:09.445780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20818): Terminated: ok {rc=0} 09:06:09.490941 --- ParallelTerminationStrategy: PID 20821 died... 09:06:09.510174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20821): Terminated: ok {rc=0} 09:06:09.597692 bus /sierra_3: Setting Powered False 09:06:10.694497 bus /sierra_3: Setting Powered False 09:06:11.811257 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:06:12.957912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:12.969677 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:06:13.040043 tst mo_mt_call_osmux.py: using LAC 27327 09:06:13.159578 tst mo_mt_call_osmux.py: using RAC 42 09:06:13.281548 tst mo_mt_call_osmux.py: using CellId 27327 09:06:13.410393 tst mo_mt_call_osmux.py: using BVCI 27328 09:06:13.528933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:13.540621 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:13.552134 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:13.563748 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:13.575341 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:06:13.586762 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:06:13.701683 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:06:13.823727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:14.292567 run create_hlr_db(pid=20824): Launched 09:06:14.408426 bus /sierra_2: Setting Powered False 09:06:15.468667 run create_hlr_db(pid=20824): Terminated: ok {rc=0} 09:06:15.901694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20826): Launched 09:06:16.265788 run osmo-hlr_10.42.42.2(pid=20827): Launched 09:06:16.458299 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:17.127193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20829): Launched 09:06:17.461574 run osmo-stp_10.42.42.5(pid=20830): Launched 09:06:17.585793 run osmo-msc_10.42.42.6: Starting osmo-msc 09:06:18.166835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20832): Launched 09:06:18.487264 run osmo-msc_10.42.42.6(pid=20833): Launched 09:06:18.666622 run osmo-stp_10.42.42.5(pid=20830): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20830)] 09:06:18.801738 run osmo-stp_10.42.42.5(pid=20830): stdout: | (launched: 2022-12-10_09:06:17.402853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:18.937690 run osmo-stp_10.42.42.5(pid=20830): stderr: | 20221210090617593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090617593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090617593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090617594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090617594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090617594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090617594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:19.072675 run osmo-stp_10.42.42.5(pid=20830): stdout: | (launched: 2022-12-10_09:06:17.402853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:19.200276 run osmo-stp_10.42.42.5(pid=20830): stderr: | 20221210090617593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090617593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090617593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090617594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090617594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090617594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090617594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:19.352912 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20830): Process ended prematurely: osmo-stp_10.42.42.5(pid=20830) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20830)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:06:19.362430 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:06:19.390045 run osmo-hlr_10.42.42.2(pid=20827): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20827)] 09:06:19.439761 run osmo-hlr_10.42.42.2(pid=20827): stdout: | (launched: 2022-12-10_09:06:16.193874) 09:06:19.491180 run osmo-hlr_10.42.42.2(pid=20827): stderr: | 20221210090616512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090616512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090616512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090616512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090616512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090616512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090616524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090616541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090616541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090616541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:19.562686 run osmo-msc_10.42.42.6(pid=20833): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20833)] 09:06:19.612379 run osmo-msc_10.42.42.6(pid=20833): stdout: | (launched: 2022-12-10_09:06:18.429269) 09:06:19.663380 run osmo-msc_10.42.42.6(pid=20833): stderr: | 20221210090618751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090618751 DLGLOBAL DEBUG validating counter group 0x7f8fd8a36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090618751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090618751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090618751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090618751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090618753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090618754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090618754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090618754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:19.714619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20826): Terminating (SIGTERM) 09:06:19.755475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20829): Terminating (SIGTERM) 09:06:19.796827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20832): Terminating (SIGTERM) 09:06:19.838921 --- ParallelTerminationStrategy: PID 20826 died... 09:06:19.858773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20826): Terminated: ok {rc=0} 09:06:19.904596 --- ParallelTerminationStrategy: PID 20829 died... 09:06:19.923902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20829): Terminated: ok {rc=0} 09:06:19.969402 --- ParallelTerminationStrategy: PID 20832 died... 09:06:19.988704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20832): Terminated: ok {rc=0} 09:06:20.075377 bus /sierra_3: Setting Powered False 09:06:21.173095 bus /sierra_3: Setting Powered False 09:06:22.289988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:06:23.541836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:23.548783 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:06:23.582943 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:06:23.610249 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:06:23.662886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:06:23.696568 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:06:23.723710 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:06:24.280296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:06:24.333143 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.344543 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:06:24.413576 tst mo_mt_call.py: using LAC 27328 09:06:24.539730 tst mo_mt_call.py: using RAC 43 09:06:24.665790 tst mo_mt_call.py: using CellId 27328 09:06:24.790103 tst mo_mt_call.py: using BVCI 27329 09:06:24.906923 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.918446 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.929836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.941155 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.952458 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:24.963788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:06:25.079391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:06:25.198070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:25.698887 run create_hlr_db(pid=20838): Launched 09:06:25.828901 bus /sierra_2: Setting Powered False 09:06:26.892176 run create_hlr_db(pid=20838): Terminated: ok {rc=0} 09:06:27.327765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Launched 09:06:27.634085 run osmo-hlr_10.42.42.2(pid=20841): Launched 09:06:27.750293 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:28.291640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Launched 09:06:28.597419 run osmo-stp_10.42.42.5(pid=20844): Launched 09:06:28.713108 run osmo-msc_10.42.42.6: Starting osmo-msc 09:06:29.265304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20846): Launched 09:06:29.570854 run osmo-msc_10.42.42.6(pid=20847): Launched 09:06:29.741408 run osmo-stp_10.42.42.5(pid=20844): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] 09:06:29.870566 run osmo-stp_10.42.42.5(pid=20844): stdout: | (launched: 2022-12-10_09:06:28.538470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:29.998703 run osmo-stp_10.42.42.5(pid=20844): stderr: | 20221210090628714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090628714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090628714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090628715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090628715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090628715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090628715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:30.124553 run osmo-stp_10.42.42.5(pid=20844): stdout: | (launched: 2022-12-10_09:06:28.538470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:30.244816 run osmo-stp_10.42.42.5(pid=20844): stderr: | 20221210090628714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090628714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090628714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090628715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090628715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090628715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090628715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:30.388885 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20844): Process ended prematurely: osmo-stp_10.42.42.5(pid=20844) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:06:30.397771 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:06:30.424226 run osmo-hlr_10.42.42.2(pid=20841): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20841)] 09:06:30.471889 run osmo-hlr_10.42.42.2(pid=20841): stdout: | (launched: 2022-12-10_09:06:27.575026) 09:06:30.520925 run osmo-hlr_10.42.42.2(pid=20841): stderr: | 20221210090627752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090627752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090627752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090627752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090627752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090627752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090627770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090627780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090627780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090627780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:30.589183 run osmo-msc_10.42.42.6(pid=20847): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20847)] 09:06:30.636519 run osmo-msc_10.42.42.6(pid=20847): stdout: | (launched: 2022-12-10_09:06:29.512278) 09:06:30.685522 run osmo-msc_10.42.42.6(pid=20847): stderr: | 20221210090629784 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090629784 DLGLOBAL DEBUG validating counter group 0x7fbd66a06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090629784 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090629784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090629784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090629785 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090629787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090629787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090629787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090629787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:30.734933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Terminating (SIGTERM) 09:06:30.774118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Terminating (SIGTERM) 09:06:30.813156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20846): Terminating (SIGTERM) 09:06:30.872928 --- ParallelTerminationStrategy: PID 20840 died... 09:06:30.896767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20840): Terminated: ok {rc=0} 09:06:30.948799 --- ParallelTerminationStrategy: PID 20843 died... 09:06:30.968554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20843): Terminated: ok {rc=0} 09:06:31.017596 --- ParallelTerminationStrategy: PID 20846 died... 09:06:31.041188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20846): Terminated: ok {rc=0} 09:06:31.146676 bus /sierra_3: Setting Powered False 09:06:32.262079 bus /sierra_3: Setting Powered False 09:06:33.376913 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:06:34.524342 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:34.536557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:06:34.607665 tst mo_mt_call_osmux.py: using LAC 27329 09:06:34.728874 tst mo_mt_call_osmux.py: using RAC 44 09:06:34.856219 tst mo_mt_call_osmux.py: using CellId 27329 09:06:34.986730 tst mo_mt_call_osmux.py: using BVCI 27330 09:06:35.106149 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:35.117811 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:35.129291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:35.141092 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:35.152814 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:06:35.164413 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:06:35.281209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:06:35.400319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:35.902421 run create_hlr_db(pid=20849): Launched 09:06:36.031217 bus /sierra_2: Setting Powered False 09:06:37.095073 run create_hlr_db(pid=20849): Terminated: ok {rc=0} 09:06:37.531037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20851): Launched 09:06:37.837976 run osmo-hlr_10.42.42.2(pid=20852): Launched 09:06:37.953376 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:38.490397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Launched 09:06:38.795727 run osmo-stp_10.42.42.5(pid=20855): Launched 09:06:38.910983 run osmo-msc_10.42.42.6: Starting osmo-msc 09:06:39.461328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20857): Launched 09:06:39.767910 run osmo-msc_10.42.42.6(pid=20858): Launched 09:06:39.937191 run osmo-stp_10.42.42.5(pid=20855): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20855)] 09:06:40.065342 run osmo-stp_10.42.42.5(pid=20855): stdout: | (launched: 2022-12-10_09:06:38.736646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:40.193522 run osmo-stp_10.42.42.5(pid=20855): stderr: | 20221210090638909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090638909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090638910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090638910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090638912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090638913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090638913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:40.320139 run osmo-stp_10.42.42.5(pid=20855): stdout: | (launched: 2022-12-10_09:06:38.736646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:40.440429 run osmo-stp_10.42.42.5(pid=20855): stderr: | 20221210090638909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090638909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090638910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090638910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090638912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090638913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090638913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:40.584381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20855): Process ended prematurely: osmo-stp_10.42.42.5(pid=20855) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20855)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:06:40.593175 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:06:40.619610 run osmo-hlr_10.42.42.2(pid=20852): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20852)] 09:06:40.666930 run osmo-hlr_10.42.42.2(pid=20852): stdout: | (launched: 2022-12-10_09:06:37.778547) 09:06:40.715770 run osmo-hlr_10.42.42.2(pid=20852): stderr: | 20221210090637959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090637959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090637959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090637959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090637959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090637959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090637972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090637982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090637983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090637983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:40.783940 run osmo-msc_10.42.42.6(pid=20858): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20858)] 09:06:40.831361 run osmo-msc_10.42.42.6(pid=20858): stdout: | (launched: 2022-12-10_09:06:39.709143) 09:06:40.880457 run osmo-msc_10.42.42.6(pid=20858): stderr: | 20221210090639984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090639984 DLGLOBAL DEBUG validating counter group 0x7f5db8961c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090639984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090639984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090639985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090639985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090639986 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090639987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090639987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090639987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:40.929713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20851): Terminating (SIGTERM) 09:06:40.969042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Terminating (SIGTERM) 09:06:41.008137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20857): Terminating (SIGTERM) 09:06:41.048175 --- ParallelTerminationStrategy: PID 20851 died... 09:06:41.066914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20851): Terminated: ok {rc=0} 09:06:41.110579 --- ParallelTerminationStrategy: PID 20854 died... 09:06:41.128516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Terminated: ok {rc=0} 09:06:41.171868 --- ParallelTerminationStrategy: PID 20857 died... 09:06:41.190128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20857): Terminated: ok {rc=0} 09:06:41.273161 bus /sierra_3: Setting Powered False 09:06:42.370264 bus /sierra_3: Setting Powered False 09:06:43.485296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:06:44.737028 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:06:44.744074 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:06:44.777956 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:06:44.805763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:06:44.859496 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:06:44.893894 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:06:44.921408 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:06:45.471260 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:06:45.522425 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:45.533964 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:06:45.605561 tst mo_mt_call.py: using LAC 27330 09:06:45.733267 tst mo_mt_call.py: using RAC 45 09:06:45.861342 tst mo_mt_call.py: using CellId 27330 09:06:45.994575 tst mo_mt_call.py: using BVCI 27331 09:06:46.121207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:46.133852 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:46.146101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:46.158544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:46.170527 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:46.182837 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:06:46.319551 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:06:46.445709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:46.977700 run create_hlr_db(pid=20863): Launched 09:06:47.111073 bus /sierra_2: Setting Powered False 09:06:48.171431 run create_hlr_db(pid=20863): Terminated: ok {rc=0} 09:06:48.614768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20865): Launched 09:06:48.937349 run osmo-hlr_10.42.42.2(pid=20866): Launched 09:06:49.059525 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:49.617607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20868): Launched 09:06:49.937534 run osmo-stp_10.42.42.5(pid=20869): Launched 09:06:50.059440 run osmo-msc_10.42.42.6: Starting osmo-msc 09:06:50.640077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20871): Launched 09:06:50.960785 run osmo-msc_10.42.42.6(pid=20872): Launched 09:06:51.139115 run osmo-stp_10.42.42.5(pid=20869): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20869)] 09:06:51.275154 run osmo-stp_10.42.42.5(pid=20869): stdout: | (launched: 2022-12-10_09:06:49.879389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:51.410610 run osmo-stp_10.42.42.5(pid=20869): stderr: | 20221210090650071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090650071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090650072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090650072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090650072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090650072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090650073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:51.545171 run osmo-stp_10.42.42.5(pid=20869): stdout: | (launched: 2022-12-10_09:06:49.879389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:06:51.672447 run osmo-stp_10.42.42.5(pid=20869): stderr: | 20221210090650071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090650071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090650072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090650072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090650072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090650072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090650073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:06:51.825688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20869): Process ended prematurely: osmo-stp_10.42.42.5(pid=20869) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20869)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:06:51.835100 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:06:51.862629 run osmo-hlr_10.42.42.2(pid=20866): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20866)] 09:06:51.912233 run osmo-hlr_10.42.42.2(pid=20866): stdout: | (launched: 2022-12-10_09:06:48.879271) 09:06:51.963421 run osmo-hlr_10.42.42.2(pid=20866): stderr: | 20221210090649077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090649077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090649077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090649077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090649077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090649078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090649090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090649098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090649099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090649099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:06:52.034493 run osmo-msc_10.42.42.6(pid=20872): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20872)] 09:06:52.084118 run osmo-msc_10.42.42.6(pid=20872): stdout: | (launched: 2022-12-10_09:06:50.902766) 09:06:52.135040 run osmo-msc_10.42.42.6(pid=20872): stderr: | 20221210090651226 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090651226 DLGLOBAL DEBUG validating counter group 0x7f8f817a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090651226 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090651226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090651227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090651227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090651228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090651229 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090651229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090651229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:06:52.186968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20865): Terminating (SIGTERM) 09:06:52.228220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20868): Terminating (SIGTERM) 09:06:52.269487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20871): Terminating (SIGTERM) 09:06:52.310830 --- ParallelTerminationStrategy: PID 20865 died... 09:06:52.330669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20865): Terminated: ok {rc=0} 09:06:52.376774 --- ParallelTerminationStrategy: PID 20868 died... 09:06:52.396175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20868): Terminated: ok {rc=0} 09:06:52.441672 --- ParallelTerminationStrategy: PID 20871 died... 09:06:52.460835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20871): Terminated: ok {rc=0} 09:06:52.547279 bus /sierra_3: Setting Powered False 09:06:53.645779 bus /sierra_3: Setting Powered False 09:06:54.761200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:06:55.907642 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:55.919870 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:06:55.991151 tst mo_mt_call_osmux.py: using LAC 27331 09:06:56.113162 tst mo_mt_call_osmux.py: using RAC 46 09:06:56.234288 tst mo_mt_call_osmux.py: using CellId 27331 09:06:56.356730 tst mo_mt_call_osmux.py: using BVCI 27332 09:06:56.468231 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:56.479483 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:56.490405 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:56.501553 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:56.512585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:06:56.523741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:06:56.643080 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:06:56.760540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:06:57.233050 run create_hlr_db(pid=20874): Launched 09:06:57.349729 bus /sierra_2: Setting Powered False 09:06:58.409882 run create_hlr_db(pid=20874): Terminated: ok {rc=0} 09:06:58.833505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20876): Launched 09:06:59.136446 run osmo-hlr_10.42.42.2(pid=20877): Launched 09:06:59.253297 run osmo-stp_10.42.42.5: Starting osmo-stp 09:06:59.787683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20879): Launched 09:07:00.089681 run osmo-stp_10.42.42.5(pid=20880): Launched 09:07:00.205895 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:00.757736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20882): Launched 09:07:01.082946 run osmo-msc_10.42.42.6(pid=20883): Launched 09:07:01.455201 run osmo-stp_10.42.42.5(pid=20880): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20880)] 09:07:01.708177 run osmo-stp_10.42.42.5(pid=20880): stdout: | (launched: 2022-12-10_09:07:00.034514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:01.871576 run osmo-stp_10.42.42.5(pid=20880): stderr: | 20221210090700204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090700204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090700204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090700205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090700206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090700206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090700206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:02.009596 run osmo-stp_10.42.42.5(pid=20880): stdout: | (launched: 2022-12-10_09:07:00.034514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:02.140296 run osmo-stp_10.42.42.5(pid=20880): stderr: | 20221210090700204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090700204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090700204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090700205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090700206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090700206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090700206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:02.296447 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20880): Process ended prematurely: osmo-stp_10.42.42.5(pid=20880) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20880)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:07:02.306369 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:07:02.336930 run osmo-hlr_10.42.42.2(pid=20877): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20877)] 09:07:02.388890 run osmo-hlr_10.42.42.2(pid=20877): stdout: | (launched: 2022-12-10_09:06:59.081470) 09:07:02.440465 run osmo-hlr_10.42.42.2(pid=20877): stderr: | 20221210090659256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090659257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090659257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090659257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090659257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090659257 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090659269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090659277 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090659277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090659277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:02.512706 run osmo-msc_10.42.42.6(pid=20883): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20883)] 09:07:02.562760 run osmo-msc_10.42.42.6(pid=20883): stdout: | (launched: 2022-12-10_09:07:01.018145) 09:07:02.614648 run osmo-msc_10.42.42.6(pid=20883): stderr: | 20221210090701368 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090701368 DLGLOBAL DEBUG validating counter group 0x7f299188ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090701368 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090701368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090701368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090701369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090701370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090701371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090701371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090701371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:02.666603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20876): Terminating (SIGTERM) 09:07:02.707849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20879): Terminating (SIGTERM) 09:07:02.749505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20882): Terminating (SIGTERM) 09:07:02.791253 --- ParallelTerminationStrategy: PID 20876 died... 09:07:02.811441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20876): Terminated: ok {rc=0} 09:07:02.857667 --- ParallelTerminationStrategy: PID 20879 died... 09:07:02.877418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20879): Terminated: ok {rc=0} 09:07:02.923110 --- ParallelTerminationStrategy: PID 20882 died... 09:07:02.942635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20882): Terminated: ok {rc=0} 09:07:03.030719 bus /sierra_3: Setting Powered False 09:07:04.128927 bus /sierra_3: Setting Powered False 09:07:05.242944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:07:06.492401 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:06.498838 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:07:06.532881 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:07:06.559496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:07:06.611071 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:07:06.643760 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:07:06.670181 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:07:07.220538 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:07:07.269734 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.280741 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:07:07.352683 tst mo_mt_call.py: using LAC 27332 09:07:07.482232 tst mo_mt_call.py: using RAC 47 09:07:07.607091 tst mo_mt_call.py: using CellId 27332 09:07:07.732140 tst mo_mt_call.py: using BVCI 27333 09:07:07.849310 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.860871 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.872421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.884083 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.895726 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:07.907199 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:07:08.023561 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:07:08.143274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:08.617607 run create_hlr_db(pid=20888): Launched 09:07:08.734331 bus /sierra_2: Setting Powered False 09:07:09.794334 run create_hlr_db(pid=20888): Terminated: ok {rc=0} 09:07:10.237371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Launched 09:07:10.560434 run osmo-hlr_10.42.42.2(pid=20891): Launched 09:07:10.683325 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:11.244681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Launched 09:07:11.569661 run osmo-stp_10.42.42.5(pid=20894): Launched 09:07:11.691691 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:12.276848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20896): Launched 09:07:12.601244 run osmo-msc_10.42.42.6(pid=20897): Launched 09:07:12.779945 run osmo-stp_10.42.42.5(pid=20894): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] 09:07:12.915799 run osmo-stp_10.42.42.5(pid=20894): stdout: | (launched: 2022-12-10_09:07:11.506894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:13.051540 run osmo-stp_10.42.42.5(pid=20894): stderr: | 20221210090711704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090711704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090711704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090711705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090711705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090711705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090711705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:13.186629 run osmo-stp_10.42.42.5(pid=20894): stdout: | (launched: 2022-12-10_09:07:11.506894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:13.314648 run osmo-stp_10.42.42.5(pid=20894): stderr: | 20221210090711704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090711704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090711704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090711705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090711705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090711705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090711705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:13.468070 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20894): Process ended prematurely: osmo-stp_10.42.42.5(pid=20894) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:07:13.477674 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:07:13.505468 run osmo-hlr_10.42.42.2(pid=20891): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20891)] 09:07:13.555511 run osmo-hlr_10.42.42.2(pid=20891): stdout: | (launched: 2022-12-10_09:07:10.498655) 09:07:13.607185 run osmo-hlr_10.42.42.2(pid=20891): stderr: | 20221210090710701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090710701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090710701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090710701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090710701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090710701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090710714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090710722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090710722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090710722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:13.679097 run osmo-msc_10.42.42.6(pid=20897): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20897)] 09:07:13.728782 run osmo-msc_10.42.42.6(pid=20897): stdout: | (launched: 2022-12-10_09:07:12.538565) 09:07:13.780015 run osmo-msc_10.42.42.6(pid=20897): stderr: | 20221210090712866 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090712866 DLGLOBAL DEBUG validating counter group 0x7f813ea47c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090712866 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090712866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090712866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090712866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090712868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090712868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090712869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090712869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:13.832116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Terminating (SIGTERM) 09:07:13.873334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Terminating (SIGTERM) 09:07:13.914616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20896): Terminating (SIGTERM) 09:07:13.956292 --- ParallelTerminationStrategy: PID 20890 died... 09:07:13.976070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20890): Terminated: ok {rc=0} 09:07:14.022386 --- ParallelTerminationStrategy: PID 20893 died... 09:07:14.041880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20893): Terminated: ok {rc=0} 09:07:14.087802 --- ParallelTerminationStrategy: PID 20896 died... 09:07:14.107345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20896): Terminated: ok {rc=0} 09:07:14.193809 bus /sierra_3: Setting Powered False 09:07:15.292352 bus /sierra_3: Setting Powered False 09:07:16.407795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:07:17.551850 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:17.563573 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:07:17.633449 tst mo_mt_call_osmux.py: using LAC 27333 09:07:17.763008 tst mo_mt_call_osmux.py: using RAC 48 09:07:17.891325 tst mo_mt_call_osmux.py: using CellId 27333 09:07:18.017946 tst mo_mt_call_osmux.py: using BVCI 27334 09:07:18.129770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:18.140888 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:18.151811 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:18.162907 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:18.174119 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:07:18.185230 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:07:18.303804 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:07:18.419755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:18.895206 run create_hlr_db(pid=20899): Launched 09:07:19.011094 bus /sierra_2: Setting Powered False 09:07:20.070722 run create_hlr_db(pid=20899): Terminated: ok {rc=0} 09:07:20.516409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20901): Launched 09:07:20.841697 run osmo-hlr_10.42.42.2(pid=20902): Launched 09:07:20.964836 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:21.521433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20904): Launched 09:07:21.846338 run osmo-stp_10.42.42.5(pid=20905): Launched 09:07:21.969201 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:22.554744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20907): Launched 09:07:22.882849 run osmo-msc_10.42.42.6(pid=20908): Launched 09:07:23.061715 run osmo-stp_10.42.42.5(pid=20905): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20905)] 09:07:23.196835 run osmo-stp_10.42.42.5(pid=20905): stdout: | (launched: 2022-12-10_09:07:21.783720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:23.332543 run osmo-stp_10.42.42.5(pid=20905): stderr: | 20221210090721979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090721979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090721980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090721980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090721980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090721980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090721981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:23.467692 run osmo-stp_10.42.42.5(pid=20905): stdout: | (launched: 2022-12-10_09:07:21.783720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:23.595912 run osmo-stp_10.42.42.5(pid=20905): stderr: | 20221210090721979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090721979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090721980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090721980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090721980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090721980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090721981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:23.749289 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20905): Process ended prematurely: osmo-stp_10.42.42.5(pid=20905) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20905)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:07:23.758678 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:07:23.786325 run osmo-hlr_10.42.42.2(pid=20902): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20902)] 09:07:23.836429 run osmo-hlr_10.42.42.2(pid=20902): stdout: | (launched: 2022-12-10_09:07:20.779043) 09:07:23.887925 run osmo-hlr_10.42.42.2(pid=20902): stderr: | 20221210090720981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090720981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090720981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090720981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090720981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090720981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090720993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090721001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090721002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090721002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:23.959449 run osmo-msc_10.42.42.6(pid=20908): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20908)] 09:07:24.008891 run osmo-msc_10.42.42.6(pid=20908): stdout: | (launched: 2022-12-10_09:07:22.818158) 09:07:24.059730 run osmo-msc_10.42.42.6(pid=20908): stderr: | 20221210090723146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090723146 DLGLOBAL DEBUG validating counter group 0x7fd10e725c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090723146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090723147 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090723147 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090723147 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090723149 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090723149 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090723149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090723149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:24.111052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20901): Terminating (SIGTERM) 09:07:24.152289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20904): Terminating (SIGTERM) 09:07:24.193940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20907): Terminating (SIGTERM) 09:07:24.235619 --- ParallelTerminationStrategy: PID 20901 died... 09:07:24.255195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20901): Terminated: ok {rc=0} 09:07:24.301345 --- ParallelTerminationStrategy: PID 20904 died... 09:07:24.320449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20904): Terminated: ok {rc=0} 09:07:24.366351 --- ParallelTerminationStrategy: PID 20907 died... 09:07:24.385809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20907): Terminated: ok {rc=0} 09:07:24.472904 bus /sierra_3: Setting Powered False 09:07:25.571688 bus /sierra_3: Setting Powered False 09:07:26.686424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:07:27.943386 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:27.950285 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:07:27.984241 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:07:28.011338 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:07:28.063783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:07:28.097291 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:07:28.124124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:07:28.677555 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:07:28.728768 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:28.740224 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:07:28.810434 tst mo_mt_call.py: using LAC 27334 09:07:28.938715 tst mo_mt_call.py: using RAC 49 09:07:29.066757 tst mo_mt_call.py: using CellId 27334 09:07:29.195333 tst mo_mt_call.py: using BVCI 27335 09:07:29.312276 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:29.323772 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:29.335055 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:29.346403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:29.357839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:29.369088 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:07:29.486745 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:07:29.606534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:30.105235 run create_hlr_db(pid=20913): Launched 09:07:30.235557 bus /sierra_2: Setting Powered False 09:07:31.316359 run create_hlr_db(pid=20913): Terminated: ok {rc=0} 09:07:31.835252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Launched 09:07:32.241815 run osmo-hlr_10.42.42.2(pid=20916): Launched 09:07:32.381679 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:32.913979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Launched 09:07:33.216276 run osmo-stp_10.42.42.5(pid=20919): Launched 09:07:33.331931 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:33.879866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20921): Launched 09:07:34.182839 run osmo-msc_10.42.42.6(pid=20922): Launched 09:07:34.354118 run osmo-stp_10.42.42.5(pid=20919): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] 09:07:34.483297 run osmo-stp_10.42.42.5(pid=20919): stdout: | (launched: 2022-12-10_09:07:33.161555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:34.611680 run osmo-stp_10.42.42.5(pid=20919): stderr: | 20221210090733332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090733332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090733332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090733333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090733333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090733333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090733333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:34.738251 run osmo-stp_10.42.42.5(pid=20919): stdout: | (launched: 2022-12-10_09:07:33.161555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:34.859132 run osmo-stp_10.42.42.5(pid=20919): stderr: | 20221210090733332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090733332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090733332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090733333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090733333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090733333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090733333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:35.003179 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20919): Process ended prematurely: osmo-stp_10.42.42.5(pid=20919) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:07:35.011888 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:07:35.038226 run osmo-hlr_10.42.42.2(pid=20916): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20916)] 09:07:35.085690 run osmo-hlr_10.42.42.2(pid=20916): stdout: | (launched: 2022-12-10_09:07:32.169619) 09:07:35.134763 run osmo-hlr_10.42.42.2(pid=20916): stderr: | 20221210090732371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090732371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090732371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090732371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090732371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090732371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090732383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090732391 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090732391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090732391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:35.202974 run osmo-msc_10.42.42.6(pid=20922): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20922)] 09:07:35.250314 run osmo-msc_10.42.42.6(pid=20922): stdout: | (launched: 2022-12-10_09:07:34.127643) 09:07:35.299201 run osmo-msc_10.42.42.6(pid=20922): stderr: | 20221210090734396 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090734396 DLGLOBAL DEBUG validating counter group 0x7efe3b1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090734396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090734396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090734397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090734397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090734399 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090734399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090734399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090734399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:35.349078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Terminating (SIGTERM) 09:07:35.388410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminating (SIGTERM) 09:07:35.427369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20921): Terminating (SIGTERM) 09:07:35.467358 --- ParallelTerminationStrategy: PID 20915 died... 09:07:35.486084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20915): Terminated: ok {rc=0} 09:07:35.529666 --- ParallelTerminationStrategy: PID 20918 died... 09:07:35.547934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminated: ok {rc=0} 09:07:35.591717 --- ParallelTerminationStrategy: PID 20921 died... 09:07:35.609960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20921): Terminated: ok {rc=0} 09:07:35.694797 bus /sierra_3: Setting Powered False 09:07:36.792924 bus /sierra_3: Setting Powered False 09:07:37.907959 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:07:39.053918 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.065687 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:07:39.134685 tst mo_mt_call_osmux.py: using LAC 27335 09:07:39.253644 tst mo_mt_call_osmux.py: using RAC 50 09:07:39.372341 tst mo_mt_call_osmux.py: using CellId 27335 09:07:39.491579 tst mo_mt_call_osmux.py: using BVCI 27336 09:07:39.602327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.613329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.624131 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.635247 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.646638 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:07:39.657521 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:07:39.776933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:07:39.894637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:40.365517 run create_hlr_db(pid=20926): Launched 09:07:40.480825 bus /sierra_2: Setting Powered False 09:07:41.541441 run create_hlr_db(pid=20926): Terminated: ok {rc=0} 09:07:41.981712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20928): Launched 09:07:42.300629 run osmo-hlr_10.42.42.2(pid=20929): Launched 09:07:42.423631 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:42.980605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20931): Launched 09:07:43.299812 run osmo-stp_10.42.42.5(pid=20932): Launched 09:07:43.422359 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:44.004408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20934): Launched 09:07:44.322829 run osmo-msc_10.42.42.6(pid=20935): Launched 09:07:44.501526 run osmo-stp_10.42.42.5(pid=20932): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20932)] 09:07:44.636417 run osmo-stp_10.42.42.5(pid=20932): stdout: | (launched: 2022-12-10_09:07:43.241648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:44.771533 run osmo-stp_10.42.42.5(pid=20932): stderr: | 20221210090743434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090743434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090743434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090743435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090743435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090743435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090743435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:44.906193 run osmo-stp_10.42.42.5(pid=20932): stdout: | (launched: 2022-12-10_09:07:43.241648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:45.033282 run osmo-stp_10.42.42.5(pid=20932): stderr: | 20221210090743434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090743434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090743434 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090743435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090743435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090743435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090743435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:45.185165 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20932): Process ended prematurely: osmo-stp_10.42.42.5(pid=20932) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20932)] [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:07:45.194501 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:07:45.221824 run osmo-hlr_10.42.42.2(pid=20929): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20929)] 09:07:45.271643 run osmo-hlr_10.42.42.2(pid=20929): stdout: | (launched: 2022-12-10_09:07:42.242771) 09:07:45.322914 run osmo-hlr_10.42.42.2(pid=20929): stderr: | 20221210090742442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090742442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090742442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090742442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090742443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090742443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090742454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090742463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090742463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090742463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:45.394795 run osmo-msc_10.42.42.6(pid=20935): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20935)] 09:07:45.444402 run osmo-msc_10.42.42.6(pid=20935): stdout: | (launched: 2022-12-10_09:07:44.264881) 09:07:45.495803 run osmo-msc_10.42.42.6(pid=20935): stderr: | 20221210090744586 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090744586 DLGLOBAL DEBUG validating counter group 0x7f3855b17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090744586 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090744586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090744586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090744586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090744588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090744588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090744589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090744589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:45.547327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20928): Terminating (SIGTERM) 09:07:45.588310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20931): Terminating (SIGTERM) 09:07:45.629756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20934): Terminating (SIGTERM) 09:07:45.671181 --- ParallelTerminationStrategy: PID 20928 died... 09:07:45.690441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20928): Terminated: ok {rc=0} 09:07:45.735918 --- ParallelTerminationStrategy: PID 20931 died... 09:07:45.755242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20931): Terminated: ok {rc=0} 09:07:45.800580 --- ParallelTerminationStrategy: PID 20934 died... 09:07:45.819851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20934): Terminated: ok {rc=0} 09:07:45.912183 bus /sierra_3: Setting Powered False 09:07:47.011688 bus /sierra_3: Setting Powered False 09:07:48.126768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:07:49.381654 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:07:49.388650 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:07:49.422626 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:07:49.450005 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:07:49.502412 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:07:49.536443 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:07:49.563832 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:07:50.117445 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:07:50.168611 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.180194 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:07:50.251839 tst mo_mt_call.py: using LAC 27336 09:07:50.379579 tst mo_mt_call.py: using RAC 51 09:07:50.505470 tst mo_mt_call.py: using CellId 27336 09:07:50.632402 tst mo_mt_call.py: using BVCI 27337 09:07:50.749051 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.760575 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.771920 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.783333 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.794808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:07:50.806207 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:50.923735 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:07:51.039098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:07:51.543198 run create_hlr_db(pid=20940): Launched 09:07:51.673890 bus /sierra_2: Setting Powered False 09:07:52.737571 run create_hlr_db(pid=20940): Terminated: ok {rc=0} 09:07:53.188694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20942): Launched 09:07:53.514273 run osmo-hlr_10.42.42.2(pid=20943): Launched 09:07:53.637353 run osmo-stp_10.42.42.5: Starting osmo-stp 09:07:54.194227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20945): Launched 09:07:54.516751 run osmo-stp_10.42.42.5(pid=20946): Launched 09:07:54.638982 run osmo-msc_10.42.42.6: Starting osmo-msc 09:07:55.223494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20948): Launched 09:07:55.548358 run osmo-msc_10.42.42.6(pid=20949): Launched 09:07:55.728051 run osmo-stp_10.42.42.5(pid=20946): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20946)] 09:07:55.863829 run osmo-stp_10.42.42.5(pid=20946): stdout: | (launched: 2022-12-10_09:07:54.455268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:55.999830 run osmo-stp_10.42.42.5(pid=20946): stderr: | 20221210090754652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090754652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090754652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090754653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090754653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090754653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090754653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:56.134711 run osmo-stp_10.42.42.5(pid=20946): stdout: | (launched: 2022-12-10_09:07:54.455268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:07:56.262191 run osmo-stp_10.42.42.5(pid=20946): stderr: | 20221210090754652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090754652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090754652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090754653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090754653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090754653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090754653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:07:56.414779 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20946): Process ended prematurely: osmo-stp_10.42.42.5(pid=20946) [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20946)] [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:07:56.424037 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:07:56.451994 run osmo-hlr_10.42.42.2(pid=20943): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20943)] 09:07:56.501685 run osmo-hlr_10.42.42.2(pid=20943): stdout: | (launched: 2022-12-10_09:07:53.450873) 09:07:56.553062 run osmo-hlr_10.42.42.2(pid=20943): stderr: | 20221210090753654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090753654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090753654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090753654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090753654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090753654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090753666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090753675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090753675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090753675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:07:56.624512 run osmo-msc_10.42.42.6(pid=20949): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20949)] 09:07:56.674101 run osmo-msc_10.42.42.6(pid=20949): stdout: | (launched: 2022-12-10_09:07:55.485892) 09:07:56.724920 run osmo-msc_10.42.42.6(pid=20949): stderr: | 20221210090755812 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090755812 DLGLOBAL DEBUG validating counter group 0x7f6c3245dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090755813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090755813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090755813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090755813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090755815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090755815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090755815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090755815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:07:56.776406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20942): Terminating (SIGTERM) 09:07:56.817595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20945): Terminating (SIGTERM) 09:07:56.859060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20948): Terminating (SIGTERM) 09:07:56.900426 --- ParallelTerminationStrategy: PID 20942 died... 09:07:56.919751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20942): Terminated: ok {rc=0} 09:07:56.965073 --- ParallelTerminationStrategy: PID 20945 died... 09:07:56.984166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20945): Terminated: ok {rc=0} 09:07:57.029352 --- ParallelTerminationStrategy: PID 20948 died... 09:07:57.048443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20948): Terminated: ok {rc=0} 09:07:57.134479 bus /sierra_3: Setting Powered False 09:07:58.232093 bus /sierra_3: Setting Powered False 09:07:59.345897 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:08:00.493791 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:00.505906 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:08:00.578025 tst mo_mt_call_osmux.py: using LAC 27337 09:08:00.705820 tst mo_mt_call_osmux.py: using RAC 52 09:08:00.838481 tst mo_mt_call_osmux.py: using CellId 27337 09:08:00.973528 tst mo_mt_call_osmux.py: using BVCI 27338 09:08:01.094427 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:01.107231 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:01.119749 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:01.132289 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:01.144455 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:08:01.156553 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:08:01.281824 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:08:01.418246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:01.940918 run create_hlr_db(pid=20951): Launched 09:08:02.093349 bus /sierra_2: Setting Powered False 09:08:03.156794 run create_hlr_db(pid=20951): Terminated: ok {rc=0} 09:08:03.594796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Launched 09:08:03.902615 run osmo-hlr_10.42.42.2(pid=20954): Launched 09:08:04.019879 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:04.557371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Launched 09:08:04.864467 run osmo-stp_10.42.42.5(pid=20957): Launched 09:08:04.981629 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:05.540592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20959): Launched 09:08:05.849367 run osmo-msc_10.42.42.6(pid=20960): Launched 09:08:06.020086 run osmo-stp_10.42.42.5(pid=20957): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] 09:08:06.149792 run osmo-stp_10.42.42.5(pid=20957): stdout: | (launched: 2022-12-10_09:08:04.805712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:06.279326 run osmo-stp_10.42.42.5(pid=20957): stderr: | 20221210090804977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090804977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090804978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090804978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090804978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090804978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090804979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:06.406167 run osmo-stp_10.42.42.5(pid=20957): stdout: | (launched: 2022-12-10_09:08:04.805712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:06.527296 run osmo-stp_10.42.42.5(pid=20957): stderr: | 20221210090804977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090804977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090804978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090804978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090804978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090804978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090804979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:06.672183 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20957): Process ended prematurely: osmo-stp_10.42.42.5(pid=20957) [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:08:06.681179 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:08:06.707829 run osmo-hlr_10.42.42.2(pid=20954): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20954)] 09:08:06.755401 run osmo-hlr_10.42.42.2(pid=20954): stdout: | (launched: 2022-12-10_09:08:03.843650) 09:08:06.804581 run osmo-hlr_10.42.42.2(pid=20954): stderr: | 20221210090804023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090804023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090804023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090804023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090804023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090804023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090804037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090804046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090804046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090804046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:06.873340 run osmo-msc_10.42.42.6(pid=20960): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20960)] 09:08:06.920673 run osmo-msc_10.42.42.6(pid=20960): stdout: | (launched: 2022-12-10_09:08:05.789803) 09:08:06.969595 run osmo-msc_10.42.42.6(pid=20960): stderr: | 20221210090806067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090806067 DLGLOBAL DEBUG validating counter group 0x7f8e32cc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090806067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090806067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090806068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090806068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090806070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090806070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090806070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090806070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:07.018887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Terminating (SIGTERM) 09:08:07.058058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Terminating (SIGTERM) 09:08:07.097339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20959): Terminating (SIGTERM) 09:08:07.136927 --- ParallelTerminationStrategy: PID 20953 died... 09:08:07.155580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20953): Terminated: ok {rc=0} 09:08:07.199302 --- ParallelTerminationStrategy: PID 20956 died... 09:08:07.217871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20956): Terminated: ok {rc=0} 09:08:07.261647 --- ParallelTerminationStrategy: PID 20959 died... 09:08:07.280106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20959): Terminated: ok {rc=0} 09:08:07.365932 bus /sierra_3: Setting Powered False 09:08:08.464141 bus /sierra_3: Setting Powered False 09:08:09.578332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:08:10.828836 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:10.834689 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:08:10.869899 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:08:10.897035 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:08:10.949101 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:08:10.982524 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:08:11.009101 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:08:11.561527 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:08:11.612672 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:11.623694 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:11.693443 tst mo_mt_call.py: using LAC 27338 09:08:11.813448 tst mo_mt_call.py: using RAC 53 09:08:11.935807 tst mo_mt_call.py: using CellId 27338 09:08:12.058002 tst mo_mt_call.py: using BVCI 27339 09:08:12.171032 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:12.181932 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:12.192562 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:12.204209 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:12.215573 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:12.226982 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:08:12.342514 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:08:12.460728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:12.961733 run create_hlr_db(pid=20965): Launched 09:08:13.092177 bus /sierra_2: Setting Powered False 09:08:14.155256 run create_hlr_db(pid=20965): Terminated: ok {rc=0} 09:08:14.601715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20967): Launched 09:08:14.923037 run osmo-hlr_10.42.42.2(pid=20968): Launched 09:08:15.045777 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:15.602395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20970): Launched 09:08:15.939542 run osmo-stp_10.42.42.5(pid=20971): Launched 09:08:16.187490 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:16.959596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Launched 09:08:17.309706 run osmo-msc_10.42.42.6(pid=21022): Launched 09:08:17.613250 run osmo-stp_10.42.42.5(pid=20971): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20971)] 09:08:17.915816 run osmo-stp_10.42.42.5(pid=20971): stdout: | (launched: 2022-12-10_09:08:15.867218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:18.235709 run osmo-stp_10.42.42.5(pid=20971): stderr: | 20221210090816150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090816151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090816151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090816151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090816152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090816152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090816152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:18.447688 run osmo-stp_10.42.42.5(pid=20971): stdout: | (launched: 2022-12-10_09:08:15.867218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:18.597989 run osmo-stp_10.42.42.5(pid=20971): stderr: | 20221210090816150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090816151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090816151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090816151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090816152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090816152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090816152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:18.772349 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20971): Process ended prematurely: osmo-stp_10.42.42.5(pid=20971) [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20971)] [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:08:18.782452 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 09:08:18.820429 run osmo-hlr_10.42.42.2(pid=20968): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20968)] 09:08:18.879448 run osmo-hlr_10.42.42.2(pid=20968): stdout: | (launched: 2022-12-10_09:08:14.864475) 09:08:18.942658 run osmo-hlr_10.42.42.2(pid=20968): stderr: | 20221210090815063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090815063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090815063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090815063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090815063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090815063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090815074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090815082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090815082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090815082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:19.026684 run osmo-msc_10.42.42.6(pid=21022): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21022)] 09:08:19.089644 run osmo-msc_10.42.42.6(pid=21022): stdout: | (launched: 2022-12-10_09:08:17.233533) 09:08:19.151681 run osmo-msc_10.42.42.6(pid=21022): stderr: | 20221210090817858 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090817858 DLGLOBAL DEBUG validating counter group 0x7f038af32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090817858 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090817858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090817858 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090817858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090817860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090817860 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090817860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090817873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:19.214363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20967): Terminating (SIGTERM) 09:08:19.259146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20970): Terminating (SIGTERM) 09:08:19.305076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Terminating (SIGTERM) 09:08:19.359482 --- ParallelTerminationStrategy: PID 20967 died... 09:08:19.387195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20967): Terminated: ok {rc=0} 09:08:19.444939 --- ParallelTerminationStrategy: PID 20970 died... 09:08:19.465899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20970): Terminated: ok {rc=0} 09:08:19.527552 --- ParallelTerminationStrategy: PID 21009 died... 09:08:19.551123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21009): Terminated: ok {rc=0} 09:08:19.665747 bus /sierra_3: Setting Powered False 09:08:20.776120 bus /sierra_3: Setting Powered False 09:08:21.892611 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:08:23.047008 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.060281 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:08:23.133961 tst mo_mt_call_osmux.py: using LAC 27339 09:08:23.264407 tst mo_mt_call_osmux.py: using RAC 54 09:08:23.394222 tst mo_mt_call_osmux.py: using CellId 27339 09:08:23.525096 tst mo_mt_call_osmux.py: using BVCI 27340 09:08:23.646954 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.659093 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.671713 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.683788 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.696037 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:08:23.708295 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:08:23.831043 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:08:23.956443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:24.477882 run create_hlr_db(pid=21249): Launched 09:08:24.636277 bus /sierra_2: Setting Powered False 09:08:25.701490 run create_hlr_db(pid=21249): Terminated: ok {rc=0} 09:08:26.170072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Launched 09:08:26.516408 run osmo-hlr_10.42.42.2(pid=21252): Launched 09:08:26.771567 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:27.425726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Launched 09:08:27.750069 run osmo-stp_10.42.42.5(pid=21255): Launched 09:08:27.984747 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:28.722040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21257): Launched 09:08:29.069722 run osmo-msc_10.42.42.6(pid=21258): Launched 09:08:29.434160 run osmo-stp_10.42.42.5(pid=21255): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] 09:08:29.715624 run osmo-stp_10.42.42.5(pid=21255): stdout: | (launched: 2022-12-10_09:08:27.685717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:29.890031 run osmo-stp_10.42.42.5(pid=21255): stderr: | 20221210090828017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090828017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090828017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090828017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090828018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090828018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090828018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:30.029476 run osmo-stp_10.42.42.5(pid=21255): stdout: | (launched: 2022-12-10_09:08:27.685717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:30.163377 run osmo-stp_10.42.42.5(pid=21255): stderr: | 20221210090828017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090828017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090828017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090828017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090828018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090828018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090828018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:30.323311 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21255): Process ended prematurely: osmo-stp_10.42.42.5(pid=21255) [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:08:30.333876 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 09:08:30.363230 run osmo-hlr_10.42.42.2(pid=21252): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21252)] 09:08:30.415577 run osmo-hlr_10.42.42.2(pid=21252): stdout: | (launched: 2022-12-10_09:08:26.451396) 09:08:30.470292 run osmo-hlr_10.42.42.2(pid=21252): stderr: | 20221210090826766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090826766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090826766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090826766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090826766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090826766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090826782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090826795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090826795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090826795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:30.544938 run osmo-msc_10.42.42.6(pid=21258): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21258)] 09:08:30.597211 run osmo-msc_10.42.42.6(pid=21258): stdout: | (launched: 2022-12-10_09:08:28.996426) 09:08:30.652753 run osmo-msc_10.42.42.6(pid=21258): stderr: | 20221210090829511 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090829511 DLGLOBAL DEBUG validating counter group 0x7faac78e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090829511 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090829511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090829511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090829511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090829513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090829513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090829514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090829514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:30.706496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Terminating (SIGTERM) 09:08:30.749451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Terminating (SIGTERM) 09:08:30.795708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21257): Terminating (SIGTERM) 09:08:30.853916 --- ParallelTerminationStrategy: PID 21251 died... 09:08:30.884530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Terminated: ok {rc=0} 09:08:30.944608 --- ParallelTerminationStrategy: PID 21254 died... 09:08:30.981280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Terminated: ok {rc=0} 09:08:31.029397 --- ParallelTerminationStrategy: PID 21257 died... 09:08:31.050841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21257): Terminated: ok {rc=0} 09:08:31.142050 bus /sierra_3: Setting Powered False 09:08:32.258009 bus /sierra_3: Setting Powered False 09:08:33.394169 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:trx-lms --------------------------------------------------------------------- 09:08:34.646040 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:08:34.651202 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 09:08:34.689606 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 09:08:34.719553 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 09:08:34.806821 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 09:08:34.843170 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 09:08:34.872363 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 09:08:35.457711 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 09:08:35.463717 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:35.475589 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:08:35.527847 tst emergency_mo_mt_call.py: using LAC 27340 09:08:35.655865 tst emergency_mo_mt_call.py: using RAC 55 09:08:35.785190 tst emergency_mo_mt_call.py: using CellId 27340 09:08:35.913631 tst emergency_mo_mt_call.py: using BVCI 27341 09:08:36.033716 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:36.046782 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:36.059121 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:36.071185 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:36.082834 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:36.095132 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:36.218354 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:36.345588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:36.856610 run create_hlr_db(pid=21263): Launched 09:08:37.022134 bus /sierra_2: Setting Powered False 09:08:38.088047 run create_hlr_db(pid=21263): Terminated: ok {rc=0} 09:08:38.550752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Launched 09:08:38.897699 run osmo-hlr_10.42.42.2(pid=21266): Launched 09:08:39.144148 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:39.779119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Launched 09:08:40.079785 run osmo-stp_10.42.42.5(pid=21269): Launched 09:08:40.208252 tst emergency_mo_mt_call.py: using MSISDN 7652 09:08:40.360066 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:40.899150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Launched 09:08:41.200321 run osmo-msc_10.42.42.6(pid=21272): Launched 09:08:41.367937 run osmo-stp_10.42.42.5(pid=21269): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] 09:08:41.494853 run osmo-stp_10.42.42.5(pid=21269): stdout: | (launched: 2022-12-10_09:08:40.020636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:41.621780 run osmo-stp_10.42.42.5(pid=21269): stderr: | 20221210090840193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090840193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090840193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090840194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090840194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090840194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090840194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:41.746177 run osmo-stp_10.42.42.5(pid=21269): stdout: | (launched: 2022-12-10_09:08:40.020636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:41.864603 run osmo-stp_10.42.42.5(pid=21269): stderr: | 20221210090840193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090840193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090840193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090840194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090840194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090840194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090840194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:42.006139 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21269): Process ended prematurely: osmo-stp_10.42.42.5(pid=21269) [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 09:08:42.014391 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 09:08:42.040614 run osmo-hlr_10.42.42.2(pid=21266): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21266)] 09:08:42.088644 run osmo-hlr_10.42.42.2(pid=21266): stdout: | (launched: 2022-12-10_09:08:38.830246) 09:08:42.137820 run osmo-hlr_10.42.42.2(pid=21266): stderr: | 20221210090839148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090839157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090839157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090839157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090839157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090839157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090839169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090839185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090839185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090839185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:42.206389 run osmo-msc_10.42.42.6(pid=21272): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21272)] 09:08:42.254230 run osmo-msc_10.42.42.6(pid=21272): stdout: | (launched: 2022-12-10_09:08:41.141752) 09:08:42.303501 run osmo-msc_10.42.42.6(pid=21272): stderr: | 20221210090841416 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090841416 DLGLOBAL DEBUG validating counter group 0x7f1e13a3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090841416 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090841416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090841416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090841416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090841418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090841419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090841419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090841419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:42.353082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Terminating (SIGTERM) 09:08:42.392259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Terminating (SIGTERM) 09:08:42.431518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Terminating (SIGTERM) 09:08:42.471099 --- ParallelTerminationStrategy: PID 21265 died... 09:08:42.489796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21265): Terminated: ok {rc=0} 09:08:42.533452 --- ParallelTerminationStrategy: PID 21268 died... 09:08:42.551764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21268): Terminated: ok {rc=0} 09:08:42.595154 --- ParallelTerminationStrategy: PID 21271 died... 09:08:42.613597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21271): Terminated: ok {rc=0} 09:08:42.699013 bus /sierra_3: Setting Powered False 09:08:43.796227 bus /sierra_3: Setting Powered False 09:08:44.910678 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 09:08:46.008748 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.026294 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 09:08:46.090544 tst emergency_preemptive_call.py: using LAC 27341 09:08:46.229531 tst emergency_preemptive_call.py: using RAC 56 09:08:46.392683 tst emergency_preemptive_call.py: using CellId 27341 09:08:46.547867 tst emergency_preemptive_call.py: using BVCI 27342 09:08:46.666344 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.677534 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.689437 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.701617 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.713128 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 09:08:46.724364 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:46.844365 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:46.967511 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:47.088057 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 09:08:47.200448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:08:47.675126 run create_hlr_db(pid=21274): Launched 09:08:47.790621 bus /sierra_2: Setting Powered False 09:08:48.849984 run create_hlr_db(pid=21274): Terminated: ok {rc=0} 09:08:49.271511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21276): Launched 09:08:49.574629 run osmo-hlr_10.42.42.2(pid=21277): Launched 09:08:49.688493 run osmo-stp_10.42.42.5: Starting osmo-stp 09:08:50.219406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21279): Launched 09:08:50.521778 run osmo-stp_10.42.42.5(pid=21280): Launched 09:08:50.647059 tst emergency_preemptive_call.py: using MSISDN 7653 09:08:50.811333 run osmo-msc_10.42.42.6: Starting osmo-msc 09:08:51.351534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21282): Launched 09:08:51.651732 run osmo-msc_10.42.42.6(pid=21283): Launched 09:08:51.818936 run osmo-stp_10.42.42.5(pid=21280): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21280)] 09:08:51.945298 run osmo-stp_10.42.42.5(pid=21280): stdout: | (launched: 2022-12-10_09:08:50.462726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:52.071312 run osmo-stp_10.42.42.5(pid=21280): stderr: | 20221210090850638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090850638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090850639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090850639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090850639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090850639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090850639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:52.196189 run osmo-stp_10.42.42.5(pid=21280): stdout: | (launched: 2022-12-10_09:08:50.462726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:08:52.314608 run osmo-stp_10.42.42.5(pid=21280): stderr: | 20221210090850638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090850638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090850639 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090850639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090850639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090850639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090850639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:08:52.456334 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21280): Process ended prematurely: osmo-stp_10.42.42.5(pid=21280) [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21280)] [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py:32] 09:08:52.464638 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 09:08:52.490787 run osmo-hlr_10.42.42.2(pid=21277): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21277)] 09:08:52.538648 run osmo-hlr_10.42.42.2(pid=21277): stdout: | (launched: 2022-12-10_09:08:49.515697) 09:08:52.587840 run osmo-hlr_10.42.42.2(pid=21277): stderr: | 20221210090849698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090849698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090849698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090849699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090849699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090849699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090849714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090849724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090849725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090849725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:08:52.656378 run osmo-msc_10.42.42.6(pid=21283): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21283)] 09:08:52.703761 run osmo-msc_10.42.42.6(pid=21283): stdout: | (launched: 2022-12-10_09:08:51.593799) 09:08:52.752749 run osmo-msc_10.42.42.6(pid=21283): stderr: | 20221210090851868 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210090851869 DLGLOBAL DEBUG validating counter group 0x7feb2165fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210090851869 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210090851869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210090851869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210090851870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210090851871 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210090851872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210090851872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210090851872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:08:52.802258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21276): Terminating (SIGTERM) 09:08:52.841600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21279): Terminating (SIGTERM) 09:08:52.880938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21282): Terminating (SIGTERM) 09:08:52.920568 --- ParallelTerminationStrategy: PID 21276 died... 09:08:52.939285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21276): Terminated: ok {rc=0} 09:08:52.983765 --- ParallelTerminationStrategy: PID 21279 died... 09:08:53.002199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21279): Terminated: ok {rc=0} 09:08:53.045664 --- ParallelTerminationStrategy: PID 21282 died... 09:08:53.064010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21282): Terminated: ok {rc=0} 09:08:53.148639 bus /sierra_9: Setting Powered False 09:08:54.247385 bus /sierra_9: Setting Powered False 09:08:55.361523 bus /sierra_8: Setting Powered False 09:08:56.459790 bus /sierra_8: Setting Powered False 09:08:57.573829 bus /sierra_3: Setting Powered False 09:08:58.671803 bus /sierra_3: Setting Powered False 09:08:59.786618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms --------------------------------------------------------------------- 09:09:01.074082 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:09:01.081692 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 09:09:01.125109 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 09:09:01.173495 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 09:09:01.277778 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 09:09:01.321046 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 09:09:01.370700 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 09:09:01.977588 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 09:09:02.044936 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.056892 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:09:02.107690 tst cs_paging_gprs_active.py: using LAC 27342 09:09:02.259317 tst cs_paging_gprs_active.py: using RAC 57 09:09:02.397903 tst cs_paging_gprs_active.py: using CellId 27342 09:09:02.525025 tst cs_paging_gprs_active.py: using BVCI 27343 09:09:02.643242 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.654405 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.665193 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.676575 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.687990 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.699397 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.710797 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.721965 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:02.733389 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:02.851817 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:02.970551 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:09:03.186974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:03.510851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Launched 09:09:03.791896 run iperf3-srv_10.42.42.10(pid=21291): Launched 09:09:03.913218 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:09:04.130219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:04.454015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Launched 09:09:04.733892 run iperf3-srv_10.42.42.10(pid=21293): Launched 09:09:04.854761 tst cs_paging_gprs_active.py:38: start network... 09:09:05.073420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:05.573924 run create_hlr_db(pid=21294): Launched 09:09:05.704210 bus /sierra_2: Setting Powered False 09:09:06.768316 run create_hlr_db(pid=21294): Terminated: ok {rc=0} 09:09:07.217046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21296): Launched 09:09:07.539117 run osmo-hlr_10.42.42.2(pid=21297): Launched 09:09:07.662102 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:08.215314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21299): Launched 09:09:08.537736 run osmo-stp_10.42.42.5(pid=21300): Launched 09:09:08.660088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:09.216917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21302): Launched 09:09:09.339766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:09.612399 run patchelf(pid=21303): Launched 09:09:09.791433 run osmo-stp_10.42.42.5(pid=21300): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21300)] 09:09:09.927892 run osmo-stp_10.42.42.5(pid=21300): stdout: | (launched: 2022-12-10_09:09:08.479110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:10.065598 run osmo-stp_10.42.42.5(pid=21300): stderr: | 20221210090908674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090908674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090908675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090908675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090908676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090908676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090908676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:10.203105 run osmo-stp_10.42.42.5(pid=21300): stdout: | (launched: 2022-12-10_09:09:08.479110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:10.335720 run osmo-stp_10.42.42.5(pid=21300): stderr: | 20221210090908674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090908674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090908675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090908675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090908676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090908676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090908676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:10.491718 run patchelf(pid=21303): Terminating (SIGINT) 09:09:10.671859 run patchelf(pid=21303): Terminated: ok {rc=0} 09:09:10.801805 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21300): Process ended prematurely: osmo-stp_10.42.42.5(pid=21300) [trial-2372↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21300)] [trial-2372↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 09:09:10.811749 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:09:10.839842 run osmo-hlr_10.42.42.2(pid=21297): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21297)] 09:09:10.889540 run osmo-hlr_10.42.42.2(pid=21297): stdout: | (launched: 2022-12-10_09:09:07.480244) 09:09:10.940551 run osmo-hlr_10.42.42.2(pid=21297): stderr: | 20221210090907680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090907680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090907680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090907680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090907680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090907680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090907695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090907704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090907704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090907705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:10.991925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Terminating (SIGTERM) 09:09:11.033084 run iperf3-srv_10.42.42.10(pid=21291): Terminating (SIGTERM) 09:09:11.074175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Terminating (SIGTERM) 09:09:11.115464 run iperf3-srv_10.42.42.10(pid=21293): Terminating (SIGTERM) 09:09:11.156536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21296): Terminating (SIGTERM) 09:09:11.197728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21299): Terminating (SIGTERM) 09:09:11.238886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21302): Terminating (SIGTERM) 09:09:11.280262 --- ParallelTerminationStrategy: PID 21290 died... 09:09:11.300034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Terminated: ok {rc=0} 09:09:11.345743 --- ParallelTerminationStrategy: PID 21291 died... 09:09:11.365049 run iperf3-srv_10.42.42.10(pid=21291): Terminated {rc=256} 09:09:11.410364 --- ParallelTerminationStrategy: PID 21292 died... 09:09:11.429741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Terminated: ok {rc=0} 09:09:11.475229 --- ParallelTerminationStrategy: PID 21293 died... 09:09:11.494585 run iperf3-srv_10.42.42.10(pid=21293): Terminated {rc=256} 09:09:11.539992 --- ParallelTerminationStrategy: PID 21296 died... 09:09:11.559157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21296): Terminated: ok {rc=0} 09:09:11.604591 --- ParallelTerminationStrategy: PID 21299 died... 09:09:11.623942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21299): Terminated: ok {rc=0} 09:09:11.669331 --- ParallelTerminationStrategy: PID 21302 died... 09:09:11.688559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21302): Terminated: ok {rc=0} 09:09:11.774279 bus /gobi_0: Setting Powered False 09:09:12.872265 bus /gobi_0: Setting Powered False 09:09:13.987967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms iperf3.py ---------------------------------------------- 09:09:15.136397 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.147872 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:09:15.200571 tst iperf3.py: using LAC 27343 09:09:15.328473 tst iperf3.py: using RAC 58 09:09:15.454907 tst iperf3.py: using CellId 27343 09:09:15.575263 tst iperf3.py: using BVCI 27344 09:09:15.687671 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.698492 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.708883 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.720006 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.730727 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.741428 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.752146 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.762904 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:15.773800 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:15.904652 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:09:16.163538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:16.584400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21304): Launched 09:09:16.871948 run iperf3-srv_10.42.42.10(pid=21305): Launched 09:09:16.994463 tst iperf3.py:8: start network... 09:09:17.204490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:17.682492 run create_hlr_db(pid=21306): Launched 09:09:17.799410 bus /gobi_6: Setting Powered False 09:09:18.860260 run create_hlr_db(pid=21306): Terminated: ok {rc=0} 09:09:19.284628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Launched 09:09:19.590284 run osmo-hlr_10.42.42.2(pid=21309): Launched 09:09:19.707147 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:20.236401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Launched 09:09:20.541680 run osmo-stp_10.42.42.5(pid=21312): Launched 09:09:20.660205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:21.185139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Launched 09:09:21.301375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:21.558176 run patchelf(pid=21315): Launched 09:09:21.726865 run osmo-stp_10.42.42.5(pid=21312): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] 09:09:21.855570 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-10_09:09:20.486071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:21.986246 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221210090920658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090920659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090920659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090920659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090920660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090920660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090920660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:22.116533 run osmo-stp_10.42.42.5(pid=21312): stdout: | (launched: 2022-12-10_09:09:20.486071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:22.241367 run osmo-stp_10.42.42.5(pid=21312): stderr: | 20221210090920658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090920659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090920659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090920659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090920660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090920660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090920660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:22.390038 run patchelf(pid=21315): Terminating (SIGINT) 09:09:22.560591 run patchelf(pid=21315): Terminated: ok {rc=0} 09:09:22.683753 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2372↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] [trial-2372↪gprs:trx-lms↪iperf3.py:8] 09:09:22.693042 tst iperf3.py:8: Test FAILED (7.6 sec) 09:09:22.720261 run osmo-hlr_10.42.42.2(pid=21309): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21309)] 09:09:22.767870 run osmo-hlr_10.42.42.2(pid=21309): stdout: | (launched: 2022-12-10_09:09:19.534231) 09:09:22.817254 run osmo-hlr_10.42.42.2(pid=21309): stderr: | 20221210090919709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090919710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090919710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090919710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090919710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090919710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090919722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090919732 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090919732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090919733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:22.867133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21304): Terminating (SIGTERM) 09:09:22.906827 run iperf3-srv_10.42.42.10(pid=21305): Terminating (SIGTERM) 09:09:22.946007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminating (SIGTERM) 09:09:22.985858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminating (SIGTERM) 09:09:23.025394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Terminating (SIGTERM) 09:09:23.065346 --- ParallelTerminationStrategy: PID 21304 died... 09:09:23.084282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21304): Terminated: ok {rc=0} 09:09:23.128468 --- ParallelTerminationStrategy: PID 21305 died... 09:09:23.146800 run iperf3-srv_10.42.42.10(pid=21305): Terminated {rc=256} 09:09:23.190595 --- ParallelTerminationStrategy: PID 21308 died... 09:09:23.209065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21308): Terminated: ok {rc=0} 09:09:23.253189 --- ParallelTerminationStrategy: PID 21311 died... 09:09:23.271659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21311): Terminated: ok {rc=0} 09:09:23.315719 --- ParallelTerminationStrategy: PID 21314 died... 09:09:23.334244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21314): Terminated: ok {rc=0} 09:09:23.417516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms iperf3m4.py ---------------------------------------------- 09:09:24.561798 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:24.573046 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:09:24.622346 tst iperf3m4.py: using LAC 27344 09:09:24.743885 tst iperf3m4.py: using RAC 59 09:09:24.862922 tst iperf3m4.py: using CellId 27344 09:09:24.984400 tst iperf3m4.py: using BVCI 27345 09:09:25.095255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.106083 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.116561 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.127391 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.138084 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.148833 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.159526 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.170395 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:25.181302 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:25.300873 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:25.424635 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:25.544745 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:25.661229 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:09:25.865811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:26.170729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Launched 09:09:26.435292 run iperf3-srv_10.42.42.10(pid=21317): Launched 09:09:26.548902 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:09:26.752665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:27.057444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21318): Launched 09:09:27.321687 run iperf3-srv_10.42.42.10(pid=21319): Launched 09:09:27.436034 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:09:27.640476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:27.945390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21320): Launched 09:09:28.209815 run iperf3-srv_10.42.42.10(pid=21321): Launched 09:09:28.323706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:09:28.527905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:09:28.833078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21322): Launched 09:09:29.097384 run iperf3-srv_10.42.42.10(pid=21323): Launched 09:09:29.210878 tst iperf3m4.py:8: start network... 09:09:29.414822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:29.885334 run create_hlr_db(pid=21324): Launched 09:09:30.001341 bus /gobi_6: Setting Powered False 09:09:31.060551 run create_hlr_db(pid=21324): Terminated: ok {rc=0} 09:09:31.509767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Launched 09:09:31.837742 run osmo-hlr_10.42.42.2(pid=21327): Launched 09:09:32.053827 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:32.615937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Launched 09:09:32.923270 run osmo-stp_10.42.42.5(pid=21330): Launched 09:09:33.040029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:33.564871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21332): Launched 09:09:33.681042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:33.938033 run patchelf(pid=21333): Launched 09:09:34.106945 run osmo-stp_10.42.42.5(pid=21330): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] 09:09:34.235849 run osmo-stp_10.42.42.5(pid=21330): stdout: | (launched: 2022-12-10_09:09:32.864649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:34.366451 run osmo-stp_10.42.42.5(pid=21330): stderr: | 20221210090933038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090933038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090933038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090933039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090933041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090933041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090933041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:34.497201 run osmo-stp_10.42.42.5(pid=21330): stdout: | (launched: 2022-12-10_09:09:32.864649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:34.622989 run osmo-stp_10.42.42.5(pid=21330): stderr: | 20221210090933038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090933038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090933038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090933039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090933041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090933041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090933041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:34.771334 run patchelf(pid=21333): Terminating (SIGINT) 09:09:34.942453 run patchelf(pid=21333): Terminated: ok {rc=0} 09:09:35.065570 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21330): Process ended prematurely: osmo-stp_10.42.42.5(pid=21330) [trial-2372↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] [trial-2372↪gprs:trx-lms↪iperf3m4.py:8] 09:09:35.075064 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:09:35.102740 run osmo-hlr_10.42.42.2(pid=21327): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21327)] 09:09:35.150213 run osmo-hlr_10.42.42.2(pid=21327): stdout: | (launched: 2022-12-10_09:09:31.769494) 09:09:35.199066 run osmo-hlr_10.42.42.2(pid=21327): stderr: | 20221210090932157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090932157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090932157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090932157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090932157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090932157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090932177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090932193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090932193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090932193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:35.248238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Terminating (SIGTERM) 09:09:35.287809 run iperf3-srv_10.42.42.10(pid=21317): Terminating (SIGTERM) 09:09:35.327355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21318): Terminating (SIGTERM) 09:09:35.366771 run iperf3-srv_10.42.42.10(pid=21319): Terminating (SIGTERM) 09:09:35.406118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21320): Terminating (SIGTERM) 09:09:35.445636 run iperf3-srv_10.42.42.10(pid=21321): Terminating (SIGTERM) 09:09:35.485166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21322): Terminating (SIGTERM) 09:09:35.524734 run iperf3-srv_10.42.42.10(pid=21323): Terminating (SIGTERM) 09:09:35.564174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Terminating (SIGTERM) 09:09:35.603685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Terminating (SIGTERM) 09:09:35.643309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21332): Terminating (SIGTERM) 09:09:35.683265 --- ParallelTerminationStrategy: PID 21316 died... 09:09:35.702338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Terminated: ok {rc=0} 09:09:35.746743 --- ParallelTerminationStrategy: PID 21317 died... 09:09:35.765244 run iperf3-srv_10.42.42.10(pid=21317): Terminated {rc=256} 09:09:35.809989 --- ParallelTerminationStrategy: PID 21318 died... 09:09:35.828566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21318): Terminated: ok {rc=0} 09:09:35.873147 --- ParallelTerminationStrategy: PID 21319 died... 09:09:35.891577 run iperf3-srv_10.42.42.10(pid=21319): Terminated {rc=256} 09:09:35.935606 --- ParallelTerminationStrategy: PID 21320 died... 09:09:35.954223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21320): Terminated: ok {rc=0} 09:09:35.998211 --- ParallelTerminationStrategy: PID 21321 died... 09:09:36.016688 run iperf3-srv_10.42.42.10(pid=21321): Terminated {rc=256} 09:09:36.060681 --- ParallelTerminationStrategy: PID 21322 died... 09:09:36.079378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21322): Terminated: ok {rc=0} 09:09:36.123793 --- ParallelTerminationStrategy: PID 21323 died... 09:09:36.142497 run iperf3-srv_10.42.42.10(pid=21323): Terminated {rc=256} 09:09:36.187141 --- ParallelTerminationStrategy: PID 21326 died... 09:09:36.205927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21326): Terminated: ok {rc=0} 09:09:36.250625 --- ParallelTerminationStrategy: PID 21329 died... 09:09:36.269221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21329): Terminated: ok {rc=0} 09:09:36.313428 --- ParallelTerminationStrategy: PID 21332 died... 09:09:36.331900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21332): Terminated: ok {rc=0} 09:09:36.418812 bus /gobi_4: Setting Powered False 09:09:37.518673 bus /gobi_4: Setting Powered False 09:09:38.634866 bus /gobi_1: Setting Powered False 09:09:39.734853 bus /gobi_1: Setting Powered False 09:09:40.850637 bus /gobi_0: Setting Powered False 09:09:41.948526 bus /gobi_0: Setting Powered False 09:09:43.063825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms ping.py ---------------------------------------------- 09:09:44.165285 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.176241 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:09:44.224530 tst ping.py: using LAC 27345 09:09:44.340915 tst ping.py: using RAC 60 09:09:44.457458 tst ping.py: using CellId 27345 09:09:44.583284 tst ping.py: using BVCI 27346 09:09:44.694409 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.705007 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.715521 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.726156 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.736816 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.747503 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.758416 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:44.768870 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:44.886575 tst ping.py:19: start network... 09:09:45.100758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:45.591250 run create_hlr_db(pid=21334): Launched 09:09:45.720265 bus /gobi_6: Setting Powered False 09:09:46.781029 run create_hlr_db(pid=21334): Terminated: ok {rc=0} 09:09:47.233701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21336): Launched 09:09:47.549482 run osmo-hlr_10.42.42.2(pid=21337): Launched 09:09:47.670130 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:48.221878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21339): Launched 09:09:48.537485 run osmo-stp_10.42.42.5(pid=21340): Launched 09:09:48.658613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:49.207908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21342): Launched 09:09:49.328609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:49.596673 run patchelf(pid=21343): Launched 09:09:49.773243 run osmo-stp_10.42.42.5(pid=21340): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21340)] 09:09:49.907831 run osmo-stp_10.42.42.5(pid=21340): stdout: | (launched: 2022-12-10_09:09:48.479966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:50.044135 run osmo-stp_10.42.42.5(pid=21340): stderr: | 20221210090948672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090948672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090948672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090948673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090948673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090948673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090948673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:50.180222 run osmo-stp_10.42.42.5(pid=21340): stdout: | (launched: 2022-12-10_09:09:48.479966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:50.310815 run osmo-stp_10.42.42.5(pid=21340): stderr: | 20221210090948672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090948672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090948672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090948673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090948673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090948673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090948673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:50.465273 run patchelf(pid=21343): Terminating (SIGINT) 09:09:50.644332 run patchelf(pid=21343): Terminated: ok {rc=0} 09:09:50.772517 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21340): Process ended prematurely: osmo-stp_10.42.42.5(pid=21340) [trial-2372↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21340)] [trial-2372↪gprs:trx-lms↪ping.py:22] 09:09:50.781900 tst ping.py:22: Test FAILED (6.6 sec) 09:09:50.809758 run osmo-hlr_10.42.42.2(pid=21337): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21337)] 09:09:50.859681 run osmo-hlr_10.42.42.2(pid=21337): stdout: | (launched: 2022-12-10_09:09:47.491905) 09:09:50.911730 run osmo-hlr_10.42.42.2(pid=21337): stderr: | 20221210090947690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090947690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090947690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090947690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090947690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090947690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090947702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090947711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090947711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090947711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:50.963859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21336): Terminating (SIGTERM) 09:09:51.005649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21339): Terminating (SIGTERM) 09:09:51.047502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21342): Terminating (SIGTERM) 09:09:51.089753 --- ParallelTerminationStrategy: PID 21336 died... 09:09:51.109849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21336): Terminated: ok {rc=0} 09:09:51.156270 --- ParallelTerminationStrategy: PID 21339 died... 09:09:51.175844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21339): Terminated: ok {rc=0} 09:09:51.222006 --- ParallelTerminationStrategy: PID 21342 died... 09:09:51.241704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21342): Terminated: ok {rc=0} 09:09:51.329847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 09:09:52.417186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:52.428220 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 09:09:52.478860 tst ping_idle_ping.py: using LAC 27346 09:09:52.599751 tst ping_idle_ping.py: using RAC 61 09:09:52.727815 tst ping_idle_ping.py: using CellId 27346 09:09:52.853662 tst ping_idle_ping.py: using BVCI 27347 09:09:52.969354 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:52.980459 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:52.991441 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:53.002546 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:53.013669 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:53.024456 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:53.035454 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 09:09:53.046413 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 09:09:53.161423 tst ping_idle_ping.py:24: start network... 09:09:53.363072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:09:53.829715 run create_hlr_db(pid=21345): Launched 09:09:53.944200 bus /gobi_6: Setting Powered False 09:09:55.004558 run create_hlr_db(pid=21345): Terminated: ok {rc=0} 09:09:55.442294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Launched 09:09:55.760704 run osmo-hlr_10.42.42.2(pid=21348): Launched 09:09:55.882703 run osmo-stp_10.42.42.5: Starting osmo-stp 09:09:56.435584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Launched 09:09:56.752461 run osmo-stp_10.42.42.5(pid=21351): Launched 09:09:56.873921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:09:57.423471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21353): Launched 09:09:57.545152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:09:57.813490 run patchelf(pid=21354): Launched 09:09:57.990390 run osmo-stp_10.42.42.5(pid=21351): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] 09:09:58.124401 run osmo-stp_10.42.42.5(pid=21351): stdout: | (launched: 2022-12-10_09:09:56.694703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:58.259818 run osmo-stp_10.42.42.5(pid=21351): stderr: | 20221210090956889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090956889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090956890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090956890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090956890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090956890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090956890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:58.395635 run osmo-stp_10.42.42.5(pid=21351): stdout: | (launched: 2022-12-10_09:09:56.694703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:09:58.526020 run osmo-stp_10.42.42.5(pid=21351): stderr: | 20221210090956889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210090956889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210090956890 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210090956890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210090956890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210090956890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210090956890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:09:58.680431 run patchelf(pid=21354): Terminating (SIGINT) 09:09:58.858738 run patchelf(pid=21354): Terminated: ok {rc=0} 09:09:58.987170 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21351): Process ended prematurely: osmo-stp_10.42.42.5(pid=21351) [trial-2372↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] [trial-2372↪gprs:trx-lms↪ping_idle_ping.py:27] 09:09:58.996462 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:09:59.024295 run osmo-hlr_10.42.42.2(pid=21348): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21348)] 09:09:59.073954 run osmo-hlr_10.42.42.2(pid=21348): stdout: | (launched: 2022-12-10_09:09:55.702741) 09:09:59.125329 run osmo-hlr_10.42.42.2(pid=21348): stderr: | 20221210090955902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210090955902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210090955902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210090955902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210090955902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210090955902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210090955914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210090955922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210090955922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210090955922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:09:59.176888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Terminating (SIGTERM) 09:09:59.218381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Terminating (SIGTERM) 09:09:59.260077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21353): Terminating (SIGTERM) 09:09:59.302149 --- ParallelTerminationStrategy: PID 21347 died... 09:09:59.322224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21347): Terminated: ok {rc=0} 09:09:59.368448 --- ParallelTerminationStrategy: PID 21350 died... 09:09:59.388043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21350): Terminated: ok {rc=0} 09:09:59.433929 --- ParallelTerminationStrategy: PID 21353 died... 09:09:59.453381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21353): Terminated: ok {rc=0} 09:09:59.541388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 09:10:00.854864 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:10:00.860812 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:10:00.895573 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:10:00.936491 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:10:01.029616 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:10:01.072161 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:10:01.146749 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:10:01.730926 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:10:01.785169 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:01.797074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:10:01.851623 tst cs_paging_gprs_active.py: using LAC 27347 09:10:01.974336 tst cs_paging_gprs_active.py: using RAC 62 09:10:02.098452 tst cs_paging_gprs_active.py: using CellId 27347 09:10:02.244360 tst cs_paging_gprs_active.py: using BVCI 27348 09:10:02.358264 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.370041 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.381716 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.394678 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.407962 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.420699 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.432530 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.445608 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:02.458383 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:02.580634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:02.699584 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:10:02.919524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:03.249922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21368): Launched 09:10:03.536223 run iperf3-srv_10.42.42.10(pid=21369): Launched 09:10:03.657587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:10:03.874969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:04.205109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21370): Launched 09:10:04.490078 run iperf3-srv_10.42.42.10(pid=21371): Launched 09:10:04.611090 tst cs_paging_gprs_active.py:38: start network... 09:10:04.830098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:05.335134 run create_hlr_db(pid=21372): Launched 09:10:05.465794 bus /gobi_6: Setting Powered False 09:10:06.530110 run create_hlr_db(pid=21372): Terminated: ok {rc=0} 09:10:06.971623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21374): Launched 09:10:07.280734 run osmo-hlr_10.42.42.2(pid=21375): Launched 09:10:07.397375 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:07.936293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21377): Launched 09:10:08.246033 run osmo-stp_10.42.42.5(pid=21378): Launched 09:10:08.362074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:08.890958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21380): Launched 09:10:09.006943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:09.267783 run patchelf(pid=21381): Launched 09:10:09.438330 run osmo-stp_10.42.42.5(pid=21378): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21378)] 09:10:09.567072 run osmo-stp_10.42.42.5(pid=21378): stdout: | (launched: 2022-12-10_09:10:08.185085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:09.697456 run osmo-stp_10.42.42.5(pid=21378): stderr: | 20221210091008362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091008362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091008362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091008363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091008363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091008363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091008363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:09.828133 run osmo-stp_10.42.42.5(pid=21378): stdout: | (launched: 2022-12-10_09:10:08.185085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:09.953184 run osmo-stp_10.42.42.5(pid=21378): stderr: | 20221210091008362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091008362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091008362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091008363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091008363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091008363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091008363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:10.101392 run patchelf(pid=21381): Terminating (SIGINT) 09:10:10.272096 run patchelf(pid=21381): Terminated: ok {rc=0} 09:10:10.395466 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21378): Process ended prematurely: osmo-stp_10.42.42.5(pid=21378) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21378)] [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:10:10.404835 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:10:10.432067 run osmo-hlr_10.42.42.2(pid=21375): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21375)] 09:10:10.479391 run osmo-hlr_10.42.42.2(pid=21375): stdout: | (launched: 2022-12-10_09:10:07.220453) 09:10:10.528038 run osmo-hlr_10.42.42.2(pid=21375): stderr: | 20221210091007402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091007402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091007402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091007402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091007402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091007402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091007414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091007423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091007423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091007423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:10.577470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21368): Terminating (SIGTERM) 09:10:10.616616 run iperf3-srv_10.42.42.10(pid=21369): Terminating (SIGTERM) 09:10:10.655837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21370): Terminating (SIGTERM) 09:10:10.695625 run iperf3-srv_10.42.42.10(pid=21371): Terminating (SIGTERM) 09:10:10.736114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21374): Terminating (SIGTERM) 09:10:10.776078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21377): Terminating (SIGTERM) 09:10:10.815352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21380): Terminating (SIGTERM) 09:10:10.854864 --- ParallelTerminationStrategy: PID 21368 died... 09:10:10.873681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21368): Terminated: ok {rc=0} 09:10:10.917523 --- ParallelTerminationStrategy: PID 21369 died... 09:10:10.935605 run iperf3-srv_10.42.42.10(pid=21369): Terminated {rc=256} 09:10:10.979240 --- ParallelTerminationStrategy: PID 21370 died... 09:10:10.997709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21370): Terminated: ok {rc=0} 09:10:11.041275 --- ParallelTerminationStrategy: PID 21371 died... 09:10:11.059502 run iperf3-srv_10.42.42.10(pid=21371): Terminated {rc=256} 09:10:11.103415 --- ParallelTerminationStrategy: PID 21374 died... 09:10:11.121800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21374): Terminated: ok {rc=0} 09:10:11.165335 --- ParallelTerminationStrategy: PID 21377 died... 09:10:11.183693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21377): Terminated: ok {rc=0} 09:10:11.227327 --- ParallelTerminationStrategy: PID 21380 died... 09:10:11.245688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21380): Terminated: ok {rc=0} 09:10:11.327889 bus /gobi_0: Setting Powered False 09:10:12.432445 bus /gobi_0: Setting Powered False 09:10:13.551969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:10:14.701840 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:14.713623 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:10:14.766290 tst iperf3.py: using LAC 27348 09:10:14.898045 tst iperf3.py: using RAC 63 09:10:15.026231 tst iperf3.py: using CellId 27348 09:10:15.152699 tst iperf3.py: using BVCI 27349 09:10:15.270070 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.281404 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.292469 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.303709 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.314951 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.326039 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.337298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.348266 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:15.359567 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:15.478554 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:10:15.696857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:16.058420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21738): Launched 09:10:16.353703 run iperf3-srv_10.42.42.10(pid=21739): Launched 09:10:16.486909 tst iperf3.py:8: start network... 09:10:16.709739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:17.224515 run create_hlr_db(pid=21740): Launched 09:10:17.354615 bus /gobi_6: Setting Powered False 09:10:18.419276 run create_hlr_db(pid=21740): Terminated: ok {rc=0} 09:10:18.859018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21742): Launched 09:10:19.168126 run osmo-hlr_10.42.42.2(pid=21743): Launched 09:10:19.284837 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:19.816454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21745): Launched 09:10:20.124201 run osmo-stp_10.42.42.5(pid=21746): Launched 09:10:20.241627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:20.771190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21748): Launched 09:10:20.887508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:21.148138 run patchelf(pid=21749): Launched 09:10:21.317069 run osmo-stp_10.42.42.5(pid=21746): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21746)] 09:10:21.445025 run osmo-stp_10.42.42.5(pid=21746): stdout: | (launched: 2022-12-10_09:10:20.064673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:21.574770 run osmo-stp_10.42.42.5(pid=21746): stderr: | 20221210091020239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091020239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091020239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091020239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091020240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091020240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091020240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:21.704885 run osmo-stp_10.42.42.5(pid=21746): stdout: | (launched: 2022-12-10_09:10:20.064673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:21.829638 run osmo-stp_10.42.42.5(pid=21746): stderr: | 20221210091020239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091020239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091020239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091020239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091020240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091020240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091020240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:21.978505 run patchelf(pid=21749): Terminating (SIGINT) 09:10:22.152694 run patchelf(pid=21749): Terminated: ok {rc=0} 09:10:22.280815 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21746): Process ended prematurely: osmo-stp_10.42.42.5(pid=21746) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21746)] [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 09:10:22.291289 tst iperf3.py:8: Test FAILED (7.6 sec) 09:10:22.320244 run osmo-hlr_10.42.42.2(pid=21743): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21743)] 09:10:22.369870 run osmo-hlr_10.42.42.2(pid=21743): stdout: | (launched: 2022-12-10_09:10:19.108223) 09:10:22.421109 run osmo-hlr_10.42.42.2(pid=21743): stderr: | 20221210091019288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091019288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091019288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091019288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091019288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091019288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091019301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091019310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091019310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091019310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:22.472453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21738): Terminating (SIGTERM) 09:10:22.514174 run iperf3-srv_10.42.42.10(pid=21739): Terminating (SIGTERM) 09:10:22.558459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21742): Terminating (SIGTERM) 09:10:22.599979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21745): Terminating (SIGTERM) 09:10:22.641584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21748): Terminating (SIGTERM) 09:10:22.684180 --- ParallelTerminationStrategy: PID 21738 died... 09:10:22.703542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21738): Terminated: ok {rc=0} 09:10:22.749815 --- ParallelTerminationStrategy: PID 21739 died... 09:10:22.768890 run iperf3-srv_10.42.42.10(pid=21739): Terminated {rc=256} 09:10:22.814618 --- ParallelTerminationStrategy: PID 21742 died... 09:10:22.834032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21742): Terminated: ok {rc=0} 09:10:22.880307 --- ParallelTerminationStrategy: PID 21745 died... 09:10:22.899765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21745): Terminated: ok {rc=0} 09:10:22.945892 --- ParallelTerminationStrategy: PID 21748 died... 09:10:22.965271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21748): Terminated: ok {rc=0} 09:10:23.050012 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:10:24.204714 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.217629 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:10:24.272145 tst iperf3m4.py: using LAC 27349 09:10:24.400465 tst iperf3m4.py: using RAC 64 09:10:24.530896 tst iperf3m4.py: using CellId 27349 09:10:24.663206 tst iperf3m4.py: using BVCI 27350 09:10:24.785313 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.797585 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.810589 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.822863 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.834828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.846817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.861025 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.873919 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:24.885611 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:25.011090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:25.137332 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:25.259443 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:25.381736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:10:25.606192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:25.948272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Launched 09:10:26.252197 run iperf3-srv_10.42.42.10(pid=21926): Launched 09:10:26.388930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:10:26.613164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:26.956079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Launched 09:10:27.271285 run iperf3-srv_10.42.42.10(pid=21928): Launched 09:10:27.407134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:10:27.635748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:27.981446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Launched 09:10:28.284038 run iperf3-srv_10.42.42.10(pid=21931): Launched 09:10:28.405489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:10:28.623412 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:10:28.953834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Launched 09:10:29.238746 run iperf3-srv_10.42.42.10(pid=21933): Launched 09:10:29.359736 tst iperf3m4.py:8: start network... 09:10:29.577472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:30.082809 run create_hlr_db(pid=21934): Launched 09:10:30.213475 bus /gobi_6: Setting Powered False 09:10:31.284442 run create_hlr_db(pid=21934): Terminated: ok {rc=0} 09:10:31.806591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Launched 09:10:32.156240 run osmo-hlr_10.42.42.2(pid=21937): Launched 09:10:32.278513 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:32.823194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Launched 09:10:33.133788 run osmo-stp_10.42.42.5(pid=21940): Launched 09:10:33.250717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:33.781976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Launched 09:10:33.905964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:34.184494 run patchelf(pid=21943): Launched 09:10:34.363757 run osmo-stp_10.42.42.5(pid=21940): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] 09:10:34.501047 run osmo-stp_10.42.42.5(pid=21940): stdout: | (launched: 2022-12-10_09:10:33.073543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:34.639545 run osmo-stp_10.42.42.5(pid=21940): stderr: | 20221210091033246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091033246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091033246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091033247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091033249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091033249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091033249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:34.778211 run osmo-stp_10.42.42.5(pid=21940): stdout: | (launched: 2022-12-10_09:10:33.073543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:34.911019 run osmo-stp_10.42.42.5(pid=21940): stderr: | 20221210091033246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091033246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091033246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091033247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091033249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091033249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091033249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:35.069821 run patchelf(pid=21943): Terminating (SIGINT) 09:10:35.250732 run patchelf(pid=21943): Terminated: ok {rc=0} 09:10:35.381368 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21940): Process ended prematurely: osmo-stp_10.42.42.5(pid=21940) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 09:10:35.391296 tst iperf3m4.py:8: Test FAILED (11.2 sec) 09:10:35.419840 run osmo-hlr_10.42.42.2(pid=21937): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21937)] 09:10:35.469531 run osmo-hlr_10.42.42.2(pid=21937): stdout: | (launched: 2022-12-10_09:10:32.085424) 09:10:35.520656 run osmo-hlr_10.42.42.2(pid=21937): stderr: | 20221210091032285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091032285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091032285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091032285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091032286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091032286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091032296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091032304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091032305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091032305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:35.572127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminating (SIGTERM) 09:10:35.613258 run iperf3-srv_10.42.42.10(pid=21926): Terminating (SIGTERM) 09:10:35.654287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Terminating (SIGTERM) 09:10:35.695522 run iperf3-srv_10.42.42.10(pid=21928): Terminating (SIGTERM) 09:10:35.736449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Terminating (SIGTERM) 09:10:35.777608 run iperf3-srv_10.42.42.10(pid=21931): Terminating (SIGTERM) 09:10:35.818446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminating (SIGTERM) 09:10:35.859588 run iperf3-srv_10.42.42.10(pid=21933): Terminating (SIGTERM) 09:10:35.900507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Terminating (SIGTERM) 09:10:35.941852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Terminating (SIGTERM) 09:10:35.983008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Terminating (SIGTERM) 09:10:36.024322 --- ParallelTerminationStrategy: PID 21925 died... 09:10:36.044227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21925): Terminated: ok {rc=0} 09:10:36.089986 --- ParallelTerminationStrategy: PID 21926 died... 09:10:36.109209 run iperf3-srv_10.42.42.10(pid=21926): Terminated {rc=256} 09:10:36.154772 --- ParallelTerminationStrategy: PID 21927 died... 09:10:36.174220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21927): Terminated: ok {rc=0} 09:10:36.220179 --- ParallelTerminationStrategy: PID 21928 died... 09:10:36.239602 run iperf3-srv_10.42.42.10(pid=21928): Terminated {rc=256} 09:10:36.285767 --- ParallelTerminationStrategy: PID 21930 died... 09:10:36.305130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Terminated: ok {rc=0} 09:10:36.351219 --- ParallelTerminationStrategy: PID 21931 died... 09:10:36.370670 run iperf3-srv_10.42.42.10(pid=21931): Terminated {rc=256} 09:10:36.415987 --- ParallelTerminationStrategy: PID 21932 died... 09:10:36.435289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminated: ok {rc=0} 09:10:36.481249 --- ParallelTerminationStrategy: PID 21933 died... 09:10:36.500573 run iperf3-srv_10.42.42.10(pid=21933): Terminated {rc=256} 09:10:36.545978 --- ParallelTerminationStrategy: PID 21936 died... 09:10:36.565449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Terminated: ok {rc=0} 09:10:36.610837 --- ParallelTerminationStrategy: PID 21939 died... 09:10:36.630315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Terminated: ok {rc=0} 09:10:36.676240 --- ParallelTerminationStrategy: PID 21942 died... 09:10:36.695738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Terminated: ok {rc=0} 09:10:36.783116 bus /gobi_4: Setting Powered False 09:10:37.883185 bus /gobi_4: Setting Powered False 09:10:39.002599 bus /gobi_1: Setting Powered False 09:10:40.099984 bus /gobi_1: Setting Powered False 09:10:41.216326 bus /gobi_0: Setting Powered False 09:10:42.315025 bus /gobi_0: Setting Powered False 09:10:43.428839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 09:10:44.531767 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:44.543508 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:10:44.597736 tst ping.py: using LAC 27350 09:10:44.724215 tst ping.py: using RAC 65 09:10:44.844028 tst ping.py: using CellId 27350 09:10:44.964438 tst ping.py: using BVCI 27351 09:10:45.075708 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.086803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.097664 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.108656 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.119511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.130348 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.141354 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:45.152141 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:45.270253 tst ping.py:19: start network... 09:10:45.483536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:45.993811 run create_hlr_db(pid=21944): Launched 09:10:46.113793 bus /gobi_6: Setting Powered False 09:10:47.172534 run create_hlr_db(pid=21944): Terminated: ok {rc=0} 09:10:47.602597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21946): Launched 09:10:47.905315 run osmo-hlr_10.42.42.2(pid=21947): Launched 09:10:48.019292 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:48.549775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21949): Launched 09:10:48.852818 run osmo-stp_10.42.42.5(pid=21950): Launched 09:10:48.967007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:49.485777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21952): Launched 09:10:49.599727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:49.856864 run patchelf(pid=21953): Launched 09:10:50.023293 run osmo-stp_10.42.42.5(pid=21950): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21950)] 09:10:50.150251 run osmo-stp_10.42.42.5(pid=21950): stdout: | (launched: 2022-12-10_09:10:48.793671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:50.278570 run osmo-stp_10.42.42.5(pid=21950): stderr: | 20221210091048966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091048966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091048966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091048966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091048967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091048967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091048967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:50.407285 run osmo-stp_10.42.42.5(pid=21950): stdout: | (launched: 2022-12-10_09:10:48.793671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:50.530558 run osmo-stp_10.42.42.5(pid=21950): stderr: | 20221210091048966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091048966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091048966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091048966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091048967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091048967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091048967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:50.676780 run patchelf(pid=21953): Terminating (SIGINT) 09:10:50.846507 run patchelf(pid=21953): Terminated: ok {rc=0} 09:10:50.968334 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21950): Process ended prematurely: osmo-stp_10.42.42.5(pid=21950) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21950)] [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 09:10:50.977132 tst ping.py:22: Test FAILED (6.4 sec) 09:10:51.003661 run osmo-hlr_10.42.42.2(pid=21947): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21947)] 09:10:51.051526 run osmo-hlr_10.42.42.2(pid=21947): stdout: | (launched: 2022-12-10_09:10:47.846119) 09:10:51.101167 run osmo-hlr_10.42.42.2(pid=21947): stderr: | 20221210091048026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091048026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091048026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091048026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091048026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091048026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091048038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091048048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091048048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091048048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:51.150875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21946): Terminating (SIGTERM) 09:10:51.190503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21949): Terminating (SIGTERM) 09:10:51.230372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21952): Terminating (SIGTERM) 09:10:51.270880 --- ParallelTerminationStrategy: PID 21946 died... 09:10:51.290101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21946): Terminated: ok {rc=0} 09:10:51.334869 --- ParallelTerminationStrategy: PID 21949 died... 09:10:51.353634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21949): Terminated: ok {rc=0} 09:10:51.398626 --- ParallelTerminationStrategy: PID 21952 died... 09:10:51.417517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21952): Terminated: ok {rc=0} 09:10:51.500800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:10:52.587298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:52.599593 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:10:52.653760 tst ping_idle_ping.py: using LAC 27351 09:10:52.781161 tst ping_idle_ping.py: using RAC 66 09:10:52.910712 tst ping_idle_ping.py: using CellId 27351 09:10:53.038962 tst ping_idle_ping.py: using BVCI 27352 09:10:53.155817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.167187 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.178465 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.190300 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.201862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.213512 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.225465 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:10:53.237185 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:10:53.354916 tst ping_idle_ping.py:24: start network... 09:10:53.557259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:10:54.028848 run create_hlr_db(pid=21954): Launched 09:10:54.144117 bus /gobi_6: Setting Powered False 09:10:55.204750 run create_hlr_db(pid=21954): Terminated: ok {rc=0} 09:10:55.646611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21956): Launched 09:10:55.968877 run osmo-hlr_10.42.42.2(pid=21957): Launched 09:10:56.090595 run osmo-stp_10.42.42.5: Starting osmo-stp 09:10:56.644124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21959): Launched 09:10:56.967222 run osmo-stp_10.42.42.5(pid=21960): Launched 09:10:57.088604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:10:57.643149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21962): Launched 09:10:57.764713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:10:58.067349 run patchelf(pid=21963): Launched 09:10:58.244222 run osmo-stp_10.42.42.5(pid=21960): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21960)] 09:10:58.378856 run osmo-stp_10.42.42.5(pid=21960): stdout: | (launched: 2022-12-10_09:10:56.904467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:58.514736 run osmo-stp_10.42.42.5(pid=21960): stderr: | 20221210091057101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091057101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091057101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091057102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091057102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091057102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091057102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:58.650876 run osmo-stp_10.42.42.5(pid=21960): stdout: | (launched: 2022-12-10_09:10:56.904467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:10:58.780924 run osmo-stp_10.42.42.5(pid=21960): stderr: | 20221210091057101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091057101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091057101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091057102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091057102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091057102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091057102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:10:58.935479 run patchelf(pid=21963): Terminating (SIGINT) 09:10:59.114072 run patchelf(pid=21963): Terminated: ok {rc=0} 09:10:59.242733 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21960): Process ended prematurely: osmo-stp_10.42.42.5(pid=21960) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21960)] [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 09:10:59.252042 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:10:59.279975 run osmo-hlr_10.42.42.2(pid=21957): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21957)] 09:10:59.329734 run osmo-hlr_10.42.42.2(pid=21957): stdout: | (launched: 2022-12-10_09:10:55.906274) 09:10:59.380808 run osmo-hlr_10.42.42.2(pid=21957): stderr: | 20221210091056110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091056110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091056110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091056110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091056110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091056110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091056123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091056133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091056133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091056133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:10:59.432234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21956): Terminating (SIGTERM) 09:10:59.473599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21959): Terminating (SIGTERM) 09:10:59.515617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21962): Terminating (SIGTERM) 09:10:59.557587 --- ParallelTerminationStrategy: PID 21956 died... 09:10:59.577522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21956): Terminated: ok {rc=0} 09:10:59.623496 --- ParallelTerminationStrategy: PID 21959 died... 09:10:59.643095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21959): Terminated: ok {rc=0} 09:10:59.689146 --- ParallelTerminationStrategy: PID 21962 died... 09:10:59.708550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21962): Terminated: ok {rc=0} 09:10:59.796235 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:11:01.110899 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:11:01.117368 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:11:01.151826 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:11:01.192161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:11:01.282988 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:11:01.318853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:11:01.359358 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:11:01.946586 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:11:02.000880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.012896 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:11:02.085218 tst cs_paging_gprs_active.py: using LAC 27352 09:11:02.209134 tst cs_paging_gprs_active.py: using RAC 67 09:11:02.332256 tst cs_paging_gprs_active.py: using CellId 27352 09:11:02.454789 tst cs_paging_gprs_active.py: using BVCI 27353 09:11:02.568785 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.579897 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.590861 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.602565 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.614057 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.625499 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.636870 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.648274 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:02.659805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:02.776861 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:02.896347 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:11:03.117950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:03.444724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21967): Launched 09:11:03.725476 run iperf3-srv_10.42.42.10(pid=21968): Launched 09:11:03.846752 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:11:04.065675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:04.390595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21969): Launched 09:11:04.671522 run iperf3-srv_10.42.42.10(pid=21970): Launched 09:11:04.792644 tst cs_paging_gprs_active.py:38: start network... 09:11:05.010635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:05.511285 run create_hlr_db(pid=21971): Launched 09:11:05.642726 bus /gobi_6: Setting Powered False 09:11:06.707187 run create_hlr_db(pid=21971): Terminated: ok {rc=0} 09:11:07.141686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Launched 09:11:07.447598 run osmo-hlr_10.42.42.2(pid=21974): Launched 09:11:07.565827 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:08.091986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21976): Launched 09:11:08.397423 run osmo-stp_10.42.42.5(pid=21977): Launched 09:11:08.514214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:09.040884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21979): Launched 09:11:09.157621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:09.423089 run patchelf(pid=21980): Launched 09:11:09.592817 run osmo-stp_10.42.42.5(pid=21977): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21977)] 09:11:09.722075 run osmo-stp_10.42.42.5(pid=21977): stdout: | (launched: 2022-12-10_09:11:08.341791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:09.852714 run osmo-stp_10.42.42.5(pid=21977): stderr: | 20221210091108511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091108511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091108511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091108512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091108514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091108514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091108514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:09.983839 run osmo-stp_10.42.42.5(pid=21977): stdout: | (launched: 2022-12-10_09:11:08.341791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:10.109074 run osmo-stp_10.42.42.5(pid=21977): stderr: | 20221210091108511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091108511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091108511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091108512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091108514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091108514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091108514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:10.257523 run patchelf(pid=21980): Terminating (SIGINT) 09:11:10.429194 run patchelf(pid=21980): Terminated: ok {rc=0} 09:11:10.552711 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21977): Process ended prematurely: osmo-stp_10.42.42.5(pid=21977) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21977)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:11:10.562212 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:11:10.589800 run osmo-hlr_10.42.42.2(pid=21974): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21974)] 09:11:10.637589 run osmo-hlr_10.42.42.2(pid=21974): stdout: | (launched: 2022-12-10_09:11:07.392140) 09:11:10.687311 run osmo-hlr_10.42.42.2(pid=21974): stderr: | 20221210091107567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091107567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091107567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091107567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091107567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091107567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091107585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091107595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091107596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091107596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:10.737068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21967): Terminating (SIGTERM) 09:11:10.776536 run iperf3-srv_10.42.42.10(pid=21968): Terminating (SIGTERM) 09:11:10.815951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21969): Terminating (SIGTERM) 09:11:10.855590 run iperf3-srv_10.42.42.10(pid=21970): Terminating (SIGTERM) 09:11:10.894932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Terminating (SIGTERM) 09:11:10.934499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21976): Terminating (SIGTERM) 09:11:10.974062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21979): Terminating (SIGTERM) 09:11:11.014002 --- ParallelTerminationStrategy: PID 21967 died... 09:11:11.032760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21967): Terminated: ok {rc=0} 09:11:11.077118 --- ParallelTerminationStrategy: PID 21968 died... 09:11:11.095707 run iperf3-srv_10.42.42.10(pid=21968): Terminated {rc=256} 09:11:11.139575 --- ParallelTerminationStrategy: PID 21969 died... 09:11:11.158170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21969): Terminated: ok {rc=0} 09:11:11.202105 --- ParallelTerminationStrategy: PID 21970 died... 09:11:11.220703 run iperf3-srv_10.42.42.10(pid=21970): Terminated {rc=256} 09:11:11.265102 --- ParallelTerminationStrategy: PID 21973 died... 09:11:11.283774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Terminated: ok {rc=0} 09:11:11.328040 --- ParallelTerminationStrategy: PID 21976 died... 09:11:11.346786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21976): Terminated: ok {rc=0} 09:11:11.390594 --- ParallelTerminationStrategy: PID 21979 died... 09:11:11.409236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21979): Terminated: ok {rc=0} 09:11:11.495095 bus /gobi_0: Setting Powered False 09:11:12.593281 bus /gobi_0: Setting Powered False 09:11:13.708069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:11:14.852812 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:14.864309 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:11:14.933362 tst iperf3.py: using LAC 27353 09:11:15.054273 tst iperf3.py: using RAC 68 09:11:15.176255 tst iperf3.py: using CellId 27353 09:11:15.298361 tst iperf3.py: using BVCI 27354 09:11:15.411255 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.422064 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.432549 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.443414 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.454301 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.465138 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.475927 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.486622 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:15.497737 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:15.613100 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:11:15.818741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:16.142988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21981): Launched 09:11:16.445985 run iperf3-srv_10.42.42.10(pid=21982): Launched 09:11:16.573913 tst iperf3.py:8: start network... 09:11:16.783314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:17.265049 run create_hlr_db(pid=21983): Launched 09:11:17.381710 bus /gobi_6: Setting Powered False 09:11:18.442186 run create_hlr_db(pid=21983): Terminated: ok {rc=0} 09:11:18.864917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21985): Launched 09:11:19.168370 run osmo-hlr_10.42.42.2(pid=21986): Launched 09:11:19.284423 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:19.813060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21988): Launched 09:11:20.116820 run osmo-stp_10.42.42.5(pid=21989): Launched 09:11:20.234033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:20.757878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21991): Launched 09:11:20.874018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:21.130706 run patchelf(pid=21992): Launched 09:11:21.299305 run osmo-stp_10.42.42.5(pid=21989): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21989)] 09:11:21.428571 run osmo-stp_10.42.42.5(pid=21989): stdout: | (launched: 2022-12-10_09:11:20.061131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:21.558610 run osmo-stp_10.42.42.5(pid=21989): stderr: | 20221210091120230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091120230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091120230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091120231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091120231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091120231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091120231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:21.688701 run osmo-stp_10.42.42.5(pid=21989): stdout: | (launched: 2022-12-10_09:11:20.061131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:21.813571 run osmo-stp_10.42.42.5(pid=21989): stderr: | 20221210091120230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091120230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091120230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091120231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091120231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091120231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091120231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:21.961407 run patchelf(pid=21992): Terminating (SIGINT) 09:11:22.131765 run patchelf(pid=21992): Terminated: ok {rc=0} 09:11:22.254871 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21989): Process ended prematurely: osmo-stp_10.42.42.5(pid=21989) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21989)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 09:11:22.264065 tst iperf3.py:8: Test FAILED (7.4 sec) 09:11:22.291072 run osmo-hlr_10.42.42.2(pid=21986): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21986)] 09:11:22.339055 run osmo-hlr_10.42.42.2(pid=21986): stdout: | (launched: 2022-12-10_09:11:19.112802) 09:11:22.387795 run osmo-hlr_10.42.42.2(pid=21986): stderr: | 20221210091119289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091119289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091119289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091119289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091119289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091119289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091119303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091119312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091119312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091119312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:22.437246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21981): Terminating (SIGTERM) 09:11:22.476672 run iperf3-srv_10.42.42.10(pid=21982): Terminating (SIGTERM) 09:11:22.516167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21985): Terminating (SIGTERM) 09:11:22.555721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21988): Terminating (SIGTERM) 09:11:22.595164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21991): Terminating (SIGTERM) 09:11:22.634850 --- ParallelTerminationStrategy: PID 21981 died... 09:11:22.653655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21981): Terminated: ok {rc=0} 09:11:22.698439 --- ParallelTerminationStrategy: PID 21982 died... 09:11:22.716781 run iperf3-srv_10.42.42.10(pid=21982): Terminated {rc=256} 09:11:22.760736 --- ParallelTerminationStrategy: PID 21985 died... 09:11:22.779218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21985): Terminated: ok {rc=0} 09:11:22.822707 --- ParallelTerminationStrategy: PID 21988 died... 09:11:22.841191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21988): Terminated: ok {rc=0} 09:11:22.884884 --- ParallelTerminationStrategy: PID 21991 died... 09:11:22.903747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21991): Terminated: ok {rc=0} 09:11:22.988296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:11:24.134747 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.146366 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:11:24.216305 tst iperf3m4.py: using LAC 27354 09:11:24.342805 tst iperf3m4.py: using RAC 69 09:11:24.462318 tst iperf3m4.py: using CellId 27354 09:11:24.583432 tst iperf3m4.py: using BVCI 27355 09:11:24.694273 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.705168 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.716208 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.727182 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.738037 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.749095 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.760168 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.771153 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:24.782379 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:24.898722 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:25.020734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:25.136228 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:25.256520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:11:25.475686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:25.800405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21993): Launched 09:11:26.080803 run iperf3-srv_10.42.42.10(pid=21994): Launched 09:11:26.201685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:11:26.419038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:26.743059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21995): Launched 09:11:27.023346 run iperf3-srv_10.42.42.10(pid=21996): Launched 09:11:27.144225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:11:27.360873 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:27.685561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21997): Launched 09:11:27.966308 run iperf3-srv_10.42.42.10(pid=21998): Launched 09:11:28.087334 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:11:28.304523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:11:28.628765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21999): Launched 09:11:28.909145 run iperf3-srv_10.42.42.10(pid=22000): Launched 09:11:29.030493 tst iperf3m4.py:8: start network... 09:11:29.247552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:29.751431 run create_hlr_db(pid=22001): Launched 09:11:29.881990 bus /gobi_6: Setting Powered False 09:11:30.951982 run create_hlr_db(pid=22001): Terminated: ok {rc=0} 09:11:31.427869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Launched 09:11:31.766949 run osmo-hlr_10.42.42.2(pid=22004): Launched 09:11:31.906471 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:32.599620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Launched 09:11:32.903074 run osmo-stp_10.42.42.5(pid=22007): Launched 09:11:33.021365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:33.546071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22009): Launched 09:11:33.661958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:33.918150 run patchelf(pid=22010): Launched 09:11:34.088221 run osmo-stp_10.42.42.5(pid=22007): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] 09:11:34.216509 run osmo-stp_10.42.42.5(pid=22007): stdout: | (launched: 2022-12-10_09:11:32.847565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:34.346516 run osmo-stp_10.42.42.5(pid=22007): stderr: | 20221210091133019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091133020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091133020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091133020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091133021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091133021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091133021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:34.476788 run osmo-stp_10.42.42.5(pid=22007): stdout: | (launched: 2022-12-10_09:11:32.847565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:34.601366 run osmo-stp_10.42.42.5(pid=22007): stderr: | 20221210091133019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091133020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091133020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091133020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091133021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091133021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091133021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:34.749312 run patchelf(pid=22010): Terminating (SIGINT) 09:11:34.919396 run patchelf(pid=22010): Terminated: ok {rc=0} 09:11:35.042282 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22007): Process ended prematurely: osmo-stp_10.42.42.5(pid=22007) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:11:35.051609 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:11:35.079384 run osmo-hlr_10.42.42.2(pid=22004): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22004)] 09:11:35.126885 run osmo-hlr_10.42.42.2(pid=22004): stdout: | (launched: 2022-12-10_09:11:31.699531) 09:11:35.175854 run osmo-hlr_10.42.42.2(pid=22004): stderr: | 20221210091132057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091132057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091132057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091132057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091132057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091132057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091132074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091132090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091132090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091132091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:35.225257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21993): Terminating (SIGTERM) 09:11:35.265733 run iperf3-srv_10.42.42.10(pid=21994): Terminating (SIGTERM) 09:11:35.305666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21995): Terminating (SIGTERM) 09:11:35.345501 run iperf3-srv_10.42.42.10(pid=21996): Terminating (SIGTERM) 09:11:35.385242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21997): Terminating (SIGTERM) 09:11:35.425053 run iperf3-srv_10.42.42.10(pid=21998): Terminating (SIGTERM) 09:11:35.464776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21999): Terminating (SIGTERM) 09:11:35.504601 run iperf3-srv_10.42.42.10(pid=22000): Terminating (SIGTERM) 09:11:35.544319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Terminating (SIGTERM) 09:11:35.583862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Terminating (SIGTERM) 09:11:35.623411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22009): Terminating (SIGTERM) 09:11:35.663216 --- ParallelTerminationStrategy: PID 21993 died... 09:11:35.682173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21993): Terminated: ok {rc=0} 09:11:35.726959 --- ParallelTerminationStrategy: PID 21994 died... 09:11:35.745718 run iperf3-srv_10.42.42.10(pid=21994): Terminated {rc=256} 09:11:35.789985 --- ParallelTerminationStrategy: PID 21995 died... 09:11:35.808617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21995): Terminated: ok {rc=0} 09:11:35.852874 --- ParallelTerminationStrategy: PID 21996 died... 09:11:35.871824 run iperf3-srv_10.42.42.10(pid=21996): Terminated {rc=256} 09:11:35.915839 --- ParallelTerminationStrategy: PID 21997 died... 09:11:35.934580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21997): Terminated: ok {rc=0} 09:11:35.978996 --- ParallelTerminationStrategy: PID 21998 died... 09:11:35.997634 run iperf3-srv_10.42.42.10(pid=21998): Terminated {rc=256} 09:11:36.041802 --- ParallelTerminationStrategy: PID 21999 died... 09:11:36.060555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21999): Terminated: ok {rc=0} 09:11:36.104494 --- ParallelTerminationStrategy: PID 22000 died... 09:11:36.123057 run iperf3-srv_10.42.42.10(pid=22000): Terminated {rc=256} 09:11:36.166523 --- ParallelTerminationStrategy: PID 22003 died... 09:11:36.185141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22003): Terminated: ok {rc=0} 09:11:36.228921 --- ParallelTerminationStrategy: PID 22006 died... 09:11:36.247611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22006): Terminated: ok {rc=0} 09:11:36.291715 --- ParallelTerminationStrategy: PID 22009 died... 09:11:36.310280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22009): Terminated: ok {rc=0} 09:11:36.395488 bus /gobi_4: Setting Powered False 09:11:37.495328 bus /gobi_4: Setting Powered False 09:11:38.611217 bus /gobi_1: Setting Powered False 09:11:39.709586 bus /gobi_1: Setting Powered False 09:11:40.824569 bus /gobi_0: Setting Powered False 09:11:41.922553 bus /gobi_0: Setting Powered False 09:11:43.038435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:11:44.140279 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.152480 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:11:44.223644 tst ping.py: using LAC 27355 09:11:44.349489 tst ping.py: using RAC 70 09:11:44.474226 tst ping.py: using CellId 27355 09:11:44.600283 tst ping.py: using BVCI 27356 09:11:44.716833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.728267 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.739436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.750643 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.761761 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.772997 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.784214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:44.795355 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:44.912671 tst ping.py:19: start network... 09:11:45.126225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:45.616818 run create_hlr_db(pid=22011): Launched 09:11:45.746194 bus /gobi_6: Setting Powered False 09:11:46.807734 run create_hlr_db(pid=22011): Terminated: ok {rc=0} 09:11:47.289850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22013): Launched 09:11:47.609767 run osmo-hlr_10.42.42.2(pid=22014): Launched 09:11:47.730350 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:48.278722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22016): Launched 09:11:48.594573 run osmo-stp_10.42.42.5(pid=22017): Launched 09:11:48.714871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:49.263336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22019): Launched 09:11:49.385244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:49.654219 run patchelf(pid=22020): Launched 09:11:49.830814 run osmo-stp_10.42.42.5(pid=22017): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22017)] 09:11:49.965215 run osmo-stp_10.42.42.5(pid=22017): stdout: | (launched: 2022-12-10_09:11:48.536703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:50.100510 run osmo-stp_10.42.42.5(pid=22017): stderr: | 20221210091148731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091148731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091148731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091148731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091148732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091148732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091148732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:50.236058 run osmo-stp_10.42.42.5(pid=22017): stdout: | (launched: 2022-12-10_09:11:48.536703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:50.366537 run osmo-stp_10.42.42.5(pid=22017): stderr: | 20221210091148731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091148731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091148731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091148731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091148732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091148732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091148732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:50.520724 run patchelf(pid=22020): Terminating (SIGINT) 09:11:50.698748 run patchelf(pid=22020): Terminated: ok {rc=0} 09:11:50.826552 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22017): Process ended prematurely: osmo-stp_10.42.42.5(pid=22017) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22017)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 09:11:50.835893 tst ping.py:22: Test FAILED (6.7 sec) 09:11:50.864004 run osmo-hlr_10.42.42.2(pid=22014): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22014)] 09:11:50.914091 run osmo-hlr_10.42.42.2(pid=22014): stdout: | (launched: 2022-12-10_09:11:47.551544) 09:11:50.966348 run osmo-hlr_10.42.42.2(pid=22014): stderr: | 20221210091147750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091147750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091147750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091147750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091147750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091147750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091147763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091147771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091147772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091147772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:51.018753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22013): Terminating (SIGTERM) 09:11:51.060620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22016): Terminating (SIGTERM) 09:11:51.102732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22019): Terminating (SIGTERM) 09:11:51.144942 --- ParallelTerminationStrategy: PID 22013 died... 09:11:51.165085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22013): Terminated: ok {rc=0} 09:11:51.211577 --- ParallelTerminationStrategy: PID 22016 died... 09:11:51.231291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22016): Terminated: ok {rc=0} 09:11:51.277607 --- ParallelTerminationStrategy: PID 22019 died... 09:11:51.297338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22019): Terminated: ok {rc=0} 09:11:51.384783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:11:52.471512 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:52.483403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:11:52.556895 tst ping_idle_ping.py: using LAC 27356 09:11:52.682754 tst ping_idle_ping.py: using RAC 71 09:11:52.812873 tst ping_idle_ping.py: using CellId 27356 09:11:52.939430 tst ping_idle_ping.py: using BVCI 27357 09:11:53.055719 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.067102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.078290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.089471 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.100526 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.111734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.123004 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:11:53.134158 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:11:53.251973 tst ping_idle_ping.py:24: start network... 09:11:53.465921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:11:53.961664 run create_hlr_db(pid=22022): Launched 09:11:54.083735 bus /gobi_6: Setting Powered False 09:11:55.144642 run create_hlr_db(pid=22022): Terminated: ok {rc=0} 09:11:55.565867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22024): Launched 09:11:55.866004 run osmo-hlr_10.42.42.2(pid=22025): Launched 09:11:55.980469 run osmo-stp_10.42.42.5: Starting osmo-stp 09:11:56.495572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22027): Launched 09:11:56.794257 run osmo-stp_10.42.42.5(pid=22028): Launched 09:11:56.908709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:11:57.425609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22030): Launched 09:11:57.539740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:11:57.793367 run patchelf(pid=22031): Launched 09:11:57.960775 run osmo-stp_10.42.42.5(pid=22028): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22028)] 09:11:58.088136 run osmo-stp_10.42.42.5(pid=22028): stdout: | (launched: 2022-12-10_09:11:56.739199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:58.217224 run osmo-stp_10.42.42.5(pid=22028): stderr: | 20221210091156910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091156910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091156910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091156911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091156911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091156911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091156911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:58.346195 run osmo-stp_10.42.42.5(pid=22028): stdout: | (launched: 2022-12-10_09:11:56.739199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:11:58.469611 run osmo-stp_10.42.42.5(pid=22028): stderr: | 20221210091156910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091156910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091156910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091156911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091156911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091156911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091156911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:11:58.615531 run patchelf(pid=22031): Terminating (SIGINT) 09:11:58.784158 run patchelf(pid=22031): Terminated: ok {rc=0} 09:11:58.905667 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22028): Process ended prematurely: osmo-stp_10.42.42.5(pid=22028) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22028)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:11:58.914575 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:11:58.941444 run osmo-hlr_10.42.42.2(pid=22025): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22025)] 09:11:58.989283 run osmo-hlr_10.42.42.2(pid=22025): stdout: | (launched: 2022-12-10_09:11:55.810820) 09:11:59.038266 run osmo-hlr_10.42.42.2(pid=22025): stderr: | 20221210091155986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091155986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091155986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091155986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091155986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091155986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091156001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091156011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091156012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091156012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:11:59.087795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22024): Terminating (SIGTERM) 09:11:59.127542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22027): Terminating (SIGTERM) 09:11:59.167234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22030): Terminating (SIGTERM) 09:11:59.207302 --- ParallelTerminationStrategy: PID 22024 died... 09:11:59.226329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22024): Terminated: ok {rc=0} 09:11:59.270601 --- ParallelTerminationStrategy: PID 22027 died... 09:11:59.289332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22027): Terminated: ok {rc=0} 09:11:59.333359 --- ParallelTerminationStrategy: PID 22030 died... 09:11:59.351956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22030): Terminated: ok {rc=0} 09:11:59.438303 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:12:00.742384 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:12:00.748531 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:12:00.782232 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:12:00.820552 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:12:00.950789 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:12:01.013124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:12:01.054014 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:12:01.610321 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:12:01.665327 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:01.677669 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:01.749239 tst cs_paging_gprs_active.py: using LAC 27357 09:12:01.907650 tst cs_paging_gprs_active.py: using RAC 72 09:12:02.031321 tst cs_paging_gprs_active.py: using CellId 27357 09:12:02.187644 tst cs_paging_gprs_active.py: using BVCI 27358 09:12:02.301715 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.312436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.323291 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.334403 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.345538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.356558 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.367667 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.378506 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:02.389496 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:02.508674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:02.634990 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:12:02.854013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:03.184942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22036): Launched 09:12:03.471417 run iperf3-srv_10.42.42.10(pid=22037): Launched 09:12:03.592630 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:12:03.811395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:04.140168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Launched 09:12:04.425505 run iperf3-srv_10.42.42.10(pid=22039): Launched 09:12:04.546620 tst cs_paging_gprs_active.py:38: start network... 09:12:04.765082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:05.271117 run create_hlr_db(pid=22040): Launched 09:12:05.402608 bus /gobi_6: Setting Powered False 09:12:06.466788 run create_hlr_db(pid=22040): Terminated: ok {rc=0} 09:12:06.905378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22042): Launched 09:12:07.214723 run osmo-hlr_10.42.42.2(pid=22043): Launched 09:12:07.330675 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:07.864393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22045): Launched 09:12:08.174047 run osmo-stp_10.42.42.5(pid=22046): Launched 09:12:08.291293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:08.821738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22048): Launched 09:12:08.938158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:09.200451 run patchelf(pid=22049): Launched 09:12:09.372152 run osmo-stp_10.42.42.5(pid=22046): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22046)] 09:12:09.501504 run osmo-stp_10.42.42.5(pid=22046): stdout: | (launched: 2022-12-10_09:12:08.113764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:09.632059 run osmo-stp_10.42.42.5(pid=22046): stderr: | 20221210091208287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091208288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091208288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091208288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091208290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091208291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091208291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:09.763120 run osmo-stp_10.42.42.5(pid=22046): stdout: | (launched: 2022-12-10_09:12:08.113764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:09.888082 run osmo-stp_10.42.42.5(pid=22046): stderr: | 20221210091208287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091208288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091208288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091208288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091208290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091208291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091208291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:10.036197 run patchelf(pid=22049): Terminating (SIGINT) 09:12:10.207507 run patchelf(pid=22049): Terminated: ok {rc=0} 09:12:10.330621 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22046): Process ended prematurely: osmo-stp_10.42.42.5(pid=22046) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22046)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:12:10.339879 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:12:10.367119 run osmo-hlr_10.42.42.2(pid=22043): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22043)] 09:12:10.414485 run osmo-hlr_10.42.42.2(pid=22043): stdout: | (launched: 2022-12-10_09:12:07.155075) 09:12:10.463299 run osmo-hlr_10.42.42.2(pid=22043): stderr: | 20221210091207337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091207337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091207337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091207337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091207337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091207337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091207362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091207370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091207371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091207371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:10.513187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22036): Terminating (SIGTERM) 09:12:10.552831 run iperf3-srv_10.42.42.10(pid=22037): Terminating (SIGTERM) 09:12:10.592271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Terminating (SIGTERM) 09:12:10.631677 run iperf3-srv_10.42.42.10(pid=22039): Terminating (SIGTERM) 09:12:10.671056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22042): Terminating (SIGTERM) 09:12:10.710326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22045): Terminating (SIGTERM) 09:12:10.749896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22048): Terminating (SIGTERM) 09:12:10.789537 --- ParallelTerminationStrategy: PID 22036 died... 09:12:10.808209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22036): Terminated: ok {rc=0} 09:12:10.852496 --- ParallelTerminationStrategy: PID 22037 died... 09:12:10.871083 run iperf3-srv_10.42.42.10(pid=22037): Terminated {rc=256} 09:12:10.914938 --- ParallelTerminationStrategy: PID 22038 died... 09:12:10.933433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22038): Terminated: ok {rc=0} 09:12:10.977115 --- ParallelTerminationStrategy: PID 22039 died... 09:12:10.995505 run iperf3-srv_10.42.42.10(pid=22039): Terminated {rc=256} 09:12:11.039079 --- ParallelTerminationStrategy: PID 22042 died... 09:12:11.057593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22042): Terminated: ok {rc=0} 09:12:11.101201 --- ParallelTerminationStrategy: PID 22045 died... 09:12:11.119399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22045): Terminated: ok {rc=0} 09:12:11.163109 --- ParallelTerminationStrategy: PID 22048 died... 09:12:11.181371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22048): Terminated: ok {rc=0} 09:12:11.264043 bus /gobi_0: Setting Powered False 09:12:12.361465 bus /gobi_0: Setting Powered False 09:12:13.477828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:12:14.626244 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:14.638052 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:14.710156 tst iperf3.py: using LAC 27358 09:12:14.838702 tst iperf3.py: using RAC 73 09:12:14.966878 tst iperf3.py: using CellId 27358 09:12:15.094630 tst iperf3.py: using BVCI 27359 09:12:15.212182 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.223428 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.234612 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.245743 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.256689 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.267776 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.278914 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.290049 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:15.301426 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:15.417677 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:15.623594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:15.949708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22050): Launched 09:12:16.250548 run iperf3-srv_10.42.42.10(pid=22051): Launched 09:12:16.382019 tst iperf3.py:8: start network... 09:12:16.592084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:17.080687 run create_hlr_db(pid=22052): Launched 09:12:17.233942 bus /gobi_6: Setting Powered False 09:12:18.294606 run create_hlr_db(pid=22052): Terminated: ok {rc=0} 09:12:18.742630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Launched 09:12:19.072536 run osmo-hlr_10.42.42.2(pid=22055): Launched 09:12:19.196925 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:19.761951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Launched 09:12:20.089629 run osmo-stp_10.42.42.5(pid=22058): Launched 09:12:20.213105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:20.776497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Launched 09:12:20.899517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:21.177582 run patchelf(pid=22061): Launched 09:12:21.357093 run osmo-stp_10.42.42.5(pid=22058): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] 09:12:21.493754 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-10_09:12:20.026864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:21.631753 run osmo-stp_10.42.42.5(pid=22058): stderr: | 20221210091220222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091220222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091220223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091220223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091220224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091220224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091220224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:21.770239 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-10_09:12:20.026864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:21.903657 run osmo-stp_10.42.42.5(pid=22058): stderr: | 20221210091220222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091220222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091220223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091220223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091220224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091220224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091220224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:22.061509 run patchelf(pid=22061): Terminating (SIGINT) 09:12:22.242179 run patchelf(pid=22061): Terminated: ok {rc=0} 09:12:22.372360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 09:12:22.382314 tst iperf3.py:8: Test FAILED (7.8 sec) 09:12:22.411174 run osmo-hlr_10.42.42.2(pid=22055): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22055)] 09:12:22.460598 run osmo-hlr_10.42.42.2(pid=22055): stdout: | (launched: 2022-12-10_09:12:19.009260) 09:12:22.511684 run osmo-hlr_10.42.42.2(pid=22055): stderr: | 20221210091219212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091219212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091219212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091219212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091219212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091219212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091219224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091219233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091219233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091219233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:22.563830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22050): Terminating (SIGTERM) 09:12:22.605387 run iperf3-srv_10.42.42.10(pid=22051): Terminating (SIGTERM) 09:12:22.646717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminating (SIGTERM) 09:12:22.688369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminating (SIGTERM) 09:12:22.729826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Terminating (SIGTERM) 09:12:22.771804 --- ParallelTerminationStrategy: PID 22050 died... 09:12:22.791710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22050): Terminated: ok {rc=0} 09:12:22.837748 --- ParallelTerminationStrategy: PID 22051 died... 09:12:22.857337 run iperf3-srv_10.42.42.10(pid=22051): Terminated {rc=256} 09:12:22.902918 --- ParallelTerminationStrategy: PID 22054 died... 09:12:22.922694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminated: ok {rc=0} 09:12:22.968791 --- ParallelTerminationStrategy: PID 22057 died... 09:12:22.988705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminated: ok {rc=0} 09:12:23.035100 --- ParallelTerminationStrategy: PID 22060 died... 09:12:23.054896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Terminated: ok {rc=0} 09:12:23.141560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:12:24.293564 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.305621 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:24.377641 tst iperf3m4.py: using LAC 27359 09:12:24.501195 tst iperf3m4.py: using RAC 74 09:12:24.623500 tst iperf3m4.py: using CellId 27359 09:12:24.744674 tst iperf3m4.py: using BVCI 27360 09:12:24.856380 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.867538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.878179 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.889016 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.899744 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.910626 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.921699 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.932430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:24.943427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:25.063264 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:25.183117 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:25.303778 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:25.425445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:12:25.645806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:25.977193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22062): Launched 09:12:26.265232 run iperf3-srv_10.42.42.10(pid=22063): Launched 09:12:26.387042 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:12:26.605556 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:26.935172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22064): Launched 09:12:27.222756 run iperf3-srv_10.42.42.10(pid=22065): Launched 09:12:27.345014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:12:27.564257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:27.894459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22066): Launched 09:12:28.181475 run iperf3-srv_10.42.42.10(pid=22067): Launched 09:12:28.302238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:12:28.520345 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:12:28.850995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22068): Launched 09:12:29.136840 run iperf3-srv_10.42.42.10(pid=22069): Launched 09:12:29.257855 tst iperf3m4.py:8: start network... 09:12:29.475390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:29.983640 run create_hlr_db(pid=22070): Launched 09:12:30.114503 bus /gobi_6: Setting Powered False 09:12:31.189396 run create_hlr_db(pid=22070): Terminated: ok {rc=0} 09:12:31.711815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22072): Launched 09:12:32.061733 run osmo-hlr_10.42.42.2(pid=22073): Launched 09:12:32.203139 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:32.814554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22075): Launched 09:12:33.143901 run osmo-stp_10.42.42.5(pid=22076): Launched 09:12:33.267414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:33.830494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22078): Launched 09:12:33.954575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:34.234109 run patchelf(pid=22079): Launched 09:12:34.413485 run osmo-stp_10.42.42.5(pid=22076): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22076)] 09:12:34.549769 run osmo-stp_10.42.42.5(pid=22076): stdout: | (launched: 2022-12-10_09:12:33.079568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:34.687733 run osmo-stp_10.42.42.5(pid=22076): stderr: | 20221210091233279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091233279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091233279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091233280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091233280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091233280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091233280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:34.826175 run osmo-stp_10.42.42.5(pid=22076): stdout: | (launched: 2022-12-10_09:12:33.079568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:34.958649 run osmo-stp_10.42.42.5(pid=22076): stderr: | 20221210091233279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091233279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091233279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091233280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091233280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091233280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091233280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:35.116531 run patchelf(pid=22079): Terminating (SIGINT) 09:12:35.297516 run patchelf(pid=22079): Terminated: ok {rc=0} 09:12:35.428194 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22076): Process ended prematurely: osmo-stp_10.42.42.5(pid=22076) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22076)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:12:35.438321 tst iperf3m4.py:8: Test FAILED (11.2 sec) 09:12:35.466878 run osmo-hlr_10.42.42.2(pid=22073): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22073)] 09:12:35.516267 run osmo-hlr_10.42.42.2(pid=22073): stdout: | (launched: 2022-12-10_09:12:31.996048) 09:12:35.567307 run osmo-hlr_10.42.42.2(pid=22073): stderr: | 20221210091232333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091232334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091232334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091232334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091232334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091232334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091232349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091232366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091232366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091232366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:35.618863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22062): Terminating (SIGTERM) 09:12:35.660306 run iperf3-srv_10.42.42.10(pid=22063): Terminating (SIGTERM) 09:12:35.701710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22064): Terminating (SIGTERM) 09:12:35.743261 run iperf3-srv_10.42.42.10(pid=22065): Terminating (SIGTERM) 09:12:35.784562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22066): Terminating (SIGTERM) 09:12:35.826071 run iperf3-srv_10.42.42.10(pid=22067): Terminating (SIGTERM) 09:12:35.867357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22068): Terminating (SIGTERM) 09:12:35.908731 run iperf3-srv_10.42.42.10(pid=22069): Terminating (SIGTERM) 09:12:35.950915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22072): Terminating (SIGTERM) 09:12:35.994368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22075): Terminating (SIGTERM) 09:12:36.035664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22078): Terminating (SIGTERM) 09:12:36.077210 --- ParallelTerminationStrategy: PID 22062 died... 09:12:36.096889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22062): Terminated: ok {rc=0} 09:12:36.142689 --- ParallelTerminationStrategy: PID 22063 died... 09:12:36.162059 run iperf3-srv_10.42.42.10(pid=22063): Terminated {rc=256} 09:12:36.207429 --- ParallelTerminationStrategy: PID 22064 died... 09:12:36.226809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22064): Terminated: ok {rc=0} 09:12:36.272268 --- ParallelTerminationStrategy: PID 22065 died... 09:12:36.291674 run iperf3-srv_10.42.42.10(pid=22065): Terminated {rc=256} 09:12:36.337140 --- ParallelTerminationStrategy: PID 22066 died... 09:12:36.356429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22066): Terminated: ok {rc=0} 09:12:36.401982 --- ParallelTerminationStrategy: PID 22067 died... 09:12:36.421318 run iperf3-srv_10.42.42.10(pid=22067): Terminated {rc=256} 09:12:36.466880 --- ParallelTerminationStrategy: PID 22068 died... 09:12:36.486283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22068): Terminated: ok {rc=0} 09:12:36.532097 --- ParallelTerminationStrategy: PID 22069 died... 09:12:36.551511 run iperf3-srv_10.42.42.10(pid=22069): Terminated {rc=256} 09:12:36.597152 --- ParallelTerminationStrategy: PID 22072 died... 09:12:36.616469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22072): Terminated: ok {rc=0} 09:12:36.661976 --- ParallelTerminationStrategy: PID 22075 died... 09:12:36.681402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22075): Terminated: ok {rc=0} 09:12:36.726690 --- ParallelTerminationStrategy: PID 22078 died... 09:12:36.745947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22078): Terminated: ok {rc=0} 09:12:36.832010 bus /gobi_4: Setting Powered False 09:12:37.928049 bus /gobi_4: Setting Powered False 09:12:39.043369 bus /gobi_1: Setting Powered False 09:12:40.140991 bus /gobi_1: Setting Powered False 09:12:41.255760 bus /gobi_0: Setting Powered False 09:12:42.352788 bus /gobi_0: Setting Powered False 09:12:43.468759 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:12:44.570379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:44.582203 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:44.652738 tst ping.py: using LAC 27360 09:12:44.771584 tst ping.py: using RAC 75 09:12:44.898236 tst ping.py: using CellId 27360 09:12:45.025626 tst ping.py: using BVCI 27361 09:12:45.137086 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.147920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.158652 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.169686 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.180381 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.191316 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.202371 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:45.213480 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:45.328750 tst ping.py:19: start network... 09:12:45.530011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:46.016502 run create_hlr_db(pid=22083): Launched 09:12:46.175431 bus /gobi_6: Setting Powered False 09:12:47.246212 run create_hlr_db(pid=22083): Terminated: ok {rc=0} 09:12:47.678320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Launched 09:12:47.982562 run osmo-hlr_10.42.42.2(pid=22086): Launched 09:12:48.097865 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:48.634808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Launched 09:12:48.938410 run osmo-stp_10.42.42.5(pid=22089): Launched 09:12:49.052403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:49.575507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22091): Launched 09:12:49.690016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:49.947702 run patchelf(pid=22092): Launched 09:12:50.115714 run osmo-stp_10.42.42.5(pid=22089): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] 09:12:50.243132 run osmo-stp_10.42.42.5(pid=22089): stdout: | (launched: 2022-12-10_09:12:48.879135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:50.371872 run osmo-stp_10.42.42.5(pid=22089): stderr: | 20221210091249053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091249053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091249053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091249054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091249055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091249055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091249055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:50.500661 run osmo-stp_10.42.42.5(pid=22089): stdout: | (launched: 2022-12-10_09:12:48.879135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:50.624168 run osmo-stp_10.42.42.5(pid=22089): stderr: | 20221210091249053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091249053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091249053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091249054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091249055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091249055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091249055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:50.770778 run patchelf(pid=22092): Terminating (SIGINT) 09:12:50.939908 run patchelf(pid=22092): Terminated: ok {rc=0} 09:12:51.061823 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22089): Process ended prematurely: osmo-stp_10.42.42.5(pid=22089) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 09:12:51.070594 tst ping.py:22: Test FAILED (6.5 sec) 09:12:51.097619 run osmo-hlr_10.42.42.2(pid=22086): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22086)] 09:12:51.145415 run osmo-hlr_10.42.42.2(pid=22086): stdout: | (launched: 2022-12-10_09:12:47.923476) 09:12:51.194510 run osmo-hlr_10.42.42.2(pid=22086): stderr: | 20221210091248105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091248105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091248105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091248105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091248105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091248105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091248117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091248126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091248126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091248126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:51.244123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Terminating (SIGTERM) 09:12:51.283725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Terminating (SIGTERM) 09:12:51.323207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22091): Terminating (SIGTERM) 09:12:51.363247 --- ParallelTerminationStrategy: PID 22085 died... 09:12:51.382254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22085): Terminated: ok {rc=0} 09:12:51.426359 --- ParallelTerminationStrategy: PID 22088 died... 09:12:51.445097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22088): Terminated: ok {rc=0} 09:12:51.489073 --- ParallelTerminationStrategy: PID 22091 died... 09:12:51.507629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22091): Terminated: ok {rc=0} 09:12:51.594308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:12:52.681980 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:52.693870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:12:52.768333 tst ping_idle_ping.py: using LAC 27361 09:12:52.894923 tst ping_idle_ping.py: using RAC 76 09:12:53.025542 tst ping_idle_ping.py: using CellId 27361 09:12:53.150232 tst ping_idle_ping.py: using BVCI 27362 09:12:53.266734 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.278095 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.289249 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.300756 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.312214 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.323818 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.335584 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:12:53.347216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:12:53.468251 tst ping_idle_ping.py:24: start network... 09:12:53.683125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:12:54.185311 run create_hlr_db(pid=22093): Launched 09:12:54.314599 bus /gobi_6: Setting Powered False 09:12:55.378312 run create_hlr_db(pid=22093): Terminated: ok {rc=0} 09:12:55.811551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Launched 09:12:56.116858 run osmo-hlr_10.42.42.2(pid=22096): Launched 09:12:56.232552 run osmo-stp_10.42.42.5: Starting osmo-stp 09:12:56.770107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Launched 09:12:57.074583 run osmo-stp_10.42.42.5(pid=22099): Launched 09:12:57.190382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:12:57.714585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22101): Launched 09:12:57.829621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:12:58.088660 run patchelf(pid=22102): Launched 09:12:58.256695 run osmo-stp_10.42.42.5(pid=22099): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] 09:12:58.383812 run osmo-stp_10.42.42.5(pid=22099): stdout: | (launched: 2022-12-10_09:12:57.015702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:58.512674 run osmo-stp_10.42.42.5(pid=22099): stderr: | 20221210091257188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091257189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091257189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091257189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091257190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091257190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091257190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:58.641233 run osmo-stp_10.42.42.5(pid=22099): stdout: | (launched: 2022-12-10_09:12:57.015702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:12:58.764585 run osmo-stp_10.42.42.5(pid=22099): stderr: | 20221210091257188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091257189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091257189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091257189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091257190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091257190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091257190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:12:58.911027 run patchelf(pid=22102): Terminating (SIGINT) 09:12:59.079746 run patchelf(pid=22102): Terminated: ok {rc=0} 09:12:59.201497 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22099): Process ended prematurely: osmo-stp_10.42.42.5(pid=22099) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:12:59.210243 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:12:59.237400 run osmo-hlr_10.42.42.2(pid=22096): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22096)] 09:12:59.285772 run osmo-hlr_10.42.42.2(pid=22096): stdout: | (launched: 2022-12-10_09:12:56.057204) 09:12:59.335488 run osmo-hlr_10.42.42.2(pid=22096): stderr: | 20221210091256235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091256235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091256235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091256235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091256235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091256235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091256248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091256258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091256258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091256259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:12:59.385865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Terminating (SIGTERM) 09:12:59.426165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Terminating (SIGTERM) 09:12:59.466147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22101): Terminating (SIGTERM) 09:12:59.506468 --- ParallelTerminationStrategy: PID 22095 died... 09:12:59.525734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22095): Terminated: ok {rc=0} 09:12:59.570190 --- ParallelTerminationStrategy: PID 22098 died... 09:12:59.589055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22098): Terminated: ok {rc=0} 09:12:59.633472 --- ParallelTerminationStrategy: PID 22101 died... 09:12:59.652381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22101): Terminated: ok {rc=0} 09:12:59.736471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:13:01.057589 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:01.064177 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:13:01.100436 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:13:01.137477 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:13:01.197465 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:13:01.241152 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:13:01.288021 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:13:01.830473 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:13:01.837147 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:01.849758 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:13:01.924201 tst switch_tch_pdch.py: using LAC 27362 09:13:02.052303 tst switch_tch_pdch.py: using RAC 77 09:13:02.176149 tst switch_tch_pdch.py: using CellId 27362 09:13:02.297925 tst switch_tch_pdch.py: using BVCI 27363 09:13:02.414315 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.426032 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.437565 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.449054 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.460767 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.472196 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.483856 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:13:02.495289 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:13:02.611003 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:13:02.737454 tst switch_tch_pdch.py:51: start network... 09:13:02.952017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:03.445474 run create_hlr_db(pid=22106): Launched 09:13:03.574191 bus /gobi_6: Setting Powered False 09:13:04.637337 run create_hlr_db(pid=22106): Terminated: ok {rc=0} 09:13:05.065373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22108): Launched 09:13:05.365392 run osmo-hlr_10.42.42.2(pid=22109): Launched 09:13:05.479905 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:06.000913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22111): Launched 09:13:06.300530 run osmo-stp_10.42.42.5(pid=22112): Launched 09:13:06.414556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:06.931333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22114): Launched 09:13:07.045490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:07.298358 run patchelf(pid=22115): Launched 09:13:07.464492 run osmo-stp_10.42.42.5(pid=22112): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22112)] 09:13:07.591373 run osmo-stp_10.42.42.5(pid=22112): stdout: | (launched: 2022-12-10_09:13:06.245656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:07.719702 run osmo-stp_10.42.42.5(pid=22112): stderr: | 20221210091306413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091306414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091306414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091306414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091306416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091306417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091306417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:07.848126 run osmo-stp_10.42.42.5(pid=22112): stdout: | (launched: 2022-12-10_09:13:06.245656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:07.970958 run osmo-stp_10.42.42.5(pid=22112): stderr: | 20221210091306413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091306414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091306414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091306414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091306416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091306417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091306417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:08.116703 run patchelf(pid=22115): Terminating (SIGINT) 09:13:08.285727 run patchelf(pid=22115): Terminated: ok {rc=0} 09:13:08.406983 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22112): Process ended prematurely: osmo-stp_10.42.42.5(pid=22112) [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22112)] [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:13:08.415576 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:13:08.442311 run osmo-hlr_10.42.42.2(pid=22109): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22109)] 09:13:08.489820 run osmo-hlr_10.42.42.2(pid=22109): stdout: | (launched: 2022-12-10_09:13:05.310382) 09:13:08.538864 run osmo-hlr_10.42.42.2(pid=22109): stderr: | 20221210091305488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091305488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091305488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091305488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091305488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091305488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091305500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091305509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091305509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091305509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:08.588546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22108): Terminating (SIGTERM) 09:13:08.627949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22111): Terminating (SIGTERM) 09:13:08.667731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22114): Terminating (SIGTERM) 09:13:08.707619 --- ParallelTerminationStrategy: PID 22108 died... 09:13:08.726658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22108): Terminated: ok {rc=0} 09:13:08.770852 --- ParallelTerminationStrategy: PID 22111 died... 09:13:08.789377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22111): Terminated: ok {rc=0} 09:13:08.833390 --- ParallelTerminationStrategy: PID 22114 died... 09:13:08.852019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22114): Terminated: ok {rc=0} 09:13:08.937683 bus /gobi_0: Setting Powered False 09:13:10.035580 bus /gobi_0: Setting Powered False 09:13:11.150742 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:13:12.404081 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:12.410061 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:13:12.443856 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:13:12.479119 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:13:12.534867 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:13:12.568860 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:13:12.603297 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:13:13.159692 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:13:13.165244 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.176654 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:13:13.247575 tst switch_tch_pdch.py: using LAC 27363 09:13:13.373084 tst switch_tch_pdch.py: using RAC 78 09:13:13.497143 tst switch_tch_pdch.py: using CellId 27363 09:13:13.623215 tst switch_tch_pdch.py: using BVCI 27364 09:13:13.739499 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.750910 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.762064 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.773238 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.784236 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.795487 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.806729 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:13:13.817916 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:13:13.935355 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:13:14.051325 tst switch_tch_pdch.py:51: start network... 09:13:14.253151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:14.695094 run create_hlr_db(pid=22120): Launched 09:13:14.809496 bus /gobi_6: Setting Powered False 09:13:15.878449 run create_hlr_db(pid=22120): Terminated: ok {rc=0} 09:13:16.296622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22122): Launched 09:13:16.628123 run osmo-hlr_10.42.42.2(pid=22123): Launched 09:13:16.803007 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:17.539019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22125): Launched 09:13:17.841475 run osmo-stp_10.42.42.5(pid=22126): Launched 09:13:17.955743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:13:18.451510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22128): Launched 09:13:18.566139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:13:18.823419 run patchelf(pid=22129): Launched 09:13:18.989636 run osmo-stp_10.42.42.5(pid=22126): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22126)] 09:13:19.116085 run osmo-stp_10.42.42.5(pid=22126): stdout: | (launched: 2022-12-10_09:13:17.782489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:19.244086 run osmo-stp_10.42.42.5(pid=22126): stderr: | 20221210091317955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091317955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091317955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091317956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091317958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091317958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091317958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:19.372507 run osmo-stp_10.42.42.5(pid=22126): stdout: | (launched: 2022-12-10_09:13:17.782489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:19.495988 run osmo-stp_10.42.42.5(pid=22126): stderr: | 20221210091317955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091317955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091317955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091317956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091317958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091317958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091317958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:19.641425 run patchelf(pid=22129): Terminating (SIGINT) 09:13:19.810200 run patchelf(pid=22129): Terminated: ok {rc=0} 09:13:19.931851 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22126): Process ended prematurely: osmo-stp_10.42.42.5(pid=22126) [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22126)] [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:13:19.940625 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 09:13:19.967127 run osmo-hlr_10.42.42.2(pid=22123): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22123)] 09:13:20.014397 run osmo-hlr_10.42.42.2(pid=22123): stdout: | (launched: 2022-12-10_09:13:16.560339) 09:13:20.063231 run osmo-hlr_10.42.42.2(pid=22123): stderr: | 20221210091316941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091316941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091316941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091316941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091316941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091316941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091316958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091316980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091316981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091316981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:20.112517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22122): Terminating (SIGTERM) 09:13:20.151526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22125): Terminating (SIGTERM) 09:13:20.190612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22128): Terminating (SIGTERM) 09:13:20.229893 --- ParallelTerminationStrategy: PID 22122 died... 09:13:20.248571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22122): Terminated: ok {rc=0} 09:13:20.292308 --- ParallelTerminationStrategy: PID 22125 died... 09:13:20.310674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22125): Terminated: ok {rc=0} 09:13:20.353902 --- ParallelTerminationStrategy: PID 22128 died... 09:13:20.372168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22128): Terminated: ok {rc=0} 09:13:20.456356 bus /gobi_0: Setting Powered False 09:13:21.555495 bus /gobi_0: Setting Powered False 09:13:22.671657 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:13:23.917210 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:23.920890 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:13:23.950348 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:13:23.957034 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:13:24.007924 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:13:24.037424 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:13:24.044021 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:13:24.593084 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:13:24.597916 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:13:24.608642 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:13:24.652157 tst mo_mt_sms.py: using LAC 27364 09:13:24.774147 tst mo_mt_sms.py: using RAC 79 09:13:24.891712 tst mo_mt_sms.py: using CellId 27364 09:13:25.013438 tst mo_mt_sms.py: using BVCI 27365 09:13:25.124341 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:13:25.241791 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:13:25.357213 tst mo_mt_sms.py:9: start nitb and bts... 09:13:25.559571 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:13:26.169764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22133): Launched 09:13:26.469478 run osmo-nitb_10.42.42.2(pid=22134): Launched 09:13:26.635875 run osmo-nitb_10.42.42.2(pid=22134): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22134)] 09:13:26.770578 run osmo-nitb_10.42.42.2(pid=22134): stdout: | (launched: 2022-12-10_09:13:26.414495) 09:13:26.906505 run osmo-nitb_10.42.42.2(pid=22134): stderr: | (launched: 2022-12-10_09:13:26.459208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:13:27.042439 run osmo-nitb_10.42.42.2(pid=22134): stdout: | (launched: 2022-12-10_09:13:26.414495) 09:13:27.172752 run osmo-nitb_10.42.42.2(pid=22134): stderr: | (launched: 2022-12-10_09:13:26.459208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22134) [trial-2372↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22134)] 09:13:27.582830 tst osmo-nitb_10.42.42.2(pid=22134): stdout: | (launched: 2022-12-10_09:13:26.414495) 09:13:27.703480 tst osmo-nitb_10.42.42.2(pid=22134): stderr: | (launched: 2022-12-10_09:13:26.459208) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:13:27.845633 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22134) [trial-2372↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22134)] [trial-2372↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 09:13:27.853879 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 09:13:27.860259 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22133): Terminating (SIGTERM) 09:13:28.068828 --- ParallelTerminationStrategy: PID 22133 died... 09:13:28.089051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22133): Terminated: ok {rc=0} 09:13:28.172651 bus /sierra_3: Setting Powered False 09:13:29.271922 bus /sierra_3: Setting Powered False 09:13:30.390739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 09:13:31.590163 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:31.594704 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:13:31.626122 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:13:31.655597 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:13:31.710585 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:13:31.742334 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:13:31.771318 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:13:32.320114 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 09:13:32.325310 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.336448 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:13:32.380797 tst mo_mt_sms.py: using LAC 27365 09:13:32.505135 tst mo_mt_sms.py: using RAC 80 09:13:32.631022 tst mo_mt_sms.py: using CellId 27365 09:13:32.756499 tst mo_mt_sms.py: using BVCI 27366 09:13:32.871595 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.882749 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.894347 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.905387 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.916242 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:32.927183 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:13:33.042551 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:13:33.157475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:33.628253 run create_hlr_db(pid=22138): Launched 09:13:33.744756 bus /sierra_2: Setting Powered False 09:13:34.805395 run create_hlr_db(pid=22138): Terminated: ok {rc=0} 09:13:35.227769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22140): Launched 09:13:35.530255 run osmo-hlr_10.42.42.2(pid=22141): Launched 09:13:35.644679 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:36.174801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22143): Launched 09:13:36.478415 run osmo-stp_10.42.42.5(pid=22144): Launched 09:13:36.592845 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:37.141306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22146): Launched 09:13:37.445575 run osmo-msc_10.42.42.6(pid=22147): Launched 09:13:37.614720 run osmo-stp_10.42.42.5(pid=22144): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22144)] 09:13:37.742913 run osmo-stp_10.42.42.5(pid=22144): stdout: | (launched: 2022-12-10_09:13:36.419160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:37.871392 run osmo-stp_10.42.42.5(pid=22144): stderr: | 20221210091336593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091336593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091336593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091336594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091336594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091336594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091336594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:37.997218 run osmo-stp_10.42.42.5(pid=22144): stdout: | (launched: 2022-12-10_09:13:36.419160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:38.116602 run osmo-stp_10.42.42.5(pid=22144): stderr: | 20221210091336593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091336593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091336593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091336594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091336594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091336594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091336594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:38.259327 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22144): Process ended prematurely: osmo-stp_10.42.42.5(pid=22144) [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22144)] [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 09:13:38.267876 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 09:13:38.293986 run osmo-hlr_10.42.42.2(pid=22141): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22141)] 09:13:38.341912 run osmo-hlr_10.42.42.2(pid=22141): stdout: | (launched: 2022-12-10_09:13:35.471875) 09:13:38.391172 run osmo-hlr_10.42.42.2(pid=22141): stderr: | 20221210091335649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091335649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091335649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091335649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091335649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091335649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091335674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091335684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091335684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091335684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:38.461017 run osmo-msc_10.42.42.6(pid=22147): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22147)] 09:13:38.508649 run osmo-msc_10.42.42.6(pid=22147): stdout: | (launched: 2022-12-10_09:13:37.386123) 09:13:38.557946 run osmo-msc_10.42.42.6(pid=22147): stderr: | 20221210091337662 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091337662 DLGLOBAL DEBUG validating counter group 0x7f076924fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091337663 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091337663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091337663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091337663 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091337665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091337666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091337666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091337666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:38.607631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22140): Terminating (SIGTERM) 09:13:38.647113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22143): Terminating (SIGTERM) 09:13:38.686432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22146): Terminating (SIGTERM) 09:13:38.726258 --- ParallelTerminationStrategy: PID 22140 died... 09:13:38.745150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22140): Terminated: ok {rc=0} 09:13:38.789210 --- ParallelTerminationStrategy: PID 22143 died... 09:13:38.807425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22143): Terminated: ok {rc=0} 09:13:38.851574 --- ParallelTerminationStrategy: PID 22146 died... 09:13:38.870011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22146): Terminated: ok {rc=0} 09:13:38.955460 bus /sierra_3: Setting Powered False 09:13:40.054338 bus /sierra_3: Setting Powered False 09:13:41.168367 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:13:42.396683 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:42.400692 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:13:42.430381 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 09:13:42.437824 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:13:42.478076 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:13:42.507445 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 09:13:42.514329 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:13:43.029352 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:13:43.034403 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 09:13:43.045333 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:13:43.089209 tst assert_extension.py: using LAC 27366 09:13:43.205917 tst assert_extension.py: using RAC 81 09:13:43.325119 tst assert_extension.py: using CellId 27366 09:13:43.449146 tst assert_extension.py: using BVCI 27367 09:13:43.564923 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:13:43.679649 tst assert_extension.py:10: start nitb and bts... 09:13:43.881739 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:13:44.497093 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22152): Launched 09:13:44.797231 run osmo-nitb_10.42.42.2(pid=22153): Launched 09:13:44.963847 run osmo-nitb_10.42.42.2(pid=22153): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22153)] 09:13:45.099242 run osmo-nitb_10.42.42.2(pid=22153): stdout: | (launched: 2022-12-10_09:13:44.741981) 09:13:45.235348 run osmo-nitb_10.42.42.2(pid=22153): stderr: | (launched: 2022-12-10_09:13:44.786698) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:13:45.371660 run osmo-nitb_10.42.42.2(pid=22153): stdout: | (launched: 2022-12-10_09:13:44.741981) 09:13:45.502567 run osmo-nitb_10.42.42.2(pid=22153): stderr: | (launched: 2022-12-10_09:13:44.786698) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22153): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22153) [trial-2372↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22153)] 09:13:45.910557 tst osmo-nitb_10.42.42.2(pid=22153): stdout: | (launched: 2022-12-10_09:13:44.741981) 09:13:46.043756 tst osmo-nitb_10.42.42.2(pid=22153): stderr: | (launched: 2022-12-10_09:13:44.786698) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:13:46.190200 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22153): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22153) [trial-2372↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22153)] [trial-2372↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 09:13:46.199048 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:13:46.206286 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22152): Terminating (SIGTERM) 09:13:46.418466 --- ParallelTerminationStrategy: PID 22152 died... 09:13:46.445060 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22152): Terminated: ok {rc=0} 09:13:46.548891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 09:13:47.724756 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:47.729397 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:13:47.759474 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:13:47.786747 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 09:13:47.822236 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:13:47.852730 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:13:47.880192 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 09:13:48.409282 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 09:13:48.414460 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.425424 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:13:48.469675 tst assert_extension.py: using LAC 27367 09:13:48.590988 tst assert_extension.py: using RAC 82 09:13:48.711082 tst assert_extension.py: using CellId 27367 09:13:48.830989 tst assert_extension.py: using BVCI 27368 09:13:48.941987 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.952673 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.963320 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.974303 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.985469 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:13:48.996348 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 09:13:49.113967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:49.610272 run create_hlr_db(pid=22157): Launched 09:13:49.739216 bus /sierra_2: Setting Powered False 09:13:50.802340 run create_hlr_db(pid=22157): Terminated: ok {rc=0} 09:13:51.234375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22159): Launched 09:13:51.537137 run osmo-hlr_10.42.42.2(pid=22160): Launched 09:13:51.652129 run osmo-stp_10.42.42.5: Starting osmo-stp 09:13:52.190768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22162): Launched 09:13:52.494161 run osmo-stp_10.42.42.5(pid=22163): Launched 09:13:52.609276 run osmo-msc_10.42.42.6: Starting osmo-msc 09:13:53.153704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22165): Launched 09:13:53.455992 run osmo-msc_10.42.42.6(pid=22166): Launched 09:13:53.624528 run osmo-stp_10.42.42.5(pid=22163): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22163)] 09:13:53.751950 run osmo-stp_10.42.42.5(pid=22163): stdout: | (launched: 2022-12-10_09:13:52.435475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:53.879523 run osmo-stp_10.42.42.5(pid=22163): stderr: | 20221210091352609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091352609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091352609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091352609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091352610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091352610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091352610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:54.004367 run osmo-stp_10.42.42.5(pid=22163): stdout: | (launched: 2022-12-10_09:13:52.435475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:13:54.123357 run osmo-stp_10.42.42.5(pid=22163): stderr: | 20221210091352609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091352609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091352609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091352609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091352610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091352610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091352610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:13:54.265832 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22163): Process ended prematurely: osmo-stp_10.42.42.5(pid=22163) [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22163)] [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 09:13:54.273921 tst assert_extension.py:17: Test FAILED (5.9 sec) 09:13:54.300022 run osmo-hlr_10.42.42.2(pid=22160): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22160)] 09:13:54.347706 run osmo-hlr_10.42.42.2(pid=22160): stdout: | (launched: 2022-12-10_09:13:51.479157) 09:13:54.396490 run osmo-hlr_10.42.42.2(pid=22160): stderr: | 20221210091351658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091351658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091351658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091351658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091351658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091351658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091351671 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091351680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091351681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091351681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:13:54.464515 run osmo-msc_10.42.42.6(pid=22166): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22166)] 09:13:54.511492 run osmo-msc_10.42.42.6(pid=22166): stdout: | (launched: 2022-12-10_09:13:53.397372) 09:13:54.561207 run osmo-msc_10.42.42.6(pid=22166): stderr: | 20221210091353673 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091353673 DLGLOBAL DEBUG validating counter group 0x7f39cdcc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091353673 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091353673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091353674 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091353674 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091353676 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091353676 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091353677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091353677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:13:54.610628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22159): Terminating (SIGTERM) 09:13:54.649912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22162): Terminating (SIGTERM) 09:13:54.689304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22165): Terminating (SIGTERM) 09:13:54.728892 --- ParallelTerminationStrategy: PID 22159 died... 09:13:54.747582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22159): Terminated: ok {rc=0} 09:13:54.791273 --- ParallelTerminationStrategy: PID 22162 died... 09:13:54.809985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22162): Terminated: ok {rc=0} 09:13:54.853567 --- ParallelTerminationStrategy: PID 22165 died... 09:13:54.872072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22165): Terminated: ok {rc=0} 09:13:54.958246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:13:56.164077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:13:56.170684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:13:56.200890 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:13:56.227531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:13:56.281346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:13:56.312397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:13:56.340690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:13:56.887952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:13:56.943172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:56.955029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:13:57.022843 tst mo_mt_call.py: using LAC 27368 09:13:57.151385 tst mo_mt_call.py: using RAC 83 09:13:57.280800 tst mo_mt_call.py: using CellId 27368 09:13:57.414282 tst mo_mt_call.py: using BVCI 27369 09:13:57.534565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:57.546268 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:57.557921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:57.569513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:57.581252 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:13:57.592734 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:13:57.715892 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:13:57.835480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:13:58.340864 run create_hlr_db(pid=22171): Launched 09:13:58.471894 bus /sierra_2: Setting Powered False 09:13:59.536690 run create_hlr_db(pid=22171): Terminated: ok {rc=0} 09:13:59.972707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22173): Launched 09:14:00.279172 run osmo-hlr_10.42.42.2(pid=22174): Launched 09:14:00.396519 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:00.982057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22176): Launched 09:14:01.320427 run osmo-stp_10.42.42.5(pid=22177): Launched 09:14:01.538679 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:02.259747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22179): Launched 09:14:02.566429 run osmo-msc_10.42.42.6(pid=22180): Launched 09:14:02.738373 run osmo-stp_10.42.42.5(pid=22177): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22177)] 09:14:02.868724 run osmo-stp_10.42.42.5(pid=22177): stdout: | (launched: 2022-12-10_09:14:01.256063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:02.998169 run osmo-stp_10.42.42.5(pid=22177): stderr: | 20221210091401567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091401567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091401567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091401568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091401568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091401568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091401568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:03.125869 run osmo-stp_10.42.42.5(pid=22177): stdout: | (launched: 2022-12-10_09:14:01.256063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:03.247710 run osmo-stp_10.42.42.5(pid=22177): stderr: | 20221210091401567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091401567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091401567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091401568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091401568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091401568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091401568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:03.393428 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22177): Process ended prematurely: osmo-stp_10.42.42.5(pid=22177) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22177)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:14:03.402436 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 09:14:03.428843 run osmo-hlr_10.42.42.2(pid=22174): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22174)] 09:14:03.477276 run osmo-hlr_10.42.42.2(pid=22174): stdout: | (launched: 2022-12-10_09:14:00.223194) 09:14:03.527034 run osmo-hlr_10.42.42.2(pid=22174): stderr: | 20221210091400400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091400400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091400400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091400400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091400400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091400400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091400412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091400421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091400421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091400421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:03.596222 run osmo-msc_10.42.42.6(pid=22180): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22180)] 09:14:03.643697 run osmo-msc_10.42.42.6(pid=22180): stdout: | (launched: 2022-12-10_09:14:02.510167) 09:14:03.693152 run osmo-msc_10.42.42.6(pid=22180): stderr: | 20221210091402784 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091402784 DLGLOBAL DEBUG validating counter group 0x7f9b83ec1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091402784 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091402784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091402784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091402784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091402786 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091402787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091402787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091402787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:03.742760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22173): Terminating (SIGTERM) 09:14:03.782361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22176): Terminating (SIGTERM) 09:14:03.822121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22179): Terminating (SIGTERM) 09:14:03.862253 --- ParallelTerminationStrategy: PID 22173 died... 09:14:03.881242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22173): Terminated: ok {rc=0} 09:14:03.925554 --- ParallelTerminationStrategy: PID 22176 died... 09:14:03.944013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22176): Terminated: ok {rc=0} 09:14:03.988477 --- ParallelTerminationStrategy: PID 22179 died... 09:14:04.007156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22179): Terminated: ok {rc=0} 09:14:04.091887 bus /sierra_3: Setting Powered False 09:14:05.190323 bus /sierra_3: Setting Powered False 09:14:06.308832 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:14:07.455719 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:07.467538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:14:07.533777 tst mo_mt_call_osmux.py: using LAC 27369 09:14:07.656531 tst mo_mt_call_osmux.py: using RAC 84 09:14:07.779315 tst mo_mt_call_osmux.py: using CellId 27369 09:14:07.901367 tst mo_mt_call_osmux.py: using BVCI 27370 09:14:08.015077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:08.026457 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:08.037630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:08.049037 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:08.060395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:14:08.071778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:14:08.191471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:14:08.311492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:08.816448 run create_hlr_db(pid=22182): Launched 09:14:08.948056 bus /sierra_2: Setting Powered False 09:14:10.012626 run create_hlr_db(pid=22182): Terminated: ok {rc=0} 09:14:10.464815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22184): Launched 09:14:10.789614 run osmo-hlr_10.42.42.2(pid=22185): Launched 09:14:10.913534 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:11.476830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22187): Launched 09:14:11.799921 run osmo-stp_10.42.42.5(pid=22188): Launched 09:14:11.924055 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:12.514733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22190): Launched 09:14:12.839509 run osmo-msc_10.42.42.6(pid=22191): Launched 09:14:13.021441 run osmo-stp_10.42.42.5(pid=22188): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22188)] 09:14:13.158061 run osmo-stp_10.42.42.5(pid=22188): stdout: | (launched: 2022-12-10_09:14:11.740913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:13.294661 run osmo-stp_10.42.42.5(pid=22188): stderr: | 20221210091411934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091411934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091411935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091411935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091411936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091411936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091411936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:13.430657 run osmo-stp_10.42.42.5(pid=22188): stdout: | (launched: 2022-12-10_09:14:11.740913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:13.559459 run osmo-stp_10.42.42.5(pid=22188): stderr: | 20221210091411934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091411934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091411935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091411935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091411936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091411936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091411936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:13.713422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22188): Process ended prematurely: osmo-stp_10.42.42.5(pid=22188) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22188)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:14:13.722906 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:14:13.750523 run osmo-hlr_10.42.42.2(pid=22185): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22185)] 09:14:13.799996 run osmo-hlr_10.42.42.2(pid=22185): stdout: | (launched: 2022-12-10_09:14:10.730672) 09:14:13.850856 run osmo-hlr_10.42.42.2(pid=22185): stderr: | 20221210091410932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091410932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091410933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091410933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091410933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091410933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091410945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091410953 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091410953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091410953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:13.921978 run osmo-msc_10.42.42.6(pid=22191): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22191)] 09:14:13.971080 run osmo-msc_10.42.42.6(pid=22191): stdout: | (launched: 2022-12-10_09:14:12.780477) 09:14:14.021742 run osmo-msc_10.42.42.6(pid=22191): stderr: | 20221210091413108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091413108 DLGLOBAL DEBUG validating counter group 0x7f180e7b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091413108 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091413108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091413108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091413108 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091413110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091413111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091413111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091413111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:14.073182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22184): Terminating (SIGTERM) 09:14:14.113970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22187): Terminating (SIGTERM) 09:14:14.154933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22190): Terminating (SIGTERM) 09:14:14.196391 --- ParallelTerminationStrategy: PID 22184 died... 09:14:14.216182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22184): Terminated: ok {rc=0} 09:14:14.261980 --- ParallelTerminationStrategy: PID 22187 died... 09:14:14.281428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22187): Terminated: ok {rc=0} 09:14:14.326756 --- ParallelTerminationStrategy: PID 22190 died... 09:14:14.346210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22190): Terminated: ok {rc=0} 09:14:14.432490 bus /sierra_3: Setting Powered False 09:14:15.528824 bus /sierra_3: Setting Powered False 09:14:16.643750 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:14:17.894536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:14:17.901447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:14:17.931379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:14:17.958753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:14:18.011438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:14:18.041934 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:14:18.069311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:14:18.628796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:14:18.682246 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:18.693963 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:14:18.759176 tst mo_mt_call.py: using LAC 27370 09:14:18.885407 tst mo_mt_call.py: using RAC 85 09:14:19.011386 tst mo_mt_call.py: using CellId 27370 09:14:19.138468 tst mo_mt_call.py: using BVCI 27371 09:14:19.256851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:19.268563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:19.280101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:19.291707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:19.303340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:19.314888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:14:19.431111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:14:19.550648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:20.059072 run create_hlr_db(pid=22196): Launched 09:14:20.189836 bus /sierra_2: Setting Powered False 09:14:21.253944 run create_hlr_db(pid=22196): Terminated: ok {rc=0} 09:14:21.693722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Launched 09:14:22.002651 run osmo-hlr_10.42.42.2(pid=22199): Launched 09:14:22.120609 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:22.655837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Launched 09:14:22.967759 run osmo-stp_10.42.42.5(pid=22202): Launched 09:14:23.085702 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:23.643343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Launched 09:14:23.953464 run osmo-msc_10.42.42.6(pid=22205): Launched 09:14:24.126313 run osmo-stp_10.42.42.5(pid=22202): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] 09:14:24.257228 run osmo-stp_10.42.42.5(pid=22202): stdout: | (launched: 2022-12-10_09:14:22.907997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:24.387567 run osmo-stp_10.42.42.5(pid=22202): stderr: | 20221210091423082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091423082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091423083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091423083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091423084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091423084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091423084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:24.515388 run osmo-stp_10.42.42.5(pid=22202): stdout: | (launched: 2022-12-10_09:14:22.907997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:24.637823 run osmo-stp_10.42.42.5(pid=22202): stderr: | 20221210091423082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091423082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091423083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091423083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091423084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091423084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091423084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:24.784358 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22202): Process ended prematurely: osmo-stp_10.42.42.5(pid=22202) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:14:24.793394 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:14:24.820296 run osmo-hlr_10.42.42.2(pid=22199): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22199)] 09:14:24.868467 run osmo-hlr_10.42.42.2(pid=22199): stdout: | (launched: 2022-12-10_09:14:21.943392) 09:14:24.917659 run osmo-hlr_10.42.42.2(pid=22199): stderr: | 20221210091422122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091422122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091422122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091422122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091422122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091422122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091422134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091422142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091422143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091422143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:24.986736 run osmo-msc_10.42.42.6(pid=22205): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22205)] 09:14:25.033992 run osmo-msc_10.42.42.6(pid=22205): stdout: | (launched: 2022-12-10_09:14:23.893791) 09:14:25.082983 run osmo-msc_10.42.42.6(pid=22205): stderr: | 20221210091424170 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091424170 DLGLOBAL DEBUG validating counter group 0x7fab324f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091424171 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091424171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091424171 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091424171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091424173 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091424173 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091424173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091424173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:25.132310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Terminating (SIGTERM) 09:14:25.171711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Terminating (SIGTERM) 09:14:25.211228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Terminating (SIGTERM) 09:14:25.250812 --- ParallelTerminationStrategy: PID 22198 died... 09:14:25.269736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22198): Terminated: ok {rc=0} 09:14:25.313788 --- ParallelTerminationStrategy: PID 22201 died... 09:14:25.332145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22201): Terminated: ok {rc=0} 09:14:25.376053 --- ParallelTerminationStrategy: PID 22204 died... 09:14:25.394618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22204): Terminated: ok {rc=0} 09:14:25.479713 bus /sierra_3: Setting Powered False 09:14:26.579108 bus /sierra_3: Setting Powered False 09:14:27.692340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:14:28.840562 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:28.853114 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:14:28.921994 tst mo_mt_call_osmux.py: using LAC 27371 09:14:29.051231 tst mo_mt_call_osmux.py: using RAC 86 09:14:29.180407 tst mo_mt_call_osmux.py: using CellId 27371 09:14:29.307447 tst mo_mt_call_osmux.py: using BVCI 27372 09:14:29.425785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:29.437756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:29.449307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:29.460854 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:29.472504 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:14:29.484061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:14:29.605978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:14:29.723146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:30.203707 run create_hlr_db(pid=22207): Launched 09:14:30.320819 bus /sierra_2: Setting Powered False 09:14:31.387165 run create_hlr_db(pid=22207): Terminated: ok {rc=0} 09:14:31.901284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22209): Launched 09:14:32.249887 run osmo-hlr_10.42.42.2(pid=22210): Launched 09:14:32.375146 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:32.919524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22212): Launched 09:14:33.233052 run osmo-stp_10.42.42.5(pid=22213): Launched 09:14:33.351285 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:33.909748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22215): Launched 09:14:34.220049 run osmo-msc_10.42.42.6(pid=22216): Launched 09:14:34.393983 run osmo-stp_10.42.42.5(pid=22213): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22213)] 09:14:34.525192 run osmo-stp_10.42.42.5(pid=22213): stdout: | (launched: 2022-12-10_09:14:33.172669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.655702 run osmo-stp_10.42.42.5(pid=22213): stderr: | 20221210091433347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091433348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091433348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091433348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091433349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091433349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091433349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:34.783809 run osmo-stp_10.42.42.5(pid=22213): stdout: | (launched: 2022-12-10_09:14:33.172669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:34.906313 run osmo-stp_10.42.42.5(pid=22213): stderr: | 20221210091433347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091433348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091433348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091433348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091433349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091433349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091433349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:35.052389 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22213): Process ended prematurely: osmo-stp_10.42.42.5(pid=22213) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22213)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:14:35.061451 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:14:35.088436 run osmo-hlr_10.42.42.2(pid=22210): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22210)] 09:14:35.136319 run osmo-hlr_10.42.42.2(pid=22210): stdout: | (launched: 2022-12-10_09:14:32.185220) 09:14:35.185781 run osmo-hlr_10.42.42.2(pid=22210): stderr: | 20221210091432377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091432377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091432377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091432378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091432378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091432378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091432390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091432398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091432398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091432398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:35.254798 run osmo-msc_10.42.42.6(pid=22216): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22216)] 09:14:35.302293 run osmo-msc_10.42.42.6(pid=22216): stdout: | (launched: 2022-12-10_09:14:34.160268) 09:14:35.351517 run osmo-msc_10.42.42.6(pid=22216): stderr: | 20221210091434437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091434437 DLGLOBAL DEBUG validating counter group 0x7fd71c4dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091434437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091434437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091434438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091434438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091434439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091434440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091434440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091434440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:35.401130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22209): Terminating (SIGTERM) 09:14:35.440673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22212): Terminating (SIGTERM) 09:14:35.480547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22215): Terminating (SIGTERM) 09:14:35.520707 --- ParallelTerminationStrategy: PID 22209 died... 09:14:35.539742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22209): Terminated: ok {rc=0} 09:14:35.584600 --- ParallelTerminationStrategy: PID 22212 died... 09:14:35.603350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22212): Terminated: ok {rc=0} 09:14:35.647463 --- ParallelTerminationStrategy: PID 22215 died... 09:14:35.666181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22215): Terminated: ok {rc=0} 09:14:35.751577 bus /sierra_3: Setting Powered False 09:14:36.850398 bus /sierra_3: Setting Powered False 09:14:37.963740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:14:39.212688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:14:39.219690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:14:39.249655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:14:39.277053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:14:39.330529 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:14:39.361541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:14:39.388710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:14:39.937812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:14:39.987712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:39.999259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:14:40.064429 tst mo_mt_call.py: using LAC 27372 09:14:40.192787 tst mo_mt_call.py: using RAC 87 09:14:40.320243 tst mo_mt_call.py: using CellId 27372 09:14:40.449074 tst mo_mt_call.py: using BVCI 27373 09:14:40.567134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:40.578968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:40.590604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:40.602189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:40.614284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:40.625974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:14:40.743243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:14:40.859974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:41.335381 run create_hlr_db(pid=22221): Launched 09:14:41.454344 bus /sierra_2: Setting Powered False 09:14:42.515292 run create_hlr_db(pid=22221): Terminated: ok {rc=0} 09:14:42.943139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22223): Launched 09:14:43.251565 run osmo-hlr_10.42.42.2(pid=22224): Launched 09:14:43.369756 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:43.931250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22226): Launched 09:14:44.255573 run osmo-stp_10.42.42.5(pid=22227): Launched 09:14:44.379188 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:44.968928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22229): Launched 09:14:45.293682 run osmo-msc_10.42.42.6(pid=22230): Launched 09:14:45.475374 run osmo-stp_10.42.42.5(pid=22227): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22227)] 09:14:45.612101 run osmo-stp_10.42.42.5(pid=22227): stdout: | (launched: 2022-12-10_09:14:44.196580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:45.749085 run osmo-stp_10.42.42.5(pid=22227): stderr: | 20221210091444391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091444391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091444391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091444391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091444392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091444392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091444392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:45.896473 run osmo-stp_10.42.42.5(pid=22227): stdout: | (launched: 2022-12-10_09:14:44.196580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:46.037083 run osmo-stp_10.42.42.5(pid=22227): stderr: | 20221210091444391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091444391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091444391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091444391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091444392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091444392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091444392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:46.194009 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22227): Process ended prematurely: osmo-stp_10.42.42.5(pid=22227) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22227)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:14:46.204181 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:14:46.234243 run osmo-hlr_10.42.42.2(pid=22224): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22224)] 09:14:46.285858 run osmo-hlr_10.42.42.2(pid=22224): stdout: | (launched: 2022-12-10_09:14:43.195564) 09:14:46.338167 run osmo-hlr_10.42.42.2(pid=22224): stderr: | 20221210091443376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091443376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091443376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091443376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091443376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091443376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091443386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091443394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091443394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091443394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:46.411195 run osmo-msc_10.42.42.6(pid=22230): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22230)] 09:14:46.463243 run osmo-msc_10.42.42.6(pid=22230): stdout: | (launched: 2022-12-10_09:14:45.234510) 09:14:46.515287 run osmo-msc_10.42.42.6(pid=22230): stderr: | 20221210091445556 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091445556 DLGLOBAL DEBUG validating counter group 0x7f4071032c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091445556 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091445556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091445556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091445557 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091445559 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091445559 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091445559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091445559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:46.567955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22223): Terminating (SIGTERM) 09:14:46.611418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22226): Terminating (SIGTERM) 09:14:46.655993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22229): Terminating (SIGTERM) 09:14:46.702854 --- ParallelTerminationStrategy: PID 22223 died... 09:14:46.722535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22223): Terminated: ok {rc=0} 09:14:46.771944 --- ParallelTerminationStrategy: PID 22226 died... 09:14:46.791705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22226): Terminated: ok {rc=0} 09:14:46.839479 --- ParallelTerminationStrategy: PID 22229 died... 09:14:46.858972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22229): Terminated: ok {rc=0} 09:14:46.949422 bus /sierra_3: Setting Powered False 09:14:48.048179 bus /sierra_3: Setting Powered False 09:14:49.162317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:14:50.311754 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.324048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:14:50.391450 tst mo_mt_call_osmux.py: using LAC 27373 09:14:50.519055 tst mo_mt_call_osmux.py: using RAC 88 09:14:50.642423 tst mo_mt_call_osmux.py: using CellId 27373 09:14:50.765398 tst mo_mt_call_osmux.py: using BVCI 27374 09:14:50.877283 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.888639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.899956 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.911837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.923678 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:14:50.935163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:14:51.052341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:14:51.169881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:14:51.648474 run create_hlr_db(pid=22232): Launched 09:14:51.766773 bus /sierra_2: Setting Powered False 09:14:52.827941 run create_hlr_db(pid=22232): Terminated: ok {rc=0} 09:14:53.275000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Launched 09:14:53.599728 run osmo-hlr_10.42.42.2(pid=22235): Launched 09:14:53.727245 run osmo-stp_10.42.42.5: Starting osmo-stp 09:14:54.289987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Launched 09:14:54.614559 run osmo-stp_10.42.42.5(pid=22238): Launched 09:14:54.739263 run osmo-msc_10.42.42.6: Starting osmo-msc 09:14:55.330195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22240): Launched 09:14:55.654967 run osmo-msc_10.42.42.6(pid=22241): Launched 09:14:55.837300 run osmo-stp_10.42.42.5(pid=22238): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] 09:14:55.974346 run osmo-stp_10.42.42.5(pid=22238): stdout: | (launched: 2022-12-10_09:14:54.555315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:56.113063 run osmo-stp_10.42.42.5(pid=22238): stderr: | 20221210091454747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091454747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091454748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091454748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091454749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091454749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091454749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:56.248406 run osmo-stp_10.42.42.5(pid=22238): stdout: | (launched: 2022-12-10_09:14:54.555315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:14:56.377938 run osmo-stp_10.42.42.5(pid=22238): stderr: | 20221210091454747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091454747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091454748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091454748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091454749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091454749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091454749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:14:56.532149 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22238): Process ended prematurely: osmo-stp_10.42.42.5(pid=22238) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:14:56.541717 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:14:56.569542 run osmo-hlr_10.42.42.2(pid=22235): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22235)] 09:14:56.619333 run osmo-hlr_10.42.42.2(pid=22235): stdout: | (launched: 2022-12-10_09:14:53.540487) 09:14:56.671169 run osmo-hlr_10.42.42.2(pid=22235): stderr: | 20221210091453742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091453742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091453742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091453742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091453742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091453742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091453755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091453763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091453763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091453763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:14:56.742877 run osmo-msc_10.42.42.6(pid=22241): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22241)] 09:14:56.792229 run osmo-msc_10.42.42.6(pid=22241): stdout: | (launched: 2022-12-10_09:14:55.595850) 09:14:56.843271 run osmo-msc_10.42.42.6(pid=22241): stderr: | 20221210091455920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091455920 DLGLOBAL DEBUG validating counter group 0x7ff44d4f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091455920 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091455920 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091455920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091455920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091455922 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091455922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091455923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091455923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:14:56.894664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Terminating (SIGTERM) 09:14:56.935572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Terminating (SIGTERM) 09:14:56.976508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22240): Terminating (SIGTERM) 09:14:57.018137 --- ParallelTerminationStrategy: PID 22234 died... 09:14:57.038239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22234): Terminated: ok {rc=0} 09:14:57.084556 --- ParallelTerminationStrategy: PID 22237 died... 09:14:57.104392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22237): Terminated: ok {rc=0} 09:14:57.150043 --- ParallelTerminationStrategy: PID 22240 died... 09:14:57.169657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22240): Terminated: ok {rc=0} 09:14:57.256740 bus /sierra_3: Setting Powered False 09:14:58.353433 bus /sierra_3: Setting Powered False 09:14:59.466592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 09:15:00.716792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:00.725519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 09:15:00.756468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 09:15:00.783907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 09:15:00.837938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 09:15:00.876409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 09:15:00.919625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 09:15:01.482394 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 09:15:01.537959 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:01.550592 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:15:01.617882 tst mo_mt_call.py: using LAC 27374 09:15:01.749349 tst mo_mt_call.py: using RAC 89 09:15:01.900837 tst mo_mt_call.py: using CellId 27374 09:15:02.042222 tst mo_mt_call.py: using BVCI 27375 09:15:02.193058 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:02.207102 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:02.219362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:02.230847 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:02.243073 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:02.256492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:15:02.379016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:15:02.500092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:03.008905 run create_hlr_db(pid=22250): Launched 09:15:03.141365 bus /sierra_2: Setting Powered False 09:15:04.205963 run create_hlr_db(pid=22250): Terminated: ok {rc=0} 09:15:04.661567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22252): Launched 09:15:04.990044 run osmo-hlr_10.42.42.2(pid=22253): Launched 09:15:05.114452 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:05.676704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22256): Launched 09:15:06.004713 run osmo-stp_10.42.42.5(pid=22257): Launched 09:15:06.128248 run osmo-msc_10.42.42.6: Starting osmo-msc 09:15:06.725450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22259): Launched 09:15:07.054337 run osmo-msc_10.42.42.6(pid=22260): Launched 09:15:07.235959 run osmo-stp_10.42.42.5(pid=22257): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22257)] 09:15:07.372941 run osmo-stp_10.42.42.5(pid=22257): stdout: | (launched: 2022-12-10_09:15:05.940352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:07.510342 run osmo-stp_10.42.42.5(pid=22257): stderr: | 20221210091506139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091506139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091506139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091506139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091506140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091506140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091506140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:07.646822 run osmo-stp_10.42.42.5(pid=22257): stdout: | (launched: 2022-12-10_09:15:05.940352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:07.775943 run osmo-stp_10.42.42.5(pid=22257): stderr: | 20221210091506139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091506139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091506139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091506139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091506140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091506140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091506140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:07.930309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22257): Process ended prematurely: osmo-stp_10.42.42.5(pid=22257) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22257)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 09:15:07.939684 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:15:07.967402 run osmo-hlr_10.42.42.2(pid=22253): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22253)] 09:15:08.016894 run osmo-hlr_10.42.42.2(pid=22253): stdout: | (launched: 2022-12-10_09:15:04.926485) 09:15:08.068506 run osmo-hlr_10.42.42.2(pid=22253): stderr: | 20221210091505130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091505130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091505130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091505130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091505130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091505130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091505143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091505151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091505151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091505151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:08.140368 run osmo-msc_10.42.42.6(pid=22260): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22260)] 09:15:08.189804 run osmo-msc_10.42.42.6(pid=22260): stdout: | (launched: 2022-12-10_09:15:06.990719) 09:15:08.240879 run osmo-msc_10.42.42.6(pid=22260): stderr: | 20221210091507317 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091507317 DLGLOBAL DEBUG validating counter group 0x7fe7f2311c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091507317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091507318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091507318 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091507318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091507319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091507320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091507320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091507320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:15:08.292222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22252): Terminating (SIGTERM) 09:15:08.333596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22256): Terminating (SIGTERM) 09:15:08.374905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22259): Terminating (SIGTERM) 09:15:08.416458 --- ParallelTerminationStrategy: PID 22252 died... 09:15:08.436311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22252): Terminated: ok {rc=0} 09:15:08.481930 --- ParallelTerminationStrategy: PID 22256 died... 09:15:08.501261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22256): Terminated: ok {rc=0} 09:15:08.546780 --- ParallelTerminationStrategy: PID 22259 died... 09:15:08.566179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22259): Terminated: ok {rc=0} 09:15:08.652613 bus /sierra_3: Setting Powered False 09:15:09.750645 bus /sierra_3: Setting Powered False 09:15:10.867449 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 09:15:12.011197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.023259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 09:15:12.090375 tst mo_mt_call_osmux.py: using LAC 27375 09:15:12.213763 tst mo_mt_call_osmux.py: using RAC 90 09:15:12.342446 tst mo_mt_call_osmux.py: using CellId 27375 09:15:12.464605 tst mo_mt_call_osmux.py: using BVCI 27376 09:15:12.576672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.588164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.599447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.611147 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.623002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 09:15:12.634765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:15:12.755988 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 09:15:12.873081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:13.355513 run create_hlr_db(pid=22262): Launched 09:15:13.472761 bus /sierra_2: Setting Powered False 09:15:14.534380 run create_hlr_db(pid=22262): Terminated: ok {rc=0} 09:15:14.984639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22264): Launched 09:15:15.315467 run osmo-hlr_10.42.42.2(pid=22265): Launched 09:15:15.440721 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:16.035181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22267): Launched 09:15:16.441424 run osmo-stp_10.42.42.5(pid=22268): Launched 09:15:16.688654 run osmo-msc_10.42.42.6: Starting osmo-msc 09:15:17.361413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22270): Launched 09:15:17.673379 run osmo-msc_10.42.42.6(pid=22271): Launched 09:15:17.846975 run osmo-stp_10.42.42.5(pid=22268): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22268)] 09:15:17.978770 run osmo-stp_10.42.42.5(pid=22268): stdout: | (launched: 2022-12-10_09:15:16.373454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:18.109497 run osmo-stp_10.42.42.5(pid=22268): stderr: | 20221210091516723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091516724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091516724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091516724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091516739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091516739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091516739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:18.238042 run osmo-stp_10.42.42.5(pid=22268): stdout: | (launched: 2022-12-10_09:15:16.373454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:18.360562 run osmo-stp_10.42.42.5(pid=22268): stderr: | 20221210091516723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091516724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091516724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091516724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091516739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091516739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091516739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:18.507203 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22268): Process ended prematurely: osmo-stp_10.42.42.5(pid=22268) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22268)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 09:15:18.516253 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 09:15:18.543603 run osmo-hlr_10.42.42.2(pid=22265): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22265)] 09:15:18.592015 run osmo-hlr_10.42.42.2(pid=22265): stdout: | (launched: 2022-12-10_09:15:15.251858) 09:15:18.642049 run osmo-hlr_10.42.42.2(pid=22265): stderr: | 20221210091515453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091515453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091515453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091515453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091515453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091515453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091515466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091515475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091515475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091515475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:18.712065 run osmo-msc_10.42.42.6(pid=22271): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22271)] 09:15:18.760373 run osmo-msc_10.42.42.6(pid=22271): stdout: | (launched: 2022-12-10_09:15:17.612438) 09:15:18.810436 run osmo-msc_10.42.42.6(pid=22271): stderr: | 20221210091517887 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091517888 DLGLOBAL DEBUG validating counter group 0x7f9c53f87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091517888 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091517888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091517888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091517888 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091517890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091517890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091517891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091517891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:15:18.861086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22264): Terminating (SIGTERM) 09:15:18.901196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22267): Terminating (SIGTERM) 09:15:18.941475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22270): Terminating (SIGTERM) 09:15:18.982226 --- ParallelTerminationStrategy: PID 22264 died... 09:15:19.001304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22264): Terminated: ok {rc=0} 09:15:19.046236 --- ParallelTerminationStrategy: PID 22267 died... 09:15:19.065162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22267): Terminated: ok {rc=0} 09:15:19.109885 --- ParallelTerminationStrategy: PID 22270 died... 09:15:19.128858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22270): Terminated: ok {rc=0} 09:15:19.216825 bus /sierra_3: Setting Powered False 09:15:20.317779 bus /sierra_3: Setting Powered False 09:15:21.437064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:15:22.681432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:22.687746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:15:22.717825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:15:22.744515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:15:22.796076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:15:22.825549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:15:22.851983 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:15:23.408451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:15:23.459042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:23.470534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:15:23.538358 tst mo_mt_call.py: using LAC 27376 09:15:23.659211 tst mo_mt_call.py: using RAC 91 09:15:23.779283 tst mo_mt_call.py: using CellId 27376 09:15:23.898073 tst mo_mt_call.py: using BVCI 27377 09:15:24.012456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:24.023699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:24.034766 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:24.046281 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:24.057797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:24.069160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:15:24.191559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:15:24.309336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:24.786790 run create_hlr_db(pid=22276): Launched 09:15:24.904223 bus /sierra_2: Setting Powered False 09:15:25.964632 run create_hlr_db(pid=22276): Terminated: ok {rc=0} 09:15:26.411295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Launched 09:15:26.740815 run osmo-hlr_10.42.42.2(pid=22279): Launched 09:15:26.866313 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:27.428787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Launched 09:15:27.753398 run osmo-stp_10.42.42.5(pid=22282): Launched 09:15:27.877003 run osmo-msc_10.42.42.6: Starting osmo-msc 09:15:28.466915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22284): Launched 09:15:28.791452 run osmo-msc_10.42.42.6(pid=22285): Launched 09:15:28.973234 run osmo-stp_10.42.42.5(pid=22282): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] 09:15:29.110675 run osmo-stp_10.42.42.5(pid=22282): stdout: | (launched: 2022-12-10_09:15:27.694212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:29.247451 run osmo-stp_10.42.42.5(pid=22282): stderr: | 20221210091527889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091527889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091527889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091527890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091527890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091527890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091527890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:29.383674 run osmo-stp_10.42.42.5(pid=22282): stdout: | (launched: 2022-12-10_09:15:27.694212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:29.512799 run osmo-stp_10.42.42.5(pid=22282): stderr: | 20221210091527889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091527889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091527889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091527890 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091527890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091527890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091527890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:29.667216 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22282): Process ended prematurely: osmo-stp_10.42.42.5(pid=22282) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:15:29.676569 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:15:29.704261 run osmo-hlr_10.42.42.2(pid=22279): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22279)] 09:15:29.754026 run osmo-hlr_10.42.42.2(pid=22279): stdout: | (launched: 2022-12-10_09:15:26.681682) 09:15:29.805375 run osmo-hlr_10.42.42.2(pid=22279): stderr: | 20221210091526881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091526881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091526881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091526881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091526881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091526881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091526895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091526904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091526904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091526904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:29.877269 run osmo-msc_10.42.42.6(pid=22285): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22285)] 09:15:29.926712 run osmo-msc_10.42.42.6(pid=22285): stdout: | (launched: 2022-12-10_09:15:28.732232) 09:15:29.977558 run osmo-msc_10.42.42.6(pid=22285): stderr: | 20221210091529055 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091529055 DLGLOBAL DEBUG validating counter group 0x7f83aac21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091529055 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091529055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091529055 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091529055 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091529057 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091529057 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091529058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091529058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:15:30.028920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Terminating (SIGTERM) 09:15:30.070921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Terminating (SIGTERM) 09:15:30.112283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22284): Terminating (SIGTERM) 09:15:30.154052 --- ParallelTerminationStrategy: PID 22278 died... 09:15:30.173850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22278): Terminated: ok {rc=0} 09:15:30.219653 --- ParallelTerminationStrategy: PID 22281 died... 09:15:30.239074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22281): Terminated: ok {rc=0} 09:15:30.284652 --- ParallelTerminationStrategy: PID 22284 died... 09:15:30.304076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22284): Terminated: ok {rc=0} 09:15:30.390512 bus /sierra_3: Setting Powered False 09:15:31.490345 bus /sierra_3: Setting Powered False 09:15:32.616055 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:15:33.763793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:33.776206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:15:33.850737 tst mo_mt_call_osmux.py: using LAC 27377 09:15:33.990126 tst mo_mt_call_osmux.py: using RAC 92 09:15:34.120434 tst mo_mt_call_osmux.py: using CellId 27377 09:15:34.242142 tst mo_mt_call_osmux.py: using BVCI 27378 09:15:34.354309 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:34.365832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:34.377211 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:34.388625 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:34.400106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:15:34.411373 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:15:34.530957 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:15:34.653411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:35.160670 run create_hlr_db(pid=22287): Launched 09:15:35.292202 bus /sierra_2: Setting Powered False 09:15:36.355972 run create_hlr_db(pid=22287): Terminated: ok {rc=0} 09:15:36.793140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22289): Launched 09:15:37.099984 run osmo-hlr_10.42.42.2(pid=22290): Launched 09:15:37.217701 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:37.747122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22292): Launched 09:15:38.052920 run osmo-stp_10.42.42.5(pid=22293): Launched 09:15:38.170238 run osmo-msc_10.42.42.6: Starting osmo-msc 09:15:38.725113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22295): Launched 09:15:39.032639 run osmo-msc_10.42.42.6(pid=22296): Launched 09:15:39.205167 run osmo-stp_10.42.42.5(pid=22293): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22293)] 09:15:39.335982 run osmo-stp_10.42.42.5(pid=22293): stdout: | (launched: 2022-12-10_09:15:37.996851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:39.467027 run osmo-stp_10.42.42.5(pid=22293): stderr: | 20221210091538169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091538169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091538169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091538170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091538170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091538170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091538170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:39.595239 run osmo-stp_10.42.42.5(pid=22293): stdout: | (launched: 2022-12-10_09:15:37.996851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:39.717240 run osmo-stp_10.42.42.5(pid=22293): stderr: | 20221210091538169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091538169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091538169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091538170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091538170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091538170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091538170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:39.863842 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22293): Process ended prematurely: osmo-stp_10.42.42.5(pid=22293) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22293)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:15:39.873104 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:15:39.900319 run osmo-hlr_10.42.42.2(pid=22290): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22290)] 09:15:39.948460 run osmo-hlr_10.42.42.2(pid=22290): stdout: | (launched: 2022-12-10_09:15:37.043318) 09:15:39.997975 run osmo-hlr_10.42.42.2(pid=22290): stderr: | 20221210091537219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091537219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091537219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091537219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091537219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091537219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091537236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091537246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091537246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091537246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:40.067471 run osmo-msc_10.42.42.6(pid=22296): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22296)] 09:15:40.115470 run osmo-msc_10.42.42.6(pid=22296): stdout: | (launched: 2022-12-10_09:15:38.976031) 09:15:40.164900 run osmo-msc_10.42.42.6(pid=22296): stderr: | 20221210091539250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091539250 DLGLOBAL DEBUG validating counter group 0x7f290ce22c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091539250 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091539250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091539251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091539251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091539252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091539253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091539253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091539253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:15:40.214877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22289): Terminating (SIGTERM) 09:15:40.254578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22292): Terminating (SIGTERM) 09:15:40.294382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22295): Terminating (SIGTERM) 09:15:40.334679 --- ParallelTerminationStrategy: PID 22289 died... 09:15:40.353887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22289): Terminated: ok {rc=0} 09:15:40.398272 --- ParallelTerminationStrategy: PID 22292 died... 09:15:40.417193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22292): Terminated: ok {rc=0} 09:15:40.461508 --- ParallelTerminationStrategy: PID 22295 died... 09:15:40.480232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22295): Terminated: ok {rc=0} 09:15:40.566431 bus /sierra_3: Setting Powered False 09:15:41.664926 bus /sierra_3: Setting Powered False 09:15:42.779642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:15:44.023863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:15:44.030297 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:15:44.060513 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:15:44.087011 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:15:44.139659 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:15:44.169226 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:15:44.195560 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:15:44.747668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:15:44.797178 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:44.808509 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:15:44.877889 tst mo_mt_call.py: using LAC 27378 09:15:45.006308 tst mo_mt_call.py: using RAC 93 09:15:45.136664 tst mo_mt_call.py: using CellId 27378 09:15:45.266687 tst mo_mt_call.py: using BVCI 27379 09:15:45.385526 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:45.397552 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:45.409379 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:45.421515 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:45.433888 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:45.445838 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:45.563141 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:45.682249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:46.192826 run create_hlr_db(pid=22301): Launched 09:15:46.348904 bus /sierra_2: Setting Powered False 09:15:47.413691 run create_hlr_db(pid=22301): Terminated: ok {rc=0} 09:15:47.855849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Launched 09:15:48.167457 run osmo-hlr_10.42.42.2(pid=22304): Launched 09:15:48.285150 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:48.821689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Launched 09:15:49.131594 run osmo-stp_10.42.42.5(pid=22307): Launched 09:15:49.249257 run osmo-msc_10.42.42.6: Starting osmo-msc 09:15:49.809477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22309): Launched 09:15:50.120581 run osmo-msc_10.42.42.6(pid=22310): Launched 09:15:50.292665 run osmo-stp_10.42.42.5(pid=22307): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] 09:15:50.423196 run osmo-stp_10.42.42.5(pid=22307): stdout: | (launched: 2022-12-10_09:15:49.071279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:50.552591 run osmo-stp_10.42.42.5(pid=22307): stderr: | 20221210091549243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091549243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091549243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091549243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091549246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091549246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091549246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:50.680828 run osmo-stp_10.42.42.5(pid=22307): stdout: | (launched: 2022-12-10_09:15:49.071279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:15:50.802676 run osmo-stp_10.42.42.5(pid=22307): stderr: | 20221210091549243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091549243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091549243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091549243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091549246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091549246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091549246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:15:50.949402 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22307): Process ended prematurely: osmo-stp_10.42.42.5(pid=22307) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:15:50.958153 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:15:50.984940 run osmo-hlr_10.42.42.2(pid=22304): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22304)] 09:15:51.032417 run osmo-hlr_10.42.42.2(pid=22304): stdout: | (launched: 2022-12-10_09:15:48.107329) 09:15:51.081614 run osmo-hlr_10.42.42.2(pid=22304): stderr: | 20221210091548286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091548286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091548286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091548286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091548286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091548286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091548298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091548306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091548307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091548307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:15:51.150608 run osmo-msc_10.42.42.6(pid=22310): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22310)] 09:15:51.198176 run osmo-msc_10.42.42.6(pid=22310): stdout: | (launched: 2022-12-10_09:15:50.060330) 09:15:51.247321 run osmo-msc_10.42.42.6(pid=22310): stderr: | 20221210091550334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091550335 DLGLOBAL DEBUG validating counter group 0x7fac02554c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091550335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091550335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091550335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091550335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091550337 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091550337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091550337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091550338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:15:51.296808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Terminating (SIGTERM) 09:15:51.336239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Terminating (SIGTERM) 09:15:51.375668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22309): Terminating (SIGTERM) 09:15:51.415213 --- ParallelTerminationStrategy: PID 22303 died... 09:15:51.434353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22303): Terminated: ok {rc=0} 09:15:51.478451 --- ParallelTerminationStrategy: PID 22306 died... 09:15:51.496661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22306): Terminated: ok {rc=0} 09:15:51.540911 --- ParallelTerminationStrategy: PID 22309 died... 09:15:51.559522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22309): Terminated: ok {rc=0} 09:15:51.645676 bus /sierra_3: Setting Powered False 09:15:52.744488 bus /sierra_3: Setting Powered False 09:15:53.859609 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:15:55.009083 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.021823 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:15:55.091519 tst mo_mt_call_osmux.py: using LAC 27379 09:15:55.222831 tst mo_mt_call_osmux.py: using RAC 94 09:15:55.353079 tst mo_mt_call_osmux.py: using CellId 27379 09:15:55.481622 tst mo_mt_call_osmux.py: using BVCI 27380 09:15:55.602676 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.614607 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.626410 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.638352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.650391 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:15:55.662306 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:55.780142 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:15:55.901326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:15:56.414475 run create_hlr_db(pid=22312): Launched 09:15:56.547816 bus /sierra_2: Setting Powered False 09:15:57.611949 run create_hlr_db(pid=22312): Terminated: ok {rc=0} 09:15:58.054393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22314): Launched 09:15:58.365983 run osmo-hlr_10.42.42.2(pid=22315): Launched 09:15:58.483365 run osmo-stp_10.42.42.5: Starting osmo-stp 09:15:59.028362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22317): Launched 09:15:59.340753 run osmo-stp_10.42.42.5(pid=22318): Launched 09:15:59.459752 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:00.020226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22320): Launched 09:16:00.331913 run osmo-msc_10.42.42.6(pid=22321): Launched 09:16:00.505272 run osmo-stp_10.42.42.5(pid=22318): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22318)] 09:16:00.636067 run osmo-stp_10.42.42.5(pid=22318): stdout: | (launched: 2022-12-10_09:15:59.280466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:00.766723 run osmo-stp_10.42.42.5(pid=22318): stderr: | 20221210091559455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091559455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091559456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091559456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091559457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091559457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091559457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:00.924337 run osmo-stp_10.42.42.5(pid=22318): stdout: | (launched: 2022-12-10_09:15:59.280466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:01.050291 run osmo-stp_10.42.42.5(pid=22318): stderr: | 20221210091559455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091559455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091559456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091559456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091559457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091559457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091559457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:01.201204 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22318): Process ended prematurely: osmo-stp_10.42.42.5(pid=22318) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22318)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:16:01.211020 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:16:01.240148 run osmo-hlr_10.42.42.2(pid=22315): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22315)] 09:16:01.290690 run osmo-hlr_10.42.42.2(pid=22315): stdout: | (launched: 2022-12-10_09:15:58.305485) 09:16:01.342551 run osmo-hlr_10.42.42.2(pid=22315): stderr: | 20221210091558488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091558488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091558488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091558488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091558488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091558488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091558501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091558510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091558510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091558510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:01.414528 run osmo-msc_10.42.42.6(pid=22321): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22321)] 09:16:01.465188 run osmo-msc_10.42.42.6(pid=22321): stdout: | (launched: 2022-12-10_09:16:00.271686) 09:16:01.517131 run osmo-msc_10.42.42.6(pid=22321): stderr: | 20221210091600548 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091600548 DLGLOBAL DEBUG validating counter group 0x7f5cbb466c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091600548 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091600548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091600548 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091600549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091600552 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091600552 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091600553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091600553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:01.569992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22314): Terminating (SIGTERM) 09:16:01.612655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22317): Terminating (SIGTERM) 09:16:01.654922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22320): Terminating (SIGTERM) 09:16:01.697450 --- ParallelTerminationStrategy: PID 22314 died... 09:16:01.717051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22314): Terminated: ok {rc=0} 09:16:01.764933 --- ParallelTerminationStrategy: PID 22317 died... 09:16:01.784759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22317): Terminated: ok {rc=0} 09:16:01.840736 --- ParallelTerminationStrategy: PID 22320 died... 09:16:01.864415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22320): Terminated: ok {rc=0} 09:16:01.975931 bus /sierra_3: Setting Powered False 09:16:03.074062 bus /sierra_3: Setting Powered False 09:16:04.188810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:16:05.439207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:05.445711 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:16:05.478982 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 09:16:05.505590 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 09:16:05.561723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:16:05.591518 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 09:16:05.618030 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 09:16:06.172899 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 09:16:06.223652 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.234849 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:16:06.298944 tst mo_mt_call.py: using LAC 27380 09:16:06.418438 tst mo_mt_call.py: using RAC 95 09:16:06.539668 tst mo_mt_call.py: using CellId 27380 09:16:06.668733 tst mo_mt_call.py: using BVCI 27381 09:16:06.787477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.799207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.810719 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.822705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.834497 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:06.846211 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:16:06.962526 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:16:07.077978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:07.583497 run create_hlr_db(pid=22326): Launched 09:16:07.715196 bus /sierra_2: Setting Powered False 09:16:08.780451 run create_hlr_db(pid=22326): Terminated: ok {rc=0} 09:16:09.218023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Launched 09:16:09.525460 run osmo-hlr_10.42.42.2(pid=22329): Launched 09:16:09.643765 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:10.185719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Launched 09:16:10.492390 run osmo-stp_10.42.42.5(pid=22332): Launched 09:16:10.610987 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:11.166499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Launched 09:16:11.474064 run osmo-msc_10.42.42.6(pid=22335): Launched 09:16:11.648260 run osmo-stp_10.42.42.5(pid=22332): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] 09:16:11.779227 run osmo-stp_10.42.42.5(pid=22332): stdout: | (launched: 2022-12-10_09:16:10.435841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:11.909650 run osmo-stp_10.42.42.5(pid=22332): stderr: | 20221210091610606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091610606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091610606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091610607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091610607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091610607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091610607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:12.037520 run osmo-stp_10.42.42.5(pid=22332): stdout: | (launched: 2022-12-10_09:16:10.435841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:12.159973 run osmo-stp_10.42.42.5(pid=22332): stderr: | 20221210091610606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091610606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091610606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091610607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091610607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091610607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091610607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:12.306445 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22332): Process ended prematurely: osmo-stp_10.42.42.5(pid=22332) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 09:16:12.315286 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:16:12.342227 run osmo-hlr_10.42.42.2(pid=22329): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22329)] 09:16:12.389939 run osmo-hlr_10.42.42.2(pid=22329): stdout: | (launched: 2022-12-10_09:16:09.469144) 09:16:12.439467 run osmo-hlr_10.42.42.2(pid=22329): stderr: | 20221210091609648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091609648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091609648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091609648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091609648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091609648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091609660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091609670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091609671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091609671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:12.508451 run osmo-msc_10.42.42.6(pid=22335): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22335)] 09:16:12.556680 run osmo-msc_10.42.42.6(pid=22335): stdout: | (launched: 2022-12-10_09:16:11.417501) 09:16:12.606138 run osmo-msc_10.42.42.6(pid=22335): stderr: | 20221210091611689 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091611690 DLGLOBAL DEBUG validating counter group 0x7fcf932ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091611690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091611690 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091611690 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091611690 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091611692 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091611692 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091611692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091611693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:12.655951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Terminating (SIGTERM) 09:16:12.695842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Terminating (SIGTERM) 09:16:12.735644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Terminating (SIGTERM) 09:16:12.775774 --- ParallelTerminationStrategy: PID 22328 died... 09:16:12.794908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Terminated: ok {rc=0} 09:16:12.839510 --- ParallelTerminationStrategy: PID 22331 died... 09:16:12.858214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Terminated: ok {rc=0} 09:16:12.902470 --- ParallelTerminationStrategy: PID 22334 died... 09:16:12.921171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Terminated: ok {rc=0} 09:16:13.007202 bus /sierra_3: Setting Powered False 09:16:14.106689 bus /sierra_3: Setting Powered False 09:16:15.223543 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 09:16:16.374965 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:16.387691 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:16:16.456360 tst mo_mt_call_osmux.py: using LAC 27381 09:16:16.579184 tst mo_mt_call_osmux.py: using RAC 96 09:16:16.704391 tst mo_mt_call_osmux.py: using CellId 27381 09:16:16.864890 tst mo_mt_call_osmux.py: using BVCI 27382 09:16:16.981650 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:16.994002 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:17.005997 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:17.018951 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:17.032630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 09:16:17.044784 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:16:17.164440 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 09:16:17.288252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:17.796850 run create_hlr_db(pid=22337): Launched 09:16:17.928673 bus /sierra_2: Setting Powered False 09:16:18.993765 run create_hlr_db(pid=22337): Terminated: ok {rc=0} 09:16:19.432231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22339): Launched 09:16:19.741633 run osmo-hlr_10.42.42.2(pid=22340): Launched 09:16:19.859982 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:20.406373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22342): Launched 09:16:20.712525 run osmo-stp_10.42.42.5(pid=22343): Launched 09:16:20.830150 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:21.384265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22345): Launched 09:16:21.691457 run osmo-msc_10.42.42.6(pid=22346): Launched 09:16:21.865240 run osmo-stp_10.42.42.5(pid=22343): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22343)] 09:16:21.995955 run osmo-stp_10.42.42.5(pid=22343): stdout: | (launched: 2022-12-10_09:16:20.656431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:22.126158 run osmo-stp_10.42.42.5(pid=22343): stderr: | 20221210091620826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091620826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091620826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091620826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091620828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091620829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091620829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:22.254258 run osmo-stp_10.42.42.5(pid=22343): stdout: | (launched: 2022-12-10_09:16:20.656431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:22.376508 run osmo-stp_10.42.42.5(pid=22343): stderr: | 20221210091620826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091620826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091620826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091620826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091620828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091620829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091620829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:22.522949 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22343): Process ended prematurely: osmo-stp_10.42.42.5(pid=22343) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22343)] [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 09:16:22.531922 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:16:22.558783 run osmo-hlr_10.42.42.2(pid=22340): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22340)] 09:16:22.606393 run osmo-hlr_10.42.42.2(pid=22340): stdout: | (launched: 2022-12-10_09:16:19.685039) 09:16:22.655767 run osmo-hlr_10.42.42.2(pid=22340): stderr: | 20221210091619859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091619859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091619859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091619860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091619860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091619860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091619873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091619881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091619881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091619881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:22.725069 run osmo-msc_10.42.42.6(pid=22346): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22346)] 09:16:22.772606 run osmo-msc_10.42.42.6(pid=22346): stdout: | (launched: 2022-12-10_09:16:21.635045) 09:16:22.821764 run osmo-msc_10.42.42.6(pid=22346): stderr: | 20221210091621908 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091621908 DLGLOBAL DEBUG validating counter group 0x7f55547fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091621908 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091621908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091621908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091621908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091621910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091621911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091621911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091621911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:22.871339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22339): Terminating (SIGTERM) 09:16:22.910825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22342): Terminating (SIGTERM) 09:16:22.950345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22345): Terminating (SIGTERM) 09:16:22.990724 --- ParallelTerminationStrategy: PID 22339 died... 09:16:23.009583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22339): Terminated: ok {rc=0} 09:16:23.053591 --- ParallelTerminationStrategy: PID 22342 died... 09:16:23.071959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22342): Terminated: ok {rc=0} 09:16:23.116103 --- ParallelTerminationStrategy: PID 22345 died... 09:16:23.134695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22345): Terminated: ok {rc=0} 09:16:23.217166 bus /sierra_3: Setting Powered False 09:16:24.312318 bus /sierra_3: Setting Powered False 09:16:25.427023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 09:16:26.667175 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:26.671507 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:16:26.701483 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:16:26.728076 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:16:26.810867 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:16:26.839935 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:16:26.867059 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:16:27.454695 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 09:16:27.459875 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:27.470876 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:16:27.516060 tst emergency_mo_mt_call.py: using LAC 27382 09:16:27.633180 tst emergency_mo_mt_call.py: using RAC 97 09:16:27.750240 tst emergency_mo_mt_call.py: using CellId 27382 09:16:27.867493 tst emergency_mo_mt_call.py: using BVCI 27383 09:16:27.976792 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:27.987736 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:27.998378 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:28.009234 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:28.020090 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:28.030961 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:28.148480 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:28.263852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:28.734979 run create_hlr_db(pid=22351): Launched 09:16:28.850496 bus /sierra_2: Setting Powered False 09:16:29.911607 run create_hlr_db(pid=22351): Terminated: ok {rc=0} 09:16:30.337519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22353): Launched 09:16:30.642967 run osmo-hlr_10.42.42.2(pid=22354): Launched 09:16:30.757814 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:31.377588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22356): Launched 09:16:31.706817 run osmo-stp_10.42.42.5(pid=22357): Launched 09:16:31.884328 tst emergency_mo_mt_call.py: using MSISDN 7654 09:16:32.181594 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:32.734459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22359): Launched 09:16:33.040751 run osmo-msc_10.42.42.6(pid=22360): Launched 09:16:33.211105 run osmo-stp_10.42.42.5(pid=22357): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22357)] 09:16:33.339903 run osmo-stp_10.42.42.5(pid=22357): stdout: | (launched: 2022-12-10_09:16:31.638586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:33.468180 run osmo-stp_10.42.42.5(pid=22357): stderr: | 20221210091631982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091631983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091631983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091631983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091631984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091631984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091631984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:33.594847 run osmo-stp_10.42.42.5(pid=22357): stdout: | (launched: 2022-12-10_09:16:31.638586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:33.715099 run osmo-stp_10.42.42.5(pid=22357): stderr: | 20221210091631982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091631983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091631983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091631983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091631984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091631984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091631984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:33.859617 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22357): Process ended prematurely: osmo-stp_10.42.42.5(pid=22357) [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22357)] [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 09:16:33.867983 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 09:16:33.895026 run osmo-hlr_10.42.42.2(pid=22354): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22354)] 09:16:33.943069 run osmo-hlr_10.42.42.2(pid=22354): stdout: | (launched: 2022-12-10_09:16:30.583983) 09:16:33.993295 run osmo-hlr_10.42.42.2(pid=22354): stderr: | 20221210091630765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091630765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091630765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091630765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091630765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091630765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091630777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091630786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091630786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091630786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:34.062553 run osmo-msc_10.42.42.6(pid=22360): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22360)] 09:16:34.110665 run osmo-msc_10.42.42.6(pid=22360): stdout: | (launched: 2022-12-10_09:16:32.980882) 09:16:34.160140 run osmo-msc_10.42.42.6(pid=22360): stderr: | 20221210091633257 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091633257 DLGLOBAL DEBUG validating counter group 0x7f2399bf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091633257 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091633257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091633257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091633258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091633259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091633260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091633260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091633260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:34.210142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22353): Terminating (SIGTERM) 09:16:34.249849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22356): Terminating (SIGTERM) 09:16:34.289663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22359): Terminating (SIGTERM) 09:16:34.330048 --- ParallelTerminationStrategy: PID 22353 died... 09:16:34.348986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22353): Terminated: ok {rc=0} 09:16:34.393508 --- ParallelTerminationStrategy: PID 22356 died... 09:16:34.412282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22356): Terminated: ok {rc=0} 09:16:34.456671 --- ParallelTerminationStrategy: PID 22359 died... 09:16:34.475425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22359): Terminated: ok {rc=0} 09:16:34.561608 bus /sierra_3: Setting Powered False 09:16:35.660358 bus /sierra_3: Setting Powered False 09:16:36.775107 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 09:16:37.862987 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:37.874678 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:16:37.925410 tst emergency_preemptive_call.py: using LAC 27383 09:16:38.045385 tst emergency_preemptive_call.py: using RAC 98 09:16:38.162927 tst emergency_preemptive_call.py: using CellId 27383 09:16:38.279944 tst emergency_preemptive_call.py: using BVCI 27384 09:16:38.390297 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:38.401430 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:38.412077 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:38.423511 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:38.435035 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:16:38.446487 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:38.562970 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:38.681037 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:38.799116 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:38.912500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:39.385820 run create_hlr_db(pid=22363): Launched 09:16:39.501579 bus /sierra_2: Setting Powered False 09:16:40.562378 run create_hlr_db(pid=22363): Terminated: ok {rc=0} 09:16:41.006850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22365): Launched 09:16:41.333916 run osmo-hlr_10.42.42.2(pid=22366): Launched 09:16:41.456702 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:42.015230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22368): Launched 09:16:42.340169 run osmo-stp_10.42.42.5(pid=22369): Launched 09:16:42.471061 tst emergency_preemptive_call.py: using MSISDN 7655 09:16:42.635230 run osmo-msc_10.42.42.6: Starting osmo-msc 09:16:43.214221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22371): Launched 09:16:43.537726 run osmo-msc_10.42.42.6(pid=22372): Launched 09:16:43.715666 run osmo-stp_10.42.42.5(pid=22369): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22369)] 09:16:43.850603 run osmo-stp_10.42.42.5(pid=22369): stdout: | (launched: 2022-12-10_09:16:42.276615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:43.986641 run osmo-stp_10.42.42.5(pid=22369): stderr: | 20221210091642475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091642476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091642476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091642477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091642477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091642477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091642477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:44.121570 run osmo-stp_10.42.42.5(pid=22369): stdout: | (launched: 2022-12-10_09:16:42.276615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:16:44.248614 run osmo-stp_10.42.42.5(pid=22369): stderr: | 20221210091642475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091642476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091642476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091642477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091642477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091642477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091642477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:16:44.400855 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22369): Process ended prematurely: osmo-stp_10.42.42.5(pid=22369) [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22369)] [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 09:16:44.409706 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 09:16:44.437150 run osmo-hlr_10.42.42.2(pid=22366): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22366)] 09:16:44.487096 run osmo-hlr_10.42.42.2(pid=22366): stdout: | (launched: 2022-12-10_09:16:41.271079) 09:16:44.539020 run osmo-hlr_10.42.42.2(pid=22366): stderr: | 20221210091641473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091641473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091641473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091641473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091641473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091641473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091641489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091641498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091641498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091641498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:16:44.611914 run osmo-msc_10.42.42.6(pid=22372): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22372)] 09:16:44.661847 run osmo-msc_10.42.42.6(pid=22372): stdout: | (launched: 2022-12-10_09:16:43.474634) 09:16:44.713621 run osmo-msc_10.42.42.6(pid=22372): stderr: | 20221210091643802 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210091643802 DLGLOBAL DEBUG validating counter group 0x7fd916ee2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210091643802 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210091643802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210091643802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210091643803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210091643805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210091643805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210091643805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210091643805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:16:44.765683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22365): Terminating (SIGTERM) 09:16:44.807380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22368): Terminating (SIGTERM) 09:16:44.849372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22371): Terminating (SIGTERM) 09:16:44.891719 --- ParallelTerminationStrategy: PID 22365 died... 09:16:44.911777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22365): Terminated: ok {rc=0} 09:16:44.958299 --- ParallelTerminationStrategy: PID 22368 died... 09:16:44.977937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22368): Terminated: ok {rc=0} 09:16:45.024106 --- ParallelTerminationStrategy: PID 22371 died... 09:16:45.043542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22371): Terminated: ok {rc=0} 09:16:45.131615 bus /sierra_9: Setting Powered False 09:16:46.227166 bus /sierra_9: Setting Powered False 09:16:47.343674 bus /sierra_8: Setting Powered False 09:16:48.440402 bus /sierra_8: Setting Powered False 09:16:49.554686 bus /sierra_3: Setting Powered False 09:16:50.653691 bus /sierra_3: Setting Powered False 09:16:51.772707 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 09:16:53.046288 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:16:53.050747 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 09:16:53.080614 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 09:16:53.119514 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 09:16:53.207327 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 09:16:53.238310 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 09:16:53.278315 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 09:16:53.867247 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 09:16:53.917722 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:53.928387 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:16:53.972581 tst cs_paging_gprs_active.py: using LAC 27384 09:16:54.094836 tst cs_paging_gprs_active.py: using RAC 99 09:16:54.215931 tst cs_paging_gprs_active.py: using CellId 27384 09:16:54.337615 tst cs_paging_gprs_active.py: using BVCI 27385 09:16:54.457565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.468938 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.480329 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.492118 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.503403 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.514747 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.526594 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.537948 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:16:54.549260 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:54.669359 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:16:54.785655 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:16:54.993801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:55.303567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22377): Launched 09:16:55.571301 run iperf3-srv_10.42.42.10(pid=22378): Launched 09:16:55.686772 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:16:55.893934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:16:56.203052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22379): Launched 09:16:56.471435 run iperf3-srv_10.42.42.10(pid=22380): Launched 09:16:56.587171 tst cs_paging_gprs_active.py:38: start network... 09:16:56.794567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:16:57.271792 run create_hlr_db(pid=22381): Launched 09:16:57.391033 bus /sierra_2: Setting Powered False 09:16:58.452328 run create_hlr_db(pid=22381): Terminated: ok {rc=0} 09:16:58.882535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22383): Launched 09:16:59.190572 run osmo-hlr_10.42.42.2(pid=22384): Launched 09:16:59.308857 run osmo-stp_10.42.42.5: Starting osmo-stp 09:16:59.851914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22386): Launched 09:17:00.160774 run osmo-stp_10.42.42.5(pid=22387): Launched 09:17:00.279278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:00.809827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22389): Launched 09:17:00.939125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:01.212079 run patchelf(pid=22390): Launched 09:17:01.404559 run osmo-stp_10.42.42.5(pid=22387): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22387)] 09:17:01.539119 run osmo-stp_10.42.42.5(pid=22387): stdout: | (launched: 2022-12-10_09:17:00.104208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:01.675700 run osmo-stp_10.42.42.5(pid=22387): stderr: | 20221210091700274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091700274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091700274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091700275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091700276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091700276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091700276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:01.812128 run osmo-stp_10.42.42.5(pid=22387): stdout: | (launched: 2022-12-10_09:17:00.104208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:01.943398 run osmo-stp_10.42.42.5(pid=22387): stderr: | 20221210091700274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091700274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091700274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091700275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091700276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091700276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091700276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:02.097861 run patchelf(pid=22390): Terminating (SIGINT) 09:17:02.275562 run patchelf(pid=22390): Terminated: ok {rc=0} 09:17:02.403747 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22387): Process ended prematurely: osmo-stp_10.42.42.5(pid=22387) [trial-2372↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22387)] [trial-2372↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 09:17:02.413396 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:17:02.441226 run osmo-hlr_10.42.42.2(pid=22384): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22384)] 09:17:02.490236 run osmo-hlr_10.42.42.2(pid=22384): stdout: | (launched: 2022-12-10_09:16:59.133975) 09:17:02.540265 run osmo-hlr_10.42.42.2(pid=22384): stderr: | 20221210091659312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091659312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091659312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091659312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091659312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091659312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091659323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091659334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091659334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091659334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:02.590604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22377): Terminating (SIGTERM) 09:17:02.651388 run iperf3-srv_10.42.42.10(pid=22378): Terminating (SIGTERM) 09:17:02.691504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22379): Terminating (SIGTERM) 09:17:02.731602 run iperf3-srv_10.42.42.10(pid=22380): Terminating (SIGTERM) 09:17:02.771407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22383): Terminating (SIGTERM) 09:17:02.811355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22386): Terminating (SIGTERM) 09:17:02.851352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22389): Terminating (SIGTERM) 09:17:02.891635 --- ParallelTerminationStrategy: PID 22377 died... 09:17:02.910870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22377): Terminated: ok {rc=0} 09:17:02.955653 --- ParallelTerminationStrategy: PID 22378 died... 09:17:02.974394 run iperf3-srv_10.42.42.10(pid=22378): Terminated {rc=256} 09:17:03.019041 --- ParallelTerminationStrategy: PID 22379 died... 09:17:03.037941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22379): Terminated: ok {rc=0} 09:17:03.082892 --- ParallelTerminationStrategy: PID 22380 died... 09:17:03.101595 run iperf3-srv_10.42.42.10(pid=22380): Terminated {rc=256} 09:17:03.146076 --- ParallelTerminationStrategy: PID 22383 died... 09:17:03.164836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22383): Terminated: ok {rc=0} 09:17:03.209413 --- ParallelTerminationStrategy: PID 22386 died... 09:17:03.228190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22386): Terminated: ok {rc=0} 09:17:03.272843 --- ParallelTerminationStrategy: PID 22389 died... 09:17:03.292071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22389): Terminated: ok {rc=0} 09:17:03.379502 bus /gobi_0: Setting Powered False 09:17:04.477113 bus /gobi_0: Setting Powered False 09:17:05.592594 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 09:17:06.740473 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:06.751860 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:17:06.798569 tst iperf3.py: using LAC 27385 09:17:06.919205 tst iperf3.py: using RAC 100 09:17:07.041607 tst iperf3.py: using CellId 27385 09:17:07.163933 tst iperf3.py: using BVCI 27386 09:17:07.278074 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.288831 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.299450 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.310867 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.322018 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.333221 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.344599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.355871 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:07.367170 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:07.482875 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:17:07.690968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:08.000471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Launched 09:17:08.269211 run iperf3-srv_10.42.42.10(pid=22395): Launched 09:17:08.384482 tst iperf3.py:8: start network... 09:17:08.590583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:09.066162 run create_hlr_db(pid=22396): Launched 09:17:09.182999 bus /gobi_6: Setting Powered False 09:17:10.244436 run create_hlr_db(pid=22396): Terminated: ok {rc=0} 09:17:10.690365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Launched 09:17:11.016095 run osmo-hlr_10.42.42.2(pid=22399): Launched 09:17:11.142077 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:11.708731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Launched 09:17:12.033049 run osmo-stp_10.42.42.5(pid=22402): Launched 09:17:12.157551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:12.723950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Launched 09:17:12.847890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:13.123730 run patchelf(pid=22405): Launched 09:17:13.303768 run osmo-stp_10.42.42.5(pid=22402): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] 09:17:13.441213 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-10_09:17:11.973845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:13.580034 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221210091712167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091712167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091712167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091712168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091712170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091712170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091712170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:13.719349 run osmo-stp_10.42.42.5(pid=22402): stdout: | (launched: 2022-12-10_09:17:11.973845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:13.852710 run osmo-stp_10.42.42.5(pid=22402): stderr: | 20221210091712167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091712167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091712167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091712168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091712170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091712170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091712170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:14.011006 run patchelf(pid=22405): Terminating (SIGINT) 09:17:14.193761 run patchelf(pid=22405): Terminated: ok {rc=0} 09:17:14.324925 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 09:17:14.334901 tst iperf3.py:8: Test FAILED (7.6 sec) 09:17:14.363228 run osmo-hlr_10.42.42.2(pid=22399): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22399)] 09:17:14.413057 run osmo-hlr_10.42.42.2(pid=22399): stdout: | (launched: 2022-12-10_09:17:10.956532) 09:17:14.464444 run osmo-hlr_10.42.42.2(pid=22399): stderr: | 20221210091711155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091711155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091711155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091711155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091711155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091711155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091711168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091711178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091711178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091711178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:14.516257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Terminating (SIGTERM) 09:17:14.558450 run iperf3-srv_10.42.42.10(pid=22395): Terminating (SIGTERM) 09:17:14.600254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminating (SIGTERM) 09:17:14.641862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminating (SIGTERM) 09:17:14.683621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminating (SIGTERM) 09:17:14.725734 --- ParallelTerminationStrategy: PID 22394 died... 09:17:14.745776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22394): Terminated: ok {rc=0} 09:17:14.792172 --- ParallelTerminationStrategy: PID 22395 died... 09:17:14.811943 run iperf3-srv_10.42.42.10(pid=22395): Terminated {rc=256} 09:17:14.857701 --- ParallelTerminationStrategy: PID 22398 died... 09:17:14.877333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22398): Terminated: ok {rc=0} 09:17:14.923264 --- ParallelTerminationStrategy: PID 22401 died... 09:17:14.942916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22401): Terminated: ok {rc=0} 09:17:14.988941 --- ParallelTerminationStrategy: PID 22404 died... 09:17:15.008455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22404): Terminated: ok {rc=0} 09:17:15.095083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 09:17:16.280561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:16.296602 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:17:16.353478 tst iperf3m4.py: using LAC 27386 09:17:16.529679 tst iperf3m4.py: using RAC 101 09:17:16.655757 tst iperf3m4.py: using CellId 27386 09:17:16.815269 tst iperf3m4.py: using BVCI 27387 09:17:16.946609 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:16.958929 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:16.971017 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:16.984913 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:16.998037 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:17.010091 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:17.023075 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:17.036718 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:17.049960 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:17.176100 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:17.307452 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:17.430058 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:17.551366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:17:17.758780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:18.068484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Launched 09:17:18.336331 run iperf3-srv_10.42.42.10(pid=22407): Launched 09:17:18.451959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:17:18.658413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:18.967257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Launched 09:17:19.234693 run iperf3-srv_10.42.42.10(pid=22409): Launched 09:17:19.350178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:17:19.555887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:19.864444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Launched 09:17:20.131761 run iperf3-srv_10.42.42.10(pid=22411): Launched 09:17:20.247698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:17:20.454252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:20.763977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Launched 09:17:21.031215 run iperf3-srv_10.42.42.10(pid=22413): Launched 09:17:21.146706 tst iperf3m4.py:8: start network... 09:17:21.352596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:21.829683 run create_hlr_db(pid=22414): Launched 09:17:21.946901 bus /gobi_6: Setting Powered False 09:17:23.008105 run create_hlr_db(pid=22414): Terminated: ok {rc=0} 09:17:23.436780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Launched 09:17:23.745043 run osmo-hlr_10.42.42.2(pid=22417): Launched 09:17:23.863713 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:24.509208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Launched 09:17:24.809918 run osmo-stp_10.42.42.5(pid=22420): Launched 09:17:24.925805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:25.457755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Launched 09:17:25.572680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:25.827003 run patchelf(pid=22423): Launched 09:17:25.993804 run osmo-stp_10.42.42.5(pid=22420): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] 09:17:26.121420 run osmo-stp_10.42.42.5(pid=22420): stdout: | (launched: 2022-12-10_09:17:24.754794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:26.250617 run osmo-stp_10.42.42.5(pid=22420): stderr: | 20221210091724935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091724935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091724935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091724936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091724936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091724936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091724936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:26.379692 run osmo-stp_10.42.42.5(pid=22420): stdout: | (launched: 2022-12-10_09:17:24.754794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:26.503205 run osmo-stp_10.42.42.5(pid=22420): stderr: | 20221210091724935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091724935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091724935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091724936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091724936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091724936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091724936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:26.649559 run patchelf(pid=22423): Terminating (SIGINT) 09:17:26.818364 run patchelf(pid=22423): Terminated: ok {rc=0} 09:17:26.940655 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22420): Process ended prematurely: osmo-stp_10.42.42.5(pid=22420) [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 09:17:26.950176 tst iperf3m4.py:8: Test FAILED (10.7 sec) 09:17:26.977671 run osmo-hlr_10.42.42.2(pid=22417): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22417)] 09:17:27.025016 run osmo-hlr_10.42.42.2(pid=22417): stdout: | (launched: 2022-12-10_09:17:23.687981) 09:17:27.073994 run osmo-hlr_10.42.42.2(pid=22417): stderr: | 20221210091723866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091723866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091723866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091723866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091723866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091723866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091723879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091723887 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091723887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091723887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:27.123019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Terminating (SIGTERM) 09:17:27.162275 run iperf3-srv_10.42.42.10(pid=22407): Terminating (SIGTERM) 09:17:27.201419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Terminating (SIGTERM) 09:17:27.241291 run iperf3-srv_10.42.42.10(pid=22409): Terminating (SIGTERM) 09:17:27.280427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Terminating (SIGTERM) 09:17:27.319878 run iperf3-srv_10.42.42.10(pid=22411): Terminating (SIGTERM) 09:17:27.358958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Terminating (SIGTERM) 09:17:27.398257 run iperf3-srv_10.42.42.10(pid=22413): Terminating (SIGTERM) 09:17:27.437434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Terminating (SIGTERM) 09:17:27.476723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Terminating (SIGTERM) 09:17:27.515888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Terminating (SIGTERM) 09:17:27.555524 --- ParallelTerminationStrategy: PID 22406 died... 09:17:27.574462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22406): Terminated: ok {rc=0} 09:17:27.618047 --- ParallelTerminationStrategy: PID 22407 died... 09:17:27.636491 run iperf3-srv_10.42.42.10(pid=22407): Terminated {rc=256} 09:17:27.679981 --- ParallelTerminationStrategy: PID 22408 died... 09:17:27.698403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22408): Terminated: ok {rc=0} 09:17:27.741963 --- ParallelTerminationStrategy: PID 22409 died... 09:17:27.760291 run iperf3-srv_10.42.42.10(pid=22409): Terminated {rc=256} 09:17:27.804142 --- ParallelTerminationStrategy: PID 22410 died... 09:17:27.822775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22410): Terminated: ok {rc=0} 09:17:27.866458 --- ParallelTerminationStrategy: PID 22411 died... 09:17:27.884750 run iperf3-srv_10.42.42.10(pid=22411): Terminated {rc=256} 09:17:27.928295 --- ParallelTerminationStrategy: PID 22412 died... 09:17:27.946721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22412): Terminated: ok {rc=0} 09:17:27.990385 --- ParallelTerminationStrategy: PID 22413 died... 09:17:28.008578 run iperf3-srv_10.42.42.10(pid=22413): Terminated {rc=256} 09:17:28.052284 --- ParallelTerminationStrategy: PID 22416 died... 09:17:28.070786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22416): Terminated: ok {rc=0} 09:17:28.114359 --- ParallelTerminationStrategy: PID 22419 died... 09:17:28.132531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22419): Terminated: ok {rc=0} 09:17:28.175946 --- ParallelTerminationStrategy: PID 22422 died... 09:17:28.194298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22422): Terminated: ok {rc=0} 09:17:28.279809 bus /gobi_4: Setting Powered False 09:17:29.378453 bus /gobi_4: Setting Powered False 09:17:30.492302 bus /gobi_1: Setting Powered False 09:17:31.598854 bus /gobi_1: Setting Powered False 09:17:32.729188 bus /gobi_0: Setting Powered False 09:17:33.825828 bus /gobi_0: Setting Powered False 09:17:34.941182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 09:17:36.041980 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.053257 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:17:36.098035 tst ping.py: using LAC 27387 09:17:36.216291 tst ping.py: using RAC 102 09:17:36.332748 tst ping.py: using CellId 27387 09:17:36.456750 tst ping.py: using BVCI 27388 09:17:36.570797 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.582175 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.593491 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.604643 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.615790 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.626912 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.638024 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:36.648935 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:36.763238 tst ping.py:19: start network... 09:17:36.962210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:37.420008 run create_hlr_db(pid=22426): Launched 09:17:37.534026 bus /gobi_6: Setting Powered False 09:17:38.593244 run create_hlr_db(pid=22426): Terminated: ok {rc=0} 09:17:39.024574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Launched 09:17:39.338716 run osmo-hlr_10.42.42.2(pid=22429): Launched 09:17:39.458183 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:40.000308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Launched 09:17:40.314337 run osmo-stp_10.42.42.5(pid=22432): Launched 09:17:40.434795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:40.977296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Launched 09:17:41.096885 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:41.363088 run patchelf(pid=22435): Launched 09:17:41.537670 run osmo-stp_10.42.42.5(pid=22432): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] 09:17:41.670845 run osmo-stp_10.42.42.5(pid=22432): stdout: | (launched: 2022-12-10_09:17:40.257072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:41.805444 run osmo-stp_10.42.42.5(pid=22432): stderr: | 20221210091740446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091740447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091740447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091740447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091740448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091740448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091740448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:41.939861 run osmo-stp_10.42.42.5(pid=22432): stdout: | (launched: 2022-12-10_09:17:40.257072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:42.069184 run osmo-stp_10.42.42.5(pid=22432): stderr: | 20221210091740446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091740447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091740447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091740447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091740448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091740448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091740448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:42.222555 run patchelf(pid=22435): Terminating (SIGINT) 09:17:42.399041 run patchelf(pid=22435): Terminated: ok {rc=0} 09:17:42.525873 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22432): Process ended prematurely: osmo-stp_10.42.42.5(pid=22432) [trial-2372↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] [trial-2372↪gprs:trx-lms-limenet-micro↪ping.py:22] 09:17:42.535150 tst ping.py:22: Test FAILED (6.5 sec) 09:17:42.562487 run osmo-hlr_10.42.42.2(pid=22429): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22429)] 09:17:42.612105 run osmo-hlr_10.42.42.2(pid=22429): stdout: | (launched: 2022-12-10_09:17:39.281580) 09:17:42.663230 run osmo-hlr_10.42.42.2(pid=22429): stderr: | 20221210091739477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091739478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091739478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091739478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091739478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091739478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091739490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091739500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091739501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091739501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:42.714708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Terminating (SIGTERM) 09:17:42.755969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Terminating (SIGTERM) 09:17:42.797222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Terminating (SIGTERM) 09:17:42.838856 --- ParallelTerminationStrategy: PID 22428 died... 09:17:42.858677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22428): Terminated: ok {rc=0} 09:17:42.904247 --- ParallelTerminationStrategy: PID 22431 died... 09:17:42.923561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22431): Terminated: ok {rc=0} 09:17:42.969318 --- ParallelTerminationStrategy: PID 22434 died... 09:17:42.988649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22434): Terminated: ok {rc=0} 09:17:43.074432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 09:17:44.162374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.174644 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 09:17:44.222447 tst ping_idle_ping.py: using LAC 27388 09:17:44.347343 tst ping_idle_ping.py: using RAC 103 09:17:44.471996 tst ping_idle_ping.py: using CellId 27388 09:17:44.597320 tst ping_idle_ping.py: using BVCI 27389 09:17:44.711825 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.722978 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.734105 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.745240 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.756159 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.767193 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.778368 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 09:17:44.789383 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 09:17:44.908080 tst ping_idle_ping.py:24: start network... 09:17:45.120633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:45.612073 run create_hlr_db(pid=22436): Launched 09:17:45.739427 bus /gobi_6: Setting Powered False 09:17:46.800239 run create_hlr_db(pid=22436): Terminated: ok {rc=0} 09:17:47.252904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Launched 09:17:47.577510 run osmo-hlr_10.42.42.2(pid=22439): Launched 09:17:47.698107 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:48.244284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Launched 09:17:48.559527 run osmo-stp_10.42.42.5(pid=22442): Launched 09:17:48.680477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:17:49.225749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Launched 09:17:49.345659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:17:49.612087 run patchelf(pid=22445): Launched 09:17:49.787062 run osmo-stp_10.42.42.5(pid=22442): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] 09:17:49.920638 run osmo-stp_10.42.42.5(pid=22442): stdout: | (launched: 2022-12-10_09:17:48.502147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:50.055582 run osmo-stp_10.42.42.5(pid=22442): stderr: | 20221210091748694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091748694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091748694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091748694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091748697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091748697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091748697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:50.191258 run osmo-stp_10.42.42.5(pid=22442): stdout: | (launched: 2022-12-10_09:17:48.502147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:17:50.320804 run osmo-stp_10.42.42.5(pid=22442): stderr: | 20221210091748694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091748694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091748694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091748694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091748697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091748697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091748697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:17:50.475003 run patchelf(pid=22445): Terminating (SIGINT) 09:17:50.651869 run patchelf(pid=22445): Terminated: ok {rc=0} 09:17:50.779198 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22442): Process ended prematurely: osmo-stp_10.42.42.5(pid=22442) [trial-2372↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] [trial-2372↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 09:17:50.788480 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:17:50.815801 run osmo-hlr_10.42.42.2(pid=22439): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22439)] 09:17:50.865276 run osmo-hlr_10.42.42.2(pid=22439): stdout: | (launched: 2022-12-10_09:17:47.520144) 09:17:50.916120 run osmo-hlr_10.42.42.2(pid=22439): stderr: | 20221210091747721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091747721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091747721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091747721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091747721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091747721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091747733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091747743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091747744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091747744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:17:50.967464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Terminating (SIGTERM) 09:17:51.008660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Terminating (SIGTERM) 09:17:51.050024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Terminating (SIGTERM) 09:17:51.091546 --- ParallelTerminationStrategy: PID 22438 died... 09:17:51.111165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22438): Terminated: ok {rc=0} 09:17:51.157166 --- ParallelTerminationStrategy: PID 22441 died... 09:17:51.176461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22441): Terminated: ok {rc=0} 09:17:51.221698 --- ParallelTerminationStrategy: PID 22444 died... 09:17:51.240808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22444): Terminated: ok {rc=0} 09:17:51.327038 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 09:17:52.632127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:17:52.638472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:17:52.668848 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:17:52.707195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:17:52.793127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:17:52.822228 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:17:52.860211 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:17:53.457214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:17:53.506113 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:53.517089 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:17:53.563583 tst cs_paging_gprs_active.py: using LAC 27389 09:17:53.683879 tst cs_paging_gprs_active.py: using RAC 104 09:17:53.812210 tst cs_paging_gprs_active.py: using CellId 27389 09:17:53.939410 tst cs_paging_gprs_active.py: using BVCI 27390 09:17:54.055720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.067376 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.078905 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.090720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.101984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.113423 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.124829 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.136499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:17:54.148094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:17:54.265144 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:17:54.380838 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:17:54.585190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:54.892936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22449): Launched 09:17:55.160157 run iperf3-srv_10.42.42.10(pid=22450): Launched 09:17:55.273683 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:17:55.476633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:17:55.784050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22451): Launched 09:17:56.052064 run iperf3-srv_10.42.42.10(pid=22452): Launched 09:17:56.166090 tst cs_paging_gprs_active.py:38: start network... 09:17:56.369535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:17:56.842704 run create_hlr_db(pid=22453): Launched 09:17:56.958801 bus /gobi_6: Setting Powered False 09:17:58.019303 run create_hlr_db(pid=22453): Terminated: ok {rc=0} 09:17:58.444277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Launched 09:17:58.751749 run osmo-hlr_10.42.42.2(pid=22456): Launched 09:17:58.867651 run osmo-stp_10.42.42.5: Starting osmo-stp 09:17:59.396637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Launched 09:17:59.702860 run osmo-stp_10.42.42.5(pid=22459): Launched 09:17:59.818682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:00.347042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Launched 09:18:00.463429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:00.725088 run patchelf(pid=22462): Launched 09:18:00.898948 run osmo-stp_10.42.42.5(pid=22459): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] 09:18:01.030040 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-10_09:17:59.643458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:01.163869 run osmo-stp_10.42.42.5(pid=22459): stderr: | 20221210091759815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091759815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091759815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091759816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091759818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091759818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091759818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:01.297740 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-10_09:17:59.643458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:01.426303 run osmo-stp_10.42.42.5(pid=22459): stderr: | 20221210091759815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091759815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091759815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091759816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091759818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091759818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091759818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:01.577603 run patchelf(pid=22462): Terminating (SIGINT) 09:18:01.753311 run patchelf(pid=22462): Terminated: ok {rc=0} 09:18:01.880852 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:18:01.891544 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 09:18:01.922069 run osmo-hlr_10.42.42.2(pid=22456): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22456)] 09:18:01.971737 run osmo-hlr_10.42.42.2(pid=22456): stdout: | (launched: 2022-12-10_09:17:58.691900) 09:18:02.023309 run osmo-hlr_10.42.42.2(pid=22456): stderr: | 20221210091758873 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091758873 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091758873 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091758873 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091758873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091758873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091758886 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091758894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091758894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091758894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:02.075451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22449): Terminating (SIGTERM) 09:18:02.116884 run iperf3-srv_10.42.42.10(pid=22450): Terminating (SIGTERM) 09:18:02.158153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22451): Terminating (SIGTERM) 09:18:02.199790 run iperf3-srv_10.42.42.10(pid=22452): Terminating (SIGTERM) 09:18:02.239508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminating (SIGTERM) 09:18:02.278770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminating (SIGTERM) 09:18:02.317956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Terminating (SIGTERM) 09:18:02.357376 --- ParallelTerminationStrategy: PID 22449 died... 09:18:02.375985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22449): Terminated: ok {rc=0} 09:18:02.419929 --- ParallelTerminationStrategy: PID 22450 died... 09:18:02.438051 run iperf3-srv_10.42.42.10(pid=22450): Terminated {rc=256} 09:18:02.481400 --- ParallelTerminationStrategy: PID 22451 died... 09:18:02.499444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22451): Terminated: ok {rc=0} 09:18:02.543770 --- ParallelTerminationStrategy: PID 22452 died... 09:18:02.562020 run iperf3-srv_10.42.42.10(pid=22452): Terminated {rc=256} 09:18:02.605097 --- ParallelTerminationStrategy: PID 22455 died... 09:18:02.623546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminated: ok {rc=0} 09:18:02.666837 --- ParallelTerminationStrategy: PID 22458 died... 09:18:02.685115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminated: ok {rc=0} 09:18:02.729120 --- ParallelTerminationStrategy: PID 22461 died... 09:18:02.747385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22461): Terminated: ok {rc=0} 09:18:02.832155 bus /gobi_0: Setting Powered False 09:18:03.931034 bus /gobi_0: Setting Powered False 09:18:05.043067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:18:06.185077 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.196664 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:18:06.245973 tst iperf3.py: using LAC 27390 09:18:06.365930 tst iperf3.py: using RAC 105 09:18:06.485198 tst iperf3.py: using CellId 27390 09:18:06.603967 tst iperf3.py: using BVCI 27391 09:18:06.714037 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.724887 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.735778 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.746810 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.757884 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.768867 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.780043 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.791092 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:06.802426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:06.917122 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:18:07.122207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:07.431348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22463): Launched 09:18:07.698329 run iperf3-srv_10.42.42.10(pid=22464): Launched 09:18:07.811661 tst iperf3.py:8: start network... 09:18:08.014931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:08.487467 run create_hlr_db(pid=22465): Launched 09:18:08.604148 bus /gobi_6: Setting Powered False 09:18:09.664616 run create_hlr_db(pid=22465): Terminated: ok {rc=0} 09:18:10.107359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22467): Launched 09:18:10.434138 run osmo-hlr_10.42.42.2(pid=22468): Launched 09:18:10.556633 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:11.117476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22470): Launched 09:18:11.441286 run osmo-stp_10.42.42.5(pid=22471): Launched 09:18:11.563384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:12.119913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22473): Launched 09:18:12.241911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:12.515704 run patchelf(pid=22474): Launched 09:18:12.693678 run osmo-stp_10.42.42.5(pid=22471): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22471)] 09:18:12.828241 run osmo-stp_10.42.42.5(pid=22471): stdout: | (launched: 2022-12-10_09:18:11.377772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:12.964265 run osmo-stp_10.42.42.5(pid=22471): stderr: | 20221210091811574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091811575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091811575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091811575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091811576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091811576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091811576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:13.100456 run osmo-stp_10.42.42.5(pid=22471): stdout: | (launched: 2022-12-10_09:18:11.377772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:13.231866 run osmo-stp_10.42.42.5(pid=22471): stderr: | 20221210091811574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091811575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091811575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091811575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091811576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091811576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091811576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:13.387353 run patchelf(pid=22474): Terminating (SIGINT) 09:18:13.565955 run patchelf(pid=22474): Terminated: ok {rc=0} 09:18:13.694867 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22471): Process ended prematurely: osmo-stp_10.42.42.5(pid=22471) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22471)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 09:18:13.704681 tst iperf3.py:8: Test FAILED (7.6 sec) 09:18:13.732882 run osmo-hlr_10.42.42.2(pid=22468): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22468)] 09:18:13.782243 run osmo-hlr_10.42.42.2(pid=22468): stdout: | (launched: 2022-12-10_09:18:10.370366) 09:18:13.833169 run osmo-hlr_10.42.42.2(pid=22468): stderr: | 20221210091810572 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091810572 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091810572 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091810572 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091810572 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091810572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091810585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091810595 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091810595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091810595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:13.884316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22463): Terminating (SIGTERM) 09:18:13.925565 run iperf3-srv_10.42.42.10(pid=22464): Terminating (SIGTERM) 09:18:13.966657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22467): Terminating (SIGTERM) 09:18:14.007944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22470): Terminating (SIGTERM) 09:18:14.049144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22473): Terminating (SIGTERM) 09:18:14.090520 --- ParallelTerminationStrategy: PID 22463 died... 09:18:14.110332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22463): Terminated: ok {rc=0} 09:18:14.156147 --- ParallelTerminationStrategy: PID 22464 died... 09:18:14.175285 run iperf3-srv_10.42.42.10(pid=22464): Terminated {rc=256} 09:18:14.220515 --- ParallelTerminationStrategy: PID 22467 died... 09:18:14.239731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22467): Terminated: ok {rc=0} 09:18:14.284896 --- ParallelTerminationStrategy: PID 22470 died... 09:18:14.304512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22470): Terminated: ok {rc=0} 09:18:14.349829 --- ParallelTerminationStrategy: PID 22473 died... 09:18:14.368849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22473): Terminated: ok {rc=0} 09:18:14.454797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:18:15.602840 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:15.614632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:18:15.665478 tst iperf3m4.py: using LAC 27391 09:18:15.786926 tst iperf3m4.py: using RAC 106 09:18:15.915302 tst iperf3m4.py: using CellId 27391 09:18:16.040804 tst iperf3m4.py: using BVCI 27392 09:18:16.154621 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.166311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.177789 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.190665 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.202902 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.215094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.226532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.238819 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:16.251189 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:16.377879 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:16.499714 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:16.618959 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:16.739298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:18:17.014531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:17.357337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22475): Launched 09:18:17.628482 run iperf3-srv_10.42.42.10(pid=22476): Launched 09:18:17.742654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:18:17.947043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:18.256615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22477): Launched 09:18:18.523954 run iperf3-srv_10.42.42.10(pid=22478): Launched 09:18:18.638014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:18:18.842452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:19.150394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22479): Launched 09:18:19.416390 run iperf3-srv_10.42.42.10(pid=22480): Launched 09:18:19.530157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:18:19.734265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:20.041952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22481): Launched 09:18:20.308300 run iperf3-srv_10.42.42.10(pid=22482): Launched 09:18:20.421819 tst iperf3m4.py:8: start network... 09:18:20.624656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:21.097383 run create_hlr_db(pid=22483): Launched 09:18:21.213943 bus /gobi_6: Setting Powered False 09:18:22.275399 run create_hlr_db(pid=22483): Terminated: ok {rc=0} 09:18:22.701045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Launched 09:18:23.007426 run osmo-hlr_10.42.42.2(pid=22486): Launched 09:18:23.124282 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:23.668918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Launched 09:18:23.975374 run osmo-stp_10.42.42.5(pid=22489): Launched 09:18:24.091816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:24.618927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22491): Launched 09:18:24.735092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:24.995580 run patchelf(pid=22492): Launched 09:18:25.163839 run osmo-stp_10.42.42.5(pid=22489): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] 09:18:25.292155 run osmo-stp_10.42.42.5(pid=22489): stdout: | (launched: 2022-12-10_09:18:23.916771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:25.421825 run osmo-stp_10.42.42.5(pid=22489): stderr: | 20221210091824091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091824091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091824092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091824092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091824093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091824093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091824093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:25.551516 run osmo-stp_10.42.42.5(pid=22489): stdout: | (launched: 2022-12-10_09:18:23.916771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:25.675745 run osmo-stp_10.42.42.5(pid=22489): stderr: | 20221210091824091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091824091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091824092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091824092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091824093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091824093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091824093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:25.822949 run patchelf(pid=22492): Terminating (SIGINT) 09:18:25.992598 run patchelf(pid=22492): Terminated: ok {rc=0} 09:18:26.115799 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22489): Process ended prematurely: osmo-stp_10.42.42.5(pid=22489) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 09:18:26.125452 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:18:26.152699 run osmo-hlr_10.42.42.2(pid=22486): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22486)] 09:18:26.200632 run osmo-hlr_10.42.42.2(pid=22486): stdout: | (launched: 2022-12-10_09:18:22.948498) 09:18:26.249810 run osmo-hlr_10.42.42.2(pid=22486): stderr: | 20221210091823129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091823129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091823129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091823129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091823130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091823130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091823142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091823152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091823153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091823153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:26.299364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22475): Terminating (SIGTERM) 09:18:26.339117 run iperf3-srv_10.42.42.10(pid=22476): Terminating (SIGTERM) 09:18:26.378566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22477): Terminating (SIGTERM) 09:18:26.418178 run iperf3-srv_10.42.42.10(pid=22478): Terminating (SIGTERM) 09:18:26.457845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22479): Terminating (SIGTERM) 09:18:26.497437 run iperf3-srv_10.42.42.10(pid=22480): Terminating (SIGTERM) 09:18:26.536730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22481): Terminating (SIGTERM) 09:18:26.576816 run iperf3-srv_10.42.42.10(pid=22482): Terminating (SIGTERM) 09:18:26.616274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Terminating (SIGTERM) 09:18:26.655679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Terminating (SIGTERM) 09:18:26.694983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22491): Terminating (SIGTERM) 09:18:26.734921 --- ParallelTerminationStrategy: PID 22475 died... 09:18:26.753787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22475): Terminated: ok {rc=0} 09:18:26.797611 --- ParallelTerminationStrategy: PID 22476 died... 09:18:26.815698 run iperf3-srv_10.42.42.10(pid=22476): Terminated {rc=256} 09:18:26.859783 --- ParallelTerminationStrategy: PID 22477 died... 09:18:26.878164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22477): Terminated: ok {rc=0} 09:18:26.921649 --- ParallelTerminationStrategy: PID 22478 died... 09:18:26.939798 run iperf3-srv_10.42.42.10(pid=22478): Terminated {rc=256} 09:18:26.983977 --- ParallelTerminationStrategy: PID 22479 died... 09:18:27.002236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22479): Terminated: ok {rc=0} 09:18:27.046013 --- ParallelTerminationStrategy: PID 22480 died... 09:18:27.064146 run iperf3-srv_10.42.42.10(pid=22480): Terminated {rc=256} 09:18:27.107755 --- ParallelTerminationStrategy: PID 22481 died... 09:18:27.126224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22481): Terminated: ok {rc=0} 09:18:27.169932 --- ParallelTerminationStrategy: PID 22482 died... 09:18:27.188282 run iperf3-srv_10.42.42.10(pid=22482): Terminated {rc=256} 09:18:27.231879 --- ParallelTerminationStrategy: PID 22485 died... 09:18:27.250293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22485): Terminated: ok {rc=0} 09:18:27.293876 --- ParallelTerminationStrategy: PID 22488 died... 09:18:27.312382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22488): Terminated: ok {rc=0} 09:18:27.356056 --- ParallelTerminationStrategy: PID 22491 died... 09:18:27.374457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22491): Terminated: ok {rc=0} 09:18:27.459953 bus /gobi_4: Setting Powered False 09:18:28.559629 bus /gobi_4: Setting Powered False 09:18:29.675431 bus /gobi_1: Setting Powered False 09:18:30.774256 bus /gobi_1: Setting Powered False 09:18:31.901678 bus /gobi_0: Setting Powered False 09:18:33.004282 bus /gobi_0: Setting Powered False 09:18:34.121898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 09:18:35.224272 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.236280 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:18:35.288681 tst ping.py: using LAC 27392 09:18:35.412638 tst ping.py: using RAC 107 09:18:35.529665 tst ping.py: using CellId 27392 09:18:35.647846 tst ping.py: using BVCI 27393 09:18:35.756148 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.767410 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.778523 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.790223 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.801467 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.812691 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.824310 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:35.835861 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:35.953934 tst ping.py:19: start network... 09:18:36.166198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:36.658230 run create_hlr_db(pid=22493): Launched 09:18:36.786953 bus /gobi_6: Setting Powered False 09:18:37.848703 run create_hlr_db(pid=22493): Terminated: ok {rc=0} 09:18:38.291242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Launched 09:18:38.610101 run osmo-hlr_10.42.42.2(pid=22496): Launched 09:18:38.729798 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:39.283201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Launched 09:18:39.601570 run osmo-stp_10.42.42.5(pid=22499): Launched 09:18:39.720818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:40.267798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22501): Launched 09:18:40.388253 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:40.658929 run patchelf(pid=22502): Launched 09:18:40.834423 run osmo-stp_10.42.42.5(pid=22499): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] 09:18:40.968177 run osmo-stp_10.42.42.5(pid=22499): stdout: | (launched: 2022-12-10_09:18:39.539307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:41.103635 run osmo-stp_10.42.42.5(pid=22499): stderr: | 20221210091839735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091839735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091839735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091839735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091839736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091839736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091839736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:41.239268 run osmo-stp_10.42.42.5(pid=22499): stdout: | (launched: 2022-12-10_09:18:39.539307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:41.368931 run osmo-stp_10.42.42.5(pid=22499): stderr: | 20221210091839735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091839735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091839735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091839735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091839736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091839736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091839736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:41.522553 run patchelf(pid=22502): Terminating (SIGINT) 09:18:41.699743 run patchelf(pid=22502): Terminated: ok {rc=0} 09:18:41.827545 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22499): Process ended prematurely: osmo-stp_10.42.42.5(pid=22499) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 09:18:41.836725 tst ping.py:22: Test FAILED (6.6 sec) 09:18:41.864326 run osmo-hlr_10.42.42.2(pid=22496): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22496)] 09:18:41.913906 run osmo-hlr_10.42.42.2(pid=22496): stdout: | (launched: 2022-12-10_09:18:38.547544) 09:18:41.964852 run osmo-hlr_10.42.42.2(pid=22496): stderr: | 20221210091838751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091838751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091838751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091838751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091838751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091838751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091838764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091838774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091838774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091838774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:42.016460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Terminating (SIGTERM) 09:18:42.057970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Terminating (SIGTERM) 09:18:42.099498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22501): Terminating (SIGTERM) 09:18:42.141278 --- ParallelTerminationStrategy: PID 22495 died... 09:18:42.161288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22495): Terminated: ok {rc=0} 09:18:42.207246 --- ParallelTerminationStrategy: PID 22498 died... 09:18:42.226742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22498): Terminated: ok {rc=0} 09:18:42.272511 --- ParallelTerminationStrategy: PID 22501 died... 09:18:42.292079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22501): Terminated: ok {rc=0} 09:18:42.378930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:18:43.464331 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:43.475978 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:18:43.525912 tst ping_idle_ping.py: using LAC 27393 09:18:43.649908 tst ping_idle_ping.py: using RAC 108 09:18:43.767862 tst ping_idle_ping.py: using CellId 27393 09:18:43.885258 tst ping_idle_ping.py: using BVCI 27394 09:18:44.001464 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.013528 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.024913 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.036593 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.048097 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.059679 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.071603 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:18:44.084712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:18:44.204308 tst ping_idle_ping.py:24: start network... 09:18:44.417037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:44.913086 run create_hlr_db(pid=22503): Launched 09:18:45.041218 bus /gobi_6: Setting Powered False 09:18:46.123982 run create_hlr_db(pid=22503): Terminated: ok {rc=0} 09:18:46.588268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Launched 09:18:46.912817 run osmo-hlr_10.42.42.2(pid=22506): Launched 09:18:47.040303 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:47.755384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Launched 09:18:48.058295 run osmo-stp_10.42.42.5(pid=22509): Launched 09:18:48.172813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:48.689647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22511): Launched 09:18:48.804033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:18:49.060572 run patchelf(pid=22512): Launched 09:18:49.227165 run osmo-stp_10.42.42.5(pid=22509): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] 09:18:49.354165 run osmo-stp_10.42.42.5(pid=22509): stdout: | (launched: 2022-12-10_09:18:47.998932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:49.482352 run osmo-stp_10.42.42.5(pid=22509): stderr: | 20221210091848174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091848174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091848175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091848175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091848175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091848176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091848176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:49.610659 run osmo-stp_10.42.42.5(pid=22509): stdout: | (launched: 2022-12-10_09:18:47.998932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:18:49.733786 run osmo-stp_10.42.42.5(pid=22509): stderr: | 20221210091848174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091848174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091848175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091848175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091848175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091848176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091848176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:18:49.879383 run patchelf(pid=22512): Terminating (SIGINT) 09:18:50.047132 run patchelf(pid=22512): Terminated: ok {rc=0} 09:18:50.168373 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22509): Process ended prematurely: osmo-stp_10.42.42.5(pid=22509) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 09:18:50.177251 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:18:50.203782 run osmo-hlr_10.42.42.2(pid=22506): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22506)] 09:18:50.251629 run osmo-hlr_10.42.42.2(pid=22506): stdout: | (launched: 2022-12-10_09:18:46.850110) 09:18:50.300796 run osmo-hlr_10.42.42.2(pid=22506): stderr: | 20221210091847199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091847199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091847199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091847199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091847199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091847199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091847222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091847243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091847243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091847243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:18:50.350302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Terminating (SIGTERM) 09:18:50.390003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Terminating (SIGTERM) 09:18:50.429467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22511): Terminating (SIGTERM) 09:18:50.469442 --- ParallelTerminationStrategy: PID 22505 died... 09:18:50.488199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22505): Terminated: ok {rc=0} 09:18:50.532585 --- ParallelTerminationStrategy: PID 22508 died... 09:18:50.551000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22508): Terminated: ok {rc=0} 09:18:50.594759 --- ParallelTerminationStrategy: PID 22511 died... 09:18:50.612923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22511): Terminated: ok {rc=0} 09:18:50.696176 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:18:51.998801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:18:52.005285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:18:52.035549 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:18:52.075156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:18:52.164038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:18:52.194657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:18:52.234587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:18:52.828398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:18:52.878276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:52.889521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:18:52.955449 tst cs_paging_gprs_active.py: using LAC 27394 09:18:53.074436 tst cs_paging_gprs_active.py: using RAC 109 09:18:53.193833 tst cs_paging_gprs_active.py: using CellId 27394 09:18:53.314158 tst cs_paging_gprs_active.py: using BVCI 27395 09:18:53.426340 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.437339 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.448113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.459240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.470281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.481297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.492448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.503515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:18:53.514909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:18:53.631580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:18:53.752481 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:18:53.973072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:54.297643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22517): Launched 09:18:54.577836 run iperf3-srv_10.42.42.10(pid=22518): Launched 09:18:54.699115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:18:54.917003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:18:55.242497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22519): Launched 09:18:55.523117 run iperf3-srv_10.42.42.10(pid=22520): Launched 09:18:55.644016 tst cs_paging_gprs_active.py:38: start network... 09:18:55.861629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:18:56.361597 run create_hlr_db(pid=22521): Launched 09:18:56.492854 bus /gobi_6: Setting Powered False 09:18:57.556169 run create_hlr_db(pid=22521): Terminated: ok {rc=0} 09:18:57.989524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Launched 09:18:58.294217 run osmo-hlr_10.42.42.2(pid=22524): Launched 09:18:58.411273 run osmo-stp_10.42.42.5: Starting osmo-stp 09:18:58.939920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Launched 09:18:59.245389 run osmo-stp_10.42.42.5(pid=22527): Launched 09:18:59.362613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:18:59.889144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22529): Launched 09:19:00.005479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:00.262853 run patchelf(pid=22530): Launched 09:19:00.432544 run osmo-stp_10.42.42.5(pid=22527): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] 09:19:00.561569 run osmo-stp_10.42.42.5(pid=22527): stdout: | (launched: 2022-12-10_09:18:59.189822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:00.692289 run osmo-stp_10.42.42.5(pid=22527): stderr: | 20221210091859361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091859361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091859361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091859362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091859362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091859362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091859362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:00.823187 run osmo-stp_10.42.42.5(pid=22527): stdout: | (launched: 2022-12-10_09:18:59.189822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:00.974681 run osmo-stp_10.42.42.5(pid=22527): stderr: | 20221210091859361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091859361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091859361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091859362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091859362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091859362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091859362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:01.126807 run patchelf(pid=22530): Terminating (SIGINT) 09:19:01.302493 run patchelf(pid=22530): Terminated: ok {rc=0} 09:19:01.429775 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22527): Process ended prematurely: osmo-stp_10.42.42.5(pid=22527) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:19:01.440195 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:19:01.470522 run osmo-hlr_10.42.42.2(pid=22524): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22524)] 09:19:01.520510 run osmo-hlr_10.42.42.2(pid=22524): stdout: | (launched: 2022-12-10_09:18:58.238425) 09:19:01.572078 run osmo-hlr_10.42.42.2(pid=22524): stderr: | 20221210091858412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091858412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091858412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091858412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091858412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091858413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091858425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091858433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091858433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091858433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:01.624459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22517): Terminating (SIGTERM) 09:19:01.666955 run iperf3-srv_10.42.42.10(pid=22518): Terminating (SIGTERM) 09:19:01.711681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22519): Terminating (SIGTERM) 09:19:01.754458 run iperf3-srv_10.42.42.10(pid=22520): Terminating (SIGTERM) 09:19:01.799114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Terminating (SIGTERM) 09:19:01.841539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Terminating (SIGTERM) 09:19:01.883927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22529): Terminating (SIGTERM) 09:19:01.925855 --- ParallelTerminationStrategy: PID 22517 died... 09:19:01.945272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22517): Terminated: ok {rc=0} 09:19:01.991961 --- ParallelTerminationStrategy: PID 22518 died... 09:19:02.011371 run iperf3-srv_10.42.42.10(pid=22518): Terminated {rc=256} 09:19:02.058139 --- ParallelTerminationStrategy: PID 22519 died... 09:19:02.077526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22519): Terminated: ok {rc=0} 09:19:02.124225 --- ParallelTerminationStrategy: PID 22520 died... 09:19:02.143516 run iperf3-srv_10.42.42.10(pid=22520): Terminated {rc=256} 09:19:02.190405 --- ParallelTerminationStrategy: PID 22523 died... 09:19:02.210135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22523): Terminated: ok {rc=0} 09:19:02.254941 --- ParallelTerminationStrategy: PID 22526 died... 09:19:02.273320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22526): Terminated: ok {rc=0} 09:19:02.318569 --- ParallelTerminationStrategy: PID 22529 died... 09:19:02.336896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22529): Terminated: ok {rc=0} 09:19:02.423295 bus /gobi_0: Setting Powered False 09:19:03.522148 bus /gobi_0: Setting Powered False 09:19:04.636486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:19:05.782011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:05.793754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:19:05.862531 tst iperf3.py: using LAC 27395 09:19:05.990424 tst iperf3.py: using RAC 110 09:19:06.116875 tst iperf3.py: using CellId 27395 09:19:06.243811 tst iperf3.py: using BVCI 27396 09:19:06.355621 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.366690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.377576 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.388678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.399740 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.410799 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.421978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.432885 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:06.444123 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:06.560766 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:19:06.765895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:07.070409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22531): Launched 09:19:07.333996 run iperf3-srv_10.42.42.10(pid=22532): Launched 09:19:07.447875 tst iperf3.py:8: start network... 09:19:07.652692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:08.122377 run create_hlr_db(pid=22533): Launched 09:19:08.237685 bus /gobi_6: Setting Powered False 09:19:09.298028 run create_hlr_db(pid=22533): Terminated: ok {rc=0} 09:19:09.720341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Launched 09:19:10.022883 run osmo-hlr_10.42.42.2(pid=22536): Launched 09:19:10.139065 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:10.669820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Launched 09:19:10.972571 run osmo-stp_10.42.42.5(pid=22539): Launched 09:19:11.088698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:11.611728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Launched 09:19:11.727911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:11.988539 run patchelf(pid=22542): Launched 09:19:12.157176 run osmo-stp_10.42.42.5(pid=22539): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] 09:19:12.285625 run osmo-stp_10.42.42.5(pid=22539): stdout: | (launched: 2022-12-10_09:19:10.916925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:12.415473 run osmo-stp_10.42.42.5(pid=22539): stderr: | 20221210091911089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091911089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091911089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091911090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091911090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091911090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091911090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:12.546049 run osmo-stp_10.42.42.5(pid=22539): stdout: | (launched: 2022-12-10_09:19:10.916925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:12.670749 run osmo-stp_10.42.42.5(pid=22539): stderr: | 20221210091911089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091911089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091911089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091911090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091911090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091911090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091911090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:12.818509 run patchelf(pid=22542): Terminating (SIGINT) 09:19:12.988655 run patchelf(pid=22542): Terminated: ok {rc=0} 09:19:13.112156 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22539): Process ended prematurely: osmo-stp_10.42.42.5(pid=22539) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 09:19:13.121849 tst iperf3.py:8: Test FAILED (7.4 sec) 09:19:13.149092 run osmo-hlr_10.42.42.2(pid=22536): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22536)] 09:19:13.197406 run osmo-hlr_10.42.42.2(pid=22536): stdout: | (launched: 2022-12-10_09:19:09.967472) 09:19:13.246566 run osmo-hlr_10.42.42.2(pid=22536): stderr: | 20221210091910144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091910144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091910144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091910144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091910144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091910144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091910155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091910164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091910164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091910164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:13.296200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22531): Terminating (SIGTERM) 09:19:13.335965 run iperf3-srv_10.42.42.10(pid=22532): Terminating (SIGTERM) 09:19:13.375693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Terminating (SIGTERM) 09:19:13.415280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Terminating (SIGTERM) 09:19:13.454787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Terminating (SIGTERM) 09:19:13.494654 --- ParallelTerminationStrategy: PID 22531 died... 09:19:13.513472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22531): Terminated: ok {rc=0} 09:19:13.557740 --- ParallelTerminationStrategy: PID 22532 died... 09:19:13.576210 run iperf3-srv_10.42.42.10(pid=22532): Terminated {rc=256} 09:19:13.620108 --- ParallelTerminationStrategy: PID 22535 died... 09:19:13.638549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22535): Terminated: ok {rc=0} 09:19:13.682108 --- ParallelTerminationStrategy: PID 22538 died... 09:19:13.700507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22538): Terminated: ok {rc=0} 09:19:13.744114 --- ParallelTerminationStrategy: PID 22541 died... 09:19:13.762503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22541): Terminated: ok {rc=0} 09:19:13.845482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:19:14.992244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.004523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:19:15.073722 tst iperf3m4.py: using LAC 27396 09:19:15.195181 tst iperf3m4.py: using RAC 111 09:19:15.316424 tst iperf3m4.py: using CellId 27396 09:19:15.438569 tst iperf3m4.py: using BVCI 27397 09:19:15.550697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.561744 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.572823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.584069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.595205 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.606405 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.617683 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.628711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:15.639925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:15.756464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:15.890374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:16.012882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:16.134496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:19:16.344803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:16.659157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22543): Launched 09:19:16.948344 run iperf3-srv_10.42.42.10(pid=22544): Launched 09:19:17.115700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:19:17.330125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:17.637031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22545): Launched 09:19:17.901665 run iperf3-srv_10.42.42.10(pid=22546): Launched 09:19:18.015565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:19:18.219122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:18.524053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Launched 09:19:18.788052 run iperf3-srv_10.42.42.10(pid=22548): Launched 09:19:18.901824 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:19:19.105126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:19.409679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Launched 09:19:19.672792 run iperf3-srv_10.42.42.10(pid=22550): Launched 09:19:19.786277 tst iperf3m4.py:8: start network... 09:19:19.989801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:20.459921 run create_hlr_db(pid=22551): Launched 09:19:20.574981 bus /gobi_6: Setting Powered False 09:19:21.635264 run create_hlr_db(pid=22551): Terminated: ok {rc=0} 09:19:22.058788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Launched 09:19:22.362152 run osmo-hlr_10.42.42.2(pid=22554): Launched 09:19:22.478633 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:23.001632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Launched 09:19:23.305490 run osmo-stp_10.42.42.5(pid=22557): Launched 09:19:23.421956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:23.946322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Launched 09:19:24.062446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:24.319578 run patchelf(pid=22560): Launched 09:19:24.487781 run osmo-stp_10.42.42.5(pid=22557): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] 09:19:24.615956 run osmo-stp_10.42.42.5(pid=22557): stdout: | (launched: 2022-12-10_09:19:23.249982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:24.745798 run osmo-stp_10.42.42.5(pid=22557): stderr: | 20221210091923421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091923421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091923421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091923422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091923422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091923422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091923422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:24.875639 run osmo-stp_10.42.42.5(pid=22557): stdout: | (launched: 2022-12-10_09:19:23.249982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:25.000038 run osmo-stp_10.42.42.5(pid=22557): stderr: | 20221210091923421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091923421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091923421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091923422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091923422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091923422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091923422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:25.147953 run patchelf(pid=22560): Terminating (SIGINT) 09:19:25.318487 run patchelf(pid=22560): Terminated: ok {rc=0} 09:19:25.441335 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22557): Process ended prematurely: osmo-stp_10.42.42.5(pid=22557) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:19:25.450682 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:19:25.478102 run osmo-hlr_10.42.42.2(pid=22554): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22554)] 09:19:25.525444 run osmo-hlr_10.42.42.2(pid=22554): stdout: | (launched: 2022-12-10_09:19:22.306724) 09:19:25.574332 run osmo-hlr_10.42.42.2(pid=22554): stderr: | 20221210091922484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091922484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091922484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091922484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091922484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091922484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091922496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091922505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091922505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091922505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:25.623850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22543): Terminating (SIGTERM) 09:19:25.663246 run iperf3-srv_10.42.42.10(pid=22544): Terminating (SIGTERM) 09:19:25.702635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22545): Terminating (SIGTERM) 09:19:25.742080 run iperf3-srv_10.42.42.10(pid=22546): Terminating (SIGTERM) 09:19:25.781129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Terminating (SIGTERM) 09:19:25.820408 run iperf3-srv_10.42.42.10(pid=22548): Terminating (SIGTERM) 09:19:25.859574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Terminating (SIGTERM) 09:19:25.898732 run iperf3-srv_10.42.42.10(pid=22550): Terminating (SIGTERM) 09:19:25.937964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Terminating (SIGTERM) 09:19:25.977293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Terminating (SIGTERM) 09:19:26.016548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Terminating (SIGTERM) 09:19:26.056021 --- ParallelTerminationStrategy: PID 22543 died... 09:19:26.074806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22543): Terminated: ok {rc=0} 09:19:26.118593 --- ParallelTerminationStrategy: PID 22544 died... 09:19:26.136839 run iperf3-srv_10.42.42.10(pid=22544): Terminated {rc=256} 09:19:26.180234 --- ParallelTerminationStrategy: PID 22545 died... 09:19:26.198433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22545): Terminated: ok {rc=0} 09:19:26.241730 --- ParallelTerminationStrategy: PID 22546 died... 09:19:26.259814 run iperf3-srv_10.42.42.10(pid=22546): Terminated {rc=256} 09:19:26.303066 --- ParallelTerminationStrategy: PID 22547 died... 09:19:26.321371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22547): Terminated: ok {rc=0} 09:19:26.365043 --- ParallelTerminationStrategy: PID 22548 died... 09:19:26.383277 run iperf3-srv_10.42.42.10(pid=22548): Terminated {rc=256} 09:19:26.426884 --- ParallelTerminationStrategy: PID 22549 died... 09:19:26.445195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22549): Terminated: ok {rc=0} 09:19:26.488893 --- ParallelTerminationStrategy: PID 22550 died... 09:19:26.507709 run iperf3-srv_10.42.42.10(pid=22550): Terminated {rc=256} 09:19:26.551431 --- ParallelTerminationStrategy: PID 22553 died... 09:19:26.569822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22553): Terminated: ok {rc=0} 09:19:26.613488 --- ParallelTerminationStrategy: PID 22556 died... 09:19:26.631860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22556): Terminated: ok {rc=0} 09:19:26.675772 --- ParallelTerminationStrategy: PID 22559 died... 09:19:26.694203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22559): Terminated: ok {rc=0} 09:19:26.778841 bus /gobi_4: Setting Powered False 09:19:27.878422 bus /gobi_4: Setting Powered False 09:19:28.993615 bus /gobi_1: Setting Powered False 09:19:30.089259 bus /gobi_1: Setting Powered False 09:19:31.205963 bus /gobi_0: Setting Powered False 09:19:32.305337 bus /gobi_0: Setting Powered False 09:19:33.419850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:19:34.524577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:34.536896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:19:34.604883 tst ping.py: using LAC 27397 09:19:34.729057 tst ping.py: using RAC 112 09:19:34.852831 tst ping.py: using CellId 27397 09:19:34.976689 tst ping.py: using BVCI 27398 09:19:35.085901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.097164 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.108194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.119675 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.130853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.141928 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.153230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:35.164251 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:35.283760 tst ping.py:19: start network... 09:19:35.485074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:35.947121 run create_hlr_db(pid=22561): Launched 09:19:36.060271 bus /gobi_6: Setting Powered False 09:19:37.120271 run create_hlr_db(pid=22561): Terminated: ok {rc=0} 09:19:37.535727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22563): Launched 09:19:37.832551 run osmo-hlr_10.42.42.2(pid=22564): Launched 09:19:37.947351 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:38.475633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22566): Launched 09:19:38.771580 run osmo-stp_10.42.42.5(pid=22567): Launched 09:19:38.884498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:39.397812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22569): Launched 09:19:39.511086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:39.762317 run patchelf(pid=22570): Launched 09:19:39.927852 run osmo-stp_10.42.42.5(pid=22567): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22567)] 09:19:40.053853 run osmo-stp_10.42.42.5(pid=22567): stdout: | (launched: 2022-12-10_09:19:38.717178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:40.181486 run osmo-stp_10.42.42.5(pid=22567): stderr: | 20221210091938887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091938887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091938888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091938888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091938890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091938890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091938891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:40.309239 run osmo-stp_10.42.42.5(pid=22567): stdout: | (launched: 2022-12-10_09:19:38.717178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:40.431731 run osmo-stp_10.42.42.5(pid=22567): stderr: | 20221210091938887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091938887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091938888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091938888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091938890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091938890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091938891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:40.576570 run patchelf(pid=22570): Terminating (SIGINT) 09:19:40.743890 run patchelf(pid=22570): Terminated: ok {rc=0} 09:19:40.864319 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22567): Process ended prematurely: osmo-stp_10.42.42.5(pid=22567) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22567)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 09:19:40.873205 tst ping.py:22: Test FAILED (6.3 sec) 09:19:40.899856 run osmo-hlr_10.42.42.2(pid=22564): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22564)] 09:19:40.947188 run osmo-hlr_10.42.42.2(pid=22564): stdout: | (launched: 2022-12-10_09:19:37.778105) 09:19:40.996155 run osmo-hlr_10.42.42.2(pid=22564): stderr: | 20221210091937953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091937953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091937953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091937953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091937954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091937954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091937966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091937974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091937974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091937975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:41.045563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22563): Terminating (SIGTERM) 09:19:41.084801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22566): Terminating (SIGTERM) 09:19:41.124604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22569): Terminating (SIGTERM) 09:19:41.164765 --- ParallelTerminationStrategy: PID 22563 died... 09:19:41.184144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22563): Terminated: ok {rc=0} 09:19:41.227700 --- ParallelTerminationStrategy: PID 22566 died... 09:19:41.246043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22566): Terminated: ok {rc=0} 09:19:41.289673 --- ParallelTerminationStrategy: PID 22569 died... 09:19:41.308183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22569): Terminated: ok {rc=0} 09:19:41.393401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:19:42.480505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:42.492293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:19:42.558627 tst ping_idle_ping.py: using LAC 27398 09:19:42.685664 tst ping_idle_ping.py: using RAC 113 09:19:42.815373 tst ping_idle_ping.py: using CellId 27398 09:19:42.939882 tst ping_idle_ping.py: using BVCI 27399 09:19:43.055175 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.066859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.078232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.090139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.101975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.113882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.125988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:19:43.137757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:19:43.255647 tst ping_idle_ping.py:24: start network... 09:19:43.455671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:43.918301 run create_hlr_db(pid=22571): Launched 09:19:44.031941 bus /gobi_6: Setting Powered False 09:19:45.091101 run create_hlr_db(pid=22571): Terminated: ok {rc=0} 09:19:45.526985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22573): Launched 09:19:45.855239 run osmo-hlr_10.42.42.2(pid=22574): Launched 09:19:46.103599 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:46.796503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22576): Launched 09:19:47.123917 run osmo-stp_10.42.42.5(pid=22577): Launched 09:19:47.393743 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:47.939093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22579): Launched 09:19:48.059323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:48.327458 run patchelf(pid=22580): Launched 09:19:48.503419 run osmo-stp_10.42.42.5(pid=22577): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22577)] 09:19:48.637554 run osmo-stp_10.42.42.5(pid=22577): stdout: | (launched: 2022-12-10_09:19:47.055289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:48.773415 run osmo-stp_10.42.42.5(pid=22577): stderr: | 20221210091947259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091947259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091947259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091947260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091947260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091947260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091947260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:48.908934 run osmo-stp_10.42.42.5(pid=22577): stdout: | (launched: 2022-12-10_09:19:47.055289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:19:49.039141 run osmo-stp_10.42.42.5(pid=22577): stderr: | 20221210091947259 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091947259 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091947259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091947260 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091947260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091947260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091947260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:19:49.192890 run patchelf(pid=22580): Terminating (SIGINT) 09:19:49.371727 run patchelf(pid=22580): Terminated: ok {rc=0} 09:19:49.500024 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22577): Process ended prematurely: osmo-stp_10.42.42.5(pid=22577) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22577)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:19:49.509348 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 09:19:49.536810 run osmo-hlr_10.42.42.2(pid=22574): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22574)] 09:19:49.585903 run osmo-hlr_10.42.42.2(pid=22574): stdout: | (launched: 2022-12-10_09:19:45.785571) 09:19:49.636733 run osmo-hlr_10.42.42.2(pid=22574): stderr: | 20221210091946138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091946138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091946138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091946138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091946138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091946138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091946152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091946168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091946168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091946168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:19:49.688165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22573): Terminating (SIGTERM) 09:19:49.729066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22576): Terminating (SIGTERM) 09:19:49.770317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22579): Terminating (SIGTERM) 09:19:49.811655 --- ParallelTerminationStrategy: PID 22573 died... 09:19:49.831391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22573): Terminated: ok {rc=0} 09:19:49.876862 --- ParallelTerminationStrategy: PID 22576 died... 09:19:49.896495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22576): Terminated: ok {rc=0} 09:19:49.941595 --- ParallelTerminationStrategy: PID 22579 died... 09:19:49.960705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22579): Terminated: ok {rc=0} 09:19:50.047127 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 09:19:51.353660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:19:51.360409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 09:19:51.390860 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 09:19:51.430611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 09:19:51.520861 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 09:19:51.551755 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 09:19:51.591270 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 09:19:52.192238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 09:19:52.245571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.257270 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:19:52.323408 tst cs_paging_gprs_active.py: using LAC 27399 09:19:52.447933 tst cs_paging_gprs_active.py: using RAC 114 09:19:52.573130 tst cs_paging_gprs_active.py: using CellId 27399 09:19:52.697687 tst cs_paging_gprs_active.py: using BVCI 27400 09:19:52.814368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.825907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.837214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.848463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.859818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.871131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.882531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.893817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:19:52.905225 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:19:53.024391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:19:53.145981 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:19:53.364470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:53.693248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22586): Launched 09:19:53.977688 run iperf3-srv_10.42.42.10(pid=22587): Launched 09:19:54.097954 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:19:54.315218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:19:54.642350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22588): Launched 09:19:54.927325 run iperf3-srv_10.42.42.10(pid=22589): Launched 09:19:55.047636 tst cs_paging_gprs_active.py:38: start network... 09:19:55.265439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:19:55.771150 run create_hlr_db(pid=22590): Launched 09:19:55.901731 bus /gobi_6: Setting Powered False 09:19:56.965496 run create_hlr_db(pid=22590): Terminated: ok {rc=0} 09:19:57.401689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22592): Launched 09:19:57.711175 run osmo-hlr_10.42.42.2(pid=22593): Launched 09:19:57.828280 run osmo-stp_10.42.42.5: Starting osmo-stp 09:19:58.356359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22595): Launched 09:19:58.665872 run osmo-stp_10.42.42.5(pid=22596): Launched 09:19:58.782729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:19:59.323793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22598): Launched 09:19:59.439766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:19:59.706944 run patchelf(pid=22599): Launched 09:19:59.877090 run osmo-stp_10.42.42.5(pid=22596): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22596)] 09:20:00.006060 run osmo-stp_10.42.42.5(pid=22596): stdout: | (launched: 2022-12-10_09:19:58.605398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:00.136941 run osmo-stp_10.42.42.5(pid=22596): stderr: | 20221210091958780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091958780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091958780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091958780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091958783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091958783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091958783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:00.267750 run osmo-stp_10.42.42.5(pid=22596): stdout: | (launched: 2022-12-10_09:19:58.605398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:00.392753 run osmo-stp_10.42.42.5(pid=22596): stderr: | 20221210091958780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210091958780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210091958780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210091958780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210091958783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210091958783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210091958783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:00.541217 run patchelf(pid=22599): Terminating (SIGINT) 09:20:00.712604 run patchelf(pid=22599): Terminated: ok {rc=0} 09:20:00.838298 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22596): Process ended prematurely: osmo-stp_10.42.42.5(pid=22596) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22596)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 09:20:00.848210 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:20:00.878749 run osmo-hlr_10.42.42.2(pid=22593): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22593)] 09:20:00.940629 run osmo-hlr_10.42.42.2(pid=22593): stdout: | (launched: 2022-12-10_09:19:57.651114) 09:20:00.991509 run osmo-hlr_10.42.42.2(pid=22593): stderr: | 20221210091957829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210091957829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210091957829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210091957829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210091957829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210091957829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210091957841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210091957849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210091957849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210091957849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:01.044834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22586): Terminating (SIGTERM) 09:20:01.087301 run iperf3-srv_10.42.42.10(pid=22587): Terminating (SIGTERM) 09:20:01.132200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22588): Terminating (SIGTERM) 09:20:01.175128 run iperf3-srv_10.42.42.10(pid=22589): Terminating (SIGTERM) 09:20:01.219847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22592): Terminating (SIGTERM) 09:20:01.262491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22595): Terminating (SIGTERM) 09:20:01.309713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22598): Terminating (SIGTERM) 09:20:01.363061 --- ParallelTerminationStrategy: PID 22586 died... 09:20:01.387960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22586): Terminated: ok {rc=0} 09:20:01.435603 --- ParallelTerminationStrategy: PID 22587 died... 09:20:01.455203 run iperf3-srv_10.42.42.10(pid=22587): Terminated {rc=256} 09:20:01.502017 --- ParallelTerminationStrategy: PID 22588 died... 09:20:01.521459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22588): Terminated: ok {rc=0} 09:20:01.568478 --- ParallelTerminationStrategy: PID 22589 died... 09:20:01.588035 run iperf3-srv_10.42.42.10(pid=22589): Terminated {rc=256} 09:20:01.634950 --- ParallelTerminationStrategy: PID 22592 died... 09:20:01.654434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22592): Terminated: ok {rc=0} 09:20:01.701536 --- ParallelTerminationStrategy: PID 22595 died... 09:20:01.720932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22595): Terminated: ok {rc=0} 09:20:01.768259 --- ParallelTerminationStrategy: PID 22598 died... 09:20:01.787728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22598): Terminated: ok {rc=0} 09:20:01.874869 bus /gobi_0: Setting Powered False 09:20:02.975438 bus /gobi_0: Setting Powered False 09:20:04.090227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 09:20:05.237478 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.249652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:05.317388 tst iperf3.py: using LAC 27400 09:20:05.444755 tst iperf3.py: using RAC 115 09:20:05.571895 tst iperf3.py: using CellId 27400 09:20:05.693397 tst iperf3.py: using BVCI 27401 09:20:05.804374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.815437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.826419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.837678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.848779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.859840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.870951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.881972 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:05.893764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:06.014544 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:20:06.233884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:06.562379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22603): Launched 09:20:06.846326 run iperf3-srv_10.42.42.10(pid=22604): Launched 09:20:06.966531 tst iperf3.py:8: start network... 09:20:07.183548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:07.690202 run create_hlr_db(pid=22605): Launched 09:20:07.820377 bus /gobi_6: Setting Powered False 09:20:08.884186 run create_hlr_db(pid=22605): Terminated: ok {rc=0} 09:20:09.321250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Launched 09:20:09.629221 run osmo-hlr_10.42.42.2(pid=22608): Launched 09:20:09.745557 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:10.290956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Launched 09:20:10.599065 run osmo-stp_10.42.42.5(pid=22611): Launched 09:20:10.715164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:11.245456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Launched 09:20:11.361924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:11.623917 run patchelf(pid=22614): Launched 09:20:11.792878 run osmo-stp_10.42.42.5(pid=22611): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] 09:20:11.921951 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-10_09:20:10.539375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:12.052247 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221210092010713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092010713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092010714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092010714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092010715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092010715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092010715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:12.182726 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-10_09:20:10.539375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:12.308222 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221210092010713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092010713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092010714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092010714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092010715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092010715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092010715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:12.456337 run patchelf(pid=22614): Terminating (SIGINT) 09:20:12.627112 run patchelf(pid=22614): Terminated: ok {rc=0} 09:20:12.750278 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 09:20:12.759587 tst iperf3.py:8: Test FAILED (7.6 sec) 09:20:12.786951 run osmo-hlr_10.42.42.2(pid=22608): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22608)] 09:20:12.834421 run osmo-hlr_10.42.42.2(pid=22608): stdout: | (launched: 2022-12-10_09:20:09.569296) 09:20:12.883684 run osmo-hlr_10.42.42.2(pid=22608): stderr: | 20221210092009751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092009752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092009752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092009752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092009752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092009752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092009764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092009772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092009773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092009773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:12.933326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22603): Terminating (SIGTERM) 09:20:12.972682 run iperf3-srv_10.42.42.10(pid=22604): Terminating (SIGTERM) 09:20:13.012271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminating (SIGTERM) 09:20:13.052320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminating (SIGTERM) 09:20:13.091967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Terminating (SIGTERM) 09:20:13.131830 --- ParallelTerminationStrategy: PID 22603 died... 09:20:13.150859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22603): Terminated: ok {rc=0} 09:20:13.195092 --- ParallelTerminationStrategy: PID 22604 died... 09:20:13.213530 run iperf3-srv_10.42.42.10(pid=22604): Terminated {rc=256} 09:20:13.257377 --- ParallelTerminationStrategy: PID 22607 died... 09:20:13.275782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminated: ok {rc=0} 09:20:13.319982 --- ParallelTerminationStrategy: PID 22610 died... 09:20:13.338431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminated: ok {rc=0} 09:20:13.382293 --- ParallelTerminationStrategy: PID 22613 died... 09:20:13.400698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Terminated: ok {rc=0} 09:20:13.483920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 09:20:14.633532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:14.645564 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:14.715237 tst iperf3m4.py: using LAC 27401 09:20:14.844320 tst iperf3m4.py: using RAC 116 09:20:14.971469 tst iperf3m4.py: using CellId 27401 09:20:15.100516 tst iperf3m4.py: using BVCI 27402 09:20:15.218700 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.230227 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.241611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.253497 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.265570 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.277700 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.289638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.301624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:15.313726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:15.432071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:15.556574 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:15.673509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:15.791813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:20:16.039207 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:16.385744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Launched 09:20:16.678954 run iperf3-srv_10.42.42.10(pid=22617): Launched 09:20:16.811380 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:20:17.023962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:17.342875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Launched 09:20:17.613309 run iperf3-srv_10.42.42.10(pid=22619): Launched 09:20:17.727417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:20:17.931688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:18.241205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Launched 09:20:18.509428 run iperf3-srv_10.42.42.10(pid=22621): Launched 09:20:18.623094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:20:18.826724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:20:19.135237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Launched 09:20:19.404099 run iperf3-srv_10.42.42.10(pid=22623): Launched 09:20:19.518006 tst iperf3m4.py:8: start network... 09:20:19.722433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:20.197616 run create_hlr_db(pid=22624): Launched 09:20:20.314289 bus /gobi_6: Setting Powered False 09:20:21.374647 run create_hlr_db(pid=22624): Terminated: ok {rc=0} 09:20:21.802451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Launched 09:20:22.110908 run osmo-hlr_10.42.42.2(pid=22627): Launched 09:20:22.227545 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:22.769771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Launched 09:20:23.077654 run osmo-stp_10.42.42.5(pid=22630): Launched 09:20:23.194710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:23.725706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Launched 09:20:23.842149 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:24.102485 run patchelf(pid=22633): Launched 09:20:24.271638 run osmo-stp_10.42.42.5(pid=22630): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] 09:20:24.400211 run osmo-stp_10.42.42.5(pid=22630): stdout: | (launched: 2022-12-10_09:20:23.017953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:24.530587 run osmo-stp_10.42.42.5(pid=22630): stderr: | 20221210092023193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092023193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092023193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092023194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092023194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092023194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092023194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:24.660677 run osmo-stp_10.42.42.5(pid=22630): stdout: | (launched: 2022-12-10_09:20:23.017953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:24.785521 run osmo-stp_10.42.42.5(pid=22630): stderr: | 20221210092023193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092023193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092023193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092023194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092023194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092023194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092023194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:24.933611 run patchelf(pid=22633): Terminating (SIGINT) 09:20:25.103963 run patchelf(pid=22633): Terminated: ok {rc=0} 09:20:25.226882 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22630): Process ended prematurely: osmo-stp_10.42.42.5(pid=22630) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 09:20:25.236249 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:20:25.263858 run osmo-hlr_10.42.42.2(pid=22627): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22627)] 09:20:25.311528 run osmo-hlr_10.42.42.2(pid=22627): stdout: | (launched: 2022-12-10_09:20:22.051056) 09:20:25.360709 run osmo-hlr_10.42.42.2(pid=22627): stderr: | 20221210092022230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092022230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092022231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092022231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092022231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092022231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092022242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092022250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092022250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092022251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:25.410213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Terminating (SIGTERM) 09:20:25.450667 run iperf3-srv_10.42.42.10(pid=22617): Terminating (SIGTERM) 09:20:25.500392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Terminating (SIGTERM) 09:20:25.567573 run iperf3-srv_10.42.42.10(pid=22619): Terminating (SIGTERM) 09:20:25.611337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Terminating (SIGTERM) 09:20:25.653025 run iperf3-srv_10.42.42.10(pid=22621): Terminating (SIGTERM) 09:20:25.694594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Terminating (SIGTERM) 09:20:25.736347 run iperf3-srv_10.42.42.10(pid=22623): Terminating (SIGTERM) 09:20:25.777726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Terminating (SIGTERM) 09:20:25.819217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Terminating (SIGTERM) 09:20:25.860687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Terminating (SIGTERM) 09:20:25.902957 --- ParallelTerminationStrategy: PID 22616 died... 09:20:25.923012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22616): Terminated: ok {rc=0} 09:20:25.969064 --- ParallelTerminationStrategy: PID 22617 died... 09:20:25.988338 run iperf3-srv_10.42.42.10(pid=22617): Terminated {rc=256} 09:20:26.033834 --- ParallelTerminationStrategy: PID 22618 died... 09:20:26.053283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22618): Terminated: ok {rc=0} 09:20:26.098951 --- ParallelTerminationStrategy: PID 22619 died... 09:20:26.118278 run iperf3-srv_10.42.42.10(pid=22619): Terminated {rc=256} 09:20:26.163923 --- ParallelTerminationStrategy: PID 22620 died... 09:20:26.183340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Terminated: ok {rc=0} 09:20:26.229416 --- ParallelTerminationStrategy: PID 22621 died... 09:20:26.248659 run iperf3-srv_10.42.42.10(pid=22621): Terminated {rc=256} 09:20:26.294922 --- ParallelTerminationStrategy: PID 22622 died... 09:20:26.314444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Terminated: ok {rc=0} 09:20:26.360074 --- ParallelTerminationStrategy: PID 22623 died... 09:20:26.379416 run iperf3-srv_10.42.42.10(pid=22623): Terminated {rc=256} 09:20:26.425231 --- ParallelTerminationStrategy: PID 22626 died... 09:20:26.444415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Terminated: ok {rc=0} 09:20:26.490152 --- ParallelTerminationStrategy: PID 22629 died... 09:20:26.509942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Terminated: ok {rc=0} 09:20:26.555572 --- ParallelTerminationStrategy: PID 22632 died... 09:20:26.574980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Terminated: ok {rc=0} 09:20:26.661308 bus /gobi_4: Setting Powered False 09:20:27.760178 bus /gobi_4: Setting Powered False 09:20:28.875788 bus /gobi_1: Setting Powered False 09:20:29.973612 bus /gobi_1: Setting Powered False 09:20:31.089309 bus /gobi_0: Setting Powered False 09:20:32.192313 bus /gobi_0: Setting Powered False 09:20:33.309474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 09:20:34.409642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:34.421285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:34.490490 tst ping.py: using LAC 27402 09:20:34.606975 tst ping.py: using RAC 117 09:20:34.721935 tst ping.py: using CellId 27402 09:20:34.839553 tst ping.py: using BVCI 27403 09:20:34.948058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:34.959129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:34.969998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:34.981131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:34.992202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:35.003346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:35.014549 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:35.025847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:35.140210 tst ping.py:19: start network... 09:20:35.339896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:35.806163 run create_hlr_db(pid=22636): Launched 09:20:35.919774 bus /gobi_6: Setting Powered False 09:20:36.979091 run create_hlr_db(pid=22636): Terminated: ok {rc=0} 09:20:37.418932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Launched 09:20:37.739359 run osmo-hlr_10.42.42.2(pid=22639): Launched 09:20:37.859139 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:38.381976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Launched 09:20:38.683582 run osmo-stp_10.42.42.5(pid=22642): Launched 09:20:38.797230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:39.315495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Launched 09:20:39.429452 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:39.685025 run patchelf(pid=22645): Launched 09:20:39.851421 run osmo-stp_10.42.42.5(pid=22642): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] 09:20:39.978432 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-10_09:20:38.624508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:40.106155 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221210092038798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092038799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092038799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092038799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092038800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092038800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092038800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:40.233796 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-10_09:20:38.624508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:40.356120 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221210092038798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092038799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092038799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092038799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092038800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092038800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092038800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:40.501162 run patchelf(pid=22645): Terminating (SIGINT) 09:20:40.668402 run patchelf(pid=22645): Terminated: ok {rc=0} 09:20:40.789128 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 09:20:40.797817 tst ping.py:22: Test FAILED (6.4 sec) 09:20:40.824618 run osmo-hlr_10.42.42.2(pid=22639): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22639)] 09:20:40.871825 run osmo-hlr_10.42.42.2(pid=22639): stdout: | (launched: 2022-12-10_09:20:37.677460) 09:20:40.921135 run osmo-hlr_10.42.42.2(pid=22639): stderr: | 20221210092037878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092037878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092037878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092037878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092037878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092037878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092037892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092037900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092037900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092037900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:40.970435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminating (SIGTERM) 09:20:41.009598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminating (SIGTERM) 09:20:41.049353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Terminating (SIGTERM) 09:20:41.089844 --- ParallelTerminationStrategy: PID 22638 died... 09:20:41.108725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminated: ok {rc=0} 09:20:41.152715 --- ParallelTerminationStrategy: PID 22641 died... 09:20:41.171257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminated: ok {rc=0} 09:20:41.215113 --- ParallelTerminationStrategy: PID 22644 died... 09:20:41.233470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Terminated: ok {rc=0} 09:20:41.316719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 09:20:42.402708 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:42.415211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 09:20:42.488621 tst ping_idle_ping.py: using LAC 27403 09:20:42.613207 tst ping_idle_ping.py: using RAC 118 09:20:42.736038 tst ping_idle_ping.py: using CellId 27403 09:20:42.854717 tst ping_idle_ping.py: using BVCI 27404 09:20:42.964288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:42.975473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:42.986471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:42.998058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:43.009763 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:43.021366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:43.033096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 09:20:43.044672 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 09:20:43.161452 tst ping_idle_ping.py:24: start network... 09:20:43.363149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:43.834272 run create_hlr_db(pid=22646): Launched 09:20:43.948637 bus /gobi_6: Setting Powered False 09:20:45.009676 run create_hlr_db(pid=22646): Terminated: ok {rc=0} 09:20:45.450832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Launched 09:20:45.772348 run osmo-hlr_10.42.42.2(pid=22649): Launched 09:20:45.971691 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:46.818116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Launched 09:20:47.148556 run osmo-stp_10.42.42.5(pid=22652): Launched 09:20:47.274104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:47.882408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Launched 09:20:47.997104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:48.253940 run patchelf(pid=22655): Launched 09:20:48.420589 run osmo-stp_10.42.42.5(pid=22652): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] 09:20:48.547892 run osmo-stp_10.42.42.5(pid=22652): stdout: | (launched: 2022-12-10_09:20:47.084561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:48.676005 run osmo-stp_10.42.42.5(pid=22652): stderr: | 20221210092047366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092047366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092047367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092047367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092047367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092047368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092047368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:48.804735 run osmo-stp_10.42.42.5(pid=22652): stdout: | (launched: 2022-12-10_09:20:47.084561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:48.927814 run osmo-stp_10.42.42.5(pid=22652): stderr: | 20221210092047366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092047366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092047367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092047367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092047367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092047368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092047368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:49.073711 run patchelf(pid=22655): Terminating (SIGINT) 09:20:49.242152 run patchelf(pid=22655): Terminated: ok {rc=0} 09:20:49.363320 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22652): Process ended prematurely: osmo-stp_10.42.42.5(pid=22652) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 09:20:49.372152 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 09:20:49.399133 run osmo-hlr_10.42.42.2(pid=22649): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22649)] 09:20:49.446766 run osmo-hlr_10.42.42.2(pid=22649): stdout: | (launched: 2022-12-10_09:20:45.710311) 09:20:49.495973 run osmo-hlr_10.42.42.2(pid=22649): stderr: | 20221210092046008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092046008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092046008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092046008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092046008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092046008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092046034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092046051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092046051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092046051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:49.546007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Terminating (SIGTERM) 09:20:49.585689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Terminating (SIGTERM) 09:20:49.625171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Terminating (SIGTERM) 09:20:49.665307 --- ParallelTerminationStrategy: PID 22648 died... 09:20:49.684634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Terminated: ok {rc=0} 09:20:49.728519 --- ParallelTerminationStrategy: PID 22651 died... 09:20:49.746974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Terminated: ok {rc=0} 09:20:49.790790 --- ParallelTerminationStrategy: PID 22654 died... 09:20:49.809295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Terminated: ok {rc=0} 09:20:49.894992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:20:51.195675 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:20:51.201978 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:20:51.231839 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:20:51.266202 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:20:51.320135 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:20:51.350164 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:20:51.384447 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:20:51.942914 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:20:51.947970 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:51.959379 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:20:52.022835 tst switch_tch_pdch.py: using LAC 27404 09:20:52.143040 tst switch_tch_pdch.py: using RAC 119 09:20:52.260242 tst switch_tch_pdch.py: using CellId 27404 09:20:52.375072 tst switch_tch_pdch.py: using BVCI 27405 09:20:52.482988 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.494392 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.505694 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.517156 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.528261 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.539594 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.551264 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:20:52.563058 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:52.682616 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:20:52.803800 tst switch_tch_pdch.py:51: start network... 09:20:53.016380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:20:53.506587 run create_hlr_db(pid=22659): Launched 09:20:53.635864 bus /gobi_6: Setting Powered False 09:20:54.698054 run create_hlr_db(pid=22659): Terminated: ok {rc=0} 09:20:55.125550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22661): Launched 09:20:55.424822 run osmo-hlr_10.42.42.2(pid=22662): Launched 09:20:55.538805 run osmo-stp_10.42.42.5: Starting osmo-stp 09:20:56.063733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22664): Launched 09:20:56.362007 run osmo-stp_10.42.42.5(pid=22665): Launched 09:20:56.475195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:20:56.990376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22667): Launched 09:20:57.103596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:20:57.355087 run patchelf(pid=22668): Launched 09:20:57.520109 run osmo-stp_10.42.42.5(pid=22665): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22665)] 09:20:57.646307 run osmo-stp_10.42.42.5(pid=22665): stdout: | (launched: 2022-12-10_09:20:56.307019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:57.774028 run osmo-stp_10.42.42.5(pid=22665): stderr: | 20221210092056478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092056478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092056478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092056479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092056479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092056479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092056479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:57.902104 run osmo-stp_10.42.42.5(pid=22665): stdout: | (launched: 2022-12-10_09:20:56.307019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:20:58.024559 run osmo-stp_10.42.42.5(pid=22665): stderr: | 20221210092056478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092056478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092056478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092056479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092056479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092056479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092056479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:20:58.169878 run patchelf(pid=22668): Terminating (SIGINT) 09:20:58.337781 run patchelf(pid=22668): Terminated: ok {rc=0} 09:20:58.458817 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22665): Process ended prematurely: osmo-stp_10.42.42.5(pid=22665) [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22665)] [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:20:58.467538 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 09:20:58.494159 run osmo-hlr_10.42.42.2(pid=22662): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22662)] 09:20:58.541928 run osmo-hlr_10.42.42.2(pid=22662): stdout: | (launched: 2022-12-10_09:20:55.369507) 09:20:58.591023 run osmo-hlr_10.42.42.2(pid=22662): stderr: | 20221210092055546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092055546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092055546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092055546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092055546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092055546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092055558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092055569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092055569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092055569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:20:58.640517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22661): Terminating (SIGTERM) 09:20:58.679923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22664): Terminating (SIGTERM) 09:20:58.719270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22667): Terminating (SIGTERM) 09:20:58.758780 --- ParallelTerminationStrategy: PID 22661 died... 09:20:58.777592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22661): Terminated: ok {rc=0} 09:20:58.821287 --- ParallelTerminationStrategy: PID 22664 died... 09:20:58.839751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22664): Terminated: ok {rc=0} 09:20:58.883820 --- ParallelTerminationStrategy: PID 22667 died... 09:20:58.902267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22667): Terminated: ok {rc=0} 09:20:58.987104 bus /gobi_0: Setting Powered False 09:21:00.085384 bus /gobi_0: Setting Powered False 09:21:01.195133 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 09:21:02.451249 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:02.457574 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 09:21:02.487961 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 09:21:02.523435 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 09:21:02.576938 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 09:21:02.606801 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 09:21:02.641892 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 09:21:03.197232 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 09:21:03.202551 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.213954 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 09:21:03.281279 tst switch_tch_pdch.py: using LAC 27405 09:21:03.402569 tst switch_tch_pdch.py: using RAC 120 09:21:03.521483 tst switch_tch_pdch.py: using CellId 27405 09:21:03.644658 tst switch_tch_pdch.py: using BVCI 27406 09:21:03.759916 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.771522 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.782872 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.794315 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.805616 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.817050 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.828471 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 09:21:03.839824 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:21:03.956585 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 09:21:04.075267 tst switch_tch_pdch.py:51: start network... 09:21:04.290007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:04.758717 run create_hlr_db(pid=22672): Launched 09:21:04.886020 bus /gobi_6: Setting Powered False 09:21:05.948404 run create_hlr_db(pid=22672): Terminated: ok {rc=0} 09:21:06.368560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22674): Launched 09:21:06.689332 run osmo-hlr_10.42.42.2(pid=22675): Launched 09:21:06.810319 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:07.331187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22677): Launched 09:21:07.651183 run osmo-stp_10.42.42.5(pid=22678): Launched 09:21:07.771640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:21:08.297936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22680): Launched 09:21:08.418891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:21:08.691019 run patchelf(pid=22681): Launched 09:21:08.866912 run osmo-stp_10.42.42.5(pid=22678): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22678)] 09:21:09.000409 run osmo-stp_10.42.42.5(pid=22678): stdout: | (launched: 2022-12-10_09:21:07.589441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:09.135558 run osmo-stp_10.42.42.5(pid=22678): stderr: | 20221210092107785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092107786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092107786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092107786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092107787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092107787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092107787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:09.271203 run osmo-stp_10.42.42.5(pid=22678): stdout: | (launched: 2022-12-10_09:21:07.589441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:09.401780 run osmo-stp_10.42.42.5(pid=22678): stderr: | 20221210092107785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092107786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092107786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092107786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092107787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092107787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092107787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:09.555604 run patchelf(pid=22681): Terminating (SIGINT) 09:21:09.733200 run patchelf(pid=22681): Terminated: ok {rc=0} 09:21:09.861195 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22678): Process ended prematurely: osmo-stp_10.42.42.5(pid=22678) [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22678)] [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 09:21:09.870535 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 09:21:09.898313 run osmo-hlr_10.42.42.2(pid=22675): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22675)] 09:21:09.947881 run osmo-hlr_10.42.42.2(pid=22675): stdout: | (launched: 2022-12-10_09:21:06.626010) 09:21:09.999510 run osmo-hlr_10.42.42.2(pid=22675): stderr: | 20221210092106828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092106828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092106828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092106828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092106828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092106828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092106840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092106848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092106848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092106848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:10.051442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22674): Terminating (SIGTERM) 09:21:10.092884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22677): Terminating (SIGTERM) 09:21:10.134370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22680): Terminating (SIGTERM) 09:21:10.176010 --- ParallelTerminationStrategy: PID 22674 died... 09:21:10.195437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22674): Terminated: ok {rc=0} 09:21:10.241527 --- ParallelTerminationStrategy: PID 22677 died... 09:21:10.260662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22677): Terminated: ok {rc=0} 09:21:10.306628 --- ParallelTerminationStrategy: PID 22680 died... 09:21:10.325990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22680): Terminated: ok {rc=0} 09:21:10.411987 bus /gobi_0: Setting Powered False 09:21:11.509477 bus /gobi_0: Setting Powered False 09:21:12.623194 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_sms:nanobts --------------------------------------------------------------------- 09:21:13.875078 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:13.879188 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 09:21:13.903811 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 09:21:13.910781 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 09:21:13.962863 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 09:21:13.987221 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 09:21:13.994633 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 09:21:14.533885 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 09:21:14.540856 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 09:21:14.552105 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 09:21:14.591067 tst mo_mt_sms.py: using LAC 27406 09:21:14.709392 tst mo_mt_sms.py: using RAC 121 09:21:14.829957 tst mo_mt_sms.py: using CellId 27406 09:21:14.949616 tst mo_mt_sms.py: using BVCI 27407 09:21:15.066097 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:21:15.183211 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 09:21:15.302540 tst mo_mt_sms.py:9: start nitb and bts... 09:21:15.503873 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:21:16.148069 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22685): Launched 09:21:16.471054 run osmo-nitb_10.42.42.2(pid=22686): Launched 09:21:16.660725 run osmo-nitb_10.42.42.2(pid=22686): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22686)] 09:21:16.799807 run osmo-nitb_10.42.42.2(pid=22686): stdout: | (launched: 2022-12-10_09:21:16.408853) 09:21:16.940108 run osmo-nitb_10.42.42.2(pid=22686): stderr: | (launched: 2022-12-10_09:21:16.454432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:21:17.080660 run osmo-nitb_10.42.42.2(pid=22686): stdout: | (launched: 2022-12-10_09:21:16.408853) 09:21:17.215087 run osmo-nitb_10.42.42.2(pid=22686): stderr: | (launched: 2022-12-10_09:21:16.454432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22686) [trial-2372↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22686)] 09:21:17.606185 tst osmo-nitb_10.42.42.2(pid=22686): stdout: | (launched: 2022-12-10_09:21:16.408853) 09:21:17.727212 tst osmo-nitb_10.42.42.2(pid=22686): stderr: | (launched: 2022-12-10_09:21:16.454432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:21:17.869704 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22686) [trial-2372↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22686)] [trial-2372↪nitb_sms:nanobts↪mo_mt_sms.py:11] 09:21:17.877897 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 09:21:17.884335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22685): Terminating (SIGTERM) 09:21:18.093082 --- ParallelTerminationStrategy: PID 22685 died... 09:21:18.113226 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22685): Terminated: ok {rc=0} 09:21:18.198672 bus /sierra_3: Setting Powered False 09:21:19.299612 bus /sierra_3: Setting Powered False 09:21:20.416082 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:nanobts+band-1900 --------------------------------------------------------------------- 09:21:21.601961 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:21.607172 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:21:21.630818 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:21:21.657368 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 09:21:21.708457 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:21:21.731875 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:21:21.758704 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 09:21:22.310724 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 09:21:22.316881 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.328631 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:21:22.369609 tst mo_mt_sms.py: using LAC 27407 09:21:22.487178 tst mo_mt_sms.py: using RAC 122 09:21:22.605680 tst mo_mt_sms.py: using CellId 27407 09:21:22.722233 tst mo_mt_sms.py: using BVCI 27408 09:21:22.830622 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.841251 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.851805 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.862613 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.873465 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:22.884117 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:21:23.003304 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 09:21:23.118730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:23.587935 run create_hlr_db(pid=22690): Launched 09:21:23.701241 bus /sierra_2: Setting Powered False 09:21:24.761247 run create_hlr_db(pid=22690): Terminated: ok {rc=0} 09:21:25.202167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22692): Launched 09:21:25.534657 run osmo-hlr_10.42.42.2(pid=22693): Launched 09:21:25.655647 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:26.210893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22695): Launched 09:21:26.532654 run osmo-stp_10.42.42.5(pid=22696): Launched 09:21:26.653113 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:27.229996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22698): Launched 09:21:27.550577 run osmo-msc_10.42.42.6(pid=22699): Launched 09:21:27.726966 run osmo-stp_10.42.42.5(pid=22696): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22696)] 09:21:27.861969 run osmo-stp_10.42.42.5(pid=22696): stdout: | (launched: 2022-12-10_09:21:26.469446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:27.996096 run osmo-stp_10.42.42.5(pid=22696): stderr: | 20221210092126667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092126667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092126667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092126667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092126668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092126668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092126668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:28.129476 run osmo-stp_10.42.42.5(pid=22696): stdout: | (launched: 2022-12-10_09:21:26.469446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:28.256327 run osmo-stp_10.42.42.5(pid=22696): stderr: | 20221210092126667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092126667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092126667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092126667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092126668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092126668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092126668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:28.407075 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22696): Process ended prematurely: osmo-stp_10.42.42.5(pid=22696) [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22696)] [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 09:21:28.415882 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 09:21:28.443282 run osmo-hlr_10.42.42.2(pid=22693): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22693)] 09:21:28.493173 run osmo-hlr_10.42.42.2(pid=22693): stdout: | (launched: 2022-12-10_09:21:25.471681) 09:21:28.544738 run osmo-hlr_10.42.42.2(pid=22693): stderr: | 20221210092125674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092125674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092125674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092125674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092125674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092125674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092125686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092125694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092125695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092125695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:28.616432 run osmo-msc_10.42.42.6(pid=22699): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22699)] 09:21:28.666164 run osmo-msc_10.42.42.6(pid=22699): stdout: | (launched: 2022-12-10_09:21:27.488248) 09:21:28.717224 run osmo-msc_10.42.42.6(pid=22699): stderr: | 20221210092127813 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092127813 DLGLOBAL DEBUG validating counter group 0x7ff961c8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092127813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092127813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092127813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092127814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092127817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092127818 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092127818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092127818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:28.768476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22692): Terminating (SIGTERM) 09:21:28.809956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22695): Terminating (SIGTERM) 09:21:28.851303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22698): Terminating (SIGTERM) 09:21:28.893249 --- ParallelTerminationStrategy: PID 22692 died... 09:21:28.913164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22692): Terminated: ok {rc=0} 09:21:28.959074 --- ParallelTerminationStrategy: PID 22695 died... 09:21:28.978500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22695): Terminated: ok {rc=0} 09:21:29.024440 --- ParallelTerminationStrategy: PID 22698 died... 09:21:29.043927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22698): Terminated: ok {rc=0} 09:21:29.131142 bus /sierra_3: Setting Powered False 09:21:30.229181 bus /sierra_3: Setting Powered False 09:21:31.367751 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:21:32.603496 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:32.608505 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:21:32.633451 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 09:21:32.640684 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:21:32.676205 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:21:32.700869 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 09:21:32.708485 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:21:33.231720 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:21:33.237236 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 09:21:33.248605 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:21:33.287765 tst assert_extension.py: using LAC 27408 09:21:33.412519 tst assert_extension.py: using RAC 123 09:21:33.534985 tst assert_extension.py: using CellId 27408 09:21:33.659196 tst assert_extension.py: using BVCI 27409 09:21:33.774584 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:21:33.888443 tst assert_extension.py:10: start nitb and bts... 09:21:34.089381 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:21:34.699248 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22704): Launched 09:21:34.997399 run osmo-nitb_10.42.42.2(pid=22705): Launched 09:21:35.163036 run osmo-nitb_10.42.42.2(pid=22705): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22705)] 09:21:35.297072 run osmo-nitb_10.42.42.2(pid=22705): stdout: | (launched: 2022-12-10_09:21:34.942383) 09:21:35.432440 run osmo-nitb_10.42.42.2(pid=22705): stderr: | (launched: 2022-12-10_09:21:34.986970) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:21:35.567746 run osmo-nitb_10.42.42.2(pid=22705): stdout: | (launched: 2022-12-10_09:21:34.942383) 09:21:35.698139 run osmo-nitb_10.42.42.2(pid=22705): stderr: | (launched: 2022-12-10_09:21:34.986970) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22705) [trial-2372↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22705)] 09:21:36.110053 tst osmo-nitb_10.42.42.2(pid=22705): stdout: | (launched: 2022-12-10_09:21:34.942383) 09:21:36.231195 tst osmo-nitb_10.42.42.2(pid=22705): stderr: | (launched: 2022-12-10_09:21:34.986970) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:21:36.373767 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22705) [trial-2372↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22705)] [trial-2372↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 09:21:36.382268 tst assert_extension.py:12: Test FAILED (3.1 sec) 09:21:36.389014 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22704): Terminating (SIGTERM) 09:21:36.597876 --- ParallelTerminationStrategy: PID 22704 died... 09:21:36.618745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22704): Terminated: ok {rc=0} 09:21:36.703672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:nanobts+band-1900 --------------------------------------------------------------------- 09:21:37.870859 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:37.875980 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:21:37.900344 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:21:37.928043 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 09:21:37.964287 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:21:37.989287 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:21:38.016296 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 09:21:38.544028 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 09:21:38.550080 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:38.561281 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:21:38.598825 tst assert_extension.py: using LAC 27409 09:21:38.716512 tst assert_extension.py: using RAC 124 09:21:38.845765 tst assert_extension.py: using CellId 27409 09:21:38.964711 tst assert_extension.py: using BVCI 27410 09:21:39.074021 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:39.084802 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:39.095599 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:39.107105 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:39.118834 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:21:39.130372 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 09:21:39.247649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:39.719042 run create_hlr_db(pid=22709): Launched 09:21:39.833236 bus /sierra_2: Setting Powered False 09:21:40.893184 run create_hlr_db(pid=22709): Terminated: ok {rc=0} 09:21:41.333740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Launched 09:21:41.654320 run osmo-hlr_10.42.42.2(pid=22712): Launched 09:21:41.775486 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:42.302273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Launched 09:21:42.604704 run osmo-stp_10.42.42.5(pid=22715): Launched 09:21:42.720363 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:43.265240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Launched 09:21:43.567263 run osmo-msc_10.42.42.6(pid=22718): Launched 09:21:43.735092 run osmo-stp_10.42.42.5(pid=22715): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] 09:21:43.862624 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-10_09:21:42.545607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:43.989992 run osmo-stp_10.42.42.5(pid=22715): stderr: | 20221210092142720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092142720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092142720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092142720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092142721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092142721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092142721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:44.115287 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-10_09:21:42.545607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:44.233987 run osmo-stp_10.42.42.5(pid=22715): stderr: | 20221210092142720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092142720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092142720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092142720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092142721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092142721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092142721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:44.376315 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py:17] 09:21:44.384611 tst assert_extension.py:17: Test FAILED (5.8 sec) 09:21:44.411131 run osmo-hlr_10.42.42.2(pid=22712): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22712)] 09:21:44.458816 run osmo-hlr_10.42.42.2(pid=22712): stdout: | (launched: 2022-12-10_09:21:41.592181) 09:21:44.508050 run osmo-hlr_10.42.42.2(pid=22712): stderr: | 20221210092141793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092141793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092141793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092141793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092141793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092141793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092141805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092141813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092141813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092141814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:44.576526 run osmo-msc_10.42.42.6(pid=22718): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22718)] 09:21:44.623831 run osmo-msc_10.42.42.6(pid=22718): stdout: | (launched: 2022-12-10_09:21:43.508185) 09:21:44.672819 run osmo-msc_10.42.42.6(pid=22718): stderr: | 20221210092143782 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092143782 DLGLOBAL DEBUG validating counter group 0x7f47b0aa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092143782 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092143782 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092143783 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092143783 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092143787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092143787 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092143787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092143787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:44.722361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminating (SIGTERM) 09:21:44.761568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminating (SIGTERM) 09:21:44.800801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Terminating (SIGTERM) 09:21:44.840491 --- ParallelTerminationStrategy: PID 22711 died... 09:21:44.859244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminated: ok {rc=0} 09:21:44.902778 --- ParallelTerminationStrategy: PID 22714 died... 09:21:44.920881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminated: ok {rc=0} 09:21:44.964754 --- ParallelTerminationStrategy: PID 22717 died... 09:21:44.983040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22717): Terminated: ok {rc=0} 09:21:45.067758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:21:46.283592 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:21:46.291484 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:21:46.318339 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:21:46.347047 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:21:46.400735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:21:46.427108 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:21:46.456590 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:21:47.002552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:21:47.069382 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.085928 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:21:47.150730 tst mo_mt_call.py: using LAC 27410 09:21:47.282532 tst mo_mt_call.py: using RAC 125 09:21:47.401642 tst mo_mt_call.py: using CellId 27410 09:21:47.527451 tst mo_mt_call.py: using BVCI 27411 09:21:47.644244 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.656119 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.667763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.679375 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.691105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:47.702822 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:21:47.820220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:21:47.939237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:48.440776 run create_hlr_db(pid=22723): Launched 09:21:48.571707 bus /sierra_2: Setting Powered False 09:21:49.631957 run create_hlr_db(pid=22723): Terminated: ok {rc=0} 09:21:50.078841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22725): Launched 09:21:50.402235 run osmo-hlr_10.42.42.2(pid=22726): Launched 09:21:50.525403 run osmo-stp_10.42.42.5: Starting osmo-stp 09:21:51.078759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22728): Launched 09:21:51.399604 run osmo-stp_10.42.42.5(pid=22729): Launched 09:21:51.522298 run osmo-msc_10.42.42.6: Starting osmo-msc 09:21:52.106852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22731): Launched 09:21:52.430512 run osmo-msc_10.42.42.6(pid=22732): Launched 09:21:52.611371 run osmo-stp_10.42.42.5(pid=22729): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22729)] 09:21:52.747865 run osmo-stp_10.42.42.5(pid=22729): stdout: | (launched: 2022-12-10_09:21:51.341563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:52.884230 run osmo-stp_10.42.42.5(pid=22729): stderr: | 20221210092151534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092151534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092151534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092151535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092151535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092151535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092151535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:53.020243 run osmo-stp_10.42.42.5(pid=22729): stdout: | (launched: 2022-12-10_09:21:51.341563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:21:53.148862 run osmo-stp_10.42.42.5(pid=22729): stderr: | 20221210092151534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092151534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092151534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092151535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092151535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092151535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092151535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:21:53.303305 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22729): Process ended prematurely: osmo-stp_10.42.42.5(pid=22729) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22729)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:21:53.312897 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:21:53.340603 run osmo-hlr_10.42.42.2(pid=22726): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22726)] 09:21:53.390422 run osmo-hlr_10.42.42.2(pid=22726): stdout: | (launched: 2022-12-10_09:21:50.343639) 09:21:53.442089 run osmo-hlr_10.42.42.2(pid=22726): stderr: | 20221210092150541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092150541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092150541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092150541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092150541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092150541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092150553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092150563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092150563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092150563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:21:53.514071 run osmo-msc_10.42.42.6(pid=22732): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22732)] 09:21:53.563928 run osmo-msc_10.42.42.6(pid=22732): stdout: | (launched: 2022-12-10_09:21:52.371728) 09:21:53.615277 run osmo-msc_10.42.42.6(pid=22732): stderr: | 20221210092152692 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092152693 DLGLOBAL DEBUG validating counter group 0x7fd211d91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092152693 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092152693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092152693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092152693 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092152695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092152695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092152695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092152696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:21:53.666714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22725): Terminating (SIGTERM) 09:21:53.707667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22728): Terminating (SIGTERM) 09:21:53.748753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22731): Terminating (SIGTERM) 09:21:53.790371 --- ParallelTerminationStrategy: PID 22725 died... 09:21:53.810149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22725): Terminated: ok {rc=0} 09:21:53.856223 --- ParallelTerminationStrategy: PID 22728 died... 09:21:53.875765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22728): Terminated: ok {rc=0} 09:21:53.921242 --- ParallelTerminationStrategy: PID 22731 died... 09:21:53.940453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22731): Terminated: ok {rc=0} 09:21:54.027271 bus /sierra_3: Setting Powered False 09:21:55.125555 bus /sierra_3: Setting Powered False 09:21:56.240264 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:21:57.388006 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:57.400229 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:21:57.462834 tst mo_mt_call_osmux.py: using LAC 27411 09:21:57.590936 tst mo_mt_call_osmux.py: using RAC 126 09:21:57.717972 tst mo_mt_call_osmux.py: using CellId 27411 09:21:57.845887 tst mo_mt_call_osmux.py: using BVCI 27412 09:21:57.963147 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:57.974900 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:57.986459 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:57.998038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:58.009883 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:21:58.021455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:21:58.137279 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:21:58.257090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:21:58.758381 run create_hlr_db(pid=22734): Launched 09:21:58.887827 bus /sierra_2: Setting Powered False 09:21:59.952080 run create_hlr_db(pid=22734): Terminated: ok {rc=0} 09:22:00.385909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Launched 09:22:00.690379 run osmo-hlr_10.42.42.2(pid=22737): Launched 09:22:00.806394 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:01.539997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Launched 09:22:01.904343 run osmo-stp_10.42.42.5(pid=22740): Launched 09:22:02.038467 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:02.780334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22742): Launched 09:22:03.103059 run osmo-msc_10.42.42.6(pid=22743): Launched 09:22:03.283255 run osmo-stp_10.42.42.5(pid=22740): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] 09:22:03.419382 run osmo-stp_10.42.42.5(pid=22740): stdout: | (launched: 2022-12-10_09:22:01.834957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:03.555624 run osmo-stp_10.42.42.5(pid=22740): stderr: | 20221210092202217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092202217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092202218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092202218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092202219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092202219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092202219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:03.691487 run osmo-stp_10.42.42.5(pid=22740): stdout: | (launched: 2022-12-10_09:22:01.834957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:03.819905 run osmo-stp_10.42.42.5(pid=22740): stderr: | 20221210092202217 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092202217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092202218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092202218 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092202219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092202219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092202219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:03.974039 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22740): Process ended prematurely: osmo-stp_10.42.42.5(pid=22740) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:22:03.983662 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 09:22:04.011271 run osmo-hlr_10.42.42.2(pid=22737): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22737)] 09:22:04.060703 run osmo-hlr_10.42.42.2(pid=22737): stdout: | (launched: 2022-12-10_09:22:00.634676) 09:22:04.111956 run osmo-hlr_10.42.42.2(pid=22737): stderr: | 20221210092200813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092200813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092200813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092200813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092200813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092200813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092200825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092200853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092200854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092200854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:04.183538 run osmo-msc_10.42.42.6(pid=22743): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22743)] 09:22:04.232849 run osmo-msc_10.42.42.6(pid=22743): stdout: | (launched: 2022-12-10_09:22:03.043800) 09:22:04.284193 run osmo-msc_10.42.42.6(pid=22743): stderr: | 20221210092203368 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092203368 DLGLOBAL DEBUG validating counter group 0x7facf0820c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092203368 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092203368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092203368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092203369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092203370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092203371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092203371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092203371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:04.335653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Terminating (SIGTERM) 09:22:04.377606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Terminating (SIGTERM) 09:22:04.418885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22742): Terminating (SIGTERM) 09:22:04.460926 --- ParallelTerminationStrategy: PID 22736 died... 09:22:04.480868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Terminated: ok {rc=0} 09:22:04.526867 --- ParallelTerminationStrategy: PID 22739 died... 09:22:04.546397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Terminated: ok {rc=0} 09:22:04.592146 --- ParallelTerminationStrategy: PID 22742 died... 09:22:04.611670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22742): Terminated: ok {rc=0} 09:22:04.698921 bus /sierra_3: Setting Powered False 09:22:05.797832 bus /sierra_3: Setting Powered False 09:22:06.914149 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:22:08.161199 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:08.168899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:22:08.194574 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:22:08.222786 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:22:08.277121 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:22:08.302217 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:22:08.330672 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:22:08.882944 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:22:08.935042 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:08.946663 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:22:09.012802 tst mo_mt_call.py: using LAC 27412 09:22:09.138786 tst mo_mt_call.py: using RAC 127 09:22:09.264185 tst mo_mt_call.py: using CellId 27412 09:22:09.390353 tst mo_mt_call.py: using BVCI 27413 09:22:09.507912 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:09.519518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:09.531024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:09.542961 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:09.555068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:09.567039 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:22:09.685511 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:22:09.805310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:10.311040 run create_hlr_db(pid=22748): Launched 09:22:10.442510 bus /sierra_2: Setting Powered False 09:22:11.505989 run create_hlr_db(pid=22748): Terminated: ok {rc=0} 09:22:11.942207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Launched 09:22:12.250000 run osmo-hlr_10.42.42.2(pid=22751): Launched 09:22:12.365902 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:12.891552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Launched 09:22:13.198247 run osmo-stp_10.42.42.5(pid=22754): Launched 09:22:13.314872 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:13.871255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22756): Launched 09:22:14.182903 run osmo-msc_10.42.42.6(pid=22757): Launched 09:22:14.354813 run osmo-stp_10.42.42.5(pid=22754): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] 09:22:14.484371 run osmo-stp_10.42.42.5(pid=22754): stdout: | (launched: 2022-12-10_09:22:13.139282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:14.614315 run osmo-stp_10.42.42.5(pid=22754): stderr: | 20221210092213314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092213314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092213314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092213315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092213315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092213315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092213315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:14.741396 run osmo-stp_10.42.42.5(pid=22754): stdout: | (launched: 2022-12-10_09:22:13.139282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:14.862574 run osmo-stp_10.42.42.5(pid=22754): stderr: | 20221210092213314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092213314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092213314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092213315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092213315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092213315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092213315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:15.007722 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22754): Process ended prematurely: osmo-stp_10.42.42.5(pid=22754) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:22:15.016691 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 09:22:15.042994 run osmo-hlr_10.42.42.2(pid=22751): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22751)] 09:22:15.090714 run osmo-hlr_10.42.42.2(pid=22751): stdout: | (launched: 2022-12-10_09:22:12.189873) 09:22:15.140040 run osmo-hlr_10.42.42.2(pid=22751): stderr: | 20221210092212369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092212370 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092212370 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092212370 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092212370 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092212370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092212382 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092212393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092212393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092212394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:15.208762 run osmo-msc_10.42.42.6(pid=22757): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22757)] 09:22:15.256205 run osmo-msc_10.42.42.6(pid=22757): stdout: | (launched: 2022-12-10_09:22:14.122912) 09:22:15.305226 run osmo-msc_10.42.42.6(pid=22757): stderr: | 20221210092214400 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092214400 DLGLOBAL DEBUG validating counter group 0x7fadd5c3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092214400 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092214400 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092214400 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092214401 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092214402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092214403 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092214403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092214403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:15.354624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Terminating (SIGTERM) 09:22:15.394200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Terminating (SIGTERM) 09:22:15.433878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22756): Terminating (SIGTERM) 09:22:15.473929 --- ParallelTerminationStrategy: PID 22750 died... 09:22:15.492851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Terminated: ok {rc=0} 09:22:15.537140 --- ParallelTerminationStrategy: PID 22753 died... 09:22:15.555554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Terminated: ok {rc=0} 09:22:15.599283 --- ParallelTerminationStrategy: PID 22756 died... 09:22:15.617779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22756): Terminated: ok {rc=0} 09:22:15.700377 bus /sierra_3: Setting Powered False 09:22:16.800005 bus /sierra_3: Setting Powered False 09:22:17.918772 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:22:19.063768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.075676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:22:19.139153 tst mo_mt_call_osmux.py: using LAC 27413 09:22:19.258269 tst mo_mt_call_osmux.py: using RAC 128 09:22:19.377939 tst mo_mt_call_osmux.py: using CellId 27413 09:22:19.495844 tst mo_mt_call_osmux.py: using BVCI 27414 09:22:19.606689 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.617900 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.628904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.640194 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.651552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:22:19.662863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:22:19.779903 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:22:19.901119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:20.406606 run create_hlr_db(pid=22759): Launched 09:22:20.537732 bus /sierra_2: Setting Powered False 09:22:21.602138 run create_hlr_db(pid=22759): Terminated: ok {rc=0} 09:22:22.040176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22761): Launched 09:22:22.349502 run osmo-hlr_10.42.42.2(pid=22762): Launched 09:22:22.467122 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:23.005786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22764): Launched 09:22:23.313893 run osmo-stp_10.42.42.5(pid=22765): Launched 09:22:23.430413 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:23.984246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22767): Launched 09:22:24.292913 run osmo-msc_10.42.42.6(pid=22768): Launched 09:22:24.463952 run osmo-stp_10.42.42.5(pid=22765): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22765)] 09:22:24.594279 run osmo-stp_10.42.42.5(pid=22765): stdout: | (launched: 2022-12-10_09:22:23.253284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:24.723923 run osmo-stp_10.42.42.5(pid=22765): stderr: | 20221210092223428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092223429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092223429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092223429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092223430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092223430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092223430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:24.850522 run osmo-stp_10.42.42.5(pid=22765): stdout: | (launched: 2022-12-10_09:22:23.253284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:24.971544 run osmo-stp_10.42.42.5(pid=22765): stderr: | 20221210092223428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092223429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092223429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092223429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092223430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092223430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092223430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:25.116605 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22765): Process ended prematurely: osmo-stp_10.42.42.5(pid=22765) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22765)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:22:25.125691 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:22:25.152369 run osmo-hlr_10.42.42.2(pid=22762): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22762)] 09:22:25.200316 run osmo-hlr_10.42.42.2(pid=22762): stdout: | (launched: 2022-12-10_09:22:22.289406) 09:22:25.249624 run osmo-hlr_10.42.42.2(pid=22762): stderr: | 20221210092222469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092222469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092222469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092222469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092222469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092222469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092222481 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092222489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092222489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092222489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:25.318193 run osmo-msc_10.42.42.6(pid=22768): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22768)] 09:22:25.365506 run osmo-msc_10.42.42.6(pid=22768): stdout: | (launched: 2022-12-10_09:22:24.233158) 09:22:25.414750 run osmo-msc_10.42.42.6(pid=22768): stderr: | 20221210092224509 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092224510 DLGLOBAL DEBUG validating counter group 0x7fab6c615c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092224510 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092224510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092224510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092224510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092224512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092224512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092224512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092224512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:25.464255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22761): Terminating (SIGTERM) 09:22:25.503695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22764): Terminating (SIGTERM) 09:22:25.543106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22767): Terminating (SIGTERM) 09:22:25.582530 --- ParallelTerminationStrategy: PID 22761 died... 09:22:25.601391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22761): Terminated: ok {rc=0} 09:22:25.645502 --- ParallelTerminationStrategy: PID 22764 died... 09:22:25.663946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22764): Terminated: ok {rc=0} 09:22:25.707527 --- ParallelTerminationStrategy: PID 22767 died... 09:22:25.726050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22767): Terminated: ok {rc=0} 09:22:25.811080 bus /sierra_3: Setting Powered False 09:22:26.907577 bus /sierra_3: Setting Powered False 09:22:28.021864 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:22:29.264459 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:29.272103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:22:29.299518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:22:29.327117 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:22:29.380044 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:22:29.403825 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:22:29.430552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:22:29.981656 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:22:30.030773 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.042076 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:22:30.101444 tst mo_mt_call.py: using LAC 27414 09:22:30.230504 tst mo_mt_call.py: using RAC 129 09:22:30.359092 tst mo_mt_call.py: using CellId 27414 09:22:30.490774 tst mo_mt_call.py: using BVCI 27415 09:22:30.604277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.615534 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.626547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.638015 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.649432 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:30.660552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:22:30.774785 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:22:30.907628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:31.395271 run create_hlr_db(pid=22773): Launched 09:22:31.547399 bus /sierra_2: Setting Powered False 09:22:32.607574 run create_hlr_db(pid=22773): Terminated: ok {rc=0} 09:22:33.050996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Launched 09:22:33.374279 run osmo-hlr_10.42.42.2(pid=22776): Launched 09:22:33.496757 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:34.051501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Launched 09:22:34.373558 run osmo-stp_10.42.42.5(pid=22779): Launched 09:22:34.496826 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:35.080939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22781): Launched 09:22:35.403276 run osmo-msc_10.42.42.6(pid=22782): Launched 09:22:35.583554 run osmo-stp_10.42.42.5(pid=22779): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] 09:22:35.723249 run osmo-stp_10.42.42.5(pid=22779): stdout: | (launched: 2022-12-10_09:22:34.314828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:35.859534 run osmo-stp_10.42.42.5(pid=22779): stderr: | 20221210092234509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092234509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092234510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092234510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092234510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092234511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092234511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:35.997523 run osmo-stp_10.42.42.5(pid=22779): stdout: | (launched: 2022-12-10_09:22:34.314828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:36.118445 run osmo-stp_10.42.42.5(pid=22779): stderr: | 20221210092234509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092234509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092234510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092234510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092234510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092234511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092234511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:36.263242 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22779): Process ended prematurely: osmo-stp_10.42.42.5(pid=22779) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:22:36.271904 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:22:36.298401 run osmo-hlr_10.42.42.2(pid=22776): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22776)] 09:22:36.345800 run osmo-hlr_10.42.42.2(pid=22776): stdout: | (launched: 2022-12-10_09:22:33.314969) 09:22:36.394686 run osmo-hlr_10.42.42.2(pid=22776): stderr: | 20221210092233515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092233515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092233515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092233516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092233516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092233516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092233528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092233536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092233536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092233536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:36.463033 run osmo-msc_10.42.42.6(pid=22782): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22782)] 09:22:36.510306 run osmo-msc_10.42.42.6(pid=22782): stdout: | (launched: 2022-12-10_09:22:35.344620) 09:22:36.559128 run osmo-msc_10.42.42.6(pid=22782): stderr: | 20221210092235667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092235667 DLGLOBAL DEBUG validating counter group 0x7f01a2786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092235667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092235667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092235667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092235668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092235669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092235670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092235670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092235670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:36.608350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Terminating (SIGTERM) 09:22:36.647539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Terminating (SIGTERM) 09:22:36.687123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22781): Terminating (SIGTERM) 09:22:36.726853 --- ParallelTerminationStrategy: PID 22775 died... 09:22:36.745733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22775): Terminated: ok {rc=0} 09:22:36.789579 --- ParallelTerminationStrategy: PID 22778 died... 09:22:36.807788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22778): Terminated: ok {rc=0} 09:22:36.851643 --- ParallelTerminationStrategy: PID 22781 died... 09:22:36.869923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22781): Terminated: ok {rc=0} 09:22:36.952234 bus /sierra_3: Setting Powered False 09:22:38.049840 bus /sierra_3: Setting Powered False 09:22:39.165075 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:22:40.311763 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.323714 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:22:40.384363 tst mo_mt_call_osmux.py: using LAC 27415 09:22:40.503617 tst mo_mt_call_osmux.py: using RAC 130 09:22:40.625076 tst mo_mt_call_osmux.py: using CellId 27415 09:22:40.745437 tst mo_mt_call_osmux.py: using BVCI 27416 09:22:40.864462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.876381 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.888291 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.900724 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.913142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:22:40.925399 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:22:41.043751 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:22:41.162876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:41.634689 run create_hlr_db(pid=22785): Launched 09:22:41.750225 bus /sierra_2: Setting Powered False 09:22:42.810744 run create_hlr_db(pid=22785): Terminated: ok {rc=0} 09:22:43.234375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Launched 09:22:43.537846 run osmo-hlr_10.42.42.2(pid=22788): Launched 09:22:43.653773 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:44.180448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Launched 09:22:44.484516 run osmo-stp_10.42.42.5(pid=22791): Launched 09:22:44.601434 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:45.159878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Launched 09:22:45.465269 run osmo-msc_10.42.42.6(pid=22794): Launched 09:22:45.637474 run osmo-stp_10.42.42.5(pid=22791): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] 09:22:45.767704 run osmo-stp_10.42.42.5(pid=22791): stdout: | (launched: 2022-12-10_09:22:44.428260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:45.923308 run osmo-stp_10.42.42.5(pid=22791): stderr: | 20221210092244601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092244601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092244601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092244602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092244602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092244602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092244602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:46.054325 run osmo-stp_10.42.42.5(pid=22791): stdout: | (launched: 2022-12-10_09:22:44.428260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:46.179412 run osmo-stp_10.42.42.5(pid=22791): stderr: | 20221210092244601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092244601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092244601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092244602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092244602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092244602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092244602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:46.328905 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22791): Process ended prematurely: osmo-stp_10.42.42.5(pid=22791) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:22:46.338905 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:22:46.367671 run osmo-hlr_10.42.42.2(pid=22788): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22788)] 09:22:46.417261 run osmo-hlr_10.42.42.2(pid=22788): stdout: | (launched: 2022-12-10_09:22:43.482244) 09:22:46.468544 run osmo-hlr_10.42.42.2(pid=22788): stderr: | 20221210092243657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092243657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092243657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092243657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092243658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092243658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092243669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092243678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092243678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092243678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:46.539602 run osmo-msc_10.42.42.6(pid=22794): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22794)] 09:22:46.589798 run osmo-msc_10.42.42.6(pid=22794): stdout: | (launched: 2022-12-10_09:22:45.409294) 09:22:46.641477 run osmo-msc_10.42.42.6(pid=22794): stderr: | 20221210092245680 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092245680 DLGLOBAL DEBUG validating counter group 0x7f10b2198c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092245680 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092245681 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092245681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092245681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092245683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092245683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092245683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092245683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:46.693607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminating (SIGTERM) 09:22:46.736198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Terminating (SIGTERM) 09:22:46.779757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Terminating (SIGTERM) 09:22:46.821869 --- ParallelTerminationStrategy: PID 22787 died... 09:22:46.841444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22787): Terminated: ok {rc=0} 09:22:46.888400 --- ParallelTerminationStrategy: PID 22790 died... 09:22:46.907837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22790): Terminated: ok {rc=0} 09:22:46.954845 --- ParallelTerminationStrategy: PID 22793 died... 09:22:46.974306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22793): Terminated: ok {rc=0} 09:22:47.061444 bus /sierra_3: Setting Powered False 09:22:48.158423 bus /sierra_3: Setting Powered False 09:22:49.274137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:22:50.513266 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:22:50.520324 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:22:50.545715 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:22:50.573362 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:22:50.623189 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:22:50.646596 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:22:50.674402 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:22:51.227766 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:22:51.277674 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.289042 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:22:51.347789 tst mo_mt_call.py: using LAC 27416 09:22:51.465989 tst mo_mt_call.py: using RAC 131 09:22:51.584683 tst mo_mt_call.py: using CellId 27416 09:22:51.702273 tst mo_mt_call.py: using BVCI 27417 09:22:51.813082 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.824181 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.835208 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.847298 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.859157 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:22:51.870920 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:22:51.987202 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:22:52.102657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:22:52.576830 run create_hlr_db(pid=22799): Launched 09:22:52.693125 bus /sierra_2: Setting Powered False 09:22:53.753484 run create_hlr_db(pid=22799): Terminated: ok {rc=0} 09:22:54.200253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Launched 09:22:54.526478 run osmo-hlr_10.42.42.2(pid=22802): Launched 09:22:54.649971 run osmo-stp_10.42.42.5: Starting osmo-stp 09:22:55.211577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Launched 09:22:55.538247 run osmo-stp_10.42.42.5(pid=22805): Launched 09:22:55.662117 run osmo-msc_10.42.42.6: Starting osmo-msc 09:22:56.250130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22807): Launched 09:22:56.577892 run osmo-msc_10.42.42.6(pid=22808): Launched 09:22:56.757096 run osmo-stp_10.42.42.5(pid=22805): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] 09:22:56.893654 run osmo-stp_10.42.42.5(pid=22805): stdout: | (launched: 2022-12-10_09:22:55.474893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:57.029439 run osmo-stp_10.42.42.5(pid=22805): stderr: | 20221210092255670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092255670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092255670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092255670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092255671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092255671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092255671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:57.164138 run osmo-stp_10.42.42.5(pid=22805): stdout: | (launched: 2022-12-10_09:22:55.474893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:22:57.292121 run osmo-stp_10.42.42.5(pid=22805): stderr: | 20221210092255670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092255670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092255670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092255670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092255671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092255671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092255671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:22:57.445727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22805): Process ended prematurely: osmo-stp_10.42.42.5(pid=22805) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:22:57.455029 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:22:57.483546 run osmo-hlr_10.42.42.2(pid=22802): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22802)] 09:22:57.533475 run osmo-hlr_10.42.42.2(pid=22802): stdout: | (launched: 2022-12-10_09:22:54.463784) 09:22:57.584721 run osmo-hlr_10.42.42.2(pid=22802): stderr: | 20221210092254666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092254666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092254666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092254666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092254666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092254666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092254679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092254687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092254687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092254687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:22:57.656611 run osmo-msc_10.42.42.6(pid=22808): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22808)] 09:22:57.706225 run osmo-msc_10.42.42.6(pid=22808): stdout: | (launched: 2022-12-10_09:22:56.513483) 09:22:57.757221 run osmo-msc_10.42.42.6(pid=22808): stderr: | 20221210092256839 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092256839 DLGLOBAL DEBUG validating counter group 0x7f992eb5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092256839 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092256839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092256840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092256840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092256842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092256842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092256842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092256842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:22:57.808742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Terminating (SIGTERM) 09:22:57.849958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Terminating (SIGTERM) 09:22:57.891200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22807): Terminating (SIGTERM) 09:22:57.933148 --- ParallelTerminationStrategy: PID 22801 died... 09:22:57.952728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22801): Terminated: ok {rc=0} 09:22:57.998615 --- ParallelTerminationStrategy: PID 22804 died... 09:22:58.018150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22804): Terminated: ok {rc=0} 09:22:58.063705 --- ParallelTerminationStrategy: PID 22807 died... 09:22:58.082993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22807): Terminated: ok {rc=0} 09:22:58.169047 bus /sierra_3: Setting Powered False 09:22:59.267195 bus /sierra_3: Setting Powered False 09:23:00.382844 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:23:01.535841 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:01.548522 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:23:01.611193 tst mo_mt_call_osmux.py: using LAC 27417 09:23:01.739984 tst mo_mt_call_osmux.py: using RAC 132 09:23:01.864341 tst mo_mt_call_osmux.py: using CellId 27417 09:23:01.993749 tst mo_mt_call_osmux.py: using BVCI 27418 09:23:02.152122 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:02.168104 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:02.185072 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:02.201722 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:02.214484 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:23:02.226673 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:23:02.351407 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:23:02.473962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:02.979729 run create_hlr_db(pid=22810): Launched 09:23:03.110076 bus /sierra_2: Setting Powered False 09:23:04.173180 run create_hlr_db(pid=22810): Terminated: ok {rc=0} 09:23:04.610041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Launched 09:23:04.918583 run osmo-hlr_10.42.42.2(pid=22813): Launched 09:23:05.035427 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:05.577348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Launched 09:23:05.885732 run osmo-stp_10.42.42.5(pid=22816): Launched 09:23:06.001748 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:06.556234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Launched 09:23:06.864898 run osmo-msc_10.42.42.6(pid=22819): Launched 09:23:07.036511 run osmo-stp_10.42.42.5(pid=22816): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] 09:23:07.166532 run osmo-stp_10.42.42.5(pid=22816): stdout: | (launched: 2022-12-10_09:23:05.826091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:07.295925 run osmo-stp_10.42.42.5(pid=22816): stderr: | 20221210092306000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092306000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092306000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092306001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092306003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092306003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092306003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:07.422826 run osmo-stp_10.42.42.5(pid=22816): stdout: | (launched: 2022-12-10_09:23:05.826091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:07.544247 run osmo-stp_10.42.42.5(pid=22816): stderr: | 20221210092306000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092306000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092306000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092306001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092306003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092306003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092306003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:07.688613 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22816): Process ended prematurely: osmo-stp_10.42.42.5(pid=22816) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:23:07.697632 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 09:23:07.724362 run osmo-hlr_10.42.42.2(pid=22813): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22813)] 09:23:07.772493 run osmo-hlr_10.42.42.2(pid=22813): stdout: | (launched: 2022-12-10_09:23:04.858438) 09:23:07.821793 run osmo-hlr_10.42.42.2(pid=22813): stderr: | 20221210092305039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092305039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092305039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092305039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092305039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092305039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092305056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092305067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092305067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092305067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:07.890711 run osmo-msc_10.42.42.6(pid=22819): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22819)] 09:23:07.938376 run osmo-msc_10.42.42.6(pid=22819): stdout: | (launched: 2022-12-10_09:23:06.804797) 09:23:07.987491 run osmo-msc_10.42.42.6(pid=22819): stderr: | 20221210092307081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092307082 DLGLOBAL DEBUG validating counter group 0x7f5bab036c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092307082 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092307082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092307082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092307082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092307084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092307084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092307084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092307084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:08.036883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Terminating (SIGTERM) 09:23:08.076165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Terminating (SIGTERM) 09:23:08.115502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Terminating (SIGTERM) 09:23:08.155016 --- ParallelTerminationStrategy: PID 22812 died... 09:23:08.173838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22812): Terminated: ok {rc=0} 09:23:08.217853 --- ParallelTerminationStrategy: PID 22815 died... 09:23:08.236133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22815): Terminated: ok {rc=0} 09:23:08.280414 --- ParallelTerminationStrategy: PID 22818 died... 09:23:08.298768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22818): Terminated: ok {rc=0} 09:23:08.383532 bus /sierra_3: Setting Powered False 09:23:09.482275 bus /sierra_3: Setting Powered False 09:23:10.597557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:23:11.840565 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:11.848461 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:23:11.873697 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:23:11.901289 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:23:11.954104 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:23:11.978795 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:23:12.006623 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:23:12.562912 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:23:12.614896 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:12.626866 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:23:12.688751 tst mo_mt_call.py: using LAC 27418 09:23:12.816245 tst mo_mt_call.py: using RAC 133 09:23:12.936650 tst mo_mt_call.py: using CellId 27418 09:23:13.065017 tst mo_mt_call.py: using BVCI 27419 09:23:13.182584 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:13.194544 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:13.206354 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:13.218301 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:13.230358 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:13.242284 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:13.357409 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:13.475404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:13.977250 run create_hlr_db(pid=22824): Launched 09:23:14.107492 bus /sierra_2: Setting Powered False 09:23:15.170812 run create_hlr_db(pid=22824): Terminated: ok {rc=0} 09:23:15.604824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22826): Launched 09:23:15.945717 run osmo-hlr_10.42.42.2(pid=22827): Launched 09:23:16.214136 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:17.027593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Launched 09:23:17.487504 run osmo-stp_10.42.42.5(pid=22880): Launched 09:23:17.770296 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:18.635272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22933): Launched 09:23:19.052815 run osmo-msc_10.42.42.6(pid=22979): Launched 09:23:19.484001 run osmo-stp_10.42.42.5(pid=22880): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] 09:23:19.799615 run osmo-stp_10.42.42.5(pid=22880): stdout: | (launched: 2022-12-10_09:23:17.414324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:20.019172 run osmo-stp_10.42.42.5(pid=22880): stderr: | 20221210092317757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092317757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092317758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092317759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092317759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092317759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092317759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:20.161304 run osmo-stp_10.42.42.5(pid=22880): stdout: | (launched: 2022-12-10_09:23:17.414324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:20.300663 run osmo-stp_10.42.42.5(pid=22880): stderr: | 20221210092317757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092317757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092317758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092317759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092317759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092317759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092317759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:20.459288 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22880): Process ended prematurely: osmo-stp_10.42.42.5(pid=22880) [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:23:20.470047 tst mo_mt_call.py:8: Test FAILED (7.9 sec) 09:23:20.499280 run osmo-hlr_10.42.42.2(pid=22827): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22827)] 09:23:20.552480 run osmo-hlr_10.42.42.2(pid=22827): stdout: | (launched: 2022-12-10_09:23:15.868650) 09:23:20.606082 run osmo-hlr_10.42.42.2(pid=22827): stderr: | 20221210092316226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092316226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092316226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092316226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092316226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092316226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092316246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092316260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092316260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092316262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:20.680720 run osmo-msc_10.42.42.6(pid=22979): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22979)] 09:23:20.733735 run osmo-msc_10.42.42.6(pid=22979): stdout: | (launched: 2022-12-10_09:23:18.976796) 09:23:20.787170 run osmo-msc_10.42.42.6(pid=22979): stderr: | 20221210092319573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092319577 DLGLOBAL DEBUG validating counter group 0x7f78daffac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092319577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092319577 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092319577 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092319578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092319579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092319580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092319580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092319580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:20.841428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22826): Terminating (SIGTERM) 09:23:20.885166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Terminating (SIGTERM) 09:23:20.931653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22933): Terminating (SIGTERM) 09:23:20.977949 --- ParallelTerminationStrategy: PID 22826 died... 09:23:20.998861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22826): Terminated: ok {rc=0} 09:23:21.048727 --- ParallelTerminationStrategy: PID 22866 died... 09:23:21.069169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22866): Terminated: ok {rc=0} 09:23:21.117281 --- ParallelTerminationStrategy: PID 22933 died... 09:23:21.137601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22933): Terminated: ok {rc=0} 09:23:21.227577 bus /sierra_3: Setting Powered False 09:23:22.331472 bus /sierra_3: Setting Powered False 09:23:23.449811 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:23:24.600549 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:24.613620 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:23:24.676884 tst mo_mt_call_osmux.py: using LAC 27419 09:23:24.801523 tst mo_mt_call_osmux.py: using RAC 134 09:23:24.927651 tst mo_mt_call_osmux.py: using CellId 27419 09:23:25.052539 tst mo_mt_call_osmux.py: using BVCI 27420 09:23:25.168603 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:25.180742 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:25.192867 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:25.206480 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:25.220661 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:23:25.233749 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:25.372303 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:23:25.491952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:25.990329 run create_hlr_db(pid=23107): Launched 09:23:26.150761 bus /sierra_2: Setting Powered False 09:23:27.212495 run create_hlr_db(pid=23107): Terminated: ok {rc=0} 09:23:27.659641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Launched 09:23:27.992941 run osmo-hlr_10.42.42.2(pid=23110): Launched 09:23:28.239020 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:28.977508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Launched 09:23:29.317719 run osmo-stp_10.42.42.5(pid=23113): Launched 09:23:29.562943 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:30.244247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23115): Launched 09:23:30.592071 run osmo-msc_10.42.42.6(pid=23116): Launched 09:23:30.959922 run osmo-stp_10.42.42.5(pid=23113): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] 09:23:31.236822 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-10_09:23:29.246949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:31.414765 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221210092329547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092329548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092329548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092329548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092329549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092329549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092329549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:31.553165 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-10_09:23:29.246949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:31.685216 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221210092329547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092329548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092329548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092329548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092329549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092329549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092329549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:31.843019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:23:31.853061 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 09:23:31.883548 run osmo-hlr_10.42.42.2(pid=23110): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23110)] 09:23:31.943091 run osmo-hlr_10.42.42.2(pid=23110): stdout: | (launched: 2022-12-10_09:23:27.929518) 09:23:31.996162 run osmo-hlr_10.42.42.2(pid=23110): stderr: | 20221210092328277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092328277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092328277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092328277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092328277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092328277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092328300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092328315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092328316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092328316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:32.070172 run osmo-msc_10.42.42.6(pid=23116): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23116)] 09:23:32.121781 run osmo-msc_10.42.42.6(pid=23116): stdout: | (launched: 2022-12-10_09:23:30.525873) 09:23:32.174646 run osmo-msc_10.42.42.6(pid=23116): stderr: | 20221210092331036 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092331036 DLGLOBAL DEBUG validating counter group 0x7f2b09054c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092331036 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092331037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092331037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092331037 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092331039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092331039 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092331039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092331039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:32.227785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminating (SIGTERM) 09:23:32.270346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminating (SIGTERM) 09:23:32.315102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23115): Terminating (SIGTERM) 09:23:32.360031 --- ParallelTerminationStrategy: PID 23109 died... 09:23:32.380417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminated: ok {rc=0} 09:23:32.428725 --- ParallelTerminationStrategy: PID 23112 died... 09:23:32.448698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminated: ok {rc=0} 09:23:32.495456 --- ParallelTerminationStrategy: PID 23115 died... 09:23:32.515595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23115): Terminated: ok {rc=0} 09:23:32.618050 bus /sierra_3: Setting Powered False 09:23:33.738371 bus /sierra_3: Setting Powered False 09:23:34.854604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:nanobts+band-1900 --------------------------------------------------------------------- 09:23:36.098953 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:23:36.104935 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:23:36.134394 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 09:23:36.163582 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:23:36.249289 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:23:36.274028 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 09:23:36.303877 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:23:36.887977 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 09:23:36.894613 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:36.906492 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:23:36.951562 tst emergency_mo_mt_call.py: using LAC 27420 09:23:37.073510 tst emergency_mo_mt_call.py: using RAC 135 09:23:37.199396 tst emergency_mo_mt_call.py: using CellId 27420 09:23:37.320725 tst emergency_mo_mt_call.py: using BVCI 27421 09:23:37.434497 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:37.446879 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:37.458789 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:37.471314 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:37.484401 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:37.496924 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:37.618555 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:37.740047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:38.232595 run create_hlr_db(pid=23121): Launched 09:23:38.394079 bus /sierra_2: Setting Powered False 09:23:39.454401 run create_hlr_db(pid=23121): Terminated: ok {rc=0} 09:23:39.905230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Launched 09:23:40.240193 run osmo-hlr_10.42.42.2(pid=23124): Launched 09:23:40.475146 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:41.089380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Launched 09:23:41.411690 run osmo-stp_10.42.42.5(pid=23127): Launched 09:23:41.542286 tst emergency_mo_mt_call.py: using MSISDN 7656 09:23:41.704464 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:42.279911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Launched 09:23:42.602010 run osmo-msc_10.42.42.6(pid=23130): Launched 09:23:42.778128 run osmo-stp_10.42.42.5(pid=23127): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] 09:23:42.911850 run osmo-stp_10.42.42.5(pid=23127): stdout: | (launched: 2022-12-10_09:23:41.348604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:43.046397 run osmo-stp_10.42.42.5(pid=23127): stderr: | 20221210092341545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092341545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092341545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092341545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092341548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092341548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092341548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:43.179872 run osmo-stp_10.42.42.5(pid=23127): stdout: | (launched: 2022-12-10_09:23:41.348604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:43.306391 run osmo-stp_10.42.42.5(pid=23127): stderr: | 20221210092341545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092341545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092341545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092341545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092341548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092341548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092341548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:43.457111 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23127): Process ended prematurely: osmo-stp_10.42.42.5(pid=23127) [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 09:23:43.466172 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 09:23:43.493190 run osmo-hlr_10.42.42.2(pid=23124): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23124)] 09:23:43.542957 run osmo-hlr_10.42.42.2(pid=23124): stdout: | (launched: 2022-12-10_09:23:40.172179) 09:23:43.594348 run osmo-hlr_10.42.42.2(pid=23124): stderr: | 20221210092340528 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092340528 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092340528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092340528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092340528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092340528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092340551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092340568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092340568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092340568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:43.666018 run osmo-msc_10.42.42.6(pid=23130): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23130)] 09:23:43.715735 run osmo-msc_10.42.42.6(pid=23130): stdout: | (launched: 2022-12-10_09:23:42.538369) 09:23:43.766834 run osmo-msc_10.42.42.6(pid=23130): stderr: | 20221210092342865 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092342865 DLGLOBAL DEBUG validating counter group 0x7fa27f0c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092342865 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092342866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092342866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092342866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092342868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092342868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092342868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092342868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:43.818211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Terminating (SIGTERM) 09:23:43.859623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Terminating (SIGTERM) 09:23:43.901109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Terminating (SIGTERM) 09:23:43.942911 --- ParallelTerminationStrategy: PID 23123 died... 09:23:43.962716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Terminated: ok {rc=0} 09:23:44.008503 --- ParallelTerminationStrategy: PID 23126 died... 09:23:44.027981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Terminated: ok {rc=0} 09:23:44.073715 --- ParallelTerminationStrategy: PID 23129 died... 09:23:44.093163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Terminated: ok {rc=0} 09:23:44.180450 bus /sierra_3: Setting Powered False 09:23:45.277918 bus /sierra_3: Setting Powered False 09:23:46.389645 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 09:23:47.475207 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:47.486882 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:23:47.527489 tst emergency_preemptive_call.py: using LAC 27421 09:23:47.650191 tst emergency_preemptive_call.py: using RAC 136 09:23:47.785487 tst emergency_preemptive_call.py: using CellId 27421 09:23:47.904103 tst emergency_preemptive_call.py: using BVCI 27422 09:23:48.012212 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:48.023185 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:48.033979 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:48.045268 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:48.056172 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 09:23:48.066956 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:48.185139 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:48.301940 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:48.420045 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:23:48.538152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:23:49.035041 run create_hlr_db(pid=23132): Launched 09:23:49.163752 bus /sierra_2: Setting Powered False 09:23:50.223811 run create_hlr_db(pid=23132): Terminated: ok {rc=0} 09:23:50.655329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Launched 09:23:50.958468 run osmo-hlr_10.42.42.2(pid=23135): Launched 09:23:51.072201 run osmo-stp_10.42.42.5: Starting osmo-stp 09:23:51.590866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Launched 09:23:51.892763 run osmo-stp_10.42.42.5(pid=23138): Launched 09:23:52.017135 tst emergency_preemptive_call.py: using MSISDN 7657 09:23:52.170336 run osmo-msc_10.42.42.6: Starting osmo-msc 09:23:52.712016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23140): Launched 09:23:53.015385 run osmo-msc_10.42.42.6(pid=23141): Launched 09:23:53.184253 run osmo-stp_10.42.42.5(pid=23138): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] 09:23:53.312905 run osmo-stp_10.42.42.5(pid=23138): stdout: | (launched: 2022-12-10_09:23:51.834075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:53.440933 run osmo-stp_10.42.42.5(pid=23138): stderr: | 20221210092352006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092352006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092352006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092352007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092352010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092352010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092352010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:53.566639 run osmo-stp_10.42.42.5(pid=23138): stdout: | (launched: 2022-12-10_09:23:51.834075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:23:53.685887 run osmo-stp_10.42.42.5(pid=23138): stderr: | 20221210092352006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092352006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092352006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092352007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092352010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092352010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092352010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:23:53.828670 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23138): Process ended prematurely: osmo-stp_10.42.42.5(pid=23138) [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 09:23:53.837224 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 09:23:53.863726 run osmo-hlr_10.42.42.2(pid=23135): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23135)] 09:23:53.912045 run osmo-hlr_10.42.42.2(pid=23135): stdout: | (launched: 2022-12-10_09:23:50.899102) 09:23:53.961572 run osmo-hlr_10.42.42.2(pid=23135): stderr: | 20221210092351078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092351078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092351078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092351079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092351079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092351079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092351091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092351100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092351100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092351100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:23:54.030390 run osmo-msc_10.42.42.6(pid=23141): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23141)] 09:23:54.077950 run osmo-msc_10.42.42.6(pid=23141): stdout: | (launched: 2022-12-10_09:23:52.956126) 09:23:54.127327 run osmo-msc_10.42.42.6(pid=23141): stderr: | 20221210092353232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092353232 DLGLOBAL DEBUG validating counter group 0x7f16f7e69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092353232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092353232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092353232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092353232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092353234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092353235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092353235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092353235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:23:54.177132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Terminating (SIGTERM) 09:23:54.216427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Terminating (SIGTERM) 09:23:54.256149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23140): Terminating (SIGTERM) 09:23:54.296019 --- ParallelTerminationStrategy: PID 23134 died... 09:23:54.315063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23134): Terminated: ok {rc=0} 09:23:54.359881 --- ParallelTerminationStrategy: PID 23137 died... 09:23:54.378634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23137): Terminated: ok {rc=0} 09:23:54.423113 --- ParallelTerminationStrategy: PID 23140 died... 09:23:54.441774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23140): Terminated: ok {rc=0} 09:23:54.524936 bus /sierra_9: Setting Powered False 09:23:55.623441 bus /sierra_9: Setting Powered False 09:23:56.740576 bus /sierra_8: Setting Powered False 09:23:57.840253 bus /sierra_8: Setting Powered False 09:23:58.954200 bus /sierra_3: Setting Powered False 09:24:00.048831 bus /sierra_3: Setting Powered False 09:24:01.159205 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900 --------------------------------------------------------------------- 09:24:02.432773 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:24:02.437970 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 09:24:02.461613 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 09:24:02.500007 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 09:24:02.584299 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 09:24:02.607787 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 09:24:02.646142 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 09:24:03.240189 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 09:24:03.289955 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.300563 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:03.340526 tst cs_paging_gprs_active.py: using LAC 27422 09:24:03.460720 tst cs_paging_gprs_active.py: using RAC 137 09:24:03.578237 tst cs_paging_gprs_active.py: using CellId 27422 09:24:03.697274 tst cs_paging_gprs_active.py: using BVCI 27423 09:24:03.807497 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.818265 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.828641 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.839377 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.850195 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.860752 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.871529 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.882227 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:03.892895 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:04.012322 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:04.129480 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:24:04.348476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:04.672694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23146): Launched 09:24:04.953693 run iperf3-srv_10.42.42.10(pid=23147): Launched 09:24:05.074675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:24:05.293113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:05.618644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Launched 09:24:05.899612 run iperf3-srv_10.42.42.10(pid=23149): Launched 09:24:06.020780 tst cs_paging_gprs_active.py:38: start network... 09:24:06.239005 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:06.741598 run create_hlr_db(pid=23150): Launched 09:24:06.873301 bus /sierra_2: Setting Powered False 09:24:07.937412 run create_hlr_db(pid=23150): Terminated: ok {rc=0} 09:24:08.371880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23152): Launched 09:24:08.678716 run osmo-hlr_10.42.42.2(pid=23153): Launched 09:24:08.795057 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:09.323913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23155): Launched 09:24:09.630533 run osmo-stp_10.42.42.5(pid=23156): Launched 09:24:09.747130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:10.274878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23158): Launched 09:24:10.391522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:10.649634 run patchelf(pid=23159): Launched 09:24:10.819333 run osmo-stp_10.42.42.5(pid=23156): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23156)] 09:24:10.948391 run osmo-stp_10.42.42.5(pid=23156): stdout: | (launched: 2022-12-10_09:24:09.574738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:11.079212 run osmo-stp_10.42.42.5(pid=23156): stderr: | 20221210092409746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092409747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092409747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092409747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092409748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092409748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092409748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:11.210307 run osmo-stp_10.42.42.5(pid=23156): stdout: | (launched: 2022-12-10_09:24:09.574738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:11.335674 run osmo-stp_10.42.42.5(pid=23156): stderr: | 20221210092409746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092409747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092409747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092409747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092409748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092409748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092409748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:11.484453 run patchelf(pid=23159): Terminating (SIGINT) 09:24:11.655809 run patchelf(pid=23159): Terminated: ok {rc=0} 09:24:11.779348 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23156): Process ended prematurely: osmo-stp_10.42.42.5(pid=23156) [trial-2372↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23156)] [trial-2372↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 09:24:11.788560 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 09:24:11.815792 run osmo-hlr_10.42.42.2(pid=23153): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23153)] 09:24:11.863245 run osmo-hlr_10.42.42.2(pid=23153): stdout: | (launched: 2022-12-10_09:24:08.622327) 09:24:11.912560 run osmo-hlr_10.42.42.2(pid=23153): stderr: | 20221210092408800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092408800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092408800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092408800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092408800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092408800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092408812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092408821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092408821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092408821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:11.961940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23146): Terminating (SIGTERM) 09:24:12.001589 run iperf3-srv_10.42.42.10(pid=23147): Terminating (SIGTERM) 09:24:12.040907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Terminating (SIGTERM) 09:24:12.080445 run iperf3-srv_10.42.42.10(pid=23149): Terminating (SIGTERM) 09:24:12.119737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23152): Terminating (SIGTERM) 09:24:12.159331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23155): Terminating (SIGTERM) 09:24:12.198680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23158): Terminating (SIGTERM) 09:24:12.238874 --- ParallelTerminationStrategy: PID 23146 died... 09:24:12.258207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23146): Terminated: ok {rc=0} 09:24:12.302119 --- ParallelTerminationStrategy: PID 23147 died... 09:24:12.320243 run iperf3-srv_10.42.42.10(pid=23147): Terminated {rc=256} 09:24:12.364311 --- ParallelTerminationStrategy: PID 23148 died... 09:24:12.382832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23148): Terminated: ok {rc=0} 09:24:12.426403 --- ParallelTerminationStrategy: PID 23149 died... 09:24:12.444758 run iperf3-srv_10.42.42.10(pid=23149): Terminated {rc=256} 09:24:12.488317 --- ParallelTerminationStrategy: PID 23152 died... 09:24:12.506795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23152): Terminated: ok {rc=0} 09:24:12.550380 --- ParallelTerminationStrategy: PID 23155 died... 09:24:12.568693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23155): Terminated: ok {rc=0} 09:24:12.612730 --- ParallelTerminationStrategy: PID 23158 died... 09:24:12.631227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23158): Terminated: ok {rc=0} 09:24:12.713558 bus /gobi_0: Setting Powered False 09:24:13.810348 bus /gobi_0: Setting Powered False 09:24:14.925564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 09:24:16.072131 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.086564 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:16.137291 tst iperf3.py: using LAC 27423 09:24:16.281709 tst iperf3.py: using RAC 138 09:24:16.405176 tst iperf3.py: using CellId 27423 09:24:16.534425 tst iperf3.py: using BVCI 27424 09:24:16.660807 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.672925 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.684854 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.697195 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.708941 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.721212 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.733640 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.746103 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:16.758422 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:16.883154 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:17.106935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:17.433532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23160): Launched 09:24:17.714844 run iperf3-srv_10.42.42.10(pid=23161): Launched 09:24:17.835109 tst iperf3.py:8: start network... 09:24:18.052169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:18.553085 run create_hlr_db(pid=23162): Launched 09:24:18.684338 bus /gobi_6: Setting Powered False 09:24:19.748552 run create_hlr_db(pid=23162): Terminated: ok {rc=0} 09:24:20.183056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Launched 09:24:20.488742 run osmo-hlr_10.42.42.2(pid=23165): Launched 09:24:20.606146 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:21.143932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Launched 09:24:21.447738 run osmo-stp_10.42.42.5(pid=23168): Launched 09:24:21.564634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:22.092156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23170): Launched 09:24:22.209431 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:22.468120 run patchelf(pid=23171): Launched 09:24:22.637475 run osmo-stp_10.42.42.5(pid=23168): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] 09:24:22.766044 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-10_09:24:21.392154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:22.896454 run osmo-stp_10.42.42.5(pid=23168): stderr: | 20221210092421563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092421563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092421563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092421564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092421564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092421564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092421564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:23.027207 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-10_09:24:21.392154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:23.152459 run osmo-stp_10.42.42.5(pid=23168): stderr: | 20221210092421563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092421563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092421563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092421564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092421564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092421564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092421564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:23.300660 run patchelf(pid=23171): Terminating (SIGINT) 09:24:23.471694 run patchelf(pid=23171): Terminated: ok {rc=0} 09:24:23.595939 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2372↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] [trial-2372↪gprs:nanobts+band-1900↪iperf3.py:8] 09:24:23.605349 tst iperf3.py:8: Test FAILED (7.6 sec) 09:24:23.632515 run osmo-hlr_10.42.42.2(pid=23165): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23165)] 09:24:23.679560 run osmo-hlr_10.42.42.2(pid=23165): stdout: | (launched: 2022-12-10_09:24:20.432591) 09:24:23.728515 run osmo-hlr_10.42.42.2(pid=23165): stderr: | 20221210092420612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092420612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092420612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092420612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092420612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092420612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092420624 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092420633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092420633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092420633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:23.777903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23160): Terminating (SIGTERM) 09:24:23.817505 run iperf3-srv_10.42.42.10(pid=23161): Terminating (SIGTERM) 09:24:23.856775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminating (SIGTERM) 09:24:23.896293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminating (SIGTERM) 09:24:23.935616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23170): Terminating (SIGTERM) 09:24:23.975316 --- ParallelTerminationStrategy: PID 23160 died... 09:24:23.994267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23160): Terminated: ok {rc=0} 09:24:24.038240 --- ParallelTerminationStrategy: PID 23161 died... 09:24:24.056560 run iperf3-srv_10.42.42.10(pid=23161): Terminated {rc=256} 09:24:24.100438 --- ParallelTerminationStrategy: PID 23164 died... 09:24:24.118904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminated: ok {rc=0} 09:24:24.162475 --- ParallelTerminationStrategy: PID 23167 died... 09:24:24.180880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminated: ok {rc=0} 09:24:24.224740 --- ParallelTerminationStrategy: PID 23170 died... 09:24:24.243173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23170): Terminated: ok {rc=0} 09:24:24.329344 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 09:24:25.476485 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:25.487691 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:25.527169 tst iperf3m4.py: using LAC 27424 09:24:25.648689 tst iperf3m4.py: using RAC 139 09:24:25.768378 tst iperf3m4.py: using CellId 27424 09:24:25.887309 tst iperf3m4.py: using BVCI 27425 09:24:25.997972 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.008492 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.019118 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.029988 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.040637 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.051343 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.062205 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.072840 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:26.083696 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:26.201846 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:26.323177 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:26.441943 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:26.557593 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:24:26.763229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:27.070405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Launched 09:24:27.335128 run iperf3-srv_10.42.42.10(pid=23173): Launched 09:24:27.449812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:24:27.654367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:27.960781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Launched 09:24:28.225594 run iperf3-srv_10.42.42.10(pid=23175): Launched 09:24:28.339507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:24:28.543626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:28.849502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Launched 09:24:29.114882 run iperf3-srv_10.42.42.10(pid=23177): Launched 09:24:29.229468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:24:29.433780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:24:29.740667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Launched 09:24:30.005699 run iperf3-srv_10.42.42.10(pid=23179): Launched 09:24:30.120081 tst iperf3m4.py:8: start network... 09:24:30.324803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:30.798391 run create_hlr_db(pid=23180): Launched 09:24:30.949181 bus /gobi_6: Setting Powered False 09:24:32.024864 run create_hlr_db(pid=23180): Terminated: ok {rc=0} 09:24:32.517784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Launched 09:24:32.825417 run osmo-hlr_10.42.42.2(pid=23183): Launched 09:24:32.942232 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:33.479245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Launched 09:24:33.784692 run osmo-stp_10.42.42.5(pid=23186): Launched 09:24:33.901115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:34.428101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Launched 09:24:34.545072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:34.803540 run patchelf(pid=23189): Launched 09:24:34.974926 run osmo-stp_10.42.42.5(pid=23186): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] 09:24:35.104497 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-10_09:24:33.728756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:35.235917 run osmo-stp_10.42.42.5(pid=23186): stderr: | 20221210092433899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092433900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092433900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092433900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092433901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092433901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092433901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:35.367149 run osmo-stp_10.42.42.5(pid=23186): stdout: | (launched: 2022-12-10_09:24:33.728756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:35.492553 run osmo-stp_10.42.42.5(pid=23186): stderr: | 20221210092433899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092433900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092433900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092433900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092433901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092433901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092433901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:35.641860 run patchelf(pid=23189): Terminating (SIGINT) 09:24:35.813778 run patchelf(pid=23189): Terminated: ok {rc=0} 09:24:35.937432 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2372↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] [trial-2372↪gprs:nanobts+band-1900↪iperf3m4.py:8] 09:24:35.946761 tst iperf3m4.py:8: Test FAILED (10.5 sec) 09:24:35.974247 run osmo-hlr_10.42.42.2(pid=23183): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23183)] 09:24:36.021672 run osmo-hlr_10.42.42.2(pid=23183): stdout: | (launched: 2022-12-10_09:24:32.768904) 09:24:36.070317 run osmo-hlr_10.42.42.2(pid=23183): stderr: | 20221210092432948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092432948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092432948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092432948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092432948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092432948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092432960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092432969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092432969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092432969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:36.119542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Terminating (SIGTERM) 09:24:36.158702 run iperf3-srv_10.42.42.10(pid=23173): Terminating (SIGTERM) 09:24:36.197670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Terminating (SIGTERM) 09:24:36.236763 run iperf3-srv_10.42.42.10(pid=23175): Terminating (SIGTERM) 09:24:36.275929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Terminating (SIGTERM) 09:24:36.315266 run iperf3-srv_10.42.42.10(pid=23177): Terminating (SIGTERM) 09:24:36.354253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Terminating (SIGTERM) 09:24:36.393265 run iperf3-srv_10.42.42.10(pid=23179): Terminating (SIGTERM) 09:24:36.432000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminating (SIGTERM) 09:24:36.470960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminating (SIGTERM) 09:24:36.509977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Terminating (SIGTERM) 09:24:36.549391 --- ParallelTerminationStrategy: PID 23172 died... 09:24:36.568305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Terminated: ok {rc=0} 09:24:36.612399 --- ParallelTerminationStrategy: PID 23173 died... 09:24:36.630821 run iperf3-srv_10.42.42.10(pid=23173): Terminated {rc=256} 09:24:36.674927 --- ParallelTerminationStrategy: PID 23174 died... 09:24:36.693355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23174): Terminated: ok {rc=0} 09:24:36.737324 --- ParallelTerminationStrategy: PID 23175 died... 09:24:36.755653 run iperf3-srv_10.42.42.10(pid=23175): Terminated {rc=256} 09:24:36.799698 --- ParallelTerminationStrategy: PID 23176 died... 09:24:36.818144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23176): Terminated: ok {rc=0} 09:24:36.861836 --- ParallelTerminationStrategy: PID 23177 died... 09:24:36.880141 run iperf3-srv_10.42.42.10(pid=23177): Terminated {rc=256} 09:24:36.923716 --- ParallelTerminationStrategy: PID 23178 died... 09:24:36.942161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23178): Terminated: ok {rc=0} 09:24:36.985745 --- ParallelTerminationStrategy: PID 23179 died... 09:24:37.004188 run iperf3-srv_10.42.42.10(pid=23179): Terminated {rc=256} 09:24:37.047982 --- ParallelTerminationStrategy: PID 23182 died... 09:24:37.066440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23182): Terminated: ok {rc=0} 09:24:37.110125 --- ParallelTerminationStrategy: PID 23185 died... 09:24:37.128638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23185): Terminated: ok {rc=0} 09:24:37.172190 --- ParallelTerminationStrategy: PID 23188 died... 09:24:37.190606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23188): Terminated: ok {rc=0} 09:24:37.275800 bus /gobi_4: Setting Powered False 09:24:38.375614 bus /gobi_4: Setting Powered False 09:24:39.488767 bus /gobi_1: Setting Powered False 09:24:40.587838 bus /gobi_1: Setting Powered False 09:24:41.702248 bus /gobi_0: Setting Powered False 09:24:42.802248 bus /gobi_0: Setting Powered False 09:24:43.917408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 09:24:45.018268 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.029922 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:45.073490 tst ping.py: using LAC 27425 09:24:45.196255 tst ping.py: using RAC 140 09:24:45.311599 tst ping.py: using CellId 27425 09:24:45.430936 tst ping.py: using BVCI 27426 09:24:45.541520 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.552108 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.562759 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.573622 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.584050 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.595018 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.605830 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:45.616626 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:45.735786 tst ping.py:19: start network... 09:24:45.969392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:46.475097 run create_hlr_db(pid=23190): Launched 09:24:46.623907 bus /gobi_6: Setting Powered False 09:24:47.686645 run create_hlr_db(pid=23190): Terminated: ok {rc=0} 09:24:48.114859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Launched 09:24:48.414744 run osmo-hlr_10.42.42.2(pid=23193): Launched 09:24:48.528559 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:49.057747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Launched 09:24:49.357114 run osmo-stp_10.42.42.5(pid=23196): Launched 09:24:49.471470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:49.989949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23198): Launched 09:24:50.104491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:50.358058 run patchelf(pid=23199): Launched 09:24:50.524754 run osmo-stp_10.42.42.5(pid=23196): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] 09:24:50.651729 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-10_09:24:49.302013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:50.780047 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221210092449473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092449473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092449474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092449474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092449475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092449475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092449475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:50.908520 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-10_09:24:49.302013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:51.031540 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221210092449473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092449473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092449474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092449474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092449475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092449475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092449475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:51.177277 run patchelf(pid=23199): Terminating (SIGINT) 09:24:51.346220 run patchelf(pid=23199): Terminated: ok {rc=0} 09:24:51.467784 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2372↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] [trial-2372↪gprs:nanobts+band-1900↪ping.py:22] 09:24:51.476565 tst ping.py:22: Test FAILED (6.5 sec) 09:24:51.503158 run osmo-hlr_10.42.42.2(pid=23193): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23193)] 09:24:51.550797 run osmo-hlr_10.42.42.2(pid=23193): stdout: | (launched: 2022-12-10_09:24:48.359344) 09:24:51.599477 run osmo-hlr_10.42.42.2(pid=23193): stderr: | 20221210092448537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092448537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092448537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092448538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092448538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092448538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092448548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092448557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092448557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092448557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:51.648503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Terminating (SIGTERM) 09:24:51.687833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminating (SIGTERM) 09:24:51.727202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23198): Terminating (SIGTERM) 09:24:51.767100 --- ParallelTerminationStrategy: PID 23192 died... 09:24:51.785838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23192): Terminated: ok {rc=0} 09:24:51.830394 --- ParallelTerminationStrategy: PID 23195 died... 09:24:51.848668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminated: ok {rc=0} 09:24:51.892547 --- ParallelTerminationStrategy: PID 23198 died... 09:24:51.910855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23198): Terminated: ok {rc=0} 09:24:51.995553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 09:24:53.083664 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.095445 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 09:24:53.135543 tst ping_idle_ping.py: using LAC 27426 09:24:53.254604 tst ping_idle_ping.py: using RAC 141 09:24:53.373438 tst ping_idle_ping.py: using CellId 27426 09:24:53.501605 tst ping_idle_ping.py: using BVCI 27427 09:24:53.620553 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.631762 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.642884 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.654484 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.666013 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.677579 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.689206 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 09:24:53.700784 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 09:24:53.819251 tst ping_idle_ping.py:24: start network... 09:24:54.021253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:24:54.489041 run create_hlr_db(pid=23200): Launched 09:24:54.604532 bus /gobi_6: Setting Powered False 09:24:55.665084 run create_hlr_db(pid=23200): Terminated: ok {rc=0} 09:24:56.085383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23202): Launched 09:24:56.386433 run osmo-hlr_10.42.42.2(pid=23203): Launched 09:24:56.500619 run osmo-stp_10.42.42.5: Starting osmo-stp 09:24:57.031714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23205): Launched 09:24:57.331843 run osmo-stp_10.42.42.5(pid=23206): Launched 09:24:57.446315 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:24:57.966065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23208): Launched 09:24:58.080625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:24:58.335413 run patchelf(pid=23209): Launched 09:24:58.503144 run osmo-stp_10.42.42.5(pid=23206): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23206)] 09:24:58.630721 run osmo-stp_10.42.42.5(pid=23206): stdout: | (launched: 2022-12-10_09:24:57.276368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:58.759828 run osmo-stp_10.42.42.5(pid=23206): stderr: | 20221210092457448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092457448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092457448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092457449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092457451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092457451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092457451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:58.889068 run osmo-stp_10.42.42.5(pid=23206): stdout: | (launched: 2022-12-10_09:24:57.276368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:24:59.013147 run osmo-stp_10.42.42.5(pid=23206): stderr: | 20221210092457448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092457448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092457448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092457449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092457451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092457451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092457451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:24:59.159348 run patchelf(pid=23209): Terminating (SIGINT) 09:24:59.328419 run patchelf(pid=23209): Terminated: ok {rc=0} 09:24:59.450905 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23206): Process ended prematurely: osmo-stp_10.42.42.5(pid=23206) [trial-2372↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23206)] [trial-2372↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 09:24:59.459720 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:24:59.486788 run osmo-hlr_10.42.42.2(pid=23203): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23203)] 09:24:59.534205 run osmo-hlr_10.42.42.2(pid=23203): stdout: | (launched: 2022-12-10_09:24:56.330827) 09:24:59.583212 run osmo-hlr_10.42.42.2(pid=23203): stderr: | 20221210092456505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092456505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092456505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092456505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092456505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092456505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092456518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092456527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092456527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092456527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:24:59.632569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23202): Terminating (SIGTERM) 09:24:59.672118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23205): Terminating (SIGTERM) 09:24:59.711636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23208): Terminating (SIGTERM) 09:24:59.751569 --- ParallelTerminationStrategy: PID 23202 died... 09:24:59.770454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23202): Terminated: ok {rc=0} 09:24:59.814158 --- ParallelTerminationStrategy: PID 23205 died... 09:24:59.832573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23205): Terminated: ok {rc=0} 09:24:59.877113 --- ParallelTerminationStrategy: PID 23208 died... 09:24:59.895562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23208): Terminated: ok {rc=0} 09:24:59.980361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 09:25:01.317801 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:25:01.326807 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:25:01.353087 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:25:01.393880 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:25:01.488240 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:25:01.519405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:25:01.567012 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:25:02.154492 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:25:02.217875 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.229913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:25:02.271156 tst cs_paging_gprs_active.py: using LAC 27427 09:25:02.398957 tst cs_paging_gprs_active.py: using RAC 142 09:25:02.524663 tst cs_paging_gprs_active.py: using CellId 27427 09:25:02.650320 tst cs_paging_gprs_active.py: using BVCI 27428 09:25:02.768235 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.779685 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.790894 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.802575 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.814155 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.825813 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.837654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.849253 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:02.860934 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:02.981475 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:03.101406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:25:03.320273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:03.650638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23216): Launched 09:25:03.936572 run iperf3-srv_10.42.42.10(pid=23217): Launched 09:25:04.057382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:25:04.274995 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:04.604279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Launched 09:25:04.889543 run iperf3-srv_10.42.42.10(pid=23219): Launched 09:25:05.012007 tst cs_paging_gprs_active.py:38: start network... 09:25:05.230163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:05.736148 run create_hlr_db(pid=23220): Launched 09:25:05.867427 bus /gobi_6: Setting Powered False 09:25:06.931396 run create_hlr_db(pid=23220): Terminated: ok {rc=0} 09:25:07.369101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Launched 09:25:07.678025 run osmo-hlr_10.42.42.2(pid=23223): Launched 09:25:07.794600 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:08.327648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Launched 09:25:08.636371 run osmo-stp_10.42.42.5(pid=23226): Launched 09:25:08.753378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:09.285020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Launched 09:25:09.401664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:09.664582 run patchelf(pid=23229): Launched 09:25:09.834478 run osmo-stp_10.42.42.5(pid=23226): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] 09:25:09.964657 run osmo-stp_10.42.42.5(pid=23226): stdout: | (launched: 2022-12-10_09:25:08.576425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:10.095830 run osmo-stp_10.42.42.5(pid=23226): stderr: | 20221210092508753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092508753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092508753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092508754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092508754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092508754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092508754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:10.226967 run osmo-stp_10.42.42.5(pid=23226): stdout: | (launched: 2022-12-10_09:25:08.576425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:10.352299 run osmo-stp_10.42.42.5(pid=23226): stderr: | 20221210092508753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092508753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092508753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092508754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092508754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092508754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092508754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:10.501183 run patchelf(pid=23229): Terminating (SIGINT) 09:25:10.672639 run patchelf(pid=23229): Terminated: ok {rc=0} 09:25:10.796435 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23226): Process ended prematurely: osmo-stp_10.42.42.5(pid=23226) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:25:10.805879 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:25:10.832938 run osmo-hlr_10.42.42.2(pid=23223): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23223)] 09:25:10.880596 run osmo-hlr_10.42.42.2(pid=23223): stdout: | (launched: 2022-12-10_09:25:07.618593) 09:25:10.929426 run osmo-hlr_10.42.42.2(pid=23223): stderr: | 20221210092507800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092507800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092507800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092507800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092507800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092507801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092507812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092507821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092507821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092507821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:10.978742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23216): Terminating (SIGTERM) 09:25:11.017986 run iperf3-srv_10.42.42.10(pid=23217): Terminating (SIGTERM) 09:25:11.058629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Terminating (SIGTERM) 09:25:11.098380 run iperf3-srv_10.42.42.10(pid=23219): Terminating (SIGTERM) 09:25:11.137445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminating (SIGTERM) 09:25:11.176937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminating (SIGTERM) 09:25:11.216107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Terminating (SIGTERM) 09:25:11.255486 --- ParallelTerminationStrategy: PID 23216 died... 09:25:11.274216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23216): Terminated: ok {rc=0} 09:25:11.317954 --- ParallelTerminationStrategy: PID 23217 died... 09:25:11.336181 run iperf3-srv_10.42.42.10(pid=23217): Terminated {rc=256} 09:25:11.380135 --- ParallelTerminationStrategy: PID 23218 died... 09:25:11.398460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23218): Terminated: ok {rc=0} 09:25:11.441860 --- ParallelTerminationStrategy: PID 23219 died... 09:25:11.460003 run iperf3-srv_10.42.42.10(pid=23219): Terminated {rc=256} 09:25:11.503257 --- ParallelTerminationStrategy: PID 23222 died... 09:25:11.521490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23222): Terminated: ok {rc=0} 09:25:11.564800 --- ParallelTerminationStrategy: PID 23225 died... 09:25:11.583551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23225): Terminated: ok {rc=0} 09:25:11.627017 --- ParallelTerminationStrategy: PID 23228 died... 09:25:11.645379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23228): Terminated: ok {rc=0} 09:25:11.729784 bus /gobi_0: Setting Powered False 09:25:12.827966 bus /gobi_0: Setting Powered False 09:25:13.942372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:25:15.086419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.098010 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:25:15.143657 tst iperf3.py: using LAC 27428 09:25:15.263151 tst iperf3.py: using RAC 143 09:25:15.381679 tst iperf3.py: using CellId 27428 09:25:15.501265 tst iperf3.py: using BVCI 27429 09:25:15.611887 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.622847 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.633664 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.644585 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.655427 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.666302 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.677336 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.688314 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:15.699428 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:15.814603 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:25:16.030616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:16.360136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23230): Launched 09:25:16.644578 run iperf3-srv_10.42.42.10(pid=23231): Launched 09:25:16.776121 tst iperf3.py:8: start network... 09:25:16.986095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:17.469981 run create_hlr_db(pid=23232): Launched 09:25:17.586030 bus /gobi_6: Setting Powered False 09:25:18.646492 run create_hlr_db(pid=23232): Terminated: ok {rc=0} 09:25:19.074056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Launched 09:25:19.382398 run osmo-hlr_10.42.42.2(pid=23235): Launched 09:25:19.499091 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:20.031942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Launched 09:25:20.340878 run osmo-stp_10.42.42.5(pid=23238): Launched 09:25:20.458129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:20.989071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23240): Launched 09:25:21.105647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:21.368913 run patchelf(pid=23241): Launched 09:25:21.538903 run osmo-stp_10.42.42.5(pid=23238): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] 09:25:21.668251 run osmo-stp_10.42.42.5(pid=23238): stdout: | (launched: 2022-12-10_09:25:20.281062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:21.799297 run osmo-stp_10.42.42.5(pid=23238): stderr: | 20221210092520457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092520457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092520457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092520458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092520458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092520458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092520458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:21.930865 run osmo-stp_10.42.42.5(pid=23238): stdout: | (launched: 2022-12-10_09:25:20.281062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:22.056834 run osmo-stp_10.42.42.5(pid=23238): stderr: | 20221210092520457 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092520457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092520457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092520458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092520458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092520458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092520458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:22.205927 run patchelf(pid=23241): Terminating (SIGINT) 09:25:22.377520 run patchelf(pid=23241): Terminated: ok {rc=0} 09:25:22.501097 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23238): Process ended prematurely: osmo-stp_10.42.42.5(pid=23238) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 09:25:22.510472 tst iperf3.py:8: Test FAILED (7.5 sec) 09:25:22.537914 run osmo-hlr_10.42.42.2(pid=23235): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23235)] 09:25:22.585508 run osmo-hlr_10.42.42.2(pid=23235): stdout: | (launched: 2022-12-10_09:25:19.322537) 09:25:22.634568 run osmo-hlr_10.42.42.2(pid=23235): stderr: | 20221210092519502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092519502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092519502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092519502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092519502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092519502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092519514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092519524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092519524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092519524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:22.684291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23230): Terminating (SIGTERM) 09:25:22.723836 run iperf3-srv_10.42.42.10(pid=23231): Terminating (SIGTERM) 09:25:22.763191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Terminating (SIGTERM) 09:25:22.802505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Terminating (SIGTERM) 09:25:22.841798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23240): Terminating (SIGTERM) 09:25:22.881782 --- ParallelTerminationStrategy: PID 23230 died... 09:25:22.900679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23230): Terminated: ok {rc=0} 09:25:22.944707 --- ParallelTerminationStrategy: PID 23231 died... 09:25:22.963129 run iperf3-srv_10.42.42.10(pid=23231): Terminated {rc=256} 09:25:23.006756 --- ParallelTerminationStrategy: PID 23234 died... 09:25:23.025063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23234): Terminated: ok {rc=0} 09:25:23.069039 --- ParallelTerminationStrategy: PID 23237 died... 09:25:23.087424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23237): Terminated: ok {rc=0} 09:25:23.130936 --- ParallelTerminationStrategy: PID 23240 died... 09:25:23.149225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23240): Terminated: ok {rc=0} 09:25:23.231961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:25:24.373916 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.385411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:25:24.426505 tst iperf3m4.py: using LAC 27429 09:25:24.546645 tst iperf3m4.py: using RAC 144 09:25:24.673308 tst iperf3m4.py: using CellId 27429 09:25:24.800730 tst iperf3m4.py: using BVCI 27430 09:25:24.919022 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.930607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.941887 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.953195 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.964271 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.975610 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.987078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:24.998320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:25.009781 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:25.129336 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:25.247494 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:25.366804 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:25.496435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:25:25.702779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:26.013357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23242): Launched 09:25:26.285755 run iperf3-srv_10.42.42.10(pid=23243): Launched 09:25:26.401220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:25:26.607456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:26.920089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23244): Launched 09:25:27.206643 run iperf3-srv_10.42.42.10(pid=23245): Launched 09:25:27.327794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:25:27.547031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:27.876428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23246): Launched 09:25:28.163422 run iperf3-srv_10.42.42.10(pid=23247): Launched 09:25:28.285008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:25:28.504483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:25:28.834862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23248): Launched 09:25:29.121506 run iperf3-srv_10.42.42.10(pid=23249): Launched 09:25:29.242917 tst iperf3m4.py:8: start network... 09:25:29.462400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:29.972737 run create_hlr_db(pid=23250): Launched 09:25:30.104433 bus /gobi_6: Setting Powered False 09:25:31.194129 run create_hlr_db(pid=23250): Terminated: ok {rc=0} 09:25:31.689747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Launched 09:25:32.021394 run osmo-hlr_10.42.42.2(pid=23253): Launched 09:25:32.181735 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:32.743080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23255): Launched 09:25:33.052706 run osmo-stp_10.42.42.5(pid=23256): Launched 09:25:33.169686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:33.703653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23258): Launched 09:25:33.821351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:34.085110 run patchelf(pid=23259): Launched 09:25:34.255851 run osmo-stp_10.42.42.5(pid=23256): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23256)] 09:25:34.385209 run osmo-stp_10.42.42.5(pid=23256): stdout: | (launched: 2022-12-10_09:25:32.992824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:34.515789 run osmo-stp_10.42.42.5(pid=23256): stderr: | 20221210092533167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092533167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092533168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092533168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092533170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092533171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092533171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:34.646865 run osmo-stp_10.42.42.5(pid=23256): stdout: | (launched: 2022-12-10_09:25:32.992824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:34.772454 run osmo-stp_10.42.42.5(pid=23256): stderr: | 20221210092533167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092533167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092533168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092533168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092533170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092533171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092533171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:34.920879 run patchelf(pid=23259): Terminating (SIGINT) 09:25:35.092704 run patchelf(pid=23259): Terminated: ok {rc=0} 09:25:35.216808 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23256): Process ended prematurely: osmo-stp_10.42.42.5(pid=23256) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23256)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 09:25:35.226265 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:25:35.253803 run osmo-hlr_10.42.42.2(pid=23253): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23253)] 09:25:35.301440 run osmo-hlr_10.42.42.2(pid=23253): stdout: | (launched: 2022-12-10_09:25:31.953263) 09:25:35.350435 run osmo-hlr_10.42.42.2(pid=23253): stderr: | 20221210092532334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092532334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092532334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092532335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092532335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092532335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092532347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092532355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092532355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092532355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:35.399923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23242): Terminating (SIGTERM) 09:25:35.439138 run iperf3-srv_10.42.42.10(pid=23243): Terminating (SIGTERM) 09:25:35.478215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23244): Terminating (SIGTERM) 09:25:35.517464 run iperf3-srv_10.42.42.10(pid=23245): Terminating (SIGTERM) 09:25:35.556510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23246): Terminating (SIGTERM) 09:25:35.595797 run iperf3-srv_10.42.42.10(pid=23247): Terminating (SIGTERM) 09:25:35.635133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23248): Terminating (SIGTERM) 09:25:35.674545 run iperf3-srv_10.42.42.10(pid=23249): Terminating (SIGTERM) 09:25:35.713918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Terminating (SIGTERM) 09:25:35.753261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23255): Terminating (SIGTERM) 09:25:35.792581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23258): Terminating (SIGTERM) 09:25:35.832544 --- ParallelTerminationStrategy: PID 23242 died... 09:25:35.851560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23242): Terminated: ok {rc=0} 09:25:35.895619 --- ParallelTerminationStrategy: PID 23243 died... 09:25:35.913874 run iperf3-srv_10.42.42.10(pid=23243): Terminated {rc=256} 09:25:35.957263 --- ParallelTerminationStrategy: PID 23244 died... 09:25:35.975610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23244): Terminated: ok {rc=0} 09:25:36.019027 --- ParallelTerminationStrategy: PID 23245 died... 09:25:36.037270 run iperf3-srv_10.42.42.10(pid=23245): Terminated {rc=256} 09:25:36.081211 --- ParallelTerminationStrategy: PID 23246 died... 09:25:36.099497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23246): Terminated: ok {rc=0} 09:25:36.143447 --- ParallelTerminationStrategy: PID 23247 died... 09:25:36.161680 run iperf3-srv_10.42.42.10(pid=23247): Terminated {rc=256} 09:25:36.205112 --- ParallelTerminationStrategy: PID 23248 died... 09:25:36.223429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23248): Terminated: ok {rc=0} 09:25:36.266871 --- ParallelTerminationStrategy: PID 23249 died... 09:25:36.285095 run iperf3-srv_10.42.42.10(pid=23249): Terminated {rc=256} 09:25:36.328894 --- ParallelTerminationStrategy: PID 23252 died... 09:25:36.347561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23252): Terminated: ok {rc=0} 09:25:36.391118 --- ParallelTerminationStrategy: PID 23255 died... 09:25:36.409449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23255): Terminated: ok {rc=0} 09:25:36.452929 --- ParallelTerminationStrategy: PID 23258 died... 09:25:36.471319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23258): Terminated: ok {rc=0} 09:25:36.553402 bus /gobi_4: Setting Powered False 09:25:37.651062 bus /gobi_4: Setting Powered False 09:25:38.766003 bus /gobi_1: Setting Powered False 09:25:39.864111 bus /gobi_1: Setting Powered False 09:25:40.981784 bus /gobi_0: Setting Powered False 09:25:42.079408 bus /gobi_0: Setting Powered False 09:25:43.194870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 09:25:44.294207 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.305937 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:25:44.347128 tst ping.py: using LAC 27430 09:25:44.466864 tst ping.py: using RAC 145 09:25:44.584453 tst ping.py: using CellId 27430 09:25:44.701363 tst ping.py: using BVCI 27431 09:25:44.810504 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.821469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.832301 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.843315 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.854444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.865482 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.876733 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:44.887777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:45.005644 tst ping.py:19: start network... 09:25:45.219997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:45.716350 run create_hlr_db(pid=23262): Launched 09:25:45.848794 bus /gobi_6: Setting Powered False 09:25:46.916319 run create_hlr_db(pid=23262): Terminated: ok {rc=0} 09:25:47.373804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Launched 09:25:47.698242 run osmo-hlr_10.42.42.2(pid=23265): Launched 09:25:47.821156 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:48.380859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Launched 09:25:48.701512 run osmo-stp_10.42.42.5(pid=23268): Launched 09:25:48.822357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:49.383675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23270): Launched 09:25:49.499137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:49.756715 run patchelf(pid=23271): Launched 09:25:49.923761 run osmo-stp_10.42.42.5(pid=23268): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] 09:25:50.050599 run osmo-stp_10.42.42.5(pid=23268): stdout: | (launched: 2022-12-10_09:25:48.639719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:50.178746 run osmo-stp_10.42.42.5(pid=23268): stderr: | 20221210092548836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092548836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092548836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092548837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092548837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092548837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092548837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:50.307426 run osmo-stp_10.42.42.5(pid=23268): stdout: | (launched: 2022-12-10_09:25:48.639719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:50.430550 run osmo-stp_10.42.42.5(pid=23268): stderr: | 20221210092548836 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092548836 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092548836 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092548837 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092548837 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092548837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092548837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:50.575814 run patchelf(pid=23271): Terminating (SIGINT) 09:25:50.743844 run patchelf(pid=23271): Terminated: ok {rc=0} 09:25:50.865305 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23268): Process ended prematurely: osmo-stp_10.42.42.5(pid=23268) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 09:25:50.874066 tst ping.py:22: Test FAILED (6.6 sec) 09:25:50.900856 run osmo-hlr_10.42.42.2(pid=23265): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23265)] 09:25:50.948601 run osmo-hlr_10.42.42.2(pid=23265): stdout: | (launched: 2022-12-10_09:25:47.634826) 09:25:50.997604 run osmo-hlr_10.42.42.2(pid=23265): stderr: | 20221210092547836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092547836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092547836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092547836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092547836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092547837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092547848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092547857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092547857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092547857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:51.047353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Terminating (SIGTERM) 09:25:51.086739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Terminating (SIGTERM) 09:25:51.126180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23270): Terminating (SIGTERM) 09:25:51.165876 --- ParallelTerminationStrategy: PID 23264 died... 09:25:51.184393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23264): Terminated: ok {rc=0} 09:25:51.228515 --- ParallelTerminationStrategy: PID 23267 died... 09:25:51.246960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23267): Terminated: ok {rc=0} 09:25:51.290675 --- ParallelTerminationStrategy: PID 23270 died... 09:25:51.309182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23270): Terminated: ok {rc=0} 09:25:51.395173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:25:52.484439 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:52.496395 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:25:52.539165 tst ping_idle_ping.py: using LAC 27431 09:25:52.668682 tst ping_idle_ping.py: using RAC 146 09:25:52.795543 tst ping_idle_ping.py: using CellId 27431 09:25:52.920493 tst ping_idle_ping.py: using BVCI 27432 09:25:53.036462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.048243 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.059593 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.070924 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.082163 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.093430 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.105088 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:25:53.116402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:25:53.231039 tst ping_idle_ping.py:24: start network... 09:25:53.432445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:25:53.909517 run create_hlr_db(pid=23272): Launched 09:25:54.025836 bus /gobi_6: Setting Powered False 09:25:55.086369 run create_hlr_db(pid=23272): Terminated: ok {rc=0} 09:25:55.531694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Launched 09:25:55.856188 run osmo-hlr_10.42.42.2(pid=23275): Launched 09:25:55.978516 run osmo-stp_10.42.42.5: Starting osmo-stp 09:25:56.538550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Launched 09:25:56.863383 run osmo-stp_10.42.42.5(pid=23278): Launched 09:25:56.983852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:25:57.540853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Launched 09:25:57.662250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:25:57.937609 run patchelf(pid=23281): Launched 09:25:58.115075 run osmo-stp_10.42.42.5(pid=23278): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] 09:25:58.250915 run osmo-stp_10.42.42.5(pid=23278): stdout: | (launched: 2022-12-10_09:25:56.799931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:58.388611 run osmo-stp_10.42.42.5(pid=23278): stderr: | 20221210092556997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092556997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092556997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092556997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092557000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092557000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092557000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:58.525586 run osmo-stp_10.42.42.5(pid=23278): stdout: | (launched: 2022-12-10_09:25:56.799931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:25:58.657208 run osmo-stp_10.42.42.5(pid=23278): stderr: | 20221210092556997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092556997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092556997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092556997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092557000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092557000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092557000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:25:58.812643 run patchelf(pid=23281): Terminating (SIGINT) 09:25:58.992038 run patchelf(pid=23281): Terminated: ok {rc=0} 09:25:59.121349 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23278): Process ended prematurely: osmo-stp_10.42.42.5(pid=23278) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:25:59.130587 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:25:59.158381 run osmo-hlr_10.42.42.2(pid=23275): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23275)] 09:25:59.207621 run osmo-hlr_10.42.42.2(pid=23275): stdout: | (launched: 2022-12-10_09:25:55.793090) 09:25:59.258894 run osmo-hlr_10.42.42.2(pid=23275): stderr: | 20221210092555995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092555995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092555995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092555995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092555995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092555995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092556007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092556015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092556016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092556016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:25:59.310365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Terminating (SIGTERM) 09:25:59.351319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Terminating (SIGTERM) 09:25:59.392730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Terminating (SIGTERM) 09:25:59.434635 --- ParallelTerminationStrategy: PID 23274 died... 09:25:59.454523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Terminated: ok {rc=0} 09:25:59.500029 --- ParallelTerminationStrategy: PID 23277 died... 09:25:59.519332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Terminated: ok {rc=0} 09:25:59.564579 --- ParallelTerminationStrategy: PID 23280 died... 09:25:59.583868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Terminated: ok {rc=0} 09:25:59.670605 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:26:00.995221 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:26:01.007711 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:26:01.035082 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:26:01.084825 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:26:01.182439 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:26:01.214295 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:26:01.262915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:26:01.881145 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:26:01.935486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:01.947898 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:26:02.010402 tst cs_paging_gprs_active.py: using LAC 27432 09:26:02.166074 tst cs_paging_gprs_active.py: using RAC 147 09:26:02.307501 tst cs_paging_gprs_active.py: using CellId 27432 09:26:02.430634 tst cs_paging_gprs_active.py: using BVCI 27433 09:26:02.544395 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.555408 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.566486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.578101 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.589869 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.601523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.613267 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.624657 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:02.636426 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:02.756834 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:02.874968 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:26:03.081685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:03.388579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Launched 09:26:03.654958 run iperf3-srv_10.42.42.10(pid=23286): Launched 09:26:03.770285 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:26:03.975602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:04.281447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Launched 09:26:04.546673 run iperf3-srv_10.42.42.10(pid=23288): Launched 09:26:04.660918 tst cs_paging_gprs_active.py:38: start network... 09:26:04.865616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:05.339089 run create_hlr_db(pid=23289): Launched 09:26:05.456235 bus /gobi_6: Setting Powered False 09:26:06.517306 run create_hlr_db(pid=23289): Terminated: ok {rc=0} 09:26:06.961695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23291): Launched 09:26:07.286186 run osmo-hlr_10.42.42.2(pid=23292): Launched 09:26:07.410935 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:07.969607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23294): Launched 09:26:08.293683 run osmo-stp_10.42.42.5(pid=23295): Launched 09:26:08.418385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:08.978181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23297): Launched 09:26:09.101976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:09.376781 run patchelf(pid=23298): Launched 09:26:09.557737 run osmo-stp_10.42.42.5(pid=23295): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23295)] 09:26:09.695018 run osmo-stp_10.42.42.5(pid=23295): stdout: | (launched: 2022-12-10_09:26:08.234780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:09.834113 run osmo-stp_10.42.42.5(pid=23295): stderr: | 20221210092608428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092608428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092608429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092608429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092608429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092608430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092608430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:09.972681 run osmo-stp_10.42.42.5(pid=23295): stdout: | (launched: 2022-12-10_09:26:08.234780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:10.106073 run osmo-stp_10.42.42.5(pid=23295): stderr: | 20221210092608428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092608428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092608429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092608429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092608429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092608430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092608430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:10.263553 run patchelf(pid=23298): Terminating (SIGINT) 09:26:10.446367 run patchelf(pid=23298): Terminated: ok {rc=0} 09:26:10.577400 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23295): Process ended prematurely: osmo-stp_10.42.42.5(pid=23295) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23295)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:26:10.587765 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:26:10.616172 run osmo-hlr_10.42.42.2(pid=23292): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23292)] 09:26:10.665883 run osmo-hlr_10.42.42.2(pid=23292): stdout: | (launched: 2022-12-10_09:26:07.227081) 09:26:10.717297 run osmo-hlr_10.42.42.2(pid=23292): stderr: | 20221210092607427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092607427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092607427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092607427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092607427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092607427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092607440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092607448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092607448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092607448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:10.768919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminating (SIGTERM) 09:26:10.810578 run iperf3-srv_10.42.42.10(pid=23286): Terminating (SIGTERM) 09:26:10.852005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminating (SIGTERM) 09:26:10.893723 run iperf3-srv_10.42.42.10(pid=23288): Terminating (SIGTERM) 09:26:10.935273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23291): Terminating (SIGTERM) 09:26:10.976728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23294): Terminating (SIGTERM) 09:26:11.018385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23297): Terminating (SIGTERM) 09:26:11.060165 --- ParallelTerminationStrategy: PID 23285 died... 09:26:11.080169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminated: ok {rc=0} 09:26:11.126471 --- ParallelTerminationStrategy: PID 23286 died... 09:26:11.145966 run iperf3-srv_10.42.42.10(pid=23286): Terminated {rc=256} 09:26:11.191417 --- ParallelTerminationStrategy: PID 23287 died... 09:26:11.210827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminated: ok {rc=0} 09:26:11.256506 --- ParallelTerminationStrategy: PID 23288 died... 09:26:11.276013 run iperf3-srv_10.42.42.10(pid=23288): Terminated {rc=256} 09:26:11.322249 --- ParallelTerminationStrategy: PID 23291 died... 09:26:11.341731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23291): Terminated: ok {rc=0} 09:26:11.387280 --- ParallelTerminationStrategy: PID 23294 died... 09:26:11.407122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23294): Terminated: ok {rc=0} 09:26:11.452635 --- ParallelTerminationStrategy: PID 23297 died... 09:26:11.472041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23297): Terminated: ok {rc=0} 09:26:11.556941 bus /gobi_0: Setting Powered False 09:26:12.655393 bus /gobi_0: Setting Powered False 09:26:13.769577 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:26:14.917162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:14.929270 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:26:14.992733 tst iperf3.py: using LAC 27433 09:26:15.113483 tst iperf3.py: using RAC 148 09:26:15.241169 tst iperf3.py: using CellId 27433 09:26:15.368030 tst iperf3.py: using BVCI 27434 09:26:15.486259 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.497923 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.509362 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.520739 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.532042 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.543329 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.554729 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.565935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:15.577431 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:15.696148 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:26:15.931592 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:16.261710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23299): Launched 09:26:16.576202 run iperf3-srv_10.42.42.10(pid=23300): Launched 09:26:16.736777 tst iperf3.py:8: start network... 09:26:16.950523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:17.451892 run create_hlr_db(pid=23301): Launched 09:26:17.582862 bus /gobi_6: Setting Powered False 09:26:18.646800 run create_hlr_db(pid=23301): Terminated: ok {rc=0} 09:26:19.096202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23303): Launched 09:26:19.419562 run osmo-hlr_10.42.42.2(pid=23304): Launched 09:26:19.542819 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:20.105653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23306): Launched 09:26:20.428912 run osmo-stp_10.42.42.5(pid=23307): Launched 09:26:20.553736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:21.111296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23309): Launched 09:26:21.235171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:21.509290 run patchelf(pid=23310): Launched 09:26:21.688484 run osmo-stp_10.42.42.5(pid=23307): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23307)] 09:26:21.825392 run osmo-stp_10.42.42.5(pid=23307): stdout: | (launched: 2022-12-10_09:26:20.369627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:21.963744 run osmo-stp_10.42.42.5(pid=23307): stderr: | 20221210092620564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092620564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092620564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092620565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092620565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092620565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092620565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:22.102417 run osmo-stp_10.42.42.5(pid=23307): stdout: | (launched: 2022-12-10_09:26:20.369627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:22.235398 run osmo-stp_10.42.42.5(pid=23307): stderr: | 20221210092620564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092620564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092620564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092620565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092620565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092620565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092620565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:22.392757 run patchelf(pid=23310): Terminating (SIGINT) 09:26:22.575162 run patchelf(pid=23310): Terminated: ok {rc=0} 09:26:22.705974 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23307): Process ended prematurely: osmo-stp_10.42.42.5(pid=23307) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23307)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:26:22.715901 tst iperf3.py:8: Test FAILED (7.8 sec) 09:26:22.744156 run osmo-hlr_10.42.42.2(pid=23304): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23304)] 09:26:22.793932 run osmo-hlr_10.42.42.2(pid=23304): stdout: | (launched: 2022-12-10_09:26:19.360213) 09:26:22.845450 run osmo-hlr_10.42.42.2(pid=23304): stderr: | 20221210092619563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092619563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092619563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092619563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092619563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092619563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092619577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092619587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092619587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092619587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:22.897421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23299): Terminating (SIGTERM) 09:26:22.938946 run iperf3-srv_10.42.42.10(pid=23300): Terminating (SIGTERM) 09:26:22.980413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23303): Terminating (SIGTERM) 09:26:23.021868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23306): Terminating (SIGTERM) 09:26:23.063142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23309): Terminating (SIGTERM) 09:26:23.104869 --- ParallelTerminationStrategy: PID 23299 died... 09:26:23.124838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23299): Terminated: ok {rc=0} 09:26:23.170719 --- ParallelTerminationStrategy: PID 23300 died... 09:26:23.190234 run iperf3-srv_10.42.42.10(pid=23300): Terminated {rc=256} 09:26:23.235781 --- ParallelTerminationStrategy: PID 23303 died... 09:26:23.255299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23303): Terminated: ok {rc=0} 09:26:23.300839 --- ParallelTerminationStrategy: PID 23306 died... 09:26:23.320635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23306): Terminated: ok {rc=0} 09:26:23.366452 --- ParallelTerminationStrategy: PID 23309 died... 09:26:23.385965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23309): Terminated: ok {rc=0} 09:26:23.473370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:26:24.623495 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:24.635222 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:26:24.698051 tst iperf3m4.py: using LAC 27434 09:26:24.819307 tst iperf3m4.py: using RAC 149 09:26:24.938132 tst iperf3m4.py: using CellId 27434 09:26:25.058789 tst iperf3m4.py: using BVCI 27435 09:26:25.170507 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.181715 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.192462 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.204096 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.215631 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.227106 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.238710 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.250392 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:25.262226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:25.382444 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:25.505266 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:25.625261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:25.743468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:26:25.950394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:26.259159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23311): Launched 09:26:26.527078 run iperf3-srv_10.42.42.10(pid=23312): Launched 09:26:26.642344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:26:26.847757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:27.155001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23313): Launched 09:26:27.420802 run iperf3-srv_10.42.42.10(pid=23314): Launched 09:26:27.536047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:26:27.741254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:28.048399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23315): Launched 09:26:28.314225 run iperf3-srv_10.42.42.10(pid=23316): Launched 09:26:28.428875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:26:28.634352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:26:28.942162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23317): Launched 09:26:29.208037 run iperf3-srv_10.42.42.10(pid=23318): Launched 09:26:29.322537 tst iperf3m4.py:8: start network... 09:26:29.527266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:30.001588 run create_hlr_db(pid=23319): Launched 09:26:30.117498 bus /gobi_6: Setting Powered False 09:26:31.186708 run create_hlr_db(pid=23319): Terminated: ok {rc=0} 09:26:31.631882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23321): Launched 09:26:31.963366 run osmo-hlr_10.42.42.2(pid=23322): Launched 09:26:32.160874 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:32.722745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23324): Launched 09:26:33.027955 run osmo-stp_10.42.42.5(pid=23325): Launched 09:26:33.144197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:33.675150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23327): Launched 09:26:33.792075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:34.051326 run patchelf(pid=23328): Launched 09:26:34.221279 run osmo-stp_10.42.42.5(pid=23325): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23325)] 09:26:34.350306 run osmo-stp_10.42.42.5(pid=23325): stdout: | (launched: 2022-12-10_09:26:32.972019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:34.481196 run osmo-stp_10.42.42.5(pid=23325): stderr: | 20221210092633144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092633144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092633144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092633145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092633145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092633145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092633145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:34.612373 run osmo-stp_10.42.42.5(pid=23325): stdout: | (launched: 2022-12-10_09:26:32.972019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:34.737451 run osmo-stp_10.42.42.5(pid=23325): stderr: | 20221210092633144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092633144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092633144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092633145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092633145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092633145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092633145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:34.885928 run patchelf(pid=23328): Terminating (SIGINT) 09:26:35.058040 run patchelf(pid=23328): Terminated: ok {rc=0} 09:26:35.181740 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23325): Process ended prematurely: osmo-stp_10.42.42.5(pid=23325) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23325)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:26:35.191361 tst iperf3m4.py:8: Test FAILED (10.6 sec) 09:26:35.219293 run osmo-hlr_10.42.42.2(pid=23322): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23322)] 09:26:35.266931 run osmo-hlr_10.42.42.2(pid=23322): stdout: | (launched: 2022-12-10_09:26:31.897409) 09:26:35.315987 run osmo-hlr_10.42.42.2(pid=23322): stderr: | 20221210092632219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092632219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092632219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092632219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092632219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092632219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092632241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092632266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092632266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092632266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:35.365481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23311): Terminating (SIGTERM) 09:26:35.405204 run iperf3-srv_10.42.42.10(pid=23312): Terminating (SIGTERM) 09:26:35.445138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23313): Terminating (SIGTERM) 09:26:35.484803 run iperf3-srv_10.42.42.10(pid=23314): Terminating (SIGTERM) 09:26:35.524189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23315): Terminating (SIGTERM) 09:26:35.563734 run iperf3-srv_10.42.42.10(pid=23316): Terminating (SIGTERM) 09:26:35.603340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23317): Terminating (SIGTERM) 09:26:35.642748 run iperf3-srv_10.42.42.10(pid=23318): Terminating (SIGTERM) 09:26:35.682107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23321): Terminating (SIGTERM) 09:26:35.721981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23324): Terminating (SIGTERM) 09:26:35.761196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23327): Terminating (SIGTERM) 09:26:35.800938 --- ParallelTerminationStrategy: PID 23311 died... 09:26:35.819975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23311): Terminated: ok {rc=0} 09:26:35.864280 --- ParallelTerminationStrategy: PID 23312 died... 09:26:35.882791 run iperf3-srv_10.42.42.10(pid=23312): Terminated {rc=256} 09:26:35.926703 --- ParallelTerminationStrategy: PID 23313 died... 09:26:35.944911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23313): Terminated: ok {rc=0} 09:26:35.989329 --- ParallelTerminationStrategy: PID 23314 died... 09:26:36.007936 run iperf3-srv_10.42.42.10(pid=23314): Terminated {rc=256} 09:26:36.051559 --- ParallelTerminationStrategy: PID 23315 died... 09:26:36.070181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23315): Terminated: ok {rc=0} 09:26:36.114325 --- ParallelTerminationStrategy: PID 23316 died... 09:26:36.132774 run iperf3-srv_10.42.42.10(pid=23316): Terminated {rc=256} 09:26:36.176389 --- ParallelTerminationStrategy: PID 23317 died... 09:26:36.195030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23317): Terminated: ok {rc=0} 09:26:36.239265 --- ParallelTerminationStrategy: PID 23318 died... 09:26:36.257767 run iperf3-srv_10.42.42.10(pid=23318): Terminated {rc=256} 09:26:36.301243 --- ParallelTerminationStrategy: PID 23321 died... 09:26:36.319806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23321): Terminated: ok {rc=0} 09:26:36.363529 --- ParallelTerminationStrategy: PID 23324 died... 09:26:36.382131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23324): Terminated: ok {rc=0} 09:26:36.425959 --- ParallelTerminationStrategy: PID 23327 died... 09:26:36.444640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23327): Terminated: ok {rc=0} 09:26:36.529536 bus /gobi_4: Setting Powered False 09:26:37.627792 bus /gobi_4: Setting Powered False 09:26:38.743881 bus /gobi_1: Setting Powered False 09:26:39.841344 bus /gobi_1: Setting Powered False 09:26:40.955170 bus /gobi_0: Setting Powered False 09:26:42.053433 bus /gobi_0: Setting Powered False 09:26:43.165630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:26:44.266922 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.279106 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:26:44.342573 tst ping.py: using LAC 27435 09:26:44.461299 tst ping.py: using RAC 150 09:26:44.581119 tst ping.py: using CellId 27435 09:26:44.698808 tst ping.py: using BVCI 27436 09:26:44.809594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.820711 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.831902 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.843142 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.854337 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.865421 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.876411 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:44.887442 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:45.005885 tst ping.py:19: start network... 09:26:45.221321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:45.716001 run create_hlr_db(pid=23329): Launched 09:26:45.847550 bus /gobi_6: Setting Powered False 09:26:46.906627 run create_hlr_db(pid=23329): Terminated: ok {rc=0} 09:26:47.393799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23331): Launched 09:26:47.712897 run osmo-hlr_10.42.42.2(pid=23332): Launched 09:26:47.833884 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:48.388853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23334): Launched 09:26:48.707616 run osmo-stp_10.42.42.5(pid=23335): Launched 09:26:48.828682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:49.377557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23337): Launched 09:26:49.498887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:49.767101 run patchelf(pid=23338): Launched 09:26:49.944142 run osmo-stp_10.42.42.5(pid=23335): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23335)] 09:26:50.078656 run osmo-stp_10.42.42.5(pid=23335): stdout: | (launched: 2022-12-10_09:26:48.649048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:50.215186 run osmo-stp_10.42.42.5(pid=23335): stderr: | 20221210092648842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092648842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092648842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092648843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092648845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092648845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092648845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:50.351374 run osmo-stp_10.42.42.5(pid=23335): stdout: | (launched: 2022-12-10_09:26:48.649048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:50.483102 run osmo-stp_10.42.42.5(pid=23335): stderr: | 20221210092648842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092648842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092648842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092648843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092648845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092648845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092648845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:50.637991 run patchelf(pid=23338): Terminating (SIGINT) 09:26:50.817163 run patchelf(pid=23338): Terminated: ok {rc=0} 09:26:50.945902 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23335): Process ended prematurely: osmo-stp_10.42.42.5(pid=23335) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23335)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 09:26:50.955286 tst ping.py:22: Test FAILED (6.7 sec) 09:26:50.982945 run osmo-hlr_10.42.42.2(pid=23332): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23332)] 09:26:51.032374 run osmo-hlr_10.42.42.2(pid=23332): stdout: | (launched: 2022-12-10_09:26:47.654694) 09:26:51.083531 run osmo-hlr_10.42.42.2(pid=23332): stderr: | 20221210092647852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092647852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092647852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092647852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092647852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092647852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092647864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092647873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092647873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092647873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:51.134763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23331): Terminating (SIGTERM) 09:26:51.175895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23334): Terminating (SIGTERM) 09:26:51.216986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23337): Terminating (SIGTERM) 09:26:51.259243 --- ParallelTerminationStrategy: PID 23331 died... 09:26:51.279073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23331): Terminated: ok {rc=0} 09:26:51.325132 --- ParallelTerminationStrategy: PID 23334 died... 09:26:51.344313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23334): Terminated: ok {rc=0} 09:26:51.390258 --- ParallelTerminationStrategy: PID 23337 died... 09:26:51.409720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23337): Terminated: ok {rc=0} 09:26:51.496496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:26:52.584465 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:52.596638 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:26:52.660036 tst ping_idle_ping.py: using LAC 27436 09:26:52.786535 tst ping_idle_ping.py: using RAC 151 09:26:52.913326 tst ping_idle_ping.py: using CellId 27436 09:26:53.040606 tst ping_idle_ping.py: using BVCI 27437 09:26:53.156785 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.168469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.179860 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.191238 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.203069 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.214494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.226245 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:26:53.237702 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:26:53.356327 tst ping_idle_ping.py:24: start network... 09:26:53.572730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:26:54.070101 run create_hlr_db(pid=23339): Launched 09:26:54.199678 bus /gobi_6: Setting Powered False 09:26:55.263889 run create_hlr_db(pid=23339): Terminated: ok {rc=0} 09:26:55.710063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Launched 09:26:56.028468 run osmo-hlr_10.42.42.2(pid=23342): Launched 09:26:56.150187 run osmo-stp_10.42.42.5: Starting osmo-stp 09:26:56.703524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Launched 09:26:57.022418 run osmo-stp_10.42.42.5(pid=23345): Launched 09:26:57.143667 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:26:57.695162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23347): Launched 09:26:57.817172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:26:58.086404 run patchelf(pid=23348): Launched 09:26:58.263572 run osmo-stp_10.42.42.5(pid=23345): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] 09:26:58.398757 run osmo-stp_10.42.42.5(pid=23345): stdout: | (launched: 2022-12-10_09:26:56.964055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:58.535713 run osmo-stp_10.42.42.5(pid=23345): stderr: | 20221210092657155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092657155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092657155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092657156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092657156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092657156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092657156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:58.672038 run osmo-stp_10.42.42.5(pid=23345): stdout: | (launched: 2022-12-10_09:26:56.964055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:26:58.803606 run osmo-stp_10.42.42.5(pid=23345): stderr: | 20221210092657155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092657155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092657155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092657156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092657156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092657156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092657156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:26:58.959129 run patchelf(pid=23348): Terminating (SIGINT) 09:26:59.138383 run patchelf(pid=23348): Terminated: ok {rc=0} 09:26:59.267119 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23345): Process ended prematurely: osmo-stp_10.42.42.5(pid=23345) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:26:59.276340 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:26:59.304159 run osmo-hlr_10.42.42.2(pid=23342): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23342)] 09:26:59.353736 run osmo-hlr_10.42.42.2(pid=23342): stdout: | (launched: 2022-12-10_09:26:55.970241) 09:26:59.404702 run osmo-hlr_10.42.42.2(pid=23342): stderr: | 20221210092656169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092656169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092656169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092656169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092656169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092656169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092656181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092656189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092656190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092656190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:26:59.456531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Terminating (SIGTERM) 09:26:59.498084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Terminating (SIGTERM) 09:26:59.539721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23347): Terminating (SIGTERM) 09:26:59.581636 --- ParallelTerminationStrategy: PID 23341 died... 09:26:59.601595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23341): Terminated: ok {rc=0} 09:26:59.647273 --- ParallelTerminationStrategy: PID 23344 died... 09:26:59.666870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23344): Terminated: ok {rc=0} 09:26:59.712632 --- ParallelTerminationStrategy: PID 23347 died... 09:26:59.732147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23347): Terminated: ok {rc=0} 09:26:59.819096 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:27:01.139281 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:01.146959 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:27:01.173478 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:27:01.210231 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:27:01.264740 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:27:01.289762 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:27:01.332230 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:27:01.883355 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:27:01.891523 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:01.907175 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:27:01.977845 tst switch_tch_pdch.py: using LAC 27437 09:27:02.099541 tst switch_tch_pdch.py: using RAC 152 09:27:02.220481 tst switch_tch_pdch.py: using CellId 27437 09:27:02.338295 tst switch_tch_pdch.py: using BVCI 27438 09:27:02.447739 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.459511 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.471236 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.483113 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.494899 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.506654 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.519302 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:27:02.531527 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:02.649253 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:27:02.768833 tst switch_tch_pdch.py:51: start network... 09:27:02.984488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:03.484764 run create_hlr_db(pid=23352): Launched 09:27:03.613850 bus /gobi_6: Setting Powered False 09:27:04.676460 run create_hlr_db(pid=23352): Terminated: ok {rc=0} 09:27:05.109230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Launched 09:27:05.413590 run osmo-hlr_10.42.42.2(pid=23355): Launched 09:27:05.527928 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:06.047871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Launched 09:27:06.351464 run osmo-stp_10.42.42.5(pid=23358): Launched 09:27:06.465766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:27:06.989319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Launched 09:27:07.103209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:27:07.360162 run patchelf(pid=23361): Launched 09:27:07.527609 run osmo-stp_10.42.42.5(pid=23358): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] 09:27:07.654895 run osmo-stp_10.42.42.5(pid=23358): stdout: | (launched: 2022-12-10_09:27:06.293130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:07.783469 run osmo-stp_10.42.42.5(pid=23358): stderr: | 20221210092706466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092706466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092706466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092706467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092706467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092706467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092706467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:07.912500 run osmo-stp_10.42.42.5(pid=23358): stdout: | (launched: 2022-12-10_09:27:06.293130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:08.035900 run osmo-stp_10.42.42.5(pid=23358): stderr: | 20221210092706466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092706466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092706466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092706467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092706467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092706467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092706467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:08.182231 run patchelf(pid=23361): Terminating (SIGINT) 09:27:08.351442 run patchelf(pid=23361): Terminated: ok {rc=0} 09:27:08.473191 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23358): Process ended prematurely: osmo-stp_10.42.42.5(pid=23358) [trial-2372↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] [trial-2372↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:27:08.481887 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:27:08.508687 run osmo-hlr_10.42.42.2(pid=23355): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23355)] 09:27:08.556150 run osmo-hlr_10.42.42.2(pid=23355): stdout: | (launched: 2022-12-10_09:27:05.354215) 09:27:08.605481 run osmo-hlr_10.42.42.2(pid=23355): stderr: | 20221210092705533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092705533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092705533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092705533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092705534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092705534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092705567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092705578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092705578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092705578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:08.655278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Terminating (SIGTERM) 09:27:08.695327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Terminating (SIGTERM) 09:27:08.735079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Terminating (SIGTERM) 09:27:08.775070 --- ParallelTerminationStrategy: PID 23354 died... 09:27:08.794112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Terminated: ok {rc=0} 09:27:08.838258 --- ParallelTerminationStrategy: PID 23357 died... 09:27:08.857167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Terminated: ok {rc=0} 09:27:08.900893 --- ParallelTerminationStrategy: PID 23360 died... 09:27:08.919621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Terminated: ok {rc=0} 09:27:09.004150 bus /gobi_0: Setting Powered False 09:27:10.103054 bus /gobi_0: Setting Powered False 09:27:11.218506 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 sms:nanobts+band-900 --------------------------------------------------------------------- 09:27:12.464894 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:12.469808 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:27:12.502658 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:27:12.529197 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 09:27:12.581658 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:27:12.614554 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:27:12.641164 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 09:27:13.189775 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 09:27:13.194661 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.205408 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 09:27:13.251141 tst mo_mt_sms.py: using LAC 27438 09:27:13.366542 tst mo_mt_sms.py: using RAC 153 09:27:13.482388 tst mo_mt_sms.py: using CellId 27438 09:27:13.599845 tst mo_mt_sms.py: using BVCI 27439 09:27:13.708303 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.718948 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.729789 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.740539 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.751217 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:13.761883 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:27:13.879397 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 09:27:13.998554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:14.464381 run create_hlr_db(pid=23366): Launched 09:27:14.578963 bus /gobi_6: Setting Powered False 09:27:15.639103 run create_hlr_db(pid=23366): Terminated: ok {rc=0} 09:27:16.119495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23368): Launched 09:27:16.464690 run osmo-hlr_10.42.42.2(pid=23369): Launched 09:27:16.695749 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:17.363466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23371): Launched 09:27:17.683814 run osmo-stp_10.42.42.5(pid=23372): Launched 09:27:17.805817 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:18.381786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23374): Launched 09:27:18.700428 run osmo-msc_10.42.42.6(pid=23375): Launched 09:27:18.877139 run osmo-stp_10.42.42.5(pid=23372): ERR: Terminated: ERROR {rc=1} [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23372)] 09:27:19.011891 run osmo-stp_10.42.42.5(pid=23372): stdout: | (launched: 2022-12-10_09:27:17.625641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:19.147026 run osmo-stp_10.42.42.5(pid=23372): stderr: | 20221210092717818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092717819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092717819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092717819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092717820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092717820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092717820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:19.280718 run osmo-stp_10.42.42.5(pid=23372): stdout: | (launched: 2022-12-10_09:27:17.625641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:19.407618 run osmo-stp_10.42.42.5(pid=23372): stderr: | 20221210092717818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092717819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092717819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092717819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092717820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092717820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092717820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:19.559481 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23372): Process ended prematurely: osmo-stp_10.42.42.5(pid=23372) [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23372)] [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py:16] 09:27:19.568147 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 09:27:19.595141 run osmo-hlr_10.42.42.2(pid=23369): ERR: Terminated: ERROR {rc=237} [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23369)] 09:27:19.644732 run osmo-hlr_10.42.42.2(pid=23369): stdout: | (launched: 2022-12-10_09:27:16.400696) 09:27:19.695847 run osmo-hlr_10.42.42.2(pid=23369): stderr: | 20221210092716807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092716807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092716807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092716807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092716807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092716807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092716831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092716848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092716848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092716848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:19.767275 run osmo-msc_10.42.42.6(pid=23375): ERR: Terminated: ERROR {rc=2} [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23375)] 09:27:19.817217 run osmo-msc_10.42.42.6(pid=23375): stdout: | (launched: 2022-12-10_09:27:18.642242) 09:27:19.868126 run osmo-msc_10.42.42.6(pid=23375): stderr: | 20221210092718966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092718966 DLGLOBAL DEBUG validating counter group 0x7f1b6414cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092718966 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092718966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092718966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092718967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092718968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092718969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092718969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092718969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:19.919366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23368): Terminating (SIGTERM) 09:27:19.960364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23371): Terminating (SIGTERM) 09:27:20.001850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23374): Terminating (SIGTERM) 09:27:20.043309 --- ParallelTerminationStrategy: PID 23368 died... 09:27:20.063142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23368): Terminated: ok {rc=0} 09:27:20.108859 --- ParallelTerminationStrategy: PID 23371 died... 09:27:20.128597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23371): Terminated: ok {rc=0} 09:27:20.174155 --- ParallelTerminationStrategy: PID 23374 died... 09:27:20.193450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23374): Terminated: ok {rc=0} 09:27:20.280673 bus /sierra_3: Setting Powered False 09:27:21.380730 bus /sierra_3: Setting Powered False 09:27:22.495342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 09:27:23.728251 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:23.732798 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:27:23.765856 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 09:27:23.772435 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:27:23.807486 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:27:23.841574 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 09:27:23.848635 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:27:24.366093 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:27:24.371876 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 09:27:24.383213 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:27:24.429391 tst assert_extension.py: using LAC 27439 09:27:24.546287 tst assert_extension.py: using RAC 154 09:27:24.663447 tst assert_extension.py: using CellId 27439 09:27:24.786060 tst assert_extension.py: using BVCI 27440 09:27:24.895971 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:27:25.013235 tst assert_extension.py:10: start nitb and bts... 09:27:25.227862 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:27:25.883281 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23381): Launched 09:27:26.205487 run osmo-nitb_10.42.42.2(pid=23382): Launched 09:27:26.382876 run osmo-nitb_10.42.42.2(pid=23382): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23382)] 09:27:26.526308 run osmo-nitb_10.42.42.2(pid=23382): stdout: | (launched: 2022-12-10_09:27:26.143978) 09:27:26.670792 run osmo-nitb_10.42.42.2(pid=23382): stderr: | (launched: 2022-12-10_09:27:26.191392) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:27:26.815103 run osmo-nitb_10.42.42.2(pid=23382): stdout: | (launched: 2022-12-10_09:27:26.143978) 09:27:26.954241 run osmo-nitb_10.42.42.2(pid=23382): stderr: | (launched: 2022-12-10_09:27:26.191392) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23382) [trial-2372↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23382)] 09:27:27.326758 tst osmo-nitb_10.42.42.2(pid=23382): stdout: | (launched: 2022-12-10_09:27:26.143978) 09:27:27.456616 tst osmo-nitb_10.42.42.2(pid=23382): stderr: | (launched: 2022-12-10_09:27:26.191392) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:27:27.609150 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23382) [trial-2372↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23382)] [trial-2372↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 09:27:27.618191 tst assert_extension.py:12: Test FAILED (3.2 sec) 09:27:27.625323 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23381): Terminating (SIGTERM) 09:27:27.835478 --- ParallelTerminationStrategy: PID 23381 died... 09:27:27.856854 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23381): Terminated: ok {rc=0} 09:27:27.944437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 ussd:nanobts+band-900 --------------------------------------------------------------------- 09:27:29.124706 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:29.130016 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:27:29.163272 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:27:29.190607 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 09:27:29.227798 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:27:29.261291 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:27:29.287936 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 09:27:29.817530 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 09:27:29.822584 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:29.833759 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 09:27:29.880608 tst assert_extension.py: using LAC 27440 09:27:30.004903 tst assert_extension.py: using RAC 155 09:27:30.129186 tst assert_extension.py: using CellId 27440 09:27:30.253336 tst assert_extension.py: using BVCI 27441 09:27:30.368717 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:30.379800 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:30.390819 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:30.401780 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:30.412768 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:27:30.423756 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 09:27:30.539234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:31.049732 run create_hlr_db(pid=23386): Launched 09:27:31.215362 bus /sierra_2: Setting Powered False 09:27:32.277658 run create_hlr_db(pid=23386): Terminated: ok {rc=0} 09:27:32.759576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Launched 09:27:33.060347 run osmo-hlr_10.42.42.2(pid=23389): Launched 09:27:33.175042 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:33.706859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Launched 09:27:34.006170 run osmo-stp_10.42.42.5(pid=23392): Launched 09:27:34.121426 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:34.663138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23394): Launched 09:27:34.962018 run osmo-msc_10.42.42.6(pid=23395): Launched 09:27:35.129801 run osmo-stp_10.42.42.5(pid=23392): ERR: Terminated: ERROR {rc=1} [trial-2372↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] 09:27:35.256872 run osmo-stp_10.42.42.5(pid=23392): stdout: | (launched: 2022-12-10_09:27:33.951105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:35.384425 run osmo-stp_10.42.42.5(pid=23392): stderr: | 20221210092734122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092734122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092734123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092734123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092734124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092734124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092734124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:35.510542 run osmo-stp_10.42.42.5(pid=23392): stdout: | (launched: 2022-12-10_09:27:33.951105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:35.629891 run osmo-stp_10.42.42.5(pid=23392): stderr: | 20221210092734122 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092734122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092734123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092734123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092734124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092734124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092734124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:35.772281 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23392): Process ended prematurely: osmo-stp_10.42.42.5(pid=23392) [trial-2372↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] [trial-2372↪ussd:nanobts+band-900↪assert_extension.py:17] 09:27:35.780432 tst assert_extension.py:17: Test FAILED (6.0 sec) 09:27:35.806463 run osmo-hlr_10.42.42.2(pid=23389): ERR: Terminated: ERROR {rc=237} [trial-2372↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23389)] 09:27:35.854340 run osmo-hlr_10.42.42.2(pid=23389): stdout: | (launched: 2022-12-10_09:27:33.004922) 09:27:35.903654 run osmo-hlr_10.42.42.2(pid=23389): stderr: | 20221210092733181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092733181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092733181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092733181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092733181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092733181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092733193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092733202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092733202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092733202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:35.975501 run osmo-msc_10.42.42.6(pid=23395): ERR: Terminated: ERROR {rc=2} [trial-2372↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23395)] 09:27:36.023504 run osmo-msc_10.42.42.6(pid=23395): stdout: | (launched: 2022-12-10_09:27:34.907043) 09:27:36.072821 run osmo-msc_10.42.42.6(pid=23395): stderr: | 20221210092735181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092735181 DLGLOBAL DEBUG validating counter group 0x7f33fc0d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092735181 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092735181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092735181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092735181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092735183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092735184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092735184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092735184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:36.122573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Terminating (SIGTERM) 09:27:36.162220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Terminating (SIGTERM) 09:27:36.201785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23394): Terminating (SIGTERM) 09:27:36.241607 --- ParallelTerminationStrategy: PID 23388 died... 09:27:36.260541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23388): Terminated: ok {rc=0} 09:27:36.304707 --- ParallelTerminationStrategy: PID 23391 died... 09:27:36.323356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23391): Terminated: ok {rc=0} 09:27:36.367163 --- ParallelTerminationStrategy: PID 23394 died... 09:27:36.385674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23394): Terminated: ok {rc=0} 09:27:36.471001 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 09:27:37.687677 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:37.695656 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 09:27:37.730103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 09:27:37.758040 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 09:27:37.811016 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 09:27:37.844753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 09:27:37.872713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 09:27:38.425351 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 09:27:38.479111 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:38.491018 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:27:38.562741 tst mo_mt_call.py: using LAC 27441 09:27:38.684328 tst mo_mt_call.py: using RAC 156 09:27:38.804936 tst mo_mt_call.py: using CellId 27441 09:27:38.923523 tst mo_mt_call.py: using BVCI 27442 09:27:39.034857 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:39.046221 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:39.057506 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:39.068603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:39.079990 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:39.091542 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:27:39.211687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:27:39.328564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:39.808374 run create_hlr_db(pid=23403): Launched 09:27:39.925737 bus /sierra_2: Setting Powered False 09:27:40.986370 run create_hlr_db(pid=23403): Terminated: ok {rc=0} 09:27:41.434161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Launched 09:27:41.761996 run osmo-hlr_10.42.42.2(pid=23406): Launched 09:27:41.885441 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:42.446700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Launched 09:27:42.773633 run osmo-stp_10.42.42.5(pid=23409): Launched 09:27:42.897722 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:43.487584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Launched 09:27:43.813706 run osmo-msc_10.42.42.6(pid=23412): Launched 09:27:43.993918 run osmo-stp_10.42.42.5(pid=23409): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] 09:27:44.129811 run osmo-stp_10.42.42.5(pid=23409): stdout: | (launched: 2022-12-10_09:27:42.710698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:44.266227 run osmo-stp_10.42.42.5(pid=23409): stderr: | 20221210092742905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092742906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092742906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092742906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092742907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092742907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092742907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:44.402016 run osmo-stp_10.42.42.5(pid=23409): stdout: | (launched: 2022-12-10_09:27:42.710698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:44.531496 run osmo-stp_10.42.42.5(pid=23409): stderr: | 20221210092742905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092742906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092742906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092742906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092742907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092742907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092742907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:44.685280 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23409): Process ended prematurely: osmo-stp_10.42.42.5(pid=23409) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 09:27:44.694831 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:27:44.722515 run osmo-hlr_10.42.42.2(pid=23406): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23406)] 09:27:44.772339 run osmo-hlr_10.42.42.2(pid=23406): stdout: | (launched: 2022-12-10_09:27:41.699216) 09:27:44.823741 run osmo-hlr_10.42.42.2(pid=23406): stderr: | 20221210092741900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092741900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092741900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092741900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092741900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092741900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092741911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092741920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092741920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092741920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:44.895437 run osmo-msc_10.42.42.6(pid=23412): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23412)] 09:27:44.945111 run osmo-msc_10.42.42.6(pid=23412): stdout: | (launched: 2022-12-10_09:27:43.750889) 09:27:44.996136 run osmo-msc_10.42.42.6(pid=23412): stderr: | 20221210092744076 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092744076 DLGLOBAL DEBUG validating counter group 0x7fc16f1fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092744077 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092744077 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092744077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092744077 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092744079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092744079 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092744079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092744079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:45.047617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Terminating (SIGTERM) 09:27:45.088463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Terminating (SIGTERM) 09:27:45.129834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Terminating (SIGTERM) 09:27:45.171578 --- ParallelTerminationStrategy: PID 23405 died... 09:27:45.191405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23405): Terminated: ok {rc=0} 09:27:45.237382 --- ParallelTerminationStrategy: PID 23408 died... 09:27:45.256461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23408): Terminated: ok {rc=0} 09:27:45.301989 --- ParallelTerminationStrategy: PID 23411 died... 09:27:45.321472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23411): Terminated: ok {rc=0} 09:27:45.408364 bus /sierra_3: Setting Powered False 09:27:46.505623 bus /sierra_3: Setting Powered False 09:27:47.623071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 09:27:48.771613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:48.783869 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 09:27:48.852819 tst mo_mt_call_osmux.py: using LAC 27442 09:27:48.985434 tst mo_mt_call_osmux.py: using RAC 157 09:27:49.112711 tst mo_mt_call_osmux.py: using CellId 27442 09:27:49.238557 tst mo_mt_call_osmux.py: using BVCI 27443 09:27:49.356156 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:49.367892 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:49.379375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:49.391014 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:49.402634 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 09:27:49.414196 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:27:49.534762 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 09:27:49.651681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:27:50.133144 run create_hlr_db(pid=23414): Launched 09:27:50.250539 bus /sierra_2: Setting Powered False 09:27:51.311207 run create_hlr_db(pid=23414): Terminated: ok {rc=0} 09:27:51.742582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Launched 09:27:52.052750 run osmo-hlr_10.42.42.2(pid=23417): Launched 09:27:52.170604 run osmo-stp_10.42.42.5: Starting osmo-stp 09:27:52.713416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Launched 09:27:53.024195 run osmo-stp_10.42.42.5(pid=23420): Launched 09:27:53.142029 run osmo-msc_10.42.42.6: Starting osmo-msc 09:27:53.701400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Launched 09:27:54.011433 run osmo-msc_10.42.42.6(pid=23423): Launched 09:27:54.182370 run osmo-stp_10.42.42.5(pid=23420): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] 09:27:54.312033 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-10_09:27:52.963949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:54.441620 run osmo-stp_10.42.42.5(pid=23420): stderr: | 20221210092753139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092753139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092753140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092753140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092753140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092753141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092753141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:54.568895 run osmo-stp_10.42.42.5(pid=23420): stdout: | (launched: 2022-12-10_09:27:52.963949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:27:54.690494 run osmo-stp_10.42.42.5(pid=23420): stderr: | 20221210092753139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092753139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092753140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092753140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092753140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092753141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092753141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:27:54.836014 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 09:27:54.844776 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:27:54.871257 run osmo-hlr_10.42.42.2(pid=23417): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23417)] 09:27:54.918882 run osmo-hlr_10.42.42.2(pid=23417): stdout: | (launched: 2022-12-10_09:27:51.992787) 09:27:54.967770 run osmo-hlr_10.42.42.2(pid=23417): stderr: | 20221210092752175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092752175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092752175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092752175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092752175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092752175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092752187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092752195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092752195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092752196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:27:55.036237 run osmo-msc_10.42.42.6(pid=23423): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23423)] 09:27:55.083524 run osmo-msc_10.42.42.6(pid=23423): stdout: | (launched: 2022-12-10_09:27:53.951201) 09:27:55.132309 run osmo-msc_10.42.42.6(pid=23423): stderr: | 20221210092754225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092754225 DLGLOBAL DEBUG validating counter group 0x7f1bc84d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092754225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092754226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092754226 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092754226 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092754228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092754228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092754228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092754228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:27:55.181470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminating (SIGTERM) 09:27:55.220827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminating (SIGTERM) 09:27:55.260000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Terminating (SIGTERM) 09:27:55.299259 --- ParallelTerminationStrategy: PID 23416 died... 09:27:55.317992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23416): Terminated: ok {rc=0} 09:27:55.361612 --- ParallelTerminationStrategy: PID 23419 died... 09:27:55.379693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23419): Terminated: ok {rc=0} 09:27:55.423527 --- ParallelTerminationStrategy: PID 23422 died... 09:27:55.441923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23422): Terminated: ok {rc=0} 09:27:55.525243 bus /sierra_3: Setting Powered False 09:27:56.622496 bus /sierra_3: Setting Powered False 09:27:57.737390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 09:27:58.991426 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:27:58.999239 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 09:27:59.032242 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 09:27:59.059487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 09:27:59.111849 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 09:27:59.144788 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 09:27:59.172012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 09:27:59.726008 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 09:27:59.777760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:27:59.788910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:27:59.865169 tst mo_mt_call.py: using LAC 27443 09:27:59.993727 tst mo_mt_call.py: using RAC 158 09:28:00.122706 tst mo_mt_call.py: using CellId 27443 09:28:00.253811 tst mo_mt_call.py: using BVCI 27444 09:28:00.367295 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:00.378595 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:00.390163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:00.401585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:00.412877 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:00.424043 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:28:00.544051 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:28:00.660407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:01.153406 run create_hlr_db(pid=23428): Launched 09:28:01.303751 bus /sierra_2: Setting Powered False 09:28:02.366353 run create_hlr_db(pid=23428): Terminated: ok {rc=0} 09:28:02.805281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23430): Launched 09:28:03.111015 run osmo-hlr_10.42.42.2(pid=23431): Launched 09:28:03.228034 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:03.769016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23433): Launched 09:28:04.075468 run osmo-stp_10.42.42.5(pid=23434): Launched 09:28:04.193502 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:04.760216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23436): Launched 09:28:05.066425 run osmo-msc_10.42.42.6(pid=23437): Launched 09:28:05.238671 run osmo-stp_10.42.42.5(pid=23434): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23434)] 09:28:05.369534 run osmo-stp_10.42.42.5(pid=23434): stdout: | (launched: 2022-12-10_09:28:04.019474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:05.499533 run osmo-stp_10.42.42.5(pid=23434): stderr: | 20221210092804191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092804191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092804191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092804192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092804192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092804192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092804193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:05.627342 run osmo-stp_10.42.42.5(pid=23434): stdout: | (launched: 2022-12-10_09:28:04.019474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:05.748929 run osmo-stp_10.42.42.5(pid=23434): stderr: | 20221210092804191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092804191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092804191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092804192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092804192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092804192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092804193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:05.894727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23434): Process ended prematurely: osmo-stp_10.42.42.5(pid=23434) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23434)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 09:28:05.903613 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 09:28:05.929927 run osmo-hlr_10.42.42.2(pid=23431): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23431)] 09:28:05.977730 run osmo-hlr_10.42.42.2(pid=23431): stdout: | (launched: 2022-12-10_09:28:03.055374) 09:28:06.026702 run osmo-hlr_10.42.42.2(pid=23431): stderr: | 20221210092803233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092803233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092803233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092803233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092803233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092803233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092803246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092803255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092803255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092803255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:06.095070 run osmo-msc_10.42.42.6(pid=23437): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23437)] 09:28:06.142443 run osmo-msc_10.42.42.6(pid=23437): stdout: | (launched: 2022-12-10_09:28:05.010609) 09:28:06.191682 run osmo-msc_10.42.42.6(pid=23437): stderr: | 20221210092805281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092805281 DLGLOBAL DEBUG validating counter group 0x7f2e5978fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092805281 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092805281 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092805281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092805281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092805283 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092805283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092805284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092805284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:06.240914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23430): Terminating (SIGTERM) 09:28:06.280308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23433): Terminating (SIGTERM) 09:28:06.319743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23436): Terminating (SIGTERM) 09:28:06.359546 --- ParallelTerminationStrategy: PID 23430 died... 09:28:06.378421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23430): Terminated: ok {rc=0} 09:28:06.422285 --- ParallelTerminationStrategy: PID 23433 died... 09:28:06.440498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23433): Terminated: ok {rc=0} 09:28:06.484488 --- ParallelTerminationStrategy: PID 23436 died... 09:28:06.503004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23436): Terminated: ok {rc=0} 09:28:06.587381 bus /sierra_3: Setting Powered False 09:28:07.686905 bus /sierra_3: Setting Powered False 09:28:08.802526 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 09:28:09.947975 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:09.959702 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 09:28:10.026459 tst mo_mt_call_osmux.py: using LAC 27444 09:28:10.147543 tst mo_mt_call_osmux.py: using RAC 159 09:28:10.273632 tst mo_mt_call_osmux.py: using CellId 27444 09:28:10.394605 tst mo_mt_call_osmux.py: using BVCI 27445 09:28:10.508052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:10.519163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:10.530251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:10.541505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:10.552746 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 09:28:10.563981 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:28:10.683932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 09:28:10.804276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:11.310138 run create_hlr_db(pid=23439): Launched 09:28:11.442448 bus /sierra_2: Setting Powered False 09:28:12.506470 run create_hlr_db(pid=23439): Terminated: ok {rc=0} 09:28:12.957709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Launched 09:28:13.281540 run osmo-hlr_10.42.42.2(pid=23442): Launched 09:28:13.405912 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:13.964734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Launched 09:28:14.288039 run osmo-stp_10.42.42.5(pid=23445): Launched 09:28:14.412707 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:15.000334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23447): Launched 09:28:15.324323 run osmo-msc_10.42.42.6(pid=23448): Launched 09:28:15.506938 run osmo-stp_10.42.42.5(pid=23445): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] 09:28:15.643802 run osmo-stp_10.42.42.5(pid=23445): stdout: | (launched: 2022-12-10_09:28:14.229111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:15.780890 run osmo-stp_10.42.42.5(pid=23445): stderr: | 20221210092814422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092814422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092814422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092814423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092814425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092814425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092814425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:15.927145 run osmo-stp_10.42.42.5(pid=23445): stdout: | (launched: 2022-12-10_09:28:14.229111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:16.064030 run osmo-stp_10.42.42.5(pid=23445): stderr: | 20221210092814422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092814422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092814422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092814423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092814425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092814425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092814425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:16.221784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23445): Process ended prematurely: osmo-stp_10.42.42.5(pid=23445) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 09:28:16.231762 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:28:16.260543 run osmo-hlr_10.42.42.2(pid=23442): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23442)] 09:28:16.311951 run osmo-hlr_10.42.42.2(pid=23442): stdout: | (launched: 2022-12-10_09:28:13.222724) 09:28:16.364511 run osmo-hlr_10.42.42.2(pid=23442): stderr: | 20221210092813421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092813421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092813421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092813421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092813421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092813422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092813438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092813448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092813448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092813448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:16.437976 run osmo-msc_10.42.42.6(pid=23448): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23448)] 09:28:16.489404 run osmo-msc_10.42.42.6(pid=23448): stdout: | (launched: 2022-12-10_09:28:15.265297) 09:28:16.541603 run osmo-msc_10.42.42.6(pid=23448): stderr: | 20221210092815592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092815592 DLGLOBAL DEBUG validating counter group 0x7fd90f1bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092815592 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092815592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092815592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092815592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092815594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092815594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092815594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092815595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:16.594532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Terminating (SIGTERM) 09:28:16.637375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Terminating (SIGTERM) 09:28:16.681339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23447): Terminating (SIGTERM) 09:28:16.724490 --- ParallelTerminationStrategy: PID 23441 died... 09:28:16.744127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Terminated: ok {rc=0} 09:28:16.792150 --- ParallelTerminationStrategy: PID 23444 died... 09:28:16.811960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Terminated: ok {rc=0} 09:28:16.858331 --- ParallelTerminationStrategy: PID 23447 died... 09:28:16.878141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23447): Terminated: ok {rc=0} 09:28:16.971127 bus /sierra_3: Setting Powered False 09:28:18.082890 bus /sierra_3: Setting Powered False 09:28:19.198827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 09:28:20.446731 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:20.453988 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 09:28:20.486984 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 09:28:20.513317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 09:28:20.565907 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 09:28:20.598817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 09:28:20.625257 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 09:28:21.176370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 09:28:21.225591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.236649 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:28:21.302513 tst mo_mt_call.py: using LAC 27445 09:28:21.423374 tst mo_mt_call.py: using RAC 160 09:28:21.543658 tst mo_mt_call.py: using CellId 27445 09:28:21.672439 tst mo_mt_call.py: using BVCI 27446 09:28:21.790637 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.802434 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.814151 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.826001 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.837915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:21.849753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:28:21.969617 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:28:22.090023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:22.599938 run create_hlr_db(pid=23453): Launched 09:28:22.730965 bus /sierra_2: Setting Powered False 09:28:23.794991 run create_hlr_db(pid=23453): Terminated: ok {rc=0} 09:28:24.251146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23455): Launched 09:28:24.580908 run osmo-hlr_10.42.42.2(pid=23456): Launched 09:28:24.705070 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:25.267502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23458): Launched 09:28:25.598259 run osmo-stp_10.42.42.5(pid=23459): Launched 09:28:25.721745 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:26.312084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23461): Launched 09:28:26.640788 run osmo-msc_10.42.42.6(pid=23462): Launched 09:28:26.822288 run osmo-stp_10.42.42.5(pid=23459): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23459)] 09:28:26.959188 run osmo-stp_10.42.42.5(pid=23459): stdout: | (launched: 2022-12-10_09:28:25.532742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:27.096555 run osmo-stp_10.42.42.5(pid=23459): stderr: | 20221210092825730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092825730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092825730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092825731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092825733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092825733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092825733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:27.232024 run osmo-stp_10.42.42.5(pid=23459): stdout: | (launched: 2022-12-10_09:28:25.532742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:27.360803 run osmo-stp_10.42.42.5(pid=23459): stderr: | 20221210092825730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092825730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092825730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092825731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092825733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092825733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092825733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:27.516282 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23459): Process ended prematurely: osmo-stp_10.42.42.5(pid=23459) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23459)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 09:28:27.525847 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:28:27.553570 run osmo-hlr_10.42.42.2(pid=23456): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23456)] 09:28:27.603398 run osmo-hlr_10.42.42.2(pid=23456): stdout: | (launched: 2022-12-10_09:28:24.516061) 09:28:27.654787 run osmo-hlr_10.42.42.2(pid=23456): stderr: | 20221210092824719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092824719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092824719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092824719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092824719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092824719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092824732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092824741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092824741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092824741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:27.726871 run osmo-msc_10.42.42.6(pid=23462): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23462)] 09:28:27.776105 run osmo-msc_10.42.42.6(pid=23462): stdout: | (launched: 2022-12-10_09:28:26.577395) 09:28:27.827096 run osmo-msc_10.42.42.6(pid=23462): stderr: | 20221210092826902 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092826902 DLGLOBAL DEBUG validating counter group 0x7f6f53bd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092826903 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092826903 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092826903 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092826903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092826905 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092826905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092826905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092826905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:27.878420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23455): Terminating (SIGTERM) 09:28:27.919247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23458): Terminating (SIGTERM) 09:28:27.960020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23461): Terminating (SIGTERM) 09:28:28.001402 --- ParallelTerminationStrategy: PID 23455 died... 09:28:28.021170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23455): Terminated: ok {rc=0} 09:28:28.066926 --- ParallelTerminationStrategy: PID 23458 died... 09:28:28.086404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23458): Terminated: ok {rc=0} 09:28:28.131996 --- ParallelTerminationStrategy: PID 23461 died... 09:28:28.151532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23461): Terminated: ok {rc=0} 09:28:28.237907 bus /sierra_3: Setting Powered False 09:28:29.335380 bus /sierra_3: Setting Powered False 09:28:30.452159 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 09:28:31.608504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:31.621696 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 09:28:31.692738 tst mo_mt_call_osmux.py: using LAC 27446 09:28:31.825246 tst mo_mt_call_osmux.py: using RAC 161 09:28:31.963392 tst mo_mt_call_osmux.py: using CellId 27446 09:28:32.089373 tst mo_mt_call_osmux.py: using BVCI 27447 09:28:32.213451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:32.226101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:32.238709 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:32.250936 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:32.262879 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 09:28:32.274704 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:28:32.391814 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 09:28:32.512910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:32.993648 run create_hlr_db(pid=23464): Launched 09:28:33.110700 bus /sierra_2: Setting Powered False 09:28:34.171202 run create_hlr_db(pid=23464): Terminated: ok {rc=0} 09:28:34.623094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23466): Launched 09:28:34.952004 run osmo-hlr_10.42.42.2(pid=23467): Launched 09:28:35.076215 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:35.638505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23469): Launched 09:28:35.966375 run osmo-stp_10.42.42.5(pid=23470): Launched 09:28:36.089967 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:36.680815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23472): Launched 09:28:37.009704 run osmo-msc_10.42.42.6(pid=23473): Launched 09:28:37.190394 run osmo-stp_10.42.42.5(pid=23470): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23470)] 09:28:37.326973 run osmo-stp_10.42.42.5(pid=23470): stdout: | (launched: 2022-12-10_09:28:35.901901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:37.463695 run osmo-stp_10.42.42.5(pid=23470): stderr: | 20221210092836100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092836100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092836100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092836101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092836101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092836101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092836101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:37.600861 run osmo-stp_10.42.42.5(pid=23470): stdout: | (launched: 2022-12-10_09:28:35.901901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:37.729678 run osmo-stp_10.42.42.5(pid=23470): stderr: | 20221210092836100 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092836100 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092836100 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092836101 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092836101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092836101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092836101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:37.884019 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23470): Process ended prematurely: osmo-stp_10.42.42.5(pid=23470) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23470)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 09:28:37.893602 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 09:28:37.921173 run osmo-hlr_10.42.42.2(pid=23467): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23467)] 09:28:37.971826 run osmo-hlr_10.42.42.2(pid=23467): stdout: | (launched: 2022-12-10_09:28:34.889231) 09:28:38.023065 run osmo-hlr_10.42.42.2(pid=23467): stderr: | 20221210092835090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092835090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092835090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092835090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092835090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092835090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092835103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092835113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092835113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092835113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:38.094945 run osmo-msc_10.42.42.6(pid=23473): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23473)] 09:28:38.144506 run osmo-msc_10.42.42.6(pid=23473): stdout: | (launched: 2022-12-10_09:28:36.945955) 09:28:38.195561 run osmo-msc_10.42.42.6(pid=23473): stderr: | 20221210092837272 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092837273 DLGLOBAL DEBUG validating counter group 0x7fcf2836bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092837273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092837273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092837273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092837273 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092837275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092837275 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092837275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092837275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:38.246961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23466): Terminating (SIGTERM) 09:28:38.288264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23469): Terminating (SIGTERM) 09:28:38.329305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23472): Terminating (SIGTERM) 09:28:38.371455 --- ParallelTerminationStrategy: PID 23466 died... 09:28:38.391287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23466): Terminated: ok {rc=0} 09:28:38.437118 --- ParallelTerminationStrategy: PID 23469 died... 09:28:38.456360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23469): Terminated: ok {rc=0} 09:28:38.502325 --- ParallelTerminationStrategy: PID 23472 died... 09:28:38.521769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23472): Terminated: ok {rc=0} 09:28:38.608750 bus /sierra_3: Setting Powered False 09:28:39.706989 bus /sierra_3: Setting Powered False 09:28:40.821750 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 09:28:42.074432 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:28:42.082177 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 09:28:42.115251 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 09:28:42.142605 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 09:28:42.194658 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 09:28:42.227880 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 09:28:42.255217 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 09:28:42.810096 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 09:28:42.861629 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:42.873321 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:28:42.941413 tst mo_mt_call.py: using LAC 27447 09:28:43.073811 tst mo_mt_call.py: using RAC 162 09:28:43.199872 tst mo_mt_call.py: using CellId 27447 09:28:43.326009 tst mo_mt_call.py: using BVCI 27448 09:28:43.443744 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:43.455414 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:43.466877 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:43.478735 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:43.490450 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:43.502035 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:28:43.619049 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:28:43.735216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:44.211191 run create_hlr_db(pid=23478): Launched 09:28:44.328795 bus /sierra_2: Setting Powered False 09:28:45.392649 run create_hlr_db(pid=23478): Terminated: ok {rc=0} 09:28:45.832545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Launched 09:28:46.199695 run osmo-hlr_10.42.42.2(pid=23481): Launched 09:28:46.458636 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:47.106112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Launched 09:28:47.427048 run osmo-stp_10.42.42.5(pid=23484): Launched 09:28:47.545844 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:48.099853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23486): Launched 09:28:48.405800 run osmo-msc_10.42.42.6(pid=23487): Launched 09:28:48.576615 run osmo-stp_10.42.42.5(pid=23484): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] 09:28:48.706848 run osmo-stp_10.42.42.5(pid=23484): stdout: | (launched: 2022-12-10_09:28:47.370847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:48.836413 run osmo-stp_10.42.42.5(pid=23484): stderr: | 20221210092847541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092847541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092847541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092847542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092847542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092847542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092847542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:48.964181 run osmo-stp_10.42.42.5(pid=23484): stdout: | (launched: 2022-12-10_09:28:47.370847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:49.086154 run osmo-stp_10.42.42.5(pid=23484): stderr: | 20221210092847541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092847541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092847541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092847542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092847542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092847542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092847542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:49.232003 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23484): Process ended prematurely: osmo-stp_10.42.42.5(pid=23484) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 09:28:49.240931 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 09:28:49.268151 run osmo-hlr_10.42.42.2(pid=23481): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23481)] 09:28:49.316299 run osmo-hlr_10.42.42.2(pid=23481): stdout: | (launched: 2022-12-10_09:28:46.135282) 09:28:49.365873 run osmo-hlr_10.42.42.2(pid=23481): stderr: | 20221210092846420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092846420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092846420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092846420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092846420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092846420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092846441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092846450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092846450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092846450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:49.434833 run osmo-msc_10.42.42.6(pid=23487): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23487)] 09:28:49.482907 run osmo-msc_10.42.42.6(pid=23487): stdout: | (launched: 2022-12-10_09:28:48.349999) 09:28:49.532360 run osmo-msc_10.42.42.6(pid=23487): stderr: | 20221210092848622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092848623 DLGLOBAL DEBUG validating counter group 0x7fae80cdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092848623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092848623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092848623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092848623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092848625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092848625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092848626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092848626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:49.582201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Terminating (SIGTERM) 09:28:49.622083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Terminating (SIGTERM) 09:28:49.662169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23486): Terminating (SIGTERM) 09:28:49.702397 --- ParallelTerminationStrategy: PID 23480 died... 09:28:49.721391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23480): Terminated: ok {rc=0} 09:28:49.765544 --- ParallelTerminationStrategy: PID 23483 died... 09:28:49.784003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23483): Terminated: ok {rc=0} 09:28:49.828223 --- ParallelTerminationStrategy: PID 23486 died... 09:28:49.846908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23486): Terminated: ok {rc=0} 09:28:49.931477 bus /sierra_3: Setting Powered False 09:28:51.030671 bus /sierra_3: Setting Powered False 09:28:52.144273 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 09:28:53.286545 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.298634 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 09:28:53.366292 tst mo_mt_call_osmux.py: using LAC 27448 09:28:53.486257 tst mo_mt_call_osmux.py: using RAC 163 09:28:53.611220 tst mo_mt_call_osmux.py: using CellId 27448 09:28:53.732018 tst mo_mt_call_osmux.py: using BVCI 27449 09:28:53.843679 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.855195 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.866494 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.877996 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.889589 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 09:28:53.900919 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:28:54.022118 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 09:28:54.142067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:28:54.646517 run create_hlr_db(pid=23489): Launched 09:28:54.778053 bus /sierra_2: Setting Powered False 09:28:55.842493 run create_hlr_db(pid=23489): Terminated: ok {rc=0} 09:28:56.278573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Launched 09:28:56.585256 run osmo-hlr_10.42.42.2(pid=23493): Launched 09:28:56.703701 run osmo-stp_10.42.42.5: Starting osmo-stp 09:28:57.242163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Launched 09:28:57.548691 run osmo-stp_10.42.42.5(pid=23496): Launched 09:28:57.666668 run osmo-msc_10.42.42.6: Starting osmo-msc 09:28:58.221393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Launched 09:28:58.528391 run osmo-msc_10.42.42.6(pid=23499): Launched 09:28:58.700523 run osmo-stp_10.42.42.5(pid=23496): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] 09:28:58.831164 run osmo-stp_10.42.42.5(pid=23496): stdout: | (launched: 2022-12-10_09:28:57.492378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:58.960899 run osmo-stp_10.42.42.5(pid=23496): stderr: | 20221210092857662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092857662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092857663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092857663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092857665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092857665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092857666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:59.088814 run osmo-stp_10.42.42.5(pid=23496): stdout: | (launched: 2022-12-10_09:28:57.492378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:28:59.211381 run osmo-stp_10.42.42.5(pid=23496): stderr: | 20221210092857662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092857662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092857663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092857663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092857665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092857665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092857666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:28:59.357763 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23496): Process ended prematurely: osmo-stp_10.42.42.5(pid=23496) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 09:28:59.366724 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:28:59.393428 run osmo-hlr_10.42.42.2(pid=23493): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23493)] 09:28:59.441928 run osmo-hlr_10.42.42.2(pid=23493): stdout: | (launched: 2022-12-10_09:28:56.529162) 09:28:59.491501 run osmo-hlr_10.42.42.2(pid=23493): stderr: | 20221210092856704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092856704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092856704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092856704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092856704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092856704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092856716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092856724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092856724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092856724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:28:59.560197 run osmo-msc_10.42.42.6(pid=23499): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23499)] 09:28:59.607937 run osmo-msc_10.42.42.6(pid=23499): stdout: | (launched: 2022-12-10_09:28:58.471901) 09:28:59.656768 run osmo-msc_10.42.42.6(pid=23499): stderr: | 20221210092858747 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092858747 DLGLOBAL DEBUG validating counter group 0x7fab50efbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092858747 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092858747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092858747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092858748 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092858749 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092858750 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092858750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092858750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:28:59.705933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Terminating (SIGTERM) 09:28:59.746145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Terminating (SIGTERM) 09:28:59.785737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Terminating (SIGTERM) 09:28:59.825969 --- ParallelTerminationStrategy: PID 23492 died... 09:28:59.845104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23492): Terminated: ok {rc=0} 09:28:59.889723 --- ParallelTerminationStrategy: PID 23495 died... 09:28:59.908158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23495): Terminated: ok {rc=0} 09:28:59.952825 --- ParallelTerminationStrategy: PID 23498 died... 09:28:59.971912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23498): Terminated: ok {rc=0} 09:29:00.055886 bus /sierra_3: Setting Powered False 09:29:01.153560 bus /sierra_3: Setting Powered False 09:29:02.276922 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 09:29:03.529882 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:03.537788 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:29:03.572420 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 09:29:03.599947 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:29:03.656095 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:29:03.689833 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 09:29:03.717105 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:29:04.266344 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 09:29:04.317613 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.329205 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:29:04.399157 tst mo_mt_call.py: using LAC 27449 09:29:04.519680 tst mo_mt_call.py: using RAC 164 09:29:04.639459 tst mo_mt_call.py: using CellId 27449 09:29:04.765698 tst mo_mt_call.py: using BVCI 27450 09:29:04.878737 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.890293 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.901694 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.913464 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.925356 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:04.936768 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:05.053960 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:05.172926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:05.653079 run create_hlr_db(pid=23504): Launched 09:29:05.770415 bus /sierra_2: Setting Powered False 09:29:06.831198 run create_hlr_db(pid=23504): Terminated: ok {rc=0} 09:29:07.281532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23506): Launched 09:29:07.611573 run osmo-hlr_10.42.42.2(pid=23507): Launched 09:29:07.736696 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:08.303573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23509): Launched 09:29:08.632334 run osmo-stp_10.42.42.5(pid=23510): Launched 09:29:08.757997 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:09.353806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23512): Launched 09:29:09.683556 run osmo-msc_10.42.42.6(pid=23513): Launched 09:29:09.864929 run osmo-stp_10.42.42.5(pid=23510): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23510)] 09:29:10.001050 run osmo-stp_10.42.42.5(pid=23510): stdout: | (launched: 2022-12-10_09:29:08.569334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:10.137454 run osmo-stp_10.42.42.5(pid=23510): stderr: | 20221210092908765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092908765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092908765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092908766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092908766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092908766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092908766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:10.273597 run osmo-stp_10.42.42.5(pid=23510): stdout: | (launched: 2022-12-10_09:29:08.569334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:10.403015 run osmo-stp_10.42.42.5(pid=23510): stderr: | 20221210092908765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092908765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092908765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092908766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092908766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092908766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092908766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:10.557699 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23510): Process ended prematurely: osmo-stp_10.42.42.5(pid=23510) [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23510)] [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 09:29:10.566989 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 09:29:10.594535 run osmo-hlr_10.42.42.2(pid=23507): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23507)] 09:29:10.644591 run osmo-hlr_10.42.42.2(pid=23507): stdout: | (launched: 2022-12-10_09:29:07.547398) 09:29:10.696113 run osmo-hlr_10.42.42.2(pid=23507): stderr: | 20221210092907750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092907750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092907750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092907750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092907750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092907750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092907762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092907771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092907771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092907771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:10.767930 run osmo-msc_10.42.42.6(pid=23513): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23513)] 09:29:10.817681 run osmo-msc_10.42.42.6(pid=23513): stdout: | (launched: 2022-12-10_09:29:09.618942) 09:29:10.869108 run osmo-msc_10.42.42.6(pid=23513): stderr: | 20221210092909947 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092909947 DLGLOBAL DEBUG validating counter group 0x7f50432d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092909947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092909947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092909947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092909948 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092909949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092909950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092909950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092909950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:10.920768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23506): Terminating (SIGTERM) 09:29:10.962164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23509): Terminating (SIGTERM) 09:29:11.003523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23512): Terminating (SIGTERM) 09:29:11.045206 --- ParallelTerminationStrategy: PID 23506 died... 09:29:11.064832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23506): Terminated: ok {rc=0} 09:29:11.110856 --- ParallelTerminationStrategy: PID 23509 died... 09:29:11.130542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23509): Terminated: ok {rc=0} 09:29:11.176239 --- ParallelTerminationStrategy: PID 23512 died... 09:29:11.195716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23512): Terminated: ok {rc=0} 09:29:11.282856 bus /sierra_3: Setting Powered False 09:29:12.379368 bus /sierra_3: Setting Powered False 09:29:13.494989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 09:29:14.640666 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:14.652770 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:29:14.721419 tst mo_mt_call_osmux.py: using LAC 27450 09:29:14.843880 tst mo_mt_call_osmux.py: using RAC 165 09:29:14.966047 tst mo_mt_call_osmux.py: using CellId 27450 09:29:15.086637 tst mo_mt_call_osmux.py: using BVCI 27451 09:29:15.200313 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:15.211957 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:15.223333 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:15.235026 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:15.246273 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 09:29:15.258111 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:15.381491 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:29:15.501587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:16.025061 run create_hlr_db(pid=23515): Launched 09:29:16.185605 bus /sierra_2: Setting Powered False 09:29:17.248306 run create_hlr_db(pid=23515): Terminated: ok {rc=0} 09:29:17.705181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Launched 09:29:18.033251 run osmo-hlr_10.42.42.2(pid=23518): Launched 09:29:18.156636 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:18.720036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Launched 09:29:19.048338 run osmo-stp_10.42.42.5(pid=23521): Launched 09:29:19.172159 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:19.764442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23523): Launched 09:29:20.092812 run osmo-msc_10.42.42.6(pid=23524): Launched 09:29:20.274746 run osmo-stp_10.42.42.5(pid=23521): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] 09:29:20.411710 run osmo-stp_10.42.42.5(pid=23521): stdout: | (launched: 2022-12-10_09:29:18.984396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:20.549671 run osmo-stp_10.42.42.5(pid=23521): stderr: | 20221210092919180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092919180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092919181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092919181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092919182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092919182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092919182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:20.685633 run osmo-stp_10.42.42.5(pid=23521): stdout: | (launched: 2022-12-10_09:29:18.984396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:20.814621 run osmo-stp_10.42.42.5(pid=23521): stderr: | 20221210092919180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092919180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092919181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092919181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092919182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092919182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092919182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:20.969129 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23521): Process ended prematurely: osmo-stp_10.42.42.5(pid=23521) [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 09:29:20.978479 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 09:29:21.006034 run osmo-hlr_10.42.42.2(pid=23518): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23518)] 09:29:21.055799 run osmo-hlr_10.42.42.2(pid=23518): stdout: | (launched: 2022-12-10_09:29:17.970126) 09:29:21.107277 run osmo-hlr_10.42.42.2(pid=23518): stderr: | 20221210092918174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092918174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092918174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092918174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092918174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092918174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092918215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092918226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092918226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092918226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:21.179006 run osmo-msc_10.42.42.6(pid=23524): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23524)] 09:29:21.228507 run osmo-msc_10.42.42.6(pid=23524): stdout: | (launched: 2022-12-10_09:29:20.029598) 09:29:21.279587 run osmo-msc_10.42.42.6(pid=23524): stderr: | 20221210092920357 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092920357 DLGLOBAL DEBUG validating counter group 0x7f5738d55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092920358 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092920358 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092920358 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092920358 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092920360 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092920360 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092920360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092920360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:21.331382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Terminating (SIGTERM) 09:29:21.372482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Terminating (SIGTERM) 09:29:21.413674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23523): Terminating (SIGTERM) 09:29:21.455256 --- ParallelTerminationStrategy: PID 23517 died... 09:29:21.475044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23517): Terminated: ok {rc=0} 09:29:21.521162 --- ParallelTerminationStrategy: PID 23520 died... 09:29:21.540632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23520): Terminated: ok {rc=0} 09:29:21.586215 --- ParallelTerminationStrategy: PID 23523 died... 09:29:21.605592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23523): Terminated: ok {rc=0} 09:29:21.693348 bus /sierra_3: Setting Powered False 09:29:22.790743 bus /sierra_3: Setting Powered False 09:29:23.905753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:29:25.159560 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:25.167374 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:29:25.200586 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 09:29:25.228088 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 09:29:25.281423 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:29:25.314706 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 09:29:25.342154 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 09:29:25.899643 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 09:29:25.951988 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:25.964046 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:29:26.014836 tst mo_mt_call.py: using LAC 27451 09:29:26.141384 tst mo_mt_call.py: using RAC 166 09:29:26.273864 tst mo_mt_call.py: using CellId 27451 09:29:26.400624 tst mo_mt_call.py: using BVCI 27452 09:29:26.518751 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:26.530741 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:26.542562 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:26.554284 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:26.566043 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:26.577810 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:29:26.693679 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:29:26.814743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:27.318696 run create_hlr_db(pid=23529): Launched 09:29:27.450573 bus /sierra_2: Setting Powered False 09:29:28.511399 run create_hlr_db(pid=23529): Terminated: ok {rc=0} 09:29:28.946262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23531): Launched 09:29:29.252854 run osmo-hlr_10.42.42.2(pid=23532): Launched 09:29:29.370403 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:29.914175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23534): Launched 09:29:30.220581 run osmo-stp_10.42.42.5(pid=23535): Launched 09:29:30.338689 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:30.926854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23537): Launched 09:29:31.259175 run osmo-msc_10.42.42.6(pid=23538): Launched 09:29:31.536671 run osmo-stp_10.42.42.5(pid=23535): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23535)] 09:29:31.712569 run osmo-stp_10.42.42.5(pid=23535): stdout: | (launched: 2022-12-10_09:29:30.164472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:32.019468 run osmo-stp_10.42.42.5(pid=23535): stderr: | 20221210092930334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092930334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092930334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092930335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092930337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092930337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092930337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:32.163136 run osmo-stp_10.42.42.5(pid=23535): stdout: | (launched: 2022-12-10_09:29:30.164472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:32.338649 run osmo-stp_10.42.42.5(pid=23535): stderr: | 20221210092930334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092930334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092930334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092930335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092930337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092930337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092930337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:32.495508 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23535): Process ended prematurely: osmo-stp_10.42.42.5(pid=23535) [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23535)] [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 09:29:32.505643 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 09:29:32.534441 run osmo-hlr_10.42.42.2(pid=23532): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23532)] 09:29:32.584435 run osmo-hlr_10.42.42.2(pid=23532): stdout: | (launched: 2022-12-10_09:29:29.196555) 09:29:32.635753 run osmo-hlr_10.42.42.2(pid=23532): stderr: | 20221210092929375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092929375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092929375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092929375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092929375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092929375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092929387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092929396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092929397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092929397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:32.707596 run osmo-msc_10.42.42.6(pid=23538): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23538)] 09:29:32.757203 run osmo-msc_10.42.42.6(pid=23538): stdout: | (launched: 2022-12-10_09:29:31.193971) 09:29:32.808201 run osmo-msc_10.42.42.6(pid=23538): stderr: | 20221210092931884 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092931884 DLGLOBAL DEBUG validating counter group 0x7f2ee5da6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092931884 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092931884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092931884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092931884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092931886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092931887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092931887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092931887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:32.859678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23531): Terminating (SIGTERM) 09:29:32.900703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23534): Terminating (SIGTERM) 09:29:32.941901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23537): Terminating (SIGTERM) 09:29:32.983505 --- ParallelTerminationStrategy: PID 23531 died... 09:29:33.003184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23531): Terminated: ok {rc=0} 09:29:33.049447 --- ParallelTerminationStrategy: PID 23534 died... 09:29:33.069031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23534): Terminated: ok {rc=0} 09:29:33.114723 --- ParallelTerminationStrategy: PID 23537 died... 09:29:33.134138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23537): Terminated: ok {rc=0} 09:29:33.221650 bus /sierra_3: Setting Powered False 09:29:34.320098 bus /sierra_3: Setting Powered False 09:29:35.434359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 09:29:36.583713 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:36.596316 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:29:36.647826 tst mo_mt_call_osmux.py: using LAC 27452 09:29:36.769666 tst mo_mt_call_osmux.py: using RAC 167 09:29:36.890596 tst mo_mt_call_osmux.py: using CellId 27452 09:29:37.013351 tst mo_mt_call_osmux.py: using BVCI 27453 09:29:37.125509 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:37.137081 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:37.148491 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:37.160811 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:37.172672 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 09:29:37.184445 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:29:37.304743 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 09:29:37.424524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:37.899329 run create_hlr_db(pid=23540): Launched 09:29:38.016553 bus /sierra_2: Setting Powered False 09:29:39.077975 run create_hlr_db(pid=23540): Terminated: ok {rc=0} 09:29:39.505278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23542): Launched 09:29:39.812577 run osmo-hlr_10.42.42.2(pid=23543): Launched 09:29:39.930731 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:40.475894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23545): Launched 09:29:40.783332 run osmo-stp_10.42.42.5(pid=23546): Launched 09:29:40.901760 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:41.458313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23548): Launched 09:29:41.766551 run osmo-msc_10.42.42.6(pid=23549): Launched 09:29:41.939472 run osmo-stp_10.42.42.5(pid=23546): ERR: Terminated: ERROR {rc=1} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23546)] 09:29:42.070476 run osmo-stp_10.42.42.5(pid=23546): stdout: | (launched: 2022-12-10_09:29:40.727242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:42.201874 run osmo-stp_10.42.42.5(pid=23546): stderr: | 20221210092940896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092940896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092940897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092940897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092940898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092940898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092940898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:42.330716 run osmo-stp_10.42.42.5(pid=23546): stdout: | (launched: 2022-12-10_09:29:40.727242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:42.453499 run osmo-stp_10.42.42.5(pid=23546): stderr: | 20221210092940896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092940896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092940897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092940897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092940898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092940898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092940898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:42.600465 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23546): Process ended prematurely: osmo-stp_10.42.42.5(pid=23546) [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23546)] [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 09:29:42.609603 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 09:29:42.636936 run osmo-hlr_10.42.42.2(pid=23543): ERR: Terminated: ERROR {rc=237} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23543)] 09:29:42.685224 run osmo-hlr_10.42.42.2(pid=23543): stdout: | (launched: 2022-12-10_09:29:39.756327) 09:29:42.734744 run osmo-hlr_10.42.42.2(pid=23543): stderr: | 20221210092939933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092939933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092939933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092939933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092939933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092939933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092939944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092939955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092939955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092939955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:42.803740 run osmo-msc_10.42.42.6(pid=23549): ERR: Terminated: ERROR {rc=2} [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23549)] 09:29:42.851888 run osmo-msc_10.42.42.6(pid=23549): stdout: | (launched: 2022-12-10_09:29:41.710002) 09:29:42.901420 run osmo-msc_10.42.42.6(pid=23549): stderr: | 20221210092941980 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092941981 DLGLOBAL DEBUG validating counter group 0x7fef8ab9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092941981 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092941981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092941981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092941981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092941983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092941983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092941984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092941984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:42.951603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23542): Terminating (SIGTERM) 09:29:42.991727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23545): Terminating (SIGTERM) 09:29:43.032112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23548): Terminating (SIGTERM) 09:29:43.072788 --- ParallelTerminationStrategy: PID 23542 died... 09:29:43.092139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23542): Terminated: ok {rc=0} 09:29:43.137293 --- ParallelTerminationStrategy: PID 23545 died... 09:29:43.156124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23545): Terminated: ok {rc=0} 09:29:43.201118 --- ParallelTerminationStrategy: PID 23548 died... 09:29:43.219846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23548): Terminated: ok {rc=0} 09:29:43.306881 bus /sierra_3: Setting Powered False 09:29:44.406794 bus /sierra_3: Setting Powered False 09:29:45.523354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 emergency:nanobts+band-900 --------------------------------------------------------------------- 09:29:46.840697 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:29:46.850203 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:29:46.901222 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 09:29:46.939206 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:29:47.030352 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:29:47.075042 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 09:29:47.111689 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:29:47.677771 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2372 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 09:29:47.683976 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:47.695691 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:29:47.748104 tst emergency_mo_mt_call.py: using LAC 27453 09:29:47.869370 tst emergency_mo_mt_call.py: using RAC 168 09:29:47.989315 tst emergency_mo_mt_call.py: using CellId 27453 09:29:48.108564 tst emergency_mo_mt_call.py: using BVCI 27454 09:29:48.220253 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:48.231179 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:48.241945 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:48.253231 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:48.264241 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:48.275168 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:48.389112 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:48.504491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:48.975215 run create_hlr_db(pid=23554): Launched 09:29:49.089583 bus /sierra_2: Setting Powered False 09:29:50.150115 run create_hlr_db(pid=23554): Terminated: ok {rc=0} 09:29:50.593441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23556): Launched 09:29:50.917132 run osmo-hlr_10.42.42.2(pid=23557): Launched 09:29:51.038947 run osmo-stp_10.42.42.5: Starting osmo-stp 09:29:51.592576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23559): Launched 09:29:51.917043 run osmo-stp_10.42.42.5(pid=23560): Launched 09:29:52.048363 tst emergency_mo_mt_call.py: using MSISDN 7658 09:29:52.213161 run osmo-msc_10.42.42.6: Starting osmo-msc 09:29:52.795782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23562): Launched 09:29:53.119637 run osmo-msc_10.42.42.6(pid=23563): Launched 09:29:53.298464 run osmo-stp_10.42.42.5(pid=23560): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23560)] 09:29:53.433696 run osmo-stp_10.42.42.5(pid=23560): stdout: | (launched: 2022-12-10_09:29:51.853258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:53.569478 run osmo-stp_10.42.42.5(pid=23560): stderr: | 20221210092952052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092952052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092952052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092952053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092952053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092952053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092952053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:53.704277 run osmo-stp_10.42.42.5(pid=23560): stdout: | (launched: 2022-12-10_09:29:51.853258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:29:53.831322 run osmo-stp_10.42.42.5(pid=23560): stderr: | 20221210092952052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210092952052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210092952052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210092952053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210092952053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210092952053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210092952053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:29:53.983265 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23560): Process ended prematurely: osmo-stp_10.42.42.5(pid=23560) [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23560)] [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 09:29:53.992130 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 09:29:54.019749 run osmo-hlr_10.42.42.2(pid=23557): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23557)] 09:29:54.069660 run osmo-hlr_10.42.42.2(pid=23557): stdout: | (launched: 2022-12-10_09:29:50.853736) 09:29:54.121375 run osmo-hlr_10.42.42.2(pid=23557): stderr: | 20221210092951055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210092951055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210092951055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210092951055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210092951055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210092951055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210092951068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210092951076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210092951076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210092951076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:29:54.193930 run osmo-msc_10.42.42.6(pid=23563): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23563)] 09:29:54.243695 run osmo-msc_10.42.42.6(pid=23563): stdout: | (launched: 2022-12-10_09:29:53.056898) 09:29:54.295186 run osmo-msc_10.42.42.6(pid=23563): stderr: | 20221210092953383 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210092953383 DLGLOBAL DEBUG validating counter group 0x7f437f5acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210092953383 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210092953383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210092953384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210092953384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210092953386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210092953386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210092953386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210092953386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:29:54.346970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23556): Terminating (SIGTERM) 09:29:54.388117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23559): Terminating (SIGTERM) 09:29:54.429264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23562): Terminating (SIGTERM) 09:29:54.471015 --- ParallelTerminationStrategy: PID 23556 died... 09:29:54.490855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23556): Terminated: ok {rc=0} 09:29:54.537309 --- ParallelTerminationStrategy: PID 23559 died... 09:29:54.556901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23559): Terminated: ok {rc=0} 09:29:54.602445 --- ParallelTerminationStrategy: PID 23562 died... 09:29:54.621908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23562): Terminated: ok {rc=0} 09:29:54.707997 bus /sierra_3: Setting Powered False 09:29:55.807971 bus /sierra_3: Setting Powered False 09:29:56.923034 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 09:29:58.009518 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.021509 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 09:29:58.072269 tst emergency_preemptive_call.py: using LAC 27454 09:29:58.191625 tst emergency_preemptive_call.py: using RAC 169 09:29:58.310329 tst emergency_preemptive_call.py: using CellId 27454 09:29:58.431305 tst emergency_preemptive_call.py: using BVCI 27455 09:29:58.541923 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.553162 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.563963 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.575041 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.586216 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 09:29:58.597117 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:58.712148 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:58.834633 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:58.952430 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 09:29:59.069896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:29:59.572105 run create_hlr_db(pid=23565): Launched 09:29:59.696349 bus /sierra_2: Setting Powered False 09:30:00.756571 run create_hlr_db(pid=23565): Terminated: ok {rc=0} 09:30:01.197700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23567): Launched 09:30:01.531326 run osmo-hlr_10.42.42.2(pid=23569): Launched 09:30:01.796293 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:02.538627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23573): Launched 09:30:02.862236 run osmo-stp_10.42.42.5(pid=23574): Launched 09:30:02.994320 tst emergency_preemptive_call.py: using MSISDN 7659 09:30:03.159847 run osmo-msc_10.42.42.6: Starting osmo-msc 09:30:03.738717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23576): Launched 09:30:04.062715 run osmo-msc_10.42.42.6(pid=23577): Launched 09:30:04.241164 run osmo-stp_10.42.42.5(pid=23574): ERR: Terminated: ERROR {rc=1} [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23574)] 09:30:04.376730 run osmo-stp_10.42.42.5(pid=23574): stdout: | (launched: 2022-12-10_09:30:02.799486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:04.512425 run osmo-stp_10.42.42.5(pid=23574): stderr: | 20221210093002997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093002997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093002997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093002998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093002998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093002998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093002998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:04.647524 run osmo-stp_10.42.42.5(pid=23574): stdout: | (launched: 2022-12-10_09:30:02.799486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:04.774516 run osmo-stp_10.42.42.5(pid=23574): stderr: | 20221210093002997 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093002997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093002997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093002998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093002998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093002998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093002998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:04.926542 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23574): Process ended prematurely: osmo-stp_10.42.42.5(pid=23574) [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23574)] [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 09:30:04.935485 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 09:30:04.962720 run osmo-hlr_10.42.42.2(pid=23569): ERR: Terminated: ERROR {rc=237} [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23569)] 09:30:05.013188 run osmo-hlr_10.42.42.2(pid=23569): stdout: | (launched: 2022-12-10_09:30:01.458272) 09:30:05.064877 run osmo-hlr_10.42.42.2(pid=23569): stderr: | 20221210093001835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093001835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093001835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093001835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093001835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093001835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093001855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093001880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093001880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093001880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:05.136926 run osmo-msc_10.42.42.6(pid=23577): ERR: Terminated: ERROR {rc=2} [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23577)] 09:30:05.186427 run osmo-msc_10.42.42.6(pid=23577): stdout: | (launched: 2022-12-10_09:30:03.999196) 09:30:05.237581 run osmo-msc_10.42.42.6(pid=23577): stderr: | 20221210093004323 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093004323 DLGLOBAL DEBUG validating counter group 0x7fb577731c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093004323 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093004323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093004324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093004324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093004326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093004326 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093004326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093004326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:30:05.288847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23567): Terminating (SIGTERM) 09:30:05.330410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23573): Terminating (SIGTERM) 09:30:05.371887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23576): Terminating (SIGTERM) 09:30:05.413568 --- ParallelTerminationStrategy: PID 23567 died... 09:30:05.433290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23567): Terminated: ok {rc=0} 09:30:05.479382 --- ParallelTerminationStrategy: PID 23573 died... 09:30:05.498915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23573): Terminated: ok {rc=0} 09:30:05.544819 --- ParallelTerminationStrategy: PID 23576 died... 09:30:05.564759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23576): Terminated: ok {rc=0} 09:30:05.651781 bus /sierra_9: Setting Powered False 09:30:06.750739 bus /sierra_9: Setting Powered False 09:30:07.867161 bus /sierra_8: Setting Powered False 09:30:08.965642 bus /sierra_8: Setting Powered False 09:30:10.080713 bus /sierra_3: Setting Powered False 09:30:11.179147 bus /sierra_3: Setting Powered False 09:30:12.296018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900 --------------------------------------------------------------------- 09:30:13.570187 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:30:13.576336 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 09:30:13.609375 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 09:30:13.648783 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 09:30:13.738070 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 09:30:13.771385 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 09:30:13.810672 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 09:30:14.405695 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 09:30:14.458729 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:14.469942 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:30:14.518442 tst cs_paging_gprs_active.py: using LAC 27455 09:30:14.647918 tst cs_paging_gprs_active.py: using RAC 170 09:30:14.775658 tst cs_paging_gprs_active.py: using CellId 27455 09:30:14.904508 tst cs_paging_gprs_active.py: using BVCI 27456 09:30:15.022665 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.033862 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.044655 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.055676 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.066535 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.077558 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.088646 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.099560 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:15.110890 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:15.228181 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:15.348611 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:30:15.556704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:15.891234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23582): Launched 09:30:16.195469 run iperf3-srv_10.42.42.10(pid=23583): Launched 09:30:16.327510 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:30:16.538173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:16.867841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23584): Launched 09:30:17.161771 run iperf3-srv_10.42.42.10(pid=23585): Launched 09:30:17.287538 tst cs_paging_gprs_active.py:38: start network... 09:30:17.495462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:17.973078 run create_hlr_db(pid=23586): Launched 09:30:18.091664 bus /sierra_2: Setting Powered False 09:30:19.152409 run create_hlr_db(pid=23586): Terminated: ok {rc=0} 09:30:19.599915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23588): Launched 09:30:19.925779 run osmo-hlr_10.42.42.2(pid=23589): Launched 09:30:20.049683 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:20.615159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23591): Launched 09:30:20.940191 run osmo-stp_10.42.42.5(pid=23592): Launched 09:30:21.064026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:21.625911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23594): Launched 09:30:21.750009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:22.025875 run patchelf(pid=23595): Launched 09:30:22.206568 run osmo-stp_10.42.42.5(pid=23592): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23592)] 09:30:22.343776 run osmo-stp_10.42.42.5(pid=23592): stdout: | (launched: 2022-12-10_09:30:20.880619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:22.483004 run osmo-stp_10.42.42.5(pid=23592): stderr: | 20221210093021072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093021073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093021073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093021073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093021074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093021074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093021074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:22.622698 run osmo-stp_10.42.42.5(pid=23592): stdout: | (launched: 2022-12-10_09:30:20.880619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:22.755893 run osmo-stp_10.42.42.5(pid=23592): stderr: | 20221210093021072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093021073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093021073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093021073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093021074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093021074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093021074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:22.913923 run patchelf(pid=23595): Terminating (SIGINT) 09:30:23.096472 run patchelf(pid=23595): Terminated: ok {rc=0} 09:30:23.227705 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23592): Process ended prematurely: osmo-stp_10.42.42.5(pid=23592) [trial-2372↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23592)] [trial-2372↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 09:30:23.237703 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:30:23.265851 run osmo-hlr_10.42.42.2(pid=23589): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23589)] 09:30:23.315497 run osmo-hlr_10.42.42.2(pid=23589): stdout: | (launched: 2022-12-10_09:30:19.866654) 09:30:23.366839 run osmo-hlr_10.42.42.2(pid=23589): stderr: | 20221210093020065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093020065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093020065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093020065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093020065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093020065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093020077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093020085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093020085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093020085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:23.418865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23582): Terminating (SIGTERM) 09:30:23.460533 run iperf3-srv_10.42.42.10(pid=23583): Terminating (SIGTERM) 09:30:23.502073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23584): Terminating (SIGTERM) 09:30:23.544039 run iperf3-srv_10.42.42.10(pid=23585): Terminating (SIGTERM) 09:30:23.585798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23588): Terminating (SIGTERM) 09:30:23.627432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23591): Terminating (SIGTERM) 09:30:23.669090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23594): Terminating (SIGTERM) 09:30:23.711017 --- ParallelTerminationStrategy: PID 23582 died... 09:30:23.730783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23582): Terminated: ok {rc=0} 09:30:23.777149 --- ParallelTerminationStrategy: PID 23583 died... 09:30:23.796617 run iperf3-srv_10.42.42.10(pid=23583): Terminated {rc=256} 09:30:23.842390 --- ParallelTerminationStrategy: PID 23584 died... 09:30:23.861794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23584): Terminated: ok {rc=0} 09:30:23.907435 --- ParallelTerminationStrategy: PID 23585 died... 09:30:23.927143 run iperf3-srv_10.42.42.10(pid=23585): Terminated {rc=256} 09:30:23.972744 --- ParallelTerminationStrategy: PID 23588 died... 09:30:23.992194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23588): Terminated: ok {rc=0} 09:30:24.037749 --- ParallelTerminationStrategy: PID 23591 died... 09:30:24.057380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23591): Terminated: ok {rc=0} 09:30:24.103161 --- ParallelTerminationStrategy: PID 23594 died... 09:30:24.122728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23594): Terminated: ok {rc=0} 09:30:24.210956 bus /gobi_0: Setting Powered False 09:30:25.309653 bus /gobi_0: Setting Powered False 09:30:26.427459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 09:30:27.573789 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:27.585298 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:30:27.636353 tst iperf3.py: using LAC 27456 09:30:27.757831 tst iperf3.py: using RAC 171 09:30:27.883320 tst iperf3.py: using CellId 27456 09:30:28.005784 tst iperf3.py: using BVCI 27457 09:30:28.120160 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.130927 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.141677 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.152599 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.163923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.175033 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.186308 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.197476 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:28.208493 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:28.326815 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:28.548477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:28.875972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23596): Launched 09:30:29.160515 run iperf3-srv_10.42.42.10(pid=23597): Launched 09:30:29.283116 tst iperf3.py:8: start network... 09:30:29.503156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:30.010261 run create_hlr_db(pid=23598): Launched 09:30:30.142885 bus /gobi_6: Setting Powered False 09:30:31.206897 run create_hlr_db(pid=23598): Terminated: ok {rc=0} 09:30:31.682174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Launched 09:30:32.037792 run osmo-hlr_10.42.42.2(pid=23601): Launched 09:30:32.164152 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:32.739559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Launched 09:30:33.064865 run osmo-stp_10.42.42.5(pid=23604): Launched 09:30:33.189419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:33.751083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23606): Launched 09:30:33.875504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:34.151237 run patchelf(pid=23607): Launched 09:30:34.332189 run osmo-stp_10.42.42.5(pid=23604): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] 09:30:34.469968 run osmo-stp_10.42.42.5(pid=23604): stdout: | (launched: 2022-12-10_09:30:33.005640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:34.610614 run osmo-stp_10.42.42.5(pid=23604): stderr: | 20221210093033198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093033198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093033198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093033199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093033201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093033201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093033201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:34.749914 run osmo-stp_10.42.42.5(pid=23604): stdout: | (launched: 2022-12-10_09:30:33.005640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:34.883843 run osmo-stp_10.42.42.5(pid=23604): stderr: | 20221210093033198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093033198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093033198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093033199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093033201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093033201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093033201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:35.042376 run patchelf(pid=23607): Terminating (SIGINT) 09:30:35.224838 run patchelf(pid=23607): Terminated: ok {rc=0} 09:30:35.356343 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23604): Process ended prematurely: osmo-stp_10.42.42.5(pid=23604) [trial-2372↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] [trial-2372↪gprs:nanobts+band-900↪iperf3.py:8] 09:30:35.366416 tst iperf3.py:8: Test FAILED (7.8 sec) 09:30:35.394845 run osmo-hlr_10.42.42.2(pid=23601): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23601)] 09:30:35.444673 run osmo-hlr_10.42.42.2(pid=23601): stdout: | (launched: 2022-12-10_09:30:31.966265) 09:30:35.496509 run osmo-hlr_10.42.42.2(pid=23601): stderr: | 20221210093032232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093032232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093032232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093032232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093032232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093032232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093032245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093032255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093032255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093032255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:35.548872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23596): Terminating (SIGTERM) 09:30:35.590890 run iperf3-srv_10.42.42.10(pid=23597): Terminating (SIGTERM) 09:30:35.632652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Terminating (SIGTERM) 09:30:35.675015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Terminating (SIGTERM) 09:30:35.717355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23606): Terminating (SIGTERM) 09:30:35.759527 --- ParallelTerminationStrategy: PID 23596 died... 09:30:35.779563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23596): Terminated: ok {rc=0} 09:30:35.825966 --- ParallelTerminationStrategy: PID 23597 died... 09:30:35.845508 run iperf3-srv_10.42.42.10(pid=23597): Terminated {rc=256} 09:30:35.891982 --- ParallelTerminationStrategy: PID 23600 died... 09:30:35.911579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23600): Terminated: ok {rc=0} 09:30:35.957736 --- ParallelTerminationStrategy: PID 23603 died... 09:30:35.977354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23603): Terminated: ok {rc=0} 09:30:36.023724 --- ParallelTerminationStrategy: PID 23606 died... 09:30:36.043393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23606): Terminated: ok {rc=0} 09:30:36.131100 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 09:30:37.278548 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.289928 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:30:37.338085 tst iperf3m4.py: using LAC 27457 09:30:37.464871 tst iperf3m4.py: using RAC 172 09:30:37.587370 tst iperf3m4.py: using CellId 27457 09:30:37.709066 tst iperf3m4.py: using BVCI 27458 09:30:37.822251 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.833199 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.843820 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.855460 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.866813 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.878386 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.890086 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.901280 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:37.912815 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:38.031796 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:38.153840 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:38.271595 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:38.393712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:30:38.615821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:38.944673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23608): Launched 09:30:39.228791 run iperf3-srv_10.42.42.10(pid=23609): Launched 09:30:39.351356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:30:39.571778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:39.899902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23610): Launched 09:30:40.183545 run iperf3-srv_10.42.42.10(pid=23611): Launched 09:30:40.305830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:30:40.526362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:40.855106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23612): Launched 09:30:41.138617 run iperf3-srv_10.42.42.10(pid=23613): Launched 09:30:41.261235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:30:41.481068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:30:41.808883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23614): Launched 09:30:42.092201 run iperf3-srv_10.42.42.10(pid=23615): Launched 09:30:42.214884 tst iperf3m4.py:8: start network... 09:30:42.435063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:42.943283 run create_hlr_db(pid=23616): Launched 09:30:43.075644 bus /gobi_6: Setting Powered False 09:30:44.140211 run create_hlr_db(pid=23616): Terminated: ok {rc=0} 09:30:44.580182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23618): Launched 09:30:44.890575 run osmo-hlr_10.42.42.2(pid=23619): Launched 09:30:45.009761 run osmo-stp_10.42.42.5: Starting osmo-stp 09:30:45.547537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23621): Launched 09:30:45.877702 run osmo-stp_10.42.42.5(pid=23622): Launched 09:30:46.062104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:30:46.809841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23624): Launched 09:30:46.940605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:30:47.219945 run patchelf(pid=23625): Launched 09:30:47.402432 run osmo-stp_10.42.42.5(pid=23622): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23622)] 09:30:47.533477 run osmo-stp_10.42.42.5(pid=23622): stdout: | (launched: 2022-12-10_09:30:45.799956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:47.665884 run osmo-stp_10.42.42.5(pid=23622): stderr: | 20221210093046129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093046129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093046131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093046132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093046137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093046137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093046137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:47.799072 run osmo-stp_10.42.42.5(pid=23622): stdout: | (launched: 2022-12-10_09:30:45.799956) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:30:47.926092 run osmo-stp_10.42.42.5(pid=23622): stderr: | 20221210093046129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093046129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093046131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093046132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093046137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093046137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093046137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:30:48.076666 run patchelf(pid=23625): Terminating (SIGINT) 09:30:48.250944 run patchelf(pid=23625): Terminated: ok {rc=0} 09:30:48.376906 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23622): Process ended prematurely: osmo-stp_10.42.42.5(pid=23622) [trial-2372↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23622)] [trial-2372↪gprs:nanobts+band-900↪iperf3m4.py:8] 09:30:48.386540 tst iperf3m4.py:8: Test FAILED (11.1 sec) 09:30:48.414709 run osmo-hlr_10.42.42.2(pid=23619): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23619)] 09:30:48.463260 run osmo-hlr_10.42.42.2(pid=23619): stdout: | (launched: 2022-12-10_09:30:44.833790) 09:30:48.513455 run osmo-hlr_10.42.42.2(pid=23619): stderr: | 20221210093045012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093045012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093045012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093045012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093045012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093045012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093045024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093045032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093045033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093045033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:30:48.564016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23608): Terminating (SIGTERM) 09:30:48.604648 run iperf3-srv_10.42.42.10(pid=23609): Terminating (SIGTERM) 09:30:48.644816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23610): Terminating (SIGTERM) 09:30:48.685012 run iperf3-srv_10.42.42.10(pid=23611): Terminating (SIGTERM) 09:30:48.725084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23612): Terminating (SIGTERM) 09:30:48.765311 run iperf3-srv_10.42.42.10(pid=23613): Terminating (SIGTERM) 09:30:48.805451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23614): Terminating (SIGTERM) 09:30:48.845606 run iperf3-srv_10.42.42.10(pid=23615): Terminating (SIGTERM) 09:30:48.885700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23618): Terminating (SIGTERM) 09:30:48.925923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23621): Terminating (SIGTERM) 09:30:48.966058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23624): Terminating (SIGTERM) 09:30:49.006507 --- ParallelTerminationStrategy: PID 23608 died... 09:30:49.025420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23608): Terminated: ok {rc=0} 09:30:49.070126 --- ParallelTerminationStrategy: PID 23609 died... 09:30:49.088665 run iperf3-srv_10.42.42.10(pid=23609): Terminated {rc=256} 09:30:49.133419 --- ParallelTerminationStrategy: PID 23610 died... 09:30:49.152153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23610): Terminated: ok {rc=0} 09:30:49.196564 --- ParallelTerminationStrategy: PID 23611 died... 09:30:49.215215 run iperf3-srv_10.42.42.10(pid=23611): Terminated {rc=256} 09:30:49.259375 --- ParallelTerminationStrategy: PID 23612 died... 09:30:49.278128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23612): Terminated: ok {rc=0} 09:30:49.322722 --- ParallelTerminationStrategy: PID 23613 died... 09:30:49.341379 run iperf3-srv_10.42.42.10(pid=23613): Terminated {rc=256} 09:30:49.385768 --- ParallelTerminationStrategy: PID 23614 died... 09:30:49.404306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23614): Terminated: ok {rc=0} 09:30:49.449106 --- ParallelTerminationStrategy: PID 23615 died... 09:30:49.467776 run iperf3-srv_10.42.42.10(pid=23615): Terminated {rc=256} 09:30:49.512053 --- ParallelTerminationStrategy: PID 23618 died... 09:30:49.530857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23618): Terminated: ok {rc=0} 09:30:49.575541 --- ParallelTerminationStrategy: PID 23621 died... 09:30:49.594325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23621): Terminated: ok {rc=0} 09:30:49.638994 --- ParallelTerminationStrategy: PID 23624 died... 09:30:49.657867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23624): Terminated: ok {rc=0} 09:30:49.744092 bus /gobi_4: Setting Powered False 09:30:50.845850 bus /gobi_4: Setting Powered False 09:30:51.961758 bus /gobi_1: Setting Powered False 09:30:53.059817 bus /gobi_1: Setting Powered False 09:30:54.177051 bus /gobi_0: Setting Powered False 09:30:55.276325 bus /gobi_0: Setting Powered False 09:30:56.394505 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900 ping.py ---------------------------------------------- 09:30:57.497423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:57.509237 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:30:57.558102 tst ping.py: using LAC 27458 09:30:57.680242 tst ping.py: using RAC 173 09:30:57.801128 tst ping.py: using CellId 27458 09:30:57.928733 tst ping.py: using BVCI 27459 09:30:58.045968 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.057450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.068681 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.079759 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.090901 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.101952 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.113123 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:30:58.124148 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:30:58.242373 tst ping.py:19: start network... 09:30:58.459193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:30:58.956679 run create_hlr_db(pid=23631): Launched 09:30:59.086494 bus /gobi_6: Setting Powered False 09:31:00.149834 run create_hlr_db(pid=23631): Terminated: ok {rc=0} 09:31:00.581035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Launched 09:31:00.893763 run osmo-hlr_10.42.42.2(pid=23634): Launched 09:31:01.070724 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:01.779078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Launched 09:31:02.119969 run osmo-stp_10.42.42.5(pid=23637): Launched 09:31:02.313890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:02.837339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23639): Launched 09:31:02.953544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:03.209255 run patchelf(pid=23640): Launched 09:31:03.377732 run osmo-stp_10.42.42.5(pid=23637): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] 09:31:03.505648 run osmo-stp_10.42.42.5(pid=23637): stdout: | (launched: 2022-12-10_09:31:02.051362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:03.635328 run osmo-stp_10.42.42.5(pid=23637): stderr: | 20221210093102286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093102286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093102286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093102287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093102287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093102287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093102287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:03.764602 run osmo-stp_10.42.42.5(pid=23637): stdout: | (launched: 2022-12-10_09:31:02.051362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:03.888904 run osmo-stp_10.42.42.5(pid=23637): stderr: | 20221210093102286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093102286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093102286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093102287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093102287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093102287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093102287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:04.036021 run patchelf(pid=23640): Terminating (SIGINT) 09:31:04.206067 run patchelf(pid=23640): Terminated: ok {rc=0} 09:31:04.328143 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23637): Process ended prematurely: osmo-stp_10.42.42.5(pid=23637) [trial-2372↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] [trial-2372↪gprs:nanobts+band-900↪ping.py:22] 09:31:04.337049 tst ping.py:22: Test FAILED (6.8 sec) 09:31:04.364531 run osmo-hlr_10.42.42.2(pid=23634): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23634)] 09:31:04.412641 run osmo-hlr_10.42.42.2(pid=23634): stdout: | (launched: 2022-12-10_09:31:00.828221) 09:31:04.462424 run osmo-hlr_10.42.42.2(pid=23634): stderr: | 20221210093101198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093101198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093101198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093101198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093101199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093101199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093101219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093101235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093101236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093101236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:04.512576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Terminating (SIGTERM) 09:31:04.552325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Terminating (SIGTERM) 09:31:04.592157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23639): Terminating (SIGTERM) 09:31:04.632256 --- ParallelTerminationStrategy: PID 23633 died... 09:31:04.651376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Terminated: ok {rc=0} 09:31:04.695642 --- ParallelTerminationStrategy: PID 23636 died... 09:31:04.714429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Terminated: ok {rc=0} 09:31:04.758832 --- ParallelTerminationStrategy: PID 23639 died... 09:31:04.777424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23639): Terminated: ok {rc=0} 09:31:04.861340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 09:31:05.946644 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:05.957856 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 09:31:06.005919 tst ping_idle_ping.py: using LAC 27459 09:31:06.129417 tst ping_idle_ping.py: using RAC 174 09:31:06.248641 tst ping_idle_ping.py: using CellId 27459 09:31:06.366301 tst ping_idle_ping.py: using BVCI 27460 09:31:06.478802 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.489629 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.500149 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.511260 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.522014 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.532667 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.543522 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 09:31:06.554489 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 09:31:06.669204 tst ping_idle_ping.py:24: start network... 09:31:06.873564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:07.346263 run create_hlr_db(pid=23641): Launched 09:31:07.462117 bus /gobi_6: Setting Powered False 09:31:08.522394 run create_hlr_db(pid=23641): Terminated: ok {rc=0} 09:31:08.944621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23643): Launched 09:31:09.246950 run osmo-hlr_10.42.42.2(pid=23644): Launched 09:31:09.362682 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:09.896577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23646): Launched 09:31:10.198362 run osmo-stp_10.42.42.5(pid=23647): Launched 09:31:10.313915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:10.835270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23649): Launched 09:31:10.950282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:11.205391 run patchelf(pid=23650): Launched 09:31:11.374028 run osmo-stp_10.42.42.5(pid=23647): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23647)] 09:31:11.501639 run osmo-stp_10.42.42.5(pid=23647): stdout: | (launched: 2022-12-10_09:31:10.142514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:11.630734 run osmo-stp_10.42.42.5(pid=23647): stderr: | 20221210093110314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093110314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093110314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093110315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093110315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093110315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093110315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:11.759950 run osmo-stp_10.42.42.5(pid=23647): stdout: | (launched: 2022-12-10_09:31:10.142514) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:11.883892 run osmo-stp_10.42.42.5(pid=23647): stderr: | 20221210093110314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093110314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093110314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093110315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093110315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093110315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093110315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:12.030583 run patchelf(pid=23650): Terminating (SIGINT) 09:31:12.200502 run patchelf(pid=23650): Terminated: ok {rc=0} 09:31:12.322923 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23647): Process ended prematurely: osmo-stp_10.42.42.5(pid=23647) [trial-2372↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23647)] [trial-2372↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 09:31:12.331560 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 09:31:12.358907 run osmo-hlr_10.42.42.2(pid=23644): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23644)] 09:31:12.406562 run osmo-hlr_10.42.42.2(pid=23644): stdout: | (launched: 2022-12-10_09:31:09.191482) 09:31:12.455768 run osmo-hlr_10.42.42.2(pid=23644): stderr: | 20221210093109369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093109369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093109369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093109369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093109369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093109369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093109381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093109390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093109390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093109390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:12.505584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23643): Terminating (SIGTERM) 09:31:12.545552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23646): Terminating (SIGTERM) 09:31:12.585421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23649): Terminating (SIGTERM) 09:31:12.625535 --- ParallelTerminationStrategy: PID 23643 died... 09:31:12.644923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23643): Terminated: ok {rc=0} 09:31:12.689700 --- ParallelTerminationStrategy: PID 23646 died... 09:31:12.708086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23646): Terminated: ok {rc=0} 09:31:12.752686 --- ParallelTerminationStrategy: PID 23649 died... 09:31:12.771368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23649): Terminated: ok {rc=0} 09:31:12.855670 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 09:31:14.161289 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:31:14.168343 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 09:31:14.203244 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 09:31:14.243350 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 09:31:14.334062 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 09:31:14.368445 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 09:31:14.408595 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 09:31:15.008383 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 09:31:15.060352 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.074734 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:31:15.126365 tst cs_paging_gprs_active.py: using LAC 27460 09:31:15.256607 tst cs_paging_gprs_active.py: using RAC 175 09:31:15.384424 tst cs_paging_gprs_active.py: using CellId 27460 09:31:15.514967 tst cs_paging_gprs_active.py: using BVCI 27461 09:31:15.636292 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.648012 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.659341 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.670565 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.681657 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.692787 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.704039 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.715109 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:15.726393 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:15.848014 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:15.990472 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:31:16.225736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:16.572722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23654): Launched 09:31:16.883978 run iperf3-srv_10.42.42.10(pid=23655): Launched 09:31:17.059084 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:31:17.295722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:17.610665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23656): Launched 09:31:17.883346 run iperf3-srv_10.42.42.10(pid=23657): Launched 09:31:17.999272 tst cs_paging_gprs_active.py:38: start network... 09:31:18.206617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:18.718309 run create_hlr_db(pid=23658): Launched 09:31:18.851410 bus /gobi_6: Setting Powered False 09:31:19.915707 run create_hlr_db(pid=23658): Terminated: ok {rc=0} 09:31:20.357814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23660): Launched 09:31:20.670568 run osmo-hlr_10.42.42.2(pid=23661): Launched 09:31:20.788696 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:21.327524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23663): Launched 09:31:21.639448 run osmo-stp_10.42.42.5(pid=23664): Launched 09:31:21.758278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:22.293051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23666): Launched 09:31:22.410215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:22.674507 run patchelf(pid=23667): Launched 09:31:22.845403 run osmo-stp_10.42.42.5(pid=23664): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23664)] 09:31:22.975550 run osmo-stp_10.42.42.5(pid=23664): stdout: | (launched: 2022-12-10_09:31:21.578454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:23.107021 run osmo-stp_10.42.42.5(pid=23664): stderr: | 20221210093121754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093121754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093121755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093121755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093121755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093121756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093121756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:23.238399 run osmo-stp_10.42.42.5(pid=23664): stdout: | (launched: 2022-12-10_09:31:21.578454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:23.364260 run osmo-stp_10.42.42.5(pid=23664): stderr: | 20221210093121754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093121754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093121755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093121755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093121755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093121756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093121756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:23.513460 run patchelf(pid=23667): Terminating (SIGINT) 09:31:23.695957 run patchelf(pid=23667): Terminated: ok {rc=0} 09:31:23.827951 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23664): Process ended prematurely: osmo-stp_10.42.42.5(pid=23664) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23664)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 09:31:23.837893 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 09:31:23.866710 run osmo-hlr_10.42.42.2(pid=23661): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23661)] 09:31:23.917397 run osmo-hlr_10.42.42.2(pid=23661): stdout: | (launched: 2022-12-10_09:31:20.609795) 09:31:23.969043 run osmo-hlr_10.42.42.2(pid=23661): stderr: | 20221210093120790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093120790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093120790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093120790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093120791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093120791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093120803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093120814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093120814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093120814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:24.021315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23654): Terminating (SIGTERM) 09:31:24.063161 run iperf3-srv_10.42.42.10(pid=23655): Terminating (SIGTERM) 09:31:24.104679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23656): Terminating (SIGTERM) 09:31:24.146972 run iperf3-srv_10.42.42.10(pid=23657): Terminating (SIGTERM) 09:31:24.188468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23660): Terminating (SIGTERM) 09:31:24.230211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23663): Terminating (SIGTERM) 09:31:24.272075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23666): Terminating (SIGTERM) 09:31:24.314023 --- ParallelTerminationStrategy: PID 23654 died... 09:31:24.333499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23654): Terminated: ok {rc=0} 09:31:24.380779 --- ParallelTerminationStrategy: PID 23655 died... 09:31:24.400098 run iperf3-srv_10.42.42.10(pid=23655): Terminated {rc=256} 09:31:24.446390 --- ParallelTerminationStrategy: PID 23656 died... 09:31:24.465802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23656): Terminated: ok {rc=0} 09:31:24.512138 --- ParallelTerminationStrategy: PID 23657 died... 09:31:24.531485 run iperf3-srv_10.42.42.10(pid=23657): Terminated {rc=256} 09:31:24.578341 --- ParallelTerminationStrategy: PID 23660 died... 09:31:24.597624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23660): Terminated: ok {rc=0} 09:31:24.644201 --- ParallelTerminationStrategy: PID 23663 died... 09:31:24.663535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23663): Terminated: ok {rc=0} 09:31:24.710421 --- ParallelTerminationStrategy: PID 23666 died... 09:31:24.729737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23666): Terminated: ok {rc=0} 09:31:24.817898 bus /gobi_0: Setting Powered False 09:31:25.915834 bus /gobi_0: Setting Powered False 09:31:27.032689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 09:31:28.178212 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.189602 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:31:28.244127 tst iperf3.py: using LAC 27461 09:31:28.367820 tst iperf3.py: using RAC 176 09:31:28.486322 tst iperf3.py: using CellId 27461 09:31:28.607226 tst iperf3.py: using BVCI 27462 09:31:28.719237 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.730285 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.741020 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.752075 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.762987 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.773972 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.785110 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.795966 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:28.807148 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:28.927563 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:31:29.150379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:29.485402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23668): Launched 09:31:29.776590 run iperf3-srv_10.42.42.10(pid=23669): Launched 09:31:29.899702 tst iperf3.py:8: start network... 09:31:30.120880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:30.634883 run create_hlr_db(pid=23670): Launched 09:31:30.767098 bus /gobi_6: Setting Powered False 09:31:31.829538 run create_hlr_db(pid=23670): Terminated: ok {rc=0} 09:31:32.360825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Launched 09:31:32.692203 run osmo-hlr_10.42.42.2(pid=23673): Launched 09:31:32.816766 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:33.387866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Launched 09:31:33.719038 run osmo-stp_10.42.42.5(pid=23676): Launched 09:31:33.843016 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:34.411006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23678): Launched 09:31:34.535307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:34.815704 run patchelf(pid=23679): Launched 09:31:34.996849 run osmo-stp_10.42.42.5(pid=23676): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] 09:31:35.134661 run osmo-stp_10.42.42.5(pid=23676): stdout: | (launched: 2022-12-10_09:31:33.653859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:35.273386 run osmo-stp_10.42.42.5(pid=23676): stderr: | 20221210093133852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093133852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093133852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093133853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093133853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093133853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093133853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:35.412913 run osmo-stp_10.42.42.5(pid=23676): stdout: | (launched: 2022-12-10_09:31:33.653859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:35.546288 run osmo-stp_10.42.42.5(pid=23676): stderr: | 20221210093133852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093133852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093133852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093133853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093133853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093133853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093133853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:35.705390 run patchelf(pid=23679): Terminating (SIGINT) 09:31:35.886649 run patchelf(pid=23679): Terminated: ok {rc=0} 09:31:36.017762 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23676): Process ended prematurely: osmo-stp_10.42.42.5(pid=23676) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 09:31:36.027787 tst iperf3.py:8: Test FAILED (7.9 sec) 09:31:36.056405 run osmo-hlr_10.42.42.2(pid=23673): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23673)] 09:31:36.106029 run osmo-hlr_10.42.42.2(pid=23673): stdout: | (launched: 2022-12-10_09:31:32.627528) 09:31:36.157275 run osmo-hlr_10.42.42.2(pid=23673): stderr: | 20221210093132834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093132834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093132834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093132834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093132834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093132834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093132846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093132854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093132854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093132854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:36.208701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23668): Terminating (SIGTERM) 09:31:36.249889 run iperf3-srv_10.42.42.10(pid=23669): Terminating (SIGTERM) 09:31:36.291010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Terminating (SIGTERM) 09:31:36.331990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Terminating (SIGTERM) 09:31:36.372917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23678): Terminating (SIGTERM) 09:31:36.415168 --- ParallelTerminationStrategy: PID 23668 died... 09:31:36.434974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23668): Terminated: ok {rc=0} 09:31:36.480760 --- ParallelTerminationStrategy: PID 23669 died... 09:31:36.499890 run iperf3-srv_10.42.42.10(pid=23669): Terminated {rc=256} 09:31:36.546035 --- ParallelTerminationStrategy: PID 23672 died... 09:31:36.565833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23672): Terminated: ok {rc=0} 09:31:36.611569 --- ParallelTerminationStrategy: PID 23675 died... 09:31:36.630848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23675): Terminated: ok {rc=0} 09:31:36.676366 --- ParallelTerminationStrategy: PID 23678 died... 09:31:36.695725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23678): Terminated: ok {rc=0} 09:31:36.782322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 09:31:37.931651 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:37.943685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:31:37.994068 tst iperf3m4.py: using LAC 27462 09:31:38.121890 tst iperf3m4.py: using RAC 177 09:31:38.251625 tst iperf3m4.py: using CellId 27462 09:31:38.381431 tst iperf3m4.py: using BVCI 27463 09:31:38.501855 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.513250 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.524423 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.535692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.546791 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.557979 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.569779 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.580875 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:38.592178 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:38.709760 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:38.833266 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:38.951742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:39.069555 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:31:39.279005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:39.593228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23680): Launched 09:31:39.865122 run iperf3-srv_10.42.42.10(pid=23681): Launched 09:31:39.981693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:31:40.188605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:40.502530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23682): Launched 09:31:40.775482 run iperf3-srv_10.42.42.10(pid=23683): Launched 09:31:40.890788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:31:41.097985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:41.412234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23684): Launched 09:31:41.685325 run iperf3-srv_10.42.42.10(pid=23685): Launched 09:31:41.801437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:31:42.008250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:31:42.322129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23686): Launched 09:31:42.593786 run iperf3-srv_10.42.42.10(pid=23687): Launched 09:31:42.709379 tst iperf3m4.py:8: start network... 09:31:42.915918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:43.397378 run create_hlr_db(pid=23688): Launched 09:31:43.530989 bus /gobi_6: Setting Powered False 09:31:44.595778 run create_hlr_db(pid=23688): Terminated: ok {rc=0} 09:31:45.055048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23690): Launched 09:31:45.385321 run osmo-hlr_10.42.42.2(pid=23691): Launched 09:31:45.509561 run osmo-stp_10.42.42.5: Starting osmo-stp 09:31:46.109810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23693): Launched 09:31:46.452776 run osmo-stp_10.42.42.5(pid=23694): Launched 09:31:46.683344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:31:47.322114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23696): Launched 09:31:47.446284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:31:47.727702 run patchelf(pid=23697): Launched 09:31:47.908099 run osmo-stp_10.42.42.5(pid=23694): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23694)] 09:31:48.045828 run osmo-stp_10.42.42.5(pid=23694): stdout: | (launched: 2022-12-10_09:31:46.387912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:48.185303 run osmo-stp_10.42.42.5(pid=23694): stderr: | 20221210093146672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093146672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093146673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093146673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093146675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093146675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093146675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:48.325024 run osmo-stp_10.42.42.5(pid=23694): stdout: | (launched: 2022-12-10_09:31:46.387912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:31:48.459191 run osmo-stp_10.42.42.5(pid=23694): stderr: | 20221210093146672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093146672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093146673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093146673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093146675 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093146675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093146675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:31:48.618124 run patchelf(pid=23697): Terminating (SIGINT) 09:31:48.800292 run patchelf(pid=23697): Terminated: ok {rc=0} 09:31:48.931653 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23694): Process ended prematurely: osmo-stp_10.42.42.5(pid=23694) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23694)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 09:31:48.941804 tst iperf3m4.py:8: Test FAILED (11.0 sec) 09:31:48.970666 run osmo-hlr_10.42.42.2(pid=23691): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23691)] 09:31:49.020557 run osmo-hlr_10.42.42.2(pid=23691): stdout: | (launched: 2022-12-10_09:31:45.321671) 09:31:49.072291 run osmo-hlr_10.42.42.2(pid=23691): stderr: | 20221210093145525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093145525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093145525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093145525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093145525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093145525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093145538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093145546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093145546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093145546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:31:49.124693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23680): Terminating (SIGTERM) 09:31:49.167189 run iperf3-srv_10.42.42.10(pid=23681): Terminating (SIGTERM) 09:31:49.209085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23682): Terminating (SIGTERM) 09:31:49.250741 run iperf3-srv_10.42.42.10(pid=23683): Terminating (SIGTERM) 09:31:49.292352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23684): Terminating (SIGTERM) 09:31:49.334249 run iperf3-srv_10.42.42.10(pid=23685): Terminating (SIGTERM) 09:31:49.375880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23686): Terminating (SIGTERM) 09:31:49.417746 run iperf3-srv_10.42.42.10(pid=23687): Terminating (SIGTERM) 09:31:49.459257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23690): Terminating (SIGTERM) 09:31:49.500989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23693): Terminating (SIGTERM) 09:31:49.542674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23696): Terminating (SIGTERM) 09:31:49.585159 --- ParallelTerminationStrategy: PID 23680 died... 09:31:49.605300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23680): Terminated: ok {rc=0} 09:31:49.651498 --- ParallelTerminationStrategy: PID 23681 died... 09:31:49.671078 run iperf3-srv_10.42.42.10(pid=23681): Terminated {rc=256} 09:31:49.717126 --- ParallelTerminationStrategy: PID 23682 died... 09:31:49.736657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23682): Terminated: ok {rc=0} 09:31:49.782813 --- ParallelTerminationStrategy: PID 23683 died... 09:31:49.802460 run iperf3-srv_10.42.42.10(pid=23683): Terminated {rc=256} 09:31:49.848312 --- ParallelTerminationStrategy: PID 23684 died... 09:31:49.867914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23684): Terminated: ok {rc=0} 09:31:49.913609 --- ParallelTerminationStrategy: PID 23685 died... 09:31:49.933064 run iperf3-srv_10.42.42.10(pid=23685): Terminated {rc=256} 09:31:49.978806 --- ParallelTerminationStrategy: PID 23686 died... 09:31:49.998270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23686): Terminated: ok {rc=0} 09:31:50.044034 --- ParallelTerminationStrategy: PID 23687 died... 09:31:50.063478 run iperf3-srv_10.42.42.10(pid=23687): Terminated {rc=256} 09:31:50.109252 --- ParallelTerminationStrategy: PID 23690 died... 09:31:50.128629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23690): Terminated: ok {rc=0} 09:31:50.174276 --- ParallelTerminationStrategy: PID 23693 died... 09:31:50.193876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23693): Terminated: ok {rc=0} 09:31:50.239558 --- ParallelTerminationStrategy: PID 23696 died... 09:31:50.259078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23696): Terminated: ok {rc=0} 09:31:50.346325 bus /gobi_4: Setting Powered False 09:31:51.442811 bus /gobi_4: Setting Powered False 09:31:52.559357 bus /gobi_1: Setting Powered False 09:31:53.659129 bus /gobi_1: Setting Powered False 09:31:54.774661 bus /gobi_0: Setting Powered False 09:31:55.872365 bus /gobi_0: Setting Powered False 09:31:56.988611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 09:31:58.090339 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.102453 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:31:58.153231 tst ping.py: using LAC 27463 09:31:58.284017 tst ping.py: using RAC 178 09:31:58.410263 tst ping.py: using CellId 27463 09:31:58.534209 tst ping.py: using BVCI 27464 09:31:58.651617 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.663208 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.674595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.685917 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.697123 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.708325 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.719780 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:31:58.731128 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:31:58.847441 tst ping.py:19: start network... 09:31:59.050639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:31:59.523274 run create_hlr_db(pid=23698): Launched 09:31:59.640647 bus /gobi_6: Setting Powered False 09:32:00.701387 run create_hlr_db(pid=23698): Terminated: ok {rc=0} 09:32:01.162560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23700): Launched 09:32:01.504932 run osmo-hlr_10.42.42.2(pid=23701): Launched 09:32:01.739261 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:02.421236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23703): Launched 09:32:02.747655 run osmo-stp_10.42.42.5(pid=23704): Launched 09:32:02.870128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:03.430234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23706): Launched 09:32:03.554386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:03.831059 run patchelf(pid=23707): Launched 09:32:04.010504 run osmo-stp_10.42.42.5(pid=23704): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23704)] 09:32:04.146940 run osmo-stp_10.42.42.5(pid=23704): stdout: | (launched: 2022-12-10_09:32:02.684238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:04.284386 run osmo-stp_10.42.42.5(pid=23704): stderr: | 20221210093202882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093202882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093202882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093202883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093202883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093202883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093202883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:04.422641 run osmo-stp_10.42.42.5(pid=23704): stdout: | (launched: 2022-12-10_09:32:02.684238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:04.554998 run osmo-stp_10.42.42.5(pid=23704): stderr: | 20221210093202882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093202882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093202882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093202883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093202883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093202883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093202883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:04.712122 run patchelf(pid=23707): Terminating (SIGINT) 09:32:04.892602 run patchelf(pid=23707): Terminated: ok {rc=0} 09:32:05.022431 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23704): Process ended prematurely: osmo-stp_10.42.42.5(pid=23704) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23704)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 09:32:05.031763 tst ping.py:22: Test FAILED (6.9 sec) 09:32:05.059892 run osmo-hlr_10.42.42.2(pid=23701): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23701)] 09:32:05.109936 run osmo-hlr_10.42.42.2(pid=23701): stdout: | (launched: 2022-12-10_09:32:01.439195) 09:32:05.161275 run osmo-hlr_10.42.42.2(pid=23701): stderr: | 20221210093201662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093201662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093201663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093201663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093201663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093201663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093201684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093201699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093201699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093201699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:05.213360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23700): Terminating (SIGTERM) 09:32:05.255274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23703): Terminating (SIGTERM) 09:32:05.297385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23706): Terminating (SIGTERM) 09:32:05.340050 --- ParallelTerminationStrategy: PID 23700 died... 09:32:05.360278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23700): Terminated: ok {rc=0} 09:32:05.407343 --- ParallelTerminationStrategy: PID 23703 died... 09:32:05.427308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23703): Terminated: ok {rc=0} 09:32:05.474066 --- ParallelTerminationStrategy: PID 23706 died... 09:32:05.493891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23706): Terminated: ok {rc=0} 09:32:05.582291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 09:32:06.670543 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:06.686906 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 09:32:06.734790 tst ping_idle_ping.py: using LAC 27464 09:32:06.869998 tst ping_idle_ping.py: using RAC 179 09:32:07.003663 tst ping_idle_ping.py: using CellId 27464 09:32:07.129477 tst ping_idle_ping.py: using BVCI 27465 09:32:07.249338 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.260890 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.272448 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.284089 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.295616 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.307048 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.318809 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 09:32:07.330299 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 09:32:07.450961 tst ping_idle_ping.py:24: start network... 09:32:07.668356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:08.175373 run create_hlr_db(pid=23708): Launched 09:32:08.305876 bus /gobi_6: Setting Powered False 09:32:09.370217 run create_hlr_db(pid=23708): Terminated: ok {rc=0} 09:32:09.807923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23710): Launched 09:32:10.115415 run osmo-hlr_10.42.42.2(pid=23711): Launched 09:32:10.231426 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:10.762144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23713): Launched 09:32:11.068479 run osmo-stp_10.42.42.5(pid=23714): Launched 09:32:11.183951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:11.710640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23716): Launched 09:32:11.825596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:12.085513 run patchelf(pid=23717): Launched 09:32:12.254215 run osmo-stp_10.42.42.5(pid=23714): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23714)] 09:32:12.381981 run osmo-stp_10.42.42.5(pid=23714): stdout: | (launched: 2022-12-10_09:32:11.008746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:12.511417 run osmo-stp_10.42.42.5(pid=23714): stderr: | 20221210093211183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093211183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093211183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093211184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093211184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093211184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093211184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:12.641287 run osmo-stp_10.42.42.5(pid=23714): stdout: | (launched: 2022-12-10_09:32:11.008746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:12.765270 run osmo-stp_10.42.42.5(pid=23714): stderr: | 20221210093211183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093211183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093211183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093211184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093211184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093211184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093211184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:12.911905 run patchelf(pid=23717): Terminating (SIGINT) 09:32:13.082651 run patchelf(pid=23717): Terminated: ok {rc=0} 09:32:13.205169 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23714): Process ended prematurely: osmo-stp_10.42.42.5(pid=23714) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23714)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 09:32:13.214020 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 09:32:13.241105 run osmo-hlr_10.42.42.2(pid=23711): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23711)] 09:32:13.288777 run osmo-hlr_10.42.42.2(pid=23711): stdout: | (launched: 2022-12-10_09:32:10.055340) 09:32:13.338002 run osmo-hlr_10.42.42.2(pid=23711): stderr: | 20221210093210237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093210237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093210237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093210237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093210237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093210237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093210249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093210257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093210257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093210258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:13.387502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23710): Terminating (SIGTERM) 09:32:13.426809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23713): Terminating (SIGTERM) 09:32:13.466088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23716): Terminating (SIGTERM) 09:32:13.505766 --- ParallelTerminationStrategy: PID 23710 died... 09:32:13.524391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23710): Terminated: ok {rc=0} 09:32:13.568508 --- ParallelTerminationStrategy: PID 23713 died... 09:32:13.586906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23713): Terminated: ok {rc=0} 09:32:13.630901 --- ParallelTerminationStrategy: PID 23716 died... 09:32:13.649326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23716): Terminated: ok {rc=0} 09:32:13.732289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 09:32:15.041219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:32:15.048693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 09:32:15.082613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 09:32:15.122593 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 09:32:15.212072 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 09:32:15.245846 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 09:32:15.286121 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 09:32:15.900067 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 09:32:15.963319 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:15.974990 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:32:16.052237 tst cs_paging_gprs_active.py: using LAC 27465 09:32:16.182907 tst cs_paging_gprs_active.py: using RAC 180 09:32:16.314783 tst cs_paging_gprs_active.py: using CellId 27465 09:32:16.450030 tst cs_paging_gprs_active.py: using BVCI 27466 09:32:16.572397 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.585225 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.597145 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.609336 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.621254 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.633527 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.645730 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.657771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:16.669834 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:16.793157 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:16.911422 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:32:17.125115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:17.438900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23721): Launched 09:32:17.707534 run iperf3-srv_10.42.42.10(pid=23722): Launched 09:32:17.823427 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:32:18.030497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:18.357660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23723): Launched 09:32:18.642300 run iperf3-srv_10.42.42.10(pid=23724): Launched 09:32:18.764631 tst cs_paging_gprs_active.py:38: start network... 09:32:18.985000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:19.491866 run create_hlr_db(pid=23725): Launched 09:32:19.624198 bus /gobi_6: Setting Powered False 09:32:20.689259 run create_hlr_db(pid=23725): Terminated: ok {rc=0} 09:32:21.126477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23727): Launched 09:32:21.434732 run osmo-hlr_10.42.42.2(pid=23728): Launched 09:32:21.552917 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:22.083431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23730): Launched 09:32:22.392644 run osmo-stp_10.42.42.5(pid=23731): Launched 09:32:22.510729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:23.043028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23733): Launched 09:32:23.160744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:23.437279 run patchelf(pid=23734): Launched 09:32:23.618864 run osmo-stp_10.42.42.5(pid=23731): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23731)] 09:32:23.757383 run osmo-stp_10.42.42.5(pid=23731): stdout: | (launched: 2022-12-10_09:32:22.335944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:23.897518 run osmo-stp_10.42.42.5(pid=23731): stderr: | 20221210093222508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093222508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093222508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093222509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093222509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093222509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093222509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:24.037138 run osmo-stp_10.42.42.5(pid=23731): stdout: | (launched: 2022-12-10_09:32:22.335944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:24.171239 run osmo-stp_10.42.42.5(pid=23731): stderr: | 20221210093222508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093222508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093222508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093222509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093222509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093222509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093222509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:24.330160 run patchelf(pid=23734): Terminating (SIGINT) 09:32:24.512851 run patchelf(pid=23734): Terminated: ok {rc=0} 09:32:24.645257 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23731): Process ended prematurely: osmo-stp_10.42.42.5(pid=23731) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23731)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 09:32:24.655220 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 09:32:24.683530 run osmo-hlr_10.42.42.2(pid=23728): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23728)] 09:32:24.733152 run osmo-hlr_10.42.42.2(pid=23728): stdout: | (launched: 2022-12-10_09:32:21.378326) 09:32:24.784355 run osmo-hlr_10.42.42.2(pid=23728): stderr: | 20221210093221555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093221555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093221555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093221555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093221555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093221555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093221593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093221603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093221604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093221604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:24.836233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23721): Terminating (SIGTERM) 09:32:24.877690 run iperf3-srv_10.42.42.10(pid=23722): Terminating (SIGTERM) 09:32:24.919096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23723): Terminating (SIGTERM) 09:32:24.960592 run iperf3-srv_10.42.42.10(pid=23724): Terminating (SIGTERM) 09:32:25.001991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23727): Terminating (SIGTERM) 09:32:25.043355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23730): Terminating (SIGTERM) 09:32:25.084791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23733): Terminating (SIGTERM) 09:32:25.127013 --- ParallelTerminationStrategy: PID 23721 died... 09:32:25.146942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23721): Terminated: ok {rc=0} 09:32:25.192497 --- ParallelTerminationStrategy: PID 23722 died... 09:32:25.211781 run iperf3-srv_10.42.42.10(pid=23722): Terminated {rc=256} 09:32:25.257289 --- ParallelTerminationStrategy: PID 23723 died... 09:32:25.276382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23723): Terminated: ok {rc=0} 09:32:25.321891 --- ParallelTerminationStrategy: PID 23724 died... 09:32:25.341153 run iperf3-srv_10.42.42.10(pid=23724): Terminated {rc=256} 09:32:25.387377 --- ParallelTerminationStrategy: PID 23727 died... 09:32:25.406743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23727): Terminated: ok {rc=0} 09:32:25.452318 --- ParallelTerminationStrategy: PID 23730 died... 09:32:25.471763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23730): Terminated: ok {rc=0} 09:32:25.517250 --- ParallelTerminationStrategy: PID 23733 died... 09:32:25.536402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23733): Terminated: ok {rc=0} 09:32:25.623522 bus /gobi_0: Setting Powered False 09:32:26.721031 bus /gobi_0: Setting Powered False 09:32:27.835887 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 09:32:28.982702 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:28.994429 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:32:29.064340 tst iperf3.py: using LAC 27466 09:32:29.186373 tst iperf3.py: using RAC 181 09:32:29.307084 tst iperf3.py: using CellId 27466 09:32:29.430417 tst iperf3.py: using BVCI 27467 09:32:29.543491 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.554466 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.565393 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.576513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.587698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.598910 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.610269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.621411 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:29.632718 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:29.751500 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:32:29.973044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:30.301722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23735): Launched 09:32:30.587192 run iperf3-srv_10.42.42.10(pid=23736): Launched 09:32:30.710545 tst iperf3.py:8: start network... 09:32:30.948776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:31.467742 run create_hlr_db(pid=23737): Launched 09:32:31.633125 bus /gobi_6: Setting Powered False 09:32:32.694303 run create_hlr_db(pid=23737): Terminated: ok {rc=0} 09:32:33.154667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23739): Launched 09:32:33.483099 run osmo-hlr_10.42.42.2(pid=23740): Launched 09:32:33.608755 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:34.173124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23742): Launched 09:32:34.498614 run osmo-stp_10.42.42.5(pid=23743): Launched 09:32:34.623294 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:35.187198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23745): Launched 09:32:35.311942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:35.588192 run patchelf(pid=23746): Launched 09:32:35.768922 run osmo-stp_10.42.42.5(pid=23743): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23743)] 09:32:35.906823 run osmo-stp_10.42.42.5(pid=23743): stdout: | (launched: 2022-12-10_09:32:34.439221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:36.047819 run osmo-stp_10.42.42.5(pid=23743): stderr: | 20221210093234634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093234634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093234634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093234634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093234635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093234635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093234635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:36.187101 run osmo-stp_10.42.42.5(pid=23743): stdout: | (launched: 2022-12-10_09:32:34.439221) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:36.321147 run osmo-stp_10.42.42.5(pid=23743): stderr: | 20221210093234634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093234634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093234634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093234634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093234635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093234635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093234635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:36.479787 run patchelf(pid=23746): Terminating (SIGINT) 09:32:36.663007 run patchelf(pid=23746): Terminated: ok {rc=0} 09:32:36.794871 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23743): Process ended prematurely: osmo-stp_10.42.42.5(pid=23743) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23743)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 09:32:36.804659 tst iperf3.py:8: Test FAILED (7.9 sec) 09:32:36.832893 run osmo-hlr_10.42.42.2(pid=23740): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23740)] 09:32:36.882600 run osmo-hlr_10.42.42.2(pid=23740): stdout: | (launched: 2022-12-10_09:32:33.422654) 09:32:36.933829 run osmo-hlr_10.42.42.2(pid=23740): stderr: | 20221210093233623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093233623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093233623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093233623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093233623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093233623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093233638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093233647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093233647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093233647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:36.985593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23735): Terminating (SIGTERM) 09:32:37.026614 run iperf3-srv_10.42.42.10(pid=23736): Terminating (SIGTERM) 09:32:37.067456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23739): Terminating (SIGTERM) 09:32:37.108414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23742): Terminating (SIGTERM) 09:32:37.149286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23745): Terminating (SIGTERM) 09:32:37.190525 --- ParallelTerminationStrategy: PID 23735 died... 09:32:37.210274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23735): Terminated: ok {rc=0} 09:32:37.255843 --- ParallelTerminationStrategy: PID 23736 died... 09:32:37.275115 run iperf3-srv_10.42.42.10(pid=23736): Terminated {rc=256} 09:32:37.320443 --- ParallelTerminationStrategy: PID 23739 died... 09:32:37.339839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23739): Terminated: ok {rc=0} 09:32:37.385435 --- ParallelTerminationStrategy: PID 23742 died... 09:32:37.404599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23742): Terminated: ok {rc=0} 09:32:37.450527 --- ParallelTerminationStrategy: PID 23745 died... 09:32:37.469948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23745): Terminated: ok {rc=0} 09:32:37.557401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 09:32:38.707984 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:38.720079 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:32:38.788603 tst iperf3m4.py: using LAC 27467 09:32:38.916936 tst iperf3m4.py: using RAC 182 09:32:39.044693 tst iperf3m4.py: using CellId 27467 09:32:39.172585 tst iperf3m4.py: using BVCI 27468 09:32:39.291734 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.303100 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.314513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.325837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.336858 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.348568 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.360135 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.371511 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:39.383080 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:39.503961 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:39.625756 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:39.744582 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:39.867156 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:32:40.087938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:40.415854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Launched 09:32:40.700502 run iperf3-srv_10.42.42.10(pid=23749): Launched 09:32:40.822817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:32:41.043140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:41.371871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Launched 09:32:41.657145 run iperf3-srv_10.42.42.10(pid=23751): Launched 09:32:41.778877 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:32:41.998320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:42.325546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 09:32:42.609373 run iperf3-srv_10.42.42.10(pid=23753): Launched 09:32:42.731560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:32:42.951149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:32:43.278738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Launched 09:32:43.562853 run iperf3-srv_10.42.42.10(pid=23755): Launched 09:32:43.685194 tst iperf3m4.py:8: start network... 09:32:43.904782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:32:44.410314 run create_hlr_db(pid=23756): Launched 09:32:44.541903 bus /gobi_6: Setting Powered False 09:32:45.605790 run create_hlr_db(pid=23756): Terminated: ok {rc=0} 09:32:46.084358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Launched 09:32:46.419188 run osmo-hlr_10.42.42.2(pid=23759): Launched 09:32:46.672012 run osmo-stp_10.42.42.5: Starting osmo-stp 09:32:47.338210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Launched 09:32:47.666218 run osmo-stp_10.42.42.5(pid=23762): Launched 09:32:47.790903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:32:48.355090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Launched 09:32:48.479407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:32:48.755546 run patchelf(pid=23765): Launched 09:32:48.937729 run osmo-stp_10.42.42.5(pid=23762): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] 09:32:49.074804 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-10_09:32:47.606124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:49.213804 run osmo-stp_10.42.42.5(pid=23762): stderr: | 20221210093247801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093247801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093247801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093247802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093247802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093247802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093247802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:49.352625 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-10_09:32:47.606124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:32:49.485868 run osmo-stp_10.42.42.5(pid=23762): stderr: | 20221210093247801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093247801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093247801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093247802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093247802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093247802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093247802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:32:49.644578 run patchelf(pid=23765): Terminating (SIGINT) 09:32:49.826837 run patchelf(pid=23765): Terminated: ok {rc=0} 09:32:49.958200 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 09:32:49.968193 tst iperf3m4.py:8: Test FAILED (11.3 sec) 09:32:49.996654 run osmo-hlr_10.42.42.2(pid=23759): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23759)] 09:32:50.046072 run osmo-hlr_10.42.42.2(pid=23759): stdout: | (launched: 2022-12-10_09:32:46.356011) 09:32:50.097152 run osmo-hlr_10.42.42.2(pid=23759): stderr: | 20221210093246667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093246667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093246667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093246667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093246667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093246667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093246679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093246691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093246692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093246692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:32:50.148515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Terminating (SIGTERM) 09:32:50.189865 run iperf3-srv_10.42.42.10(pid=23749): Terminating (SIGTERM) 09:32:50.231148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminating (SIGTERM) 09:32:50.272413 run iperf3-srv_10.42.42.10(pid=23751): Terminating (SIGTERM) 09:32:50.313713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 09:32:50.354831 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 09:32:50.395910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminating (SIGTERM) 09:32:50.437044 run iperf3-srv_10.42.42.10(pid=23755): Terminating (SIGTERM) 09:32:50.477969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminating (SIGTERM) 09:32:50.518986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminating (SIGTERM) 09:32:50.560087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminating (SIGTERM) 09:32:50.601892 --- ParallelTerminationStrategy: PID 23748 died... 09:32:50.621677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23748): Terminated: ok {rc=0} 09:32:50.667509 --- ParallelTerminationStrategy: PID 23749 died... 09:32:50.686893 run iperf3-srv_10.42.42.10(pid=23749): Terminated {rc=256} 09:32:50.732291 --- ParallelTerminationStrategy: PID 23750 died... 09:32:50.751695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminated: ok {rc=0} 09:32:50.797735 --- ParallelTerminationStrategy: PID 23751 died... 09:32:50.817336 run iperf3-srv_10.42.42.10(pid=23751): Terminated {rc=256} 09:32:50.862749 --- ParallelTerminationStrategy: PID 23752 died... 09:32:50.882084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 09:32:50.927994 --- ParallelTerminationStrategy: PID 23753 died... 09:32:50.947470 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 09:32:50.992902 --- ParallelTerminationStrategy: PID 23754 died... 09:32:51.012314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminated: ok {rc=0} 09:32:51.058441 --- ParallelTerminationStrategy: PID 23755 died... 09:32:51.077914 run iperf3-srv_10.42.42.10(pid=23755): Terminated {rc=256} 09:32:51.123391 --- ParallelTerminationStrategy: PID 23758 died... 09:32:51.142773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminated: ok {rc=0} 09:32:51.188094 --- ParallelTerminationStrategy: PID 23761 died... 09:32:51.207608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminated: ok {rc=0} 09:32:51.253403 --- ParallelTerminationStrategy: PID 23764 died... 09:32:51.273035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminated: ok {rc=0} 09:32:51.361212 bus /gobi_4: Setting Powered False 09:32:52.460769 bus /gobi_4: Setting Powered False 09:32:53.577704 bus /gobi_1: Setting Powered False 09:32:54.677854 bus /gobi_1: Setting Powered False 09:32:55.795106 bus /gobi_0: Setting Powered False 09:32:56.894284 bus /gobi_0: Setting Powered False 09:32:58.013573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 09:32:59.116601 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.128252 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:32:59.196795 tst ping.py: using LAC 27468 09:32:59.315597 tst ping.py: using RAC 183 09:32:59.437116 tst ping.py: using CellId 27468 09:32:59.556121 tst ping.py: using BVCI 27469 09:32:59.668712 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.679834 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.690663 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.702258 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.713881 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.725622 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.737549 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:32:59.749263 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:32:59.865245 tst ping.py:19: start network... 09:33:00.083566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:00.582487 run create_hlr_db(pid=23766): Launched 09:33:00.713503 bus /gobi_6: Setting Powered False 09:33:01.778335 run create_hlr_db(pid=23766): Terminated: ok {rc=0} 09:33:02.228480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23769): Launched 09:33:02.544505 run osmo-hlr_10.42.42.2(pid=23770): Launched 09:33:02.661477 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:03.187155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23772): Launched 09:33:03.488466 run osmo-stp_10.42.42.5(pid=23773): Launched 09:33:03.603947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:04.126457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23775): Launched 09:33:04.242160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:04.498683 run patchelf(pid=23776): Launched 09:33:04.667767 run osmo-stp_10.42.42.5(pid=23773): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23773)] 09:33:04.795751 run osmo-stp_10.42.42.5(pid=23773): stdout: | (launched: 2022-12-10_09:33:03.432651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:04.925743 run osmo-stp_10.42.42.5(pid=23773): stderr: | 20221210093303604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093303604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093303604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093303605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093303605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093303605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093303605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:05.055747 run osmo-stp_10.42.42.5(pid=23773): stdout: | (launched: 2022-12-10_09:33:03.432651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:05.180253 run osmo-stp_10.42.42.5(pid=23773): stderr: | 20221210093303604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093303604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093303604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093303605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093303605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093303605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093303605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:05.327498 run patchelf(pid=23776): Terminating (SIGINT) 09:33:05.497432 run patchelf(pid=23776): Terminated: ok {rc=0} 09:33:05.619940 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23773): Process ended prematurely: osmo-stp_10.42.42.5(pid=23773) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23773)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 09:33:05.628671 tst ping.py:22: Test FAILED (6.5 sec) 09:33:05.655928 run osmo-hlr_10.42.42.2(pid=23770): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23770)] 09:33:05.704319 run osmo-hlr_10.42.42.2(pid=23770): stdout: | (launched: 2022-12-10_09:33:02.488620) 09:33:05.754352 run osmo-hlr_10.42.42.2(pid=23770): stderr: | 20221210093302666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093302666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093302666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093302666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093302666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093302666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093302683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093302692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093302692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093302693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:05.804695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23769): Terminating (SIGTERM) 09:33:05.844924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23772): Terminating (SIGTERM) 09:33:05.885113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23775): Terminating (SIGTERM) 09:33:05.925599 --- ParallelTerminationStrategy: PID 23769 died... 09:33:05.944759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23769): Terminated: ok {rc=0} 09:33:05.989843 --- ParallelTerminationStrategy: PID 23772 died... 09:33:06.009033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23772): Terminated: ok {rc=0} 09:33:06.053504 --- ParallelTerminationStrategy: PID 23775 died... 09:33:06.072321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23775): Terminated: ok {rc=0} 09:33:06.156573 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 09:33:07.242666 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.255132 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 09:33:07.326572 tst ping_idle_ping.py: using LAC 27469 09:33:07.454831 tst ping_idle_ping.py: using RAC 184 09:33:07.582935 tst ping_idle_ping.py: using CellId 27469 09:33:07.712399 tst ping_idle_ping.py: using BVCI 27470 09:33:07.829954 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.841357 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.852523 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.864270 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.875915 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.887710 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.899493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 09:33:07.911418 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 09:33:08.029892 tst ping_idle_ping.py:24: start network... 09:33:08.233894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:08.708544 run create_hlr_db(pid=23777): Launched 09:33:08.825444 bus /gobi_6: Setting Powered False 09:33:09.886075 run create_hlr_db(pid=23777): Terminated: ok {rc=0} 09:33:10.327764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Launched 09:33:10.650545 run osmo-hlr_10.42.42.2(pid=23780): Launched 09:33:10.774574 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:11.333677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Launched 09:33:11.655085 run osmo-stp_10.42.42.5(pid=23783): Launched 09:33:11.778521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:12.335871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23785): Launched 09:33:12.458906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:12.732534 run patchelf(pid=23786): Launched 09:33:12.911926 run osmo-stp_10.42.42.5(pid=23783): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] 09:33:13.048168 run osmo-stp_10.42.42.5(pid=23783): stdout: | (launched: 2022-12-10_09:33:11.595751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:13.185745 run osmo-stp_10.42.42.5(pid=23783): stderr: | 20221210093311787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093311787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093311788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093311788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093311789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093311789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093311789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:13.323537 run osmo-stp_10.42.42.5(pid=23783): stdout: | (launched: 2022-12-10_09:33:11.595751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:13.455705 run osmo-stp_10.42.42.5(pid=23783): stderr: | 20221210093311787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093311787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093311788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093311788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093311789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093311789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093311789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:13.612633 run patchelf(pid=23786): Terminating (SIGINT) 09:33:13.794294 run patchelf(pid=23786): Terminated: ok {rc=0} 09:33:13.924294 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23783): Process ended prematurely: osmo-stp_10.42.42.5(pid=23783) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 09:33:13.933792 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 09:33:13.961581 run osmo-hlr_10.42.42.2(pid=23780): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23780)] 09:33:14.011258 run osmo-hlr_10.42.42.2(pid=23780): stdout: | (launched: 2022-12-10_09:33:10.591286) 09:33:14.062960 run osmo-hlr_10.42.42.2(pid=23780): stderr: | 20221210093310790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093310790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093310790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093310790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093310790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093310790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093310803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093310813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093310813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093310813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:14.114731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Terminating (SIGTERM) 09:33:14.156178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Terminating (SIGTERM) 09:33:14.197847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23785): Terminating (SIGTERM) 09:33:14.239525 --- ParallelTerminationStrategy: PID 23779 died... 09:33:14.259327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Terminated: ok {rc=0} 09:33:14.305337 --- ParallelTerminationStrategy: PID 23782 died... 09:33:14.324701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Terminated: ok {rc=0} 09:33:14.370533 --- ParallelTerminationStrategy: PID 23785 died... 09:33:14.389928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23785): Terminated: ok {rc=0} 09:33:14.476881 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 09:33:15.783017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:33:15.790139 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 09:33:15.824575 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 09:33:15.887913 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 09:33:15.980314 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 09:33:16.016096 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 09:33:16.057759 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 09:33:16.715158 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 09:33:16.775766 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:16.791960 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:33:16.852852 tst cs_paging_gprs_active.py: using LAC 27470 09:33:16.984103 tst cs_paging_gprs_active.py: using RAC 185 09:33:17.143257 tst cs_paging_gprs_active.py: using CellId 27470 09:33:17.286686 tst cs_paging_gprs_active.py: using BVCI 27471 09:33:17.400458 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.411927 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.423271 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.435272 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.447103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.458915 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.471104 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.483056 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:17.495099 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:17.619355 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:17.737443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 09:33:17.943815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:18.253205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23791): Launched 09:33:18.520641 run iperf3-srv_10.42.42.10(pid=23792): Launched 09:33:18.635326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 09:33:18.839726 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:19.148575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23793): Launched 09:33:19.417314 run iperf3-srv_10.42.42.10(pid=23794): Launched 09:33:19.531833 tst cs_paging_gprs_active.py:38: start network... 09:33:19.736125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:20.214382 run create_hlr_db(pid=23795): Launched 09:33:20.347802 bus /gobi_6: Setting Powered False 09:33:21.412403 run create_hlr_db(pid=23795): Terminated: ok {rc=0} 09:33:21.850707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Launched 09:33:22.158651 run osmo-hlr_10.42.42.2(pid=23798): Launched 09:33:22.274827 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:22.816806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Launched 09:33:23.124571 run osmo-stp_10.42.42.5(pid=23801): Launched 09:33:23.241619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:23.772373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Launched 09:33:23.889408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:24.151897 run patchelf(pid=23804): Launched 09:33:24.321472 run osmo-stp_10.42.42.5(pid=23801): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] 09:33:24.450878 run osmo-stp_10.42.42.5(pid=23801): stdout: | (launched: 2022-12-10_09:33:23.065845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:24.581540 run osmo-stp_10.42.42.5(pid=23801): stderr: | 20221210093323240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093323240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093323240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093323241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093323241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093323241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093323241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:24.712780 run osmo-stp_10.42.42.5(pid=23801): stdout: | (launched: 2022-12-10_09:33:23.065845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:24.837934 run osmo-stp_10.42.42.5(pid=23801): stderr: | 20221210093323240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093323240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093323240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093323241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093323241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093323241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093323241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:24.986299 run patchelf(pid=23804): Terminating (SIGINT) 09:33:25.158259 run patchelf(pid=23804): Terminated: ok {rc=0} 09:33:25.282534 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23801): Process ended prematurely: osmo-stp_10.42.42.5(pid=23801) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 09:33:25.291926 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 09:33:25.319194 run osmo-hlr_10.42.42.2(pid=23798): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23798)] 09:33:25.366958 run osmo-hlr_10.42.42.2(pid=23798): stdout: | (launched: 2022-12-10_09:33:22.099034) 09:33:25.416104 run osmo-hlr_10.42.42.2(pid=23798): stderr: | 20221210093322279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093322279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093322279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093322279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093322280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093322280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093322292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093322302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093322302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093322302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:25.465941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23791): Terminating (SIGTERM) 09:33:25.505458 run iperf3-srv_10.42.42.10(pid=23792): Terminating (SIGTERM) 09:33:25.544731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23793): Terminating (SIGTERM) 09:33:25.584416 run iperf3-srv_10.42.42.10(pid=23794): Terminating (SIGTERM) 09:33:25.623966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Terminating (SIGTERM) 09:33:25.663724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Terminating (SIGTERM) 09:33:25.703388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Terminating (SIGTERM) 09:33:25.743420 --- ParallelTerminationStrategy: PID 23791 died... 09:33:25.762274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23791): Terminated: ok {rc=0} 09:33:25.806703 --- ParallelTerminationStrategy: PID 23792 died... 09:33:25.825241 run iperf3-srv_10.42.42.10(pid=23792): Terminated {rc=256} 09:33:25.869137 --- ParallelTerminationStrategy: PID 23793 died... 09:33:25.887230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23793): Terminated: ok {rc=0} 09:33:25.930855 --- ParallelTerminationStrategy: PID 23794 died... 09:33:25.949230 run iperf3-srv_10.42.42.10(pid=23794): Terminated {rc=256} 09:33:25.992892 --- ParallelTerminationStrategy: PID 23797 died... 09:33:26.011621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Terminated: ok {rc=0} 09:33:26.055454 --- ParallelTerminationStrategy: PID 23800 died... 09:33:26.073873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Terminated: ok {rc=0} 09:33:26.117711 --- ParallelTerminationStrategy: PID 23803 died... 09:33:26.136092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Terminated: ok {rc=0} 09:33:26.219653 bus /gobi_0: Setting Powered False 09:33:27.314091 bus /gobi_0: Setting Powered False 09:33:28.428292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 09:33:29.574732 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:29.586874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:33:29.636672 tst iperf3.py: using LAC 27471 09:33:29.765328 tst iperf3.py: using RAC 186 09:33:29.892722 tst iperf3.py: using CellId 27471 09:33:30.019616 tst iperf3.py: using BVCI 27472 09:33:30.132858 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.144480 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.155645 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.167183 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.179705 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.191401 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.203171 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.215118 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:30.226844 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:30.344648 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 09:33:30.549569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:30.868820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Launched 09:33:31.172337 run iperf3-srv_10.42.42.10(pid=23806): Launched 09:33:31.303255 tst iperf3.py:8: start network... 09:33:31.511602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:32.005242 run create_hlr_db(pid=23807): Launched 09:33:32.158083 bus /gobi_6: Setting Powered False 09:33:33.218323 run create_hlr_db(pid=23807): Terminated: ok {rc=0} 09:33:33.645969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Launched 09:33:33.954483 run osmo-hlr_10.42.42.2(pid=23810): Launched 09:33:34.071531 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:34.598776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Launched 09:33:34.906576 run osmo-stp_10.42.42.5(pid=23813): Launched 09:33:35.023109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:35.567757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23815): Launched 09:33:35.684328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:35.946930 run patchelf(pid=23816): Launched 09:33:36.117192 run osmo-stp_10.42.42.5(pid=23813): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] 09:33:36.246402 run osmo-stp_10.42.42.5(pid=23813): stdout: | (launched: 2022-12-10_09:33:34.847438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.377458 run osmo-stp_10.42.42.5(pid=23813): stderr: | 20221210093335021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093335021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093335022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093335022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093335022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093335022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093335023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:36.508522 run osmo-stp_10.42.42.5(pid=23813): stdout: | (launched: 2022-12-10_09:33:34.847438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:36.634363 run osmo-stp_10.42.42.5(pid=23813): stderr: | 20221210093335021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093335021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093335022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093335022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093335022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093335022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093335023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:36.783346 run patchelf(pid=23816): Terminating (SIGINT) 09:33:36.955425 run patchelf(pid=23816): Terminated: ok {rc=0} 09:33:37.079972 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23813): Process ended prematurely: osmo-stp_10.42.42.5(pid=23813) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 09:33:37.089583 tst iperf3.py:8: Test FAILED (7.6 sec) 09:33:37.116791 run osmo-hlr_10.42.42.2(pid=23810): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23810)] 09:33:37.165397 run osmo-hlr_10.42.42.2(pid=23810): stdout: | (launched: 2022-12-10_09:33:33.895148) 09:33:37.215094 run osmo-hlr_10.42.42.2(pid=23810): stderr: | 20221210093334076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093334076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093334076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093334076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093334076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093334076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093334088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093334096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093334096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093334097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:37.265113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Terminating (SIGTERM) 09:33:37.304585 run iperf3-srv_10.42.42.10(pid=23806): Terminating (SIGTERM) 09:33:37.343988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Terminating (SIGTERM) 09:33:37.383479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Terminating (SIGTERM) 09:33:37.422884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23815): Terminating (SIGTERM) 09:33:37.462501 --- ParallelTerminationStrategy: PID 23805 died... 09:33:37.481326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Terminated: ok {rc=0} 09:33:37.525652 --- ParallelTerminationStrategy: PID 23806 died... 09:33:37.543882 run iperf3-srv_10.42.42.10(pid=23806): Terminated {rc=256} 09:33:37.588043 --- ParallelTerminationStrategy: PID 23809 died... 09:33:37.606537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23809): Terminated: ok {rc=0} 09:33:37.650889 --- ParallelTerminationStrategy: PID 23812 died... 09:33:37.669393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23812): Terminated: ok {rc=0} 09:33:37.713515 --- ParallelTerminationStrategy: PID 23815 died... 09:33:37.732057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23815): Terminated: ok {rc=0} 09:33:37.817246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 09:33:38.964721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:38.976995 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:33:39.029762 tst iperf3m4.py: using LAC 27472 09:33:39.151777 tst iperf3m4.py: using RAC 187 09:33:39.272151 tst iperf3m4.py: using CellId 27472 09:33:39.393253 tst iperf3m4.py: using BVCI 27473 09:33:39.506157 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.517732 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.528907 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.540530 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.552075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.563663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.575350 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.586816 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:39.598750 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:39.719717 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:39.840016 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:39.959379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:40.077226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 09:33:40.285088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:40.596300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23817): Launched 09:33:40.865705 run iperf3-srv_10.42.42.10(pid=23818): Launched 09:33:40.979626 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 09:33:41.183790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:41.492128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Launched 09:33:41.760261 run iperf3-srv_10.42.42.10(pid=23820): Launched 09:33:41.874394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 09:33:42.080015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:42.390304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23821): Launched 09:33:42.658775 run iperf3-srv_10.42.42.10(pid=23822): Launched 09:33:42.773515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 09:33:42.978483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 09:33:43.288332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Launched 09:33:43.557244 run iperf3-srv_10.42.42.10(pid=23824): Launched 09:33:43.671553 tst iperf3m4.py:8: start network... 09:33:43.876670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:33:44.354411 run create_hlr_db(pid=23825): Launched 09:33:44.470331 bus /gobi_6: Setting Powered False 09:33:45.534676 run create_hlr_db(pid=23825): Terminated: ok {rc=0} 09:33:46.016631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23827): Launched 09:33:46.369662 run osmo-hlr_10.42.42.2(pid=23828): Launched 09:33:46.619091 run osmo-stp_10.42.42.5: Starting osmo-stp 09:33:47.379428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23830): Launched 09:33:47.694294 run osmo-stp_10.42.42.5(pid=23831): Launched 09:33:47.810825 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:33:48.343049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23833): Launched 09:33:48.459226 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:33:48.721245 run patchelf(pid=23834): Launched 09:33:48.890885 run osmo-stp_10.42.42.5(pid=23831): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23831)] 09:33:49.019844 run osmo-stp_10.42.42.5(pid=23831): stdout: | (launched: 2022-12-10_09:33:47.634040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:49.150793 run osmo-stp_10.42.42.5(pid=23831): stderr: | 20221210093347809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093347809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093347809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093347809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093347810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093347810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093347810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:49.281506 run osmo-stp_10.42.42.5(pid=23831): stdout: | (launched: 2022-12-10_09:33:47.634040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:33:49.406945 run osmo-stp_10.42.42.5(pid=23831): stderr: | 20221210093347809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093347809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093347809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093347809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093347810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093347810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093347810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:33:49.555264 run patchelf(pid=23834): Terminating (SIGINT) 09:33:49.726412 run patchelf(pid=23834): Terminated: ok {rc=0} 09:33:49.849689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23831): Process ended prematurely: osmo-stp_10.42.42.5(pid=23831) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23831)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 09:33:49.859075 tst iperf3m4.py:8: Test FAILED (10.9 sec) 09:33:49.886703 run osmo-hlr_10.42.42.2(pid=23828): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23828)] 09:33:49.934014 run osmo-hlr_10.42.42.2(pid=23828): stdout: | (launched: 2022-12-10_09:33:46.292115) 09:33:49.982900 run osmo-hlr_10.42.42.2(pid=23828): stderr: | 20221210093346577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093346577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093346577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093346577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093346577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093346577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093346604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093346612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093346612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093346612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:33:50.032385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23817): Terminating (SIGTERM) 09:33:50.072021 run iperf3-srv_10.42.42.10(pid=23818): Terminating (SIGTERM) 09:33:50.111654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Terminating (SIGTERM) 09:33:50.151194 run iperf3-srv_10.42.42.10(pid=23820): Terminating (SIGTERM) 09:33:50.190494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23821): Terminating (SIGTERM) 09:33:50.230019 run iperf3-srv_10.42.42.10(pid=23822): Terminating (SIGTERM) 09:33:50.269187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Terminating (SIGTERM) 09:33:50.308821 run iperf3-srv_10.42.42.10(pid=23824): Terminating (SIGTERM) 09:33:50.347985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23827): Terminating (SIGTERM) 09:33:50.387507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23830): Terminating (SIGTERM) 09:33:50.426789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23833): Terminating (SIGTERM) 09:33:50.466398 --- ParallelTerminationStrategy: PID 23817 died... 09:33:50.485234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23817): Terminated: ok {rc=0} 09:33:50.529274 --- ParallelTerminationStrategy: PID 23818 died... 09:33:50.547502 run iperf3-srv_10.42.42.10(pid=23818): Terminated {rc=256} 09:33:50.591085 --- ParallelTerminationStrategy: PID 23819 died... 09:33:50.609417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Terminated: ok {rc=0} 09:33:50.653070 --- ParallelTerminationStrategy: PID 23820 died... 09:33:50.671337 run iperf3-srv_10.42.42.10(pid=23820): Terminated {rc=256} 09:33:50.714865 --- ParallelTerminationStrategy: PID 23821 died... 09:33:50.733289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23821): Terminated: ok {rc=0} 09:33:50.776942 --- ParallelTerminationStrategy: PID 23822 died... 09:33:50.795412 run iperf3-srv_10.42.42.10(pid=23822): Terminated {rc=256} 09:33:50.839012 --- ParallelTerminationStrategy: PID 23823 died... 09:33:50.857397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Terminated: ok {rc=0} 09:33:50.901111 --- ParallelTerminationStrategy: PID 23824 died... 09:33:50.919406 run iperf3-srv_10.42.42.10(pid=23824): Terminated {rc=256} 09:33:50.963236 --- ParallelTerminationStrategy: PID 23827 died... 09:33:50.981721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23827): Terminated: ok {rc=0} 09:33:51.026075 --- ParallelTerminationStrategy: PID 23830 died... 09:33:51.044529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23830): Terminated: ok {rc=0} 09:33:51.088269 --- ParallelTerminationStrategy: PID 23833 died... 09:33:51.106611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23833): Terminated: ok {rc=0} 09:33:51.191595 bus /gobi_4: Setting Powered False 09:33:52.289825 bus /gobi_4: Setting Powered False 09:33:53.405525 bus /gobi_1: Setting Powered False 09:33:54.502393 bus /gobi_1: Setting Powered False 09:33:55.618211 bus /gobi_0: Setting Powered False 09:33:56.715585 bus /gobi_0: Setting Powered False 09:33:57.831489 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 09:33:58.931807 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:58.944214 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:33:58.995433 tst ping.py: using LAC 27473 09:33:59.115152 tst ping.py: using RAC 188 09:33:59.234679 tst ping.py: using CellId 27473 09:33:59.354473 tst ping.py: using BVCI 27474 09:33:59.464259 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.475970 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.487388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.499496 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.511456 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.523540 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.535661 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:33:59.547608 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:33:59.669371 tst ping.py:19: start network... 09:33:59.884134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:00.383324 run create_hlr_db(pid=23835): Launched 09:34:00.513662 bus /gobi_6: Setting Powered False 09:34:01.577163 run create_hlr_db(pid=23835): Terminated: ok {rc=0} 09:34:02.043110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Launched 09:34:02.377805 run osmo-hlr_10.42.42.2(pid=23838): Launched 09:34:02.499176 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:03.054665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Launched 09:34:03.376885 run osmo-stp_10.42.42.5(pid=23841): Launched 09:34:03.497106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:04.047877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23843): Launched 09:34:04.169383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:04.443153 run patchelf(pid=23844): Launched 09:34:04.619185 run osmo-stp_10.42.42.5(pid=23841): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] 09:34:04.753648 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-10_09:34:03.312799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:04.888844 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221210093403510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093403510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093403511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093403511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093403511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093403512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093403512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:05.024030 run osmo-stp_10.42.42.5(pid=23841): stdout: | (launched: 2022-12-10_09:34:03.312799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:05.154154 run osmo-stp_10.42.42.5(pid=23841): stderr: | 20221210093403510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093403510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093403511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093403511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093403511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093403512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093403512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:05.307933 run patchelf(pid=23844): Terminating (SIGINT) 09:34:05.485679 run patchelf(pid=23844): Terminated: ok {rc=0} 09:34:05.613675 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 09:34:05.623022 tst ping.py:22: Test FAILED (6.7 sec) 09:34:05.651040 run osmo-hlr_10.42.42.2(pid=23838): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23838)] 09:34:05.700632 run osmo-hlr_10.42.42.2(pid=23838): stdout: | (launched: 2022-12-10_09:34:02.315884) 09:34:05.751853 run osmo-hlr_10.42.42.2(pid=23838): stderr: | 20221210093402515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093402515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093402515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093402516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093402516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093402516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093402540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093402551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093402551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093402551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:05.803414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminating (SIGTERM) 09:34:05.844747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminating (SIGTERM) 09:34:05.886045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23843): Terminating (SIGTERM) 09:34:05.927323 --- ParallelTerminationStrategy: PID 23837 died... 09:34:05.946959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23837): Terminated: ok {rc=0} 09:34:05.992572 --- ParallelTerminationStrategy: PID 23840 died... 09:34:06.011911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23840): Terminated: ok {rc=0} 09:34:06.057351 --- ParallelTerminationStrategy: PID 23843 died... 09:34:06.076507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23843): Terminated: ok {rc=0} 09:34:06.163317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 09:34:07.247586 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.259688 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 09:34:07.310646 tst ping_idle_ping.py: using LAC 27474 09:34:07.429974 tst ping_idle_ping.py: using RAC 189 09:34:07.548187 tst ping_idle_ping.py: using CellId 27474 09:34:07.669027 tst ping_idle_ping.py: using BVCI 27475 09:34:07.778446 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.790240 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.801670 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.813695 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.825525 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.837226 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.849095 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 09:34:07.860892 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 09:34:07.976739 tst ping_idle_ping.py:24: start network... 09:34:08.179524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:08.651663 run create_hlr_db(pid=23845): Launched 09:34:08.766781 bus /gobi_6: Setting Powered False 09:34:09.826859 run create_hlr_db(pid=23845): Terminated: ok {rc=0} 09:34:10.270261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23848): Launched 09:34:10.594967 run osmo-hlr_10.42.42.2(pid=23849): Launched 09:34:10.717586 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:11.274537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23851): Launched 09:34:11.595565 run osmo-stp_10.42.42.5(pid=23852): Launched 09:34:11.717550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:12.274136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23854): Launched 09:34:12.395767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:12.670898 run patchelf(pid=23855): Launched 09:34:12.847426 run osmo-stp_10.42.42.5(pid=23852): ERR: Terminated: ERROR {rc=1} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23852)] 09:34:12.982483 run osmo-stp_10.42.42.5(pid=23852): stdout: | (launched: 2022-12-10_09:34:11.533474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:13.118843 run osmo-stp_10.42.42.5(pid=23852): stderr: | 20221210093411729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093411729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093411729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093411730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093411730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093411730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093411730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:13.255104 run osmo-stp_10.42.42.5(pid=23852): stdout: | (launched: 2022-12-10_09:34:11.533474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:13.385513 run osmo-stp_10.42.42.5(pid=23852): stderr: | 20221210093411729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093411729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093411729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093411730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093411730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093411730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093411730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:13.540093 run patchelf(pid=23855): Terminating (SIGINT) 09:34:13.720083 run patchelf(pid=23855): Terminated: ok {rc=0} 09:34:13.849203 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23852): Process ended prematurely: osmo-stp_10.42.42.5(pid=23852) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23852)] [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 09:34:13.858736 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 09:34:13.886525 run osmo-hlr_10.42.42.2(pid=23849): ERR: Terminated: ERROR {rc=237} [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23849)] 09:34:13.935967 run osmo-hlr_10.42.42.2(pid=23849): stdout: | (launched: 2022-12-10_09:34:10.530983) 09:34:13.987484 run osmo-hlr_10.42.42.2(pid=23849): stderr: | 20221210093410735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093410736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093410736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093410736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093410736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093410736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093410747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093410755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093410756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093410756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:14.039179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23848): Terminating (SIGTERM) 09:34:14.080572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23851): Terminating (SIGTERM) 09:34:14.122101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23854): Terminating (SIGTERM) 09:34:14.163804 --- ParallelTerminationStrategy: PID 23848 died... 09:34:14.183867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23848): Terminated: ok {rc=0} 09:34:14.230682 --- ParallelTerminationStrategy: PID 23851 died... 09:34:14.250334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23851): Terminated: ok {rc=0} 09:34:14.296289 --- ParallelTerminationStrategy: PID 23854 died... 09:34:14.315906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23854): Terminated: ok {rc=0} 09:34:14.403847 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 09:34:15.727376 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:15.735773 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 09:34:15.768867 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 09:34:15.803979 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 09:34:15.862620 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 09:34:15.906947 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 09:34:15.949840 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 09:34:16.496686 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2372 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 09:34:16.502814 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:16.515324 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 09:34:16.583812 tst switch_tch_pdch.py: using LAC 27475 09:34:16.713936 tst switch_tch_pdch.py: using RAC 190 09:34:16.837740 tst switch_tch_pdch.py: using CellId 27475 09:34:16.961411 tst switch_tch_pdch.py: using BVCI 27476 09:34:17.115192 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.129045 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.144161 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.156691 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.172028 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.184371 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.198303 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 09:34:17.212691 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:34:17.331711 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 09:34:17.454820 tst switch_tch_pdch.py:51: start network... 09:34:17.655587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:18.118911 run create_hlr_db(pid=23860): Launched 09:34:18.233065 bus /gobi_6: Setting Powered False 09:34:19.292518 run create_hlr_db(pid=23860): Terminated: ok {rc=0} 09:34:19.709068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23862): Launched 09:34:20.008605 run osmo-hlr_10.42.42.2(pid=23863): Launched 09:34:20.122891 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:20.651045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23865): Launched 09:34:20.950813 run osmo-stp_10.42.42.5(pid=23866): Launched 09:34:21.067804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 09:34:21.585539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23868): Launched 09:34:21.700007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 09:34:21.954062 run patchelf(pid=23869): Launched 09:34:22.120785 run osmo-stp_10.42.42.5(pid=23866): ERR: Terminated: ERROR {rc=1} [trial-2372↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23866)] 09:34:22.247952 run osmo-stp_10.42.42.5(pid=23866): stdout: | (launched: 2022-12-10_09:34:20.895810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:22.377327 run osmo-stp_10.42.42.5(pid=23866): stderr: | 20221210093421067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093421067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093421068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093421068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093421069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093421069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093421069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:22.506136 run osmo-stp_10.42.42.5(pid=23866): stdout: | (launched: 2022-12-10_09:34:20.895810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:34:22.629768 run osmo-stp_10.42.42.5(pid=23866): stderr: | 20221210093421067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093421067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093421068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093421068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093421069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093421069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093421069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:34:22.776025 run patchelf(pid=23869): Terminating (SIGINT) 09:34:22.944159 run patchelf(pid=23869): Terminated: ok {rc=0} 09:34:23.065981 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23866): Process ended prematurely: osmo-stp_10.42.42.5(pid=23866) [trial-2372↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23866)] [trial-2372↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 09:34:23.074753 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 09:34:23.101162 run osmo-hlr_10.42.42.2(pid=23863): ERR: Terminated: ERROR {rc=237} [trial-2372↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23863)] 09:34:23.148514 run osmo-hlr_10.42.42.2(pid=23863): stdout: | (launched: 2022-12-10_09:34:19.953931) 09:34:23.197480 run osmo-hlr_10.42.42.2(pid=23863): stderr: | 20221210093420129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093420129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093420130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093420130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093420130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093420130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093420142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093420151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093420151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093420151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:23.246982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23862): Terminating (SIGTERM) 09:34:23.286635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23865): Terminating (SIGTERM) 09:34:23.325910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23868): Terminating (SIGTERM) 09:34:23.365592 --- ParallelTerminationStrategy: PID 23862 died... 09:34:23.384374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23862): Terminated: ok {rc=0} 09:34:23.428368 --- ParallelTerminationStrategy: PID 23865 died... 09:34:23.446691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23865): Terminated: ok {rc=0} 09:34:23.490546 --- ParallelTerminationStrategy: PID 23868 died... 09:34:23.508779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23868): Terminated: ok {rc=0} 09:34:23.591360 bus /gobi_0: Setting Powered False 09:34:24.688453 bus /gobi_0: Setting Powered False 09:34:25.802349 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2372 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 nitb_smpp --------------------------------------------------------------------- 09:34:27.052189 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:27.054805 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 09:34:27.075064 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 09:34:27.083136 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 09:34:27.116585 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 09:34:27.137111 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 09:34:27.143958 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 09:34:27.664876 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2372 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:34:27.669816 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:34:27.688498 tst esme_connect_policy_acceptall.py: using MSISDN 7660 09:34:27.822895 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:34:28.399742 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23873): Launched 09:34:28.709600 run osmo-nitb_10.42.42.2(pid=23874): Launched 09:34:28.879422 run osmo-nitb_10.42.42.2(pid=23874): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23874)] 09:34:29.017115 run osmo-nitb_10.42.42.2(pid=23874): stdout: | (launched: 2022-12-10_09:34:28.650025) 09:34:29.156029 run osmo-nitb_10.42.42.2(pid=23874): stderr: | (launched: 2022-12-10_09:34:28.695570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:29.294876 run osmo-nitb_10.42.42.2(pid=23874): stdout: | (launched: 2022-12-10_09:34:28.650025) 09:34:29.428423 run osmo-nitb_10.42.42.2(pid=23874): stderr: | (launched: 2022-12-10_09:34:28.695570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23874): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23874) [trial-2372↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23874)] 09:34:29.825075 tst osmo-nitb_10.42.42.2(pid=23874): stdout: | (launched: 2022-12-10_09:34:28.650025) 09:34:29.948328 tst osmo-nitb_10.42.42.2(pid=23874): stderr: | (launched: 2022-12-10_09:34:28.695570) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:30.094535 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=23874): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23874) [trial-2372↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23874)] [trial-2372↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 09:34:30.102975 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 09:34:30.109650 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23873): Terminating (SIGTERM) 09:34:30.319020 --- ParallelTerminationStrategy: PID 23873 died... 09:34:30.339482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23873): Terminated: ok {rc=0} ---------------------------------------------- trial-2372 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 09:34:30.388117 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:34:30.408757 tst esme_connect_policy_closed.py: using MSISDN 7661 09:34:30.532383 tst esme_connect_policy_closed.py: using MSISDN 7662 09:34:30.645077 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:34:31.258314 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23875): Launched 09:34:31.588087 run osmo-nitb_10.42.42.2(pid=23876): Launched 09:34:31.777816 run osmo-nitb_10.42.42.2(pid=23876): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23876)] 09:34:31.908732 run osmo-nitb_10.42.42.2(pid=23876): stdout: | (launched: 2022-12-10_09:34:31.522059) 09:34:32.040661 run osmo-nitb_10.42.42.2(pid=23876): stderr: | (launched: 2022-12-10_09:34:31.568756) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:32.172844 run osmo-nitb_10.42.42.2(pid=23876): stdout: | (launched: 2022-12-10_09:34:31.522059) 09:34:32.296661 run osmo-nitb_10.42.42.2(pid=23876): stderr: | (launched: 2022-12-10_09:34:31.568756) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:32.443974 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=23876): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23876) [trial-2372↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23876)] [trial-2372↪nitb_smpp↪esme_connect_policy_closed.py:24] 09:34:32.452440 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 09:34:32.459034 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23875): Terminating (SIGTERM) 09:34:32.668540 --- ParallelTerminationStrategy: PID 23875 died... 09:34:32.688670 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23875): Terminated: ok {rc=0} ---------------------------------------------- trial-2372 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:34:32.737230 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:34:32.748161 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:34:32.784467 tst esme_ms_sms_storeforward.py: using LAC 27476 09:34:32.912548 tst esme_ms_sms_storeforward.py: using RAC 191 09:34:33.033374 tst esme_ms_sms_storeforward.py: using CellId 27476 09:34:33.160548 tst esme_ms_sms_storeforward.py: using BVCI 27477 09:34:33.274126 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:34:33.399818 tst esme_ms_sms_storeforward.py: using MSISDN 7663 09:34:33.514035 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 09:34:33.721678 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:34:34.354214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23877): Launched 09:34:34.667697 run osmo-nitb_10.42.42.2(pid=23878): Launched 09:34:34.835102 run osmo-nitb_10.42.42.2(pid=23878): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23878)] 09:34:34.963203 run osmo-nitb_10.42.42.2(pid=23878): stdout: | (launched: 2022-12-10_09:34:34.607613) 09:34:35.092071 run osmo-nitb_10.42.42.2(pid=23878): stderr: | (launched: 2022-12-10_09:34:34.653815) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:35.221810 run osmo-nitb_10.42.42.2(pid=23878): stdout: | (launched: 2022-12-10_09:34:34.607613) 09:34:35.344465 run osmo-nitb_10.42.42.2(pid=23878): stderr: | (launched: 2022-12-10_09:34:34.653815) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:35.491674 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=23878): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23878) [trial-2372↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23878)] [trial-2372↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 09:34:35.499976 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 09:34:35.506356 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23877): Terminating (SIGTERM) 09:34:35.714488 --- ParallelTerminationStrategy: PID 23877 died... 09:34:35.734934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23877): Terminated: ok {rc=0} 09:34:35.820009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:34:36.908387 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 09:34:36.920080 tst nitb_smpp: Using 1 x bts (candidates: 1) 09:34:36.956237 tst esme_ms_sms_transaction.py: using LAC 27477 09:34:37.081180 tst esme_ms_sms_transaction.py: using RAC 192 09:34:37.203324 tst esme_ms_sms_transaction.py: using CellId 27477 09:34:37.325862 tst esme_ms_sms_transaction.py: using BVCI 27478 09:34:37.440256 tst nitb_smpp: Using 1 x modem (candidates: 1) 09:34:37.572107 tst esme_ms_sms_transaction.py: using MSISDN 7664 09:34:37.685126 tst esme_ms_sms_transaction.py:18: start nitb and bts... 09:34:37.891968 run osmo-nitb_10.42.42.2: Starting osmo-nitb 09:34:38.519320 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23879): Launched 09:34:38.830018 run osmo-nitb_10.42.42.2(pid=23880): Launched 09:34:39.001191 run osmo-nitb_10.42.42.2(pid=23880): ERR: Terminated: ERROR {rc=2} [trial-2372↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23880)] 09:34:39.139316 run osmo-nitb_10.42.42.2(pid=23880): stdout: | (launched: 2022-12-10_09:34:38.770404) 09:34:39.279089 run osmo-nitb_10.42.42.2(pid=23880): stderr: | (launched: 2022-12-10_09:34:38.816284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:39.419331 run osmo-nitb_10.42.42.2(pid=23880): stdout: | (launched: 2022-12-10_09:34:38.770404) 09:34:39.553275 run osmo-nitb_10.42.42.2(pid=23880): stderr: | (launched: 2022-12-10_09:34:38.816284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f47ff589268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23880) [trial-2372↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23880)] 09:34:39.946773 tst osmo-nitb_10.42.42.2(pid=23880): stdout: | (launched: 2022-12-10_09:34:38.770404) 09:34:40.071303 tst osmo-nitb_10.42.42.2(pid=23880): stderr: | (launched: 2022-12-10_09:34:38.816284) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 09:34:40.218243 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=23880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23880) [trial-2372↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23880)] [trial-2372↪nitb_smpp↪esme_ms_sms_transaction.py:21] 09:34:40.226977 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 09:34:40.233635 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23879): Terminating (SIGTERM) 09:34:40.443035 --- ParallelTerminationStrategy: PID 23879 died... 09:34:40.463433 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23879): Terminated: ok {rc=0} 09:34:40.549568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 smpp --------------------------------------------------------------------- 09:34:41.718348 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:34:41.721522 tst smpp: Verifying 1 x bts (candidates: 11) 09:34:41.742554 tst smpp: Verifying 6 x ip_address (candidates: 9) 09:34:41.769821 tst smpp: Verifying 1 x modem (candidates: 12) 09:34:41.805642 tst smpp: Reserving 1 x bts (candidates: 11) 09:34:41.827035 tst smpp: Reserving 6 x ip_address (candidates: 9) 09:34:41.854345 tst smpp: Reserving 1 x modem (candidates: 12) 09:34:42.382788 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 09:34:42.388126 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:42.399098 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:42.410008 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:42.420652 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:42.442609 tst esme_connect_policy_acceptall.py: using MSISDN 7665 09:34:42.563254 run osmo-stp_10.42.42.4: Starting osmo-stp 09:34:43.120388 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23884): Launched 09:34:43.445519 run osmo-stp_10.42.42.4(pid=23885): Launched 09:34:43.570386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:44.075741 run create_hlr_db(pid=23886): Launched 09:34:44.207122 bus /sierra_2: Setting Powered False 09:34:45.270709 run create_hlr_db(pid=23886): Terminated: ok {rc=0} 09:34:45.708756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23888): Launched 09:34:46.057698 run osmo-hlr_10.42.42.2(pid=23889): Launched 09:34:46.302098 run osmo-msc_10.42.42.5: Starting osmo-msc 09:34:46.980708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23891): Launched 09:34:47.313615 run osmo-msc_10.42.42.5(pid=23892): Launched 09:34:47.497859 run osmo-hlr_10.42.42.2(pid=23889): ERR: Terminated: ERROR {rc=237} [trial-2372↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23889)] 09:34:47.639581 run osmo-hlr_10.42.42.2(pid=23889): stdout: | (launched: 2022-12-10_09:34:45.991483) 09:34:47.780683 run osmo-hlr_10.42.42.2(pid=23889): stderr: | 20221210093446254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093446254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093446271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093446280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093446280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093446280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:47.918535 run osmo-hlr_10.42.42.2(pid=23889): stdout: | (launched: 2022-12-10_09:34:45.991483) 09:34:48.048372 run osmo-hlr_10.42.42.2(pid=23889): stderr: | 20221210093446254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093446254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093446254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093446271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093446280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093446280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093446280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:48.203855 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=23889): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23889) [trial-2372↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23889)] [trial-2372↪smpp↪esme_connect_policy_acceptall.py:23] 09:34:48.212669 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 09:34:48.239954 run osmo-msc_10.42.42.5(pid=23892): ERR: Terminated: ERROR {rc=9} [trial-2372↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23892)] 09:34:48.289615 run osmo-msc_10.42.42.5(pid=23892): stdout: | (launched: 2022-12-10_09:34:47.254278) 09:34:48.341206 run osmo-msc_10.42.42.5(pid=23892): stderr: | 20221210093447620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210093447620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210093447620 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093447620 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210093447620 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210093447620 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210093447620 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210093447620 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210093447620 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:34:48.392810 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23884): Terminating (SIGTERM) 09:34:48.433825 run osmo-stp_10.42.42.4(pid=23885): Terminating (SIGTERM) 09:34:48.474757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23888): Terminating (SIGTERM) 09:34:48.518214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23891): Terminating (SIGTERM) 09:34:48.563459 --- ParallelTerminationStrategy: PID 23884 died... 09:34:48.583669 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23884): Terminated: ok {rc=0} 09:34:48.631837 --- ParallelTerminationStrategy: PID 23885 died... 09:34:48.651174 run osmo-stp_10.42.42.4(pid=23885): Terminated: ok {rc=0} 09:34:48.697227 --- ParallelTerminationStrategy: PID 23888 died... 09:34:48.716581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23888): Terminated: ok {rc=0} 09:34:48.762288 --- ParallelTerminationStrategy: PID 23891 died... 09:34:48.781690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23891): Terminated: ok {rc=0} ---------------------------------------------- trial-2372 smpp esme_connect_policy_closed.py ---------------------------------------------- 09:34:48.832162 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:48.843603 tst smpp: Using 1 x bts (candidates: 1) 09:34:48.880007 tst esme_connect_policy_closed.py: using LAC 27478 09:34:49.009594 tst esme_connect_policy_closed.py: using RAC 193 09:34:49.133180 tst esme_connect_policy_closed.py: using CellId 27478 09:34:49.254729 tst esme_connect_policy_closed.py: using BVCI 27479 09:34:49.368697 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:49.379224 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:49.389812 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:49.410133 tst esme_connect_policy_closed.py: using MSISDN 7666 09:34:49.538677 tst esme_connect_policy_closed.py: using MSISDN 7667 09:34:49.658744 run osmo-stp_10.42.42.4: Starting osmo-stp 09:34:50.214992 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23895): Launched 09:34:50.541278 run osmo-stp_10.42.42.4(pid=23896): Launched 09:34:50.666670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:51.173434 run create_hlr_db(pid=23897): Launched 09:34:52.364706 run create_hlr_db(pid=23897): Terminated: ok {rc=0} 09:34:52.710583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23899): Launched 09:34:53.036937 run osmo-hlr_10.42.42.2(pid=23900): Launched 09:34:53.162630 run osmo-msc_10.42.42.5: Starting osmo-msc 09:34:53.759153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23902): Launched 09:34:54.085642 run osmo-msc_10.42.42.5(pid=23903): Launched 09:34:54.267622 run osmo-hlr_10.42.42.2(pid=23900): ERR: Terminated: ERROR {rc=237} [trial-2372↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23900)] 09:34:54.407115 run osmo-hlr_10.42.42.2(pid=23900): stdout: | (launched: 2022-12-10_09:34:52.977546) 09:34:54.545934 run osmo-hlr_10.42.42.2(pid=23900): stderr: | 20221210093453178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093453178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093453191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093453202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093453202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093453202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:54.684311 run osmo-hlr_10.42.42.2(pid=23900): stdout: | (launched: 2022-12-10_09:34:52.977546) 09:34:54.814191 run osmo-hlr_10.42.42.2(pid=23900): stderr: | 20221210093453178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093453178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093453178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093453191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093453202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093453202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093453202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:34:54.969278 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=23900): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23900) [trial-2372↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23900)] [trial-2372↪smpp↪esme_connect_policy_closed.py:31] 09:34:54.978125 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 09:34:55.005058 run osmo-msc_10.42.42.5(pid=23903): ERR: Terminated: ERROR {rc=9} [trial-2372↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=23903)] 09:34:55.054990 run osmo-msc_10.42.42.5(pid=23903): stdout: | (launched: 2022-12-10_09:34:54.026097) 09:34:55.106515 run osmo-msc_10.42.42.5(pid=23903): stderr: | 20221210093454391 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210093454391 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210093454391 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093454391 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210093454391 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210093454391 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210093454392 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210093454392 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210093454392 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 09:34:55.158102 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23895): Terminating (SIGTERM) 09:34:55.199282 run osmo-stp_10.42.42.4(pid=23896): Terminating (SIGTERM) 09:34:55.240835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23899): Terminating (SIGTERM) 09:34:55.283814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23902): Terminating (SIGTERM) 09:34:55.328576 --- ParallelTerminationStrategy: PID 23895 died... 09:34:55.348842 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23895): Terminated: ok {rc=0} 09:34:55.397277 --- ParallelTerminationStrategy: PID 23896 died... 09:34:55.416628 run osmo-stp_10.42.42.4(pid=23896): Terminated: ok {rc=0} 09:34:55.462482 --- ParallelTerminationStrategy: PID 23899 died... 09:34:55.481695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23899): Terminated: ok {rc=0} 09:34:55.527164 --- ParallelTerminationStrategy: PID 23902 died... 09:34:55.546545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23902): Terminated: ok {rc=0} ---------------------------------------------- trial-2372 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 09:34:55.597951 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:55.609525 tst smpp: Using 1 x bts (candidates: 1) 09:34:55.645718 tst esme_ms_sms_storeforward.py: using LAC 27479 09:34:55.775684 tst esme_ms_sms_storeforward.py: using RAC 194 09:34:55.904072 tst esme_ms_sms_storeforward.py: using CellId 27479 09:34:56.032589 tst esme_ms_sms_storeforward.py: using BVCI 27480 09:34:56.153690 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:56.164620 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:56.175483 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:56.186410 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:56.197317 tst smpp: Using 1 x ip_address (candidates: 6) 09:34:56.208086 tst smpp: Using 1 x modem (candidates: 1) 09:34:56.335081 tst esme_ms_sms_storeforward.py: using MSISDN 7668 09:34:56.448793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:34:56.928129 run create_hlr_db(pid=23906): Launched 09:34:58.102773 run create_hlr_db(pid=23906): Terminated: ok {rc=0} 09:34:58.428504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Launched 09:34:58.737553 run osmo-hlr_10.42.42.2(pid=23909): Launched 09:34:58.856741 run osmo-stp_10.42.42.5: Starting osmo-stp 09:34:59.404919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Launched 09:34:59.714489 run osmo-stp_10.42.42.5(pid=23912): Launched 09:34:59.832215 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:00.388381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Launched 09:35:00.718318 run osmo-msc_10.42.42.6(pid=23915): Launched 09:35:00.973414 run osmo-stp_10.42.42.5(pid=23912): ERR: Terminated: ERROR {rc=1} [trial-2372↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] 09:35:01.241490 run osmo-stp_10.42.42.5(pid=23912): stdout: | (launched: 2022-12-10_09:34:59.657980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:01.444573 run osmo-stp_10.42.42.5(pid=23912): stderr: | 20221210093459830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093459830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093459830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093459831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093459831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093459831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093459831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:01.585103 run osmo-stp_10.42.42.5(pid=23912): stdout: | (launched: 2022-12-10_09:34:59.657980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:01.748903 run osmo-stp_10.42.42.5(pid=23912): stderr: | 20221210093459830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093459830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093459830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093459831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093459831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093459831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093459831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:01.909180 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=23912): Process ended prematurely: osmo-stp_10.42.42.5(pid=23912) [trial-2372↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] [trial-2372↪smpp↪esme_ms_sms_storeforward.py:30] 09:35:01.918518 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 09:35:01.948564 run osmo-hlr_10.42.42.2(pid=23909): ERR: Terminated: ERROR {rc=237} [trial-2372↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23909)] 09:35:01.999685 run osmo-hlr_10.42.42.2(pid=23909): stdout: | (launched: 2022-12-10_09:34:58.681350) 09:35:02.052128 run osmo-hlr_10.42.42.2(pid=23909): stderr: | 20221210093458860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093458860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093458860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093458860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093458860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093458860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093458872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093458880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093458881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093458881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:02.125448 run osmo-msc_10.42.42.6(pid=23915): ERR: Terminated: ERROR {rc=2} [trial-2372↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23915)] 09:35:02.176288 run osmo-msc_10.42.42.6(pid=23915): stdout: | (launched: 2022-12-10_09:35:00.658597) 09:35:02.228732 run osmo-msc_10.42.42.6(pid=23915): stderr: | 20221210093501099 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093501099 DLGLOBAL DEBUG validating counter group 0x7f7512ec4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093501099 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093501099 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093501099 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093501100 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093501101 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093501102 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093501102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093501102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:02.281605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Terminating (SIGTERM) 09:35:02.324700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Terminating (SIGTERM) 09:35:02.369866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Terminating (SIGTERM) 09:35:02.414771 --- ParallelTerminationStrategy: PID 23908 died... 09:35:02.435105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23908): Terminated: ok {rc=0} 09:35:02.492280 --- ParallelTerminationStrategy: PID 23911 died... 09:35:02.521384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23911): Terminated: ok {rc=0} 09:35:02.568395 --- ParallelTerminationStrategy: PID 23914 died... 09:35:02.589076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23914): Terminated: ok {rc=0} 09:35:02.679158 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 smpp esme_ms_sms_transaction.py ---------------------------------------------- 09:35:03.768431 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:03.780054 tst smpp: Using 1 x bts (candidates: 1) 09:35:03.818787 tst esme_ms_sms_transaction.py: using LAC 27480 09:35:03.952900 tst esme_ms_sms_transaction.py: using RAC 195 09:35:04.081772 tst esme_ms_sms_transaction.py: using CellId 27480 09:35:04.212341 tst esme_ms_sms_transaction.py: using BVCI 27481 09:35:04.333402 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:04.344372 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:04.355536 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:04.367022 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:04.378433 tst smpp: Using 1 x ip_address (candidates: 6) 09:35:04.389942 tst smpp: Using 1 x modem (candidates: 1) 09:35:04.519838 tst esme_ms_sms_transaction.py: using MSISDN 7669 09:35:04.639516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:05.147395 run create_hlr_db(pid=23927): Launched 09:35:05.280049 bus /sierra_2: Setting Powered False 09:35:06.345477 run create_hlr_db(pid=23927): Terminated: ok {rc=0} 09:35:06.787510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Launched 09:35:07.096930 run osmo-hlr_10.42.42.2(pid=23930): Launched 09:35:07.216325 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:07.758287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Launched 09:35:08.066444 run osmo-stp_10.42.42.5(pid=23933): Launched 09:35:08.185555 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:08.743703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Launched 09:35:09.054450 run osmo-msc_10.42.42.6(pid=23936): Launched 09:35:09.228259 run osmo-stp_10.42.42.5(pid=23933): ERR: Terminated: ERROR {rc=1} [trial-2372↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] 09:35:09.360455 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-10_09:35:08.010059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:09.492342 run osmo-stp_10.42.42.5(pid=23933): stderr: | 20221210093508182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093508182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093508182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093508183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093508183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093508183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093508183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:09.621872 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-10_09:35:08.010059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:09.745499 run osmo-stp_10.42.42.5(pid=23933): stderr: | 20221210093508182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093508182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093508182 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093508183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093508183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093508183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093508183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:09.893029 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2372↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] [trial-2372↪smpp↪esme_ms_sms_transaction.py:28] 09:35:09.901483 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 09:35:09.928078 run osmo-hlr_10.42.42.2(pid=23930): ERR: Terminated: ERROR {rc=237} [trial-2372↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23930)] 09:35:09.976477 run osmo-hlr_10.42.42.2(pid=23930): stdout: | (launched: 2022-12-10_09:35:07.040516) 09:35:10.026547 run osmo-hlr_10.42.42.2(pid=23930): stderr: | 20221210093507218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093507218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093507218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093507218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093507218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093507218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093507230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093507238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093507239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093507239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:10.096126 run osmo-msc_10.42.42.6(pid=23936): ERR: Terminated: ERROR {rc=2} [trial-2372↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23936)] 09:35:10.144161 run osmo-msc_10.42.42.6(pid=23936): stdout: | (launched: 2022-12-10_09:35:08.997629) 09:35:10.194916 run osmo-msc_10.42.42.6(pid=23936): stderr: | 20221210093509269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093509270 DLGLOBAL DEBUG validating counter group 0x7f7350e8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093509270 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093509270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093509270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093509270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093509272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093509272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093509273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093509273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:10.245397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminating (SIGTERM) 09:35:10.285368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminating (SIGTERM) 09:35:10.325592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Terminating (SIGTERM) 09:35:10.365997 --- ParallelTerminationStrategy: PID 23929 died... 09:35:10.385053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminated: ok {rc=0} 09:35:10.429459 --- ParallelTerminationStrategy: PID 23932 died... 09:35:10.448212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminated: ok {rc=0} 09:35:10.492514 --- ParallelTerminationStrategy: PID 23935 died... 09:35:10.511139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23935): Terminated: ok {rc=0} 09:35:10.596588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 encryption --------------------------------------------------------------------- 09:35:11.786493 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:11.789397 tst encryption: Verifying 1 x bts (candidates: 11) 09:35:11.810876 tst encryption: Verifying 6 x ip_address (candidates: 9) 09:35:11.838231 tst encryption: Verifying 1 x modem (candidates: 12) 09:35:11.875467 tst encryption: Reserving 1 x bts (candidates: 11) 09:35:11.898323 tst encryption: Reserving 6 x ip_address (candidates: 9) 09:35:11.925772 tst encryption: Reserving 1 x modem (candidates: 12) 09:35:12.449613 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2372 encryption register_a5_0_authopt.py ---------------------------------------------- 09:35:12.501530 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:12.512362 tst encryption: Using 1 x bts (candidates: 1) 09:35:12.547319 tst register_a5_0_authopt.py: using LAC 27481 09:35:12.669861 tst register_a5_0_authopt.py: using RAC 196 09:35:12.802984 tst register_a5_0_authopt.py: using CellId 27481 09:35:12.935787 tst register_a5_0_authopt.py: using BVCI 27482 09:35:13.053896 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:13.065376 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:13.076737 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:13.088781 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:13.102578 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:13.115072 tst encryption: Using 1 x modem (candidates: 1) 09:35:13.235090 tst register_a5_0_authopt.py:8: start network... 09:35:13.451111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:13.960248 run create_hlr_db(pid=24124): Launched 09:35:14.111507 bus /sierra_2: Setting Powered False 09:35:15.176604 run create_hlr_db(pid=24124): Terminated: ok {rc=0} 09:35:15.643459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24294): Launched 09:35:15.985151 run osmo-hlr_10.42.42.2(pid=24295): Launched 09:35:16.279453 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:16.963173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24297): Launched 09:35:17.331488 run osmo-stp_10.42.42.5(pid=24298): Launched 09:35:17.501196 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:18.107707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24300): Launched 09:35:18.441346 run osmo-msc_10.42.42.6(pid=24301): Launched 09:35:18.625901 run osmo-stp_10.42.42.5(pid=24298): ERR: Terminated: ERROR {rc=1} [trial-2372↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24298)] 09:35:18.767088 run osmo-stp_10.42.42.5(pid=24298): stdout: | (launched: 2022-12-10_09:35:17.264626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:18.906964 run osmo-stp_10.42.42.5(pid=24298): stderr: | 20221210093517496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093517496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093517496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093517496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093517497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093517497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093517497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:19.044939 run osmo-stp_10.42.42.5(pid=24298): stdout: | (launched: 2022-12-10_09:35:17.264626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:19.176161 run osmo-stp_10.42.42.5(pid=24298): stderr: | 20221210093517496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093517496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093517496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093517496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093517497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093517497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093517497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:19.333581 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24298): Process ended prematurely: osmo-stp_10.42.42.5(pid=24298) [trial-2372↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24298)] [trial-2372↪encryption↪register_a5_0_authopt.py:8] 09:35:19.343199 tst register_a5_0_authopt.py:8: Test FAILED (6.9 sec) 09:35:19.370661 run osmo-hlr_10.42.42.2(pid=24295): ERR: Terminated: ERROR {rc=237} [trial-2372↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24295)] 09:35:19.420238 run osmo-hlr_10.42.42.2(pid=24295): stdout: | (launched: 2022-12-10_09:35:15.915238) 09:35:19.471653 run osmo-hlr_10.42.42.2(pid=24295): stderr: | 20221210093516240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093516240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093516240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093516240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093516240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093516241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093516258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093516276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093516276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093516276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:19.543266 run osmo-msc_10.42.42.6(pid=24301): ERR: Terminated: ERROR {rc=2} [trial-2372↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24301)] 09:35:19.593410 run osmo-msc_10.42.42.6(pid=24301): stdout: | (launched: 2022-12-10_09:35:18.377954) 09:35:19.644915 run osmo-msc_10.42.42.6(pid=24301): stderr: | 20221210093518702 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093518702 DLGLOBAL DEBUG validating counter group 0x7f5ec0e55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093518702 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093518702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093518702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093518703 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093518704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093518705 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093518705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093518705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:19.697224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24294): Terminating (SIGTERM) 09:35:19.738343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24297): Terminating (SIGTERM) 09:35:19.779934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24300): Terminating (SIGTERM) 09:35:19.821918 --- ParallelTerminationStrategy: PID 24294 died... 09:35:19.841608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24294): Terminated: ok {rc=0} 09:35:19.887576 --- ParallelTerminationStrategy: PID 24297 died... 09:35:19.907108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24297): Terminated: ok {rc=0} 09:35:19.952663 --- ParallelTerminationStrategy: PID 24300 died... 09:35:19.971875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24300): Terminated: ok {rc=0} 09:35:20.058672 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 encryption register_a5_0_authreq.py ---------------------------------------------- 09:35:21.210560 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.222267 tst encryption: Using 1 x bts (candidates: 1) 09:35:21.258581 tst register_a5_0_authreq.py: using LAC 27482 09:35:21.390674 tst register_a5_0_authreq.py: using RAC 197 09:35:21.521050 tst register_a5_0_authreq.py: using CellId 27482 09:35:21.651760 tst register_a5_0_authreq.py: using BVCI 27483 09:35:21.774488 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.785620 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.796512 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.807969 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.819252 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:21.830765 tst encryption: Using 1 x modem (candidates: 1) 09:35:21.953226 tst register_a5_0_authreq.py:8: start network... 09:35:22.178284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:22.696818 run create_hlr_db(pid=24303): Launched 09:35:22.830547 bus /sierra_2: Setting Powered False 09:35:23.892392 run create_hlr_db(pid=24303): Terminated: ok {rc=0} 09:35:24.355689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24480): Launched 09:35:24.701645 run osmo-hlr_10.42.42.2(pid=24481): Launched 09:35:24.952879 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:25.634787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24483): Launched 09:35:25.987262 run osmo-stp_10.42.42.5(pid=24484): Launched 09:35:26.240050 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:26.928864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24486): Launched 09:35:27.283662 run osmo-msc_10.42.42.6(pid=24487): Launched 09:35:27.654183 run osmo-stp_10.42.42.5(pid=24484): ERR: Terminated: ERROR {rc=1} [trial-2372↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24484)] 09:35:27.938753 run osmo-stp_10.42.42.5(pid=24484): stdout: | (launched: 2022-12-10_09:35:25.920452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:28.111806 run osmo-stp_10.42.42.5(pid=24484): stderr: | 20221210093526230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093526230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093526230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093526231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093526231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093526231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093526231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:28.255187 run osmo-stp_10.42.42.5(pid=24484): stdout: | (launched: 2022-12-10_09:35:25.920452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:28.391991 run osmo-stp_10.42.42.5(pid=24484): stderr: | 20221210093526230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093526230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093526230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093526231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093526231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093526231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093526231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:28.553458 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24484): Process ended prematurely: osmo-stp_10.42.42.5(pid=24484) [trial-2372↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24484)] [trial-2372↪encryption↪register_a5_0_authreq.py:8] 09:35:28.564073 tst register_a5_0_authreq.py:8: Test FAILED (7.4 sec) 09:35:28.594423 run osmo-hlr_10.42.42.2(pid=24481): ERR: Terminated: ERROR {rc=237} [trial-2372↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24481)] 09:35:28.646628 run osmo-hlr_10.42.42.2(pid=24481): stdout: | (launched: 2022-12-10_09:35:24.627884) 09:35:28.700083 run osmo-hlr_10.42.42.2(pid=24481): stderr: | 20221210093524937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093524937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093524937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093524937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093524938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093524938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093524962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093524974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093524975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093524975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:28.773388 run osmo-msc_10.42.42.6(pid=24487): ERR: Terminated: ERROR {rc=2} [trial-2372↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24487)] 09:35:28.826214 run osmo-msc_10.42.42.6(pid=24487): stdout: | (launched: 2022-12-10_09:35:27.215434) 09:35:28.878965 run osmo-msc_10.42.42.6(pid=24487): stderr: | 20221210093527718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093527718 DLGLOBAL DEBUG validating counter group 0x7f8d475ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093527719 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093527719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093527719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093527719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093527730 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093527730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093527730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093527730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:28.931883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24480): Terminating (SIGTERM) 09:35:28.975448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24483): Terminating (SIGTERM) 09:35:29.022127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24486): Terminating (SIGTERM) 09:35:29.067761 --- ParallelTerminationStrategy: PID 24480 died... 09:35:29.088587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24480): Terminated: ok {rc=0} 09:35:29.136195 --- ParallelTerminationStrategy: PID 24483 died... 09:35:29.156043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24483): Terminated: ok {rc=0} 09:35:29.203219 --- ParallelTerminationStrategy: PID 24486 died... 09:35:29.223120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24486): Terminated: ok {rc=0} 09:35:29.310552 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 encryption register_a5_1_authreq.py ---------------------------------------------- 09:35:30.462118 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:30.473682 tst encryption: Using 1 x bts (candidates: 1) 09:35:30.510490 tst register_a5_1_authreq.py: using LAC 27483 09:35:30.634427 tst register_a5_1_authreq.py: using RAC 198 09:35:30.758257 tst register_a5_1_authreq.py: using CellId 27483 09:35:30.901933 tst register_a5_1_authreq.py: using BVCI 27484 09:35:31.030612 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:31.041863 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:31.052888 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:31.064223 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:31.075725 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:31.087126 tst encryption: Using 1 x modem (candidates: 1) 09:35:31.210568 tst register_a5_1_authreq.py:8: start network... 09:35:31.443535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:31.978326 run create_hlr_db(pid=24490): Launched 09:35:32.149747 bus /sierra_2: Setting Powered False 09:35:33.214761 run create_hlr_db(pid=24490): Terminated: ok {rc=0} 09:35:33.679054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Launched 09:35:34.015439 run osmo-hlr_10.42.42.2(pid=24493): Launched 09:35:34.141852 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:34.721764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Launched 09:35:35.056668 run osmo-stp_10.42.42.5(pid=24496): Launched 09:35:35.182651 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:35.784509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Launched 09:35:36.119358 run osmo-msc_10.42.42.6(pid=24499): Launched 09:35:36.303673 run osmo-stp_10.42.42.5(pid=24496): ERR: Terminated: ERROR {rc=1} [trial-2372↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] 09:35:36.442915 run osmo-stp_10.42.42.5(pid=24496): stdout: | (launched: 2022-12-10_09:35:34.992471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:36.583137 run osmo-stp_10.42.42.5(pid=24496): stderr: | 20221210093535192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093535192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093535192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093535193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093535193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093535193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093535193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:36.721795 run osmo-stp_10.42.42.5(pid=24496): stdout: | (launched: 2022-12-10_09:35:34.992471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:36.853562 run osmo-stp_10.42.42.5(pid=24496): stderr: | 20221210093535192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093535192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093535192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093535193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093535193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093535193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093535193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:37.011836 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24496): Process ended prematurely: osmo-stp_10.42.42.5(pid=24496) [trial-2372↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] [trial-2372↪encryption↪register_a5_1_authreq.py:8] 09:35:37.021148 tst register_a5_1_authreq.py:8: Test FAILED (6.6 sec) 09:35:37.048464 run osmo-hlr_10.42.42.2(pid=24493): ERR: Terminated: ERROR {rc=237} [trial-2372↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24493)] 09:35:37.098164 run osmo-hlr_10.42.42.2(pid=24493): stdout: | (launched: 2022-12-10_09:35:33.950059) 09:35:37.149329 run osmo-hlr_10.42.42.2(pid=24493): stderr: | 20221210093534155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093534155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093534156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093534156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093534156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093534156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093534169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093534178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093534179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093534179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:37.220804 run osmo-msc_10.42.42.6(pid=24499): ERR: Terminated: ERROR {rc=2} [trial-2372↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24499)] 09:35:37.270189 run osmo-msc_10.42.42.6(pid=24499): stdout: | (launched: 2022-12-10_09:35:36.054173) 09:35:37.321421 run osmo-msc_10.42.42.6(pid=24499): stderr: | 20221210093536381 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093536381 DLGLOBAL DEBUG validating counter group 0x7f8f46b2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093536382 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093536382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093536382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093536382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093536384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093536384 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093536384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093536384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:37.373168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Terminating (SIGTERM) 09:35:37.414458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Terminating (SIGTERM) 09:35:37.455819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Terminating (SIGTERM) 09:35:37.497378 --- ParallelTerminationStrategy: PID 24492 died... 09:35:37.517125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Terminated: ok {rc=0} 09:35:37.562832 --- ParallelTerminationStrategy: PID 24495 died... 09:35:37.582191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Terminated: ok {rc=0} 09:35:37.627600 --- ParallelTerminationStrategy: PID 24498 died... 09:35:37.646739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Terminated: ok {rc=0} 09:35:37.733827 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2372 encryption register_a5_3_authreq.py ---------------------------------------------- 09:35:38.883194 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:38.894709 tst encryption: Using 1 x bts (candidates: 1) 09:35:38.931238 tst register_a5_3_authreq.py: using LAC 27484 09:35:39.056103 tst register_a5_3_authreq.py: using RAC 199 09:35:39.180416 tst register_a5_3_authreq.py: using CellId 27484 09:35:39.303417 tst register_a5_3_authreq.py: using BVCI 27485 09:35:39.419542 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:39.430295 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:39.440523 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:39.451299 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:39.462147 tst encryption: Using 1 x ip_address (candidates: 6) 09:35:39.472734 tst encryption: Using 1 x modem (candidates: 1) 09:35:39.604267 tst register_a5_3_authreq.py:8: start network... 09:35:39.830622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:35:40.349449 run create_hlr_db(pid=24501): Launched 09:35:40.483311 bus /sierra_2: Setting Powered False 09:35:41.547855 run create_hlr_db(pid=24501): Terminated: ok {rc=0} 09:35:42.011524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24503): Launched 09:35:42.346716 run osmo-hlr_10.42.42.2(pid=24504): Launched 09:35:42.473758 run osmo-stp_10.42.42.5: Starting osmo-stp 09:35:43.048204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24506): Launched 09:35:43.382180 run osmo-stp_10.42.42.5(pid=24507): Launched 09:35:43.509168 run osmo-msc_10.42.42.6: Starting osmo-msc 09:35:44.110290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24509): Launched 09:35:44.444767 run osmo-msc_10.42.42.6(pid=24510): Launched 09:35:44.629457 run osmo-stp_10.42.42.5(pid=24507): ERR: Terminated: ERROR {rc=1} [trial-2372↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24507)] 09:35:44.769692 run osmo-stp_10.42.42.5(pid=24507): stdout: | (launched: 2022-12-10_09:35:43.318358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:44.910339 run osmo-stp_10.42.42.5(pid=24507): stderr: | 20221210093543517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093543517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093543517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093543517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093543518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093543518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093543518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:45.048934 run osmo-stp_10.42.42.5(pid=24507): stdout: | (launched: 2022-12-10_09:35:43.318358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:35:45.180612 run osmo-stp_10.42.42.5(pid=24507): stderr: | 20221210093543517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093543517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093543517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093543517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093543518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093543518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093543518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:35:45.337680 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24507): Process ended prematurely: osmo-stp_10.42.42.5(pid=24507) [trial-2372↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24507)] [trial-2372↪encryption↪register_a5_3_authreq.py:8] 09:35:45.347085 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 09:35:45.374229 run osmo-hlr_10.42.42.2(pid=24504): ERR: Terminated: ERROR {rc=237} [trial-2372↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24504)] 09:35:45.423924 run osmo-hlr_10.42.42.2(pid=24504): stdout: | (launched: 2022-12-10_09:35:42.281896) 09:35:45.475427 run osmo-hlr_10.42.42.2(pid=24504): stderr: | 20221210093542487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093542487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093542487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093542487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093542487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093542487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093542500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093542511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093542511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093542511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:35:45.546835 run osmo-msc_10.42.42.6(pid=24510): ERR: Terminated: ERROR {rc=2} [trial-2372↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24510)] 09:35:45.596571 run osmo-msc_10.42.42.6(pid=24510): stdout: | (launched: 2022-12-10_09:35:44.380178) 09:35:45.647898 run osmo-msc_10.42.42.6(pid=24510): stderr: | 20221210093544708 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093544708 DLGLOBAL DEBUG validating counter group 0x7fa83d473c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093544708 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093544708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093544708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093544709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093544710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093544711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093544711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093544711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:35:45.699858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24503): Terminating (SIGTERM) 09:35:45.741378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24506): Terminating (SIGTERM) 09:35:45.783035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24509): Terminating (SIGTERM) 09:35:45.824586 --- ParallelTerminationStrategy: PID 24503 died... 09:35:45.844400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24503): Terminated: ok {rc=0} 09:35:45.890541 --- ParallelTerminationStrategy: PID 24506 died... 09:35:45.910208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24506): Terminated: ok {rc=0} 09:35:45.956838 --- ParallelTerminationStrategy: PID 24509 died... 09:35:45.976574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24509): Terminated: ok {rc=0} 09:35:46.065054 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 09:35:47.273755 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:35:47.278797 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 09:35:47.299145 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 09:35:47.327116 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 09:35:47.351594 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 09:35:47.371130 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 09:35:47.398973 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 09:35:47.912148 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 09:35:47.916720 tst handover.py:11: TEST_CONFIG: {} 09:35:48.139391 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:35:48.155699 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:35:48.179886 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:35:48.229658 tst handover.py: using MSISDN 7670 09:35:48.344480 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7670', subscriber_id=0} 09:35:48.453116 run srsepc_10.42.42.118: Starting srsepc 09:35:50.287249 run rm-remote-dir(pid=24515): Launched 09:35:50.410509 bus /sierra_2: Setting Powered False 09:35:51.476027 run rm-remote-dir(pid=24515): Terminated: ok {rc=0} 09:35:51.942783 run mk-remote-dir(pid=24516): Launched 09:35:53.136177 run mk-remote-dir(pid=24516): Terminated: ok {rc=0} 09:35:53.447689 run scp-inst-to-remote(pid=24517): Launched 09:35:55.640141 run scp-inst-to-remote(pid=24517): Terminated: ok {rc=0} 09:35:55.998735 run rm-remote-dir(pid=24519): Launched 09:35:57.191365 run rm-remote-dir(pid=24519): Terminated: ok {rc=0} 09:35:57.551367 run mk-remote-dir(pid=24520): Launched 09:35:58.741788 run mk-remote-dir(pid=24520): Terminated: ok {rc=0} 09:35:59.030697 run scp-cfg-to-remote(pid=24521): Launched 09:36:00.209430 run scp-cfg-to-remote(pid=24521): Terminated: ok {rc=0} 09:36:00.497040 run scp-db-to-remote(pid=24523): Launched 09:36:01.678848 run scp-db-to-remote(pid=24523): Terminated: ok {rc=0} 09:36:01.815450 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:36:02.149852 run patchelf(pid=24525): Launched 09:36:03.357223 run patchelf(pid=24525): Terminated: ok {rc=0} 09:36:03.499635 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:36:03.831276 run setcap-netadm(pid=24526): Launched 09:36:05.021674 run setcap-netadm(pid=24526): Terminated: ok {rc=0} 09:36:05.369328 run srsepc(pid=24527): Launched 09:36:05.493247 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:36:06.681180 run rm-remote-dir(pid=24528): Launched 09:36:06.871796 run srsepc(pid=24527): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24527)] 09:36:07.017491 run srsepc(pid=24527): stdout: | (launched: 2022-12-10_09:36:05.309033) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:07.162543 run srsepc(pid=24527): stderr: | (launched: 2022-12-10_09:36:05.358295) | Connection to 10.42.42.116 closed. 09:36:07.307499 run srsepc(pid=24527): stdout: | (launched: 2022-12-10_09:36:05.309033) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:07.447121 run srsepc(pid=24527): stderr: | (launched: 2022-12-10_09:36:05.358295) | Connection to 10.42.42.116 closed. 09:36:07.612686 run rm-remote-dir(pid=24528): Terminating (SIGINT) 09:36:07.804192 run rm-remote-dir(pid=24528): Terminated: ok {rc=0} 09:36:07.941781 tst handover.py:37: ERR: Error: srsepc(pid=24527): Process ended prematurely: srsepc(pid=24527) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24527)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 09:36:07.952510 tst handover.py:37: Test FAILED (20.0 sec) 09:36:08.033537 run scp-back-log(pid=24529): Launched 09:36:09.114361 run scp-back-log(pid=24529): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24529)] 09:36:09.178648 run scp-back-log(pid=24529): stdout: | (launched: 2022-12-10_09:36:08.002066) 09:36:09.244243 run scp-back-log(pid=24529): stderr: | (launched: 2022-12-10_09:36:08.022748) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:36:09.317710 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24529): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24529)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 09:36:09.365056 tst iperf3_bidir.py:13: Number of physical ue: 1 09:36:09.588507 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:36:09.632131 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 09:36:09.855501 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:36:09.871696 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:36:09.905411 tst iperf3_bidir.py: using MSISDN 7671 09:36:10.019743 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7671', subscriber_id=0} 09:36:10.128614 run srsepc_10.42.42.118: Starting srsepc 09:36:10.769140 run rm-remote-dir(pid=24531): Launched 09:36:11.949314 run rm-remote-dir(pid=24531): Terminated: ok {rc=0} 09:36:12.289751 run mk-remote-dir(pid=24532): Launched 09:36:13.469965 run mk-remote-dir(pid=24532): Terminated: ok {rc=0} 09:36:13.762208 run scp-inst-to-remote(pid=24533): Launched 09:36:15.960031 run scp-inst-to-remote(pid=24533): Terminated: ok {rc=0} 09:36:16.359679 run rm-remote-dir(pid=24535): Launched 09:36:17.615159 run rm-remote-dir(pid=24535): Terminated: ok {rc=0} 09:36:17.975453 run mk-remote-dir(pid=24536): Launched 09:36:19.168342 run mk-remote-dir(pid=24536): Terminated: ok {rc=0} 09:36:19.475822 run scp-cfg-to-remote(pid=24537): Launched 09:36:20.665843 run scp-cfg-to-remote(pid=24537): Terminated: ok {rc=0} 09:36:20.971572 run scp-db-to-remote(pid=24539): Launched 09:36:22.161677 run scp-db-to-remote(pid=24539): Terminated: ok {rc=0} 09:36:22.303031 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:36:22.635465 run patchelf(pid=24541): Launched 09:36:23.825906 run patchelf(pid=24541): Terminated: ok {rc=0} 09:36:23.967897 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:36:24.300195 run setcap-netadm(pid=24542): Launched 09:36:25.489667 run setcap-netadm(pid=24542): Terminated: ok {rc=0} 09:36:25.837271 run srsepc(pid=24543): Launched 09:36:25.961038 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:36:27.149652 run rm-remote-dir(pid=24544): Launched 09:36:27.339422 run srsepc(pid=24543): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24543)] 09:36:27.484673 run srsepc(pid=24543): stdout: | (launched: 2022-12-10_09:36:25.777368) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:27.629284 run srsepc(pid=24543): stderr: | (launched: 2022-12-10_09:36:25.826518) | Connection to 10.42.42.116 closed. 09:36:27.774117 run srsepc(pid=24543): stdout: | (launched: 2022-12-10_09:36:25.777368) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:27.912210 run srsepc(pid=24543): stderr: | (launched: 2022-12-10_09:36:25.826518) | Connection to 10.42.42.116 closed. 09:36:28.076748 run rm-remote-dir(pid=24544): Terminating (SIGINT) 09:36:28.266488 run rm-remote-dir(pid=24544): Terminated: ok {rc=0} 09:36:28.403267 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=24543): Process ended prematurely: srsepc(pid=24543) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24543)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 09:36:28.413916 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 09:36:28.493594 run scp-back-log(pid=24545): Launched 09:36:29.573921 run scp-back-log(pid=24545): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24545)] 09:36:29.637808 run scp-back-log(pid=24545): stdout: | (launched: 2022-12-10_09:36:28.462167) 09:36:29.703162 run scp-back-log(pid=24545): stderr: | (launched: 2022-12-10_09:36:28.482740) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:36:29.776469 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24545): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24545)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 09:36:29.823871 tst iperf3_dl.py:13: Number of physical ue: 1 09:36:30.046392 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:36:30.091532 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 09:36:30.300508 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:36:30.316302 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:36:30.349586 tst iperf3_dl.py: using MSISDN 7672 09:36:30.463421 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7672', subscriber_id=0} 09:36:30.572553 run srsepc_10.42.42.118: Starting srsepc 09:36:31.286834 run rm-remote-dir(pid=24547): Launched 09:36:32.490381 run rm-remote-dir(pid=24547): Terminated: ok {rc=0} 09:36:32.830805 run mk-remote-dir(pid=24548): Launched 09:36:34.011478 run mk-remote-dir(pid=24548): Terminated: ok {rc=0} 09:36:34.301322 run scp-inst-to-remote(pid=24549): Launched 09:36:36.482340 run scp-inst-to-remote(pid=24549): Terminated: ok {rc=0} 09:36:36.820129 run rm-remote-dir(pid=24551): Launched 09:36:38.001313 run rm-remote-dir(pid=24551): Terminated: ok {rc=0} 09:36:38.341837 run mk-remote-dir(pid=24552): Launched 09:36:39.522990 run mk-remote-dir(pid=24552): Terminated: ok {rc=0} 09:36:39.812896 run scp-cfg-to-remote(pid=24553): Launched 09:36:40.992137 run scp-cfg-to-remote(pid=24553): Terminated: ok {rc=0} 09:36:41.279854 run scp-db-to-remote(pid=24555): Launched 09:36:42.458306 run scp-db-to-remote(pid=24555): Terminated: ok {rc=0} 09:36:42.591631 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:36:42.904782 run patchelf(pid=24557): Launched 09:36:44.083547 run patchelf(pid=24557): Terminated: ok {rc=0} 09:36:44.216877 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:36:44.530358 run setcap-netadm(pid=24558): Launched 09:36:45.707895 run setcap-netadm(pid=24558): Terminated: ok {rc=0} 09:36:46.077740 run srsepc(pid=24559): Launched 09:36:46.239758 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:36:47.508365 run rm-remote-dir(pid=24560): Launched 09:36:47.698893 run srsepc(pid=24559): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24559)] 09:36:47.843851 run srsepc(pid=24559): stdout: | (launched: 2022-12-10_09:36:46.005560) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:47.988069 run srsepc(pid=24559): stderr: | (launched: 2022-12-10_09:36:46.052630) | Connection to 10.42.42.116 closed. 09:36:48.132695 run srsepc(pid=24559): stdout: | (launched: 2022-12-10_09:36:46.005560) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:36:48.271667 run srsepc(pid=24559): stderr: | (launched: 2022-12-10_09:36:46.052630) | Connection to 10.42.42.116 closed. 09:36:48.436733 run rm-remote-dir(pid=24560): Terminating (SIGINT) 09:36:48.627212 run rm-remote-dir(pid=24560): Terminated: ok {rc=0} 09:36:48.764418 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=24559): Process ended prematurely: srsepc(pid=24559) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24559)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 09:36:48.775119 tst iperf3_dl.py:42: Test FAILED (18.9 sec) 09:36:48.854359 run scp-back-log(pid=24561): Launched 09:36:49.934238 run scp-back-log(pid=24561): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24561)] 09:36:49.997535 run scp-back-log(pid=24561): stdout: | (launched: 2022-12-10_09:36:48.823179) 09:36:50.062113 run scp-back-log(pid=24561): stderr: | (launched: 2022-12-10_09:36:48.843722) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:36:50.135124 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24561): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24561)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 09:36:50.181928 tst iperf3_ul.py:13: Number of physical ue: 1 09:36:50.403914 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:36:50.447378 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 09:36:50.668466 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:36:50.684773 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:36:50.718227 tst iperf3_ul.py: using MSISDN 7673 09:36:50.839722 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7673', subscriber_id=0} 09:36:50.954965 run srsepc_10.42.42.118: Starting srsepc 09:36:51.630861 run rm-remote-dir(pid=24563): Launched 09:36:52.824926 run rm-remote-dir(pid=24563): Terminated: ok {rc=0} 09:36:53.186391 run mk-remote-dir(pid=24564): Launched 09:36:54.378542 run mk-remote-dir(pid=24564): Terminated: ok {rc=0} 09:36:54.686088 run scp-inst-to-remote(pid=24565): Launched 09:36:56.874893 run scp-inst-to-remote(pid=24565): Terminated: ok {rc=0} 09:36:57.214400 run rm-remote-dir(pid=24567): Launched 09:36:58.395446 run rm-remote-dir(pid=24567): Terminated: ok {rc=0} 09:36:58.736016 run mk-remote-dir(pid=24568): Launched 09:36:59.917344 run mk-remote-dir(pid=24568): Terminated: ok {rc=0} 09:37:00.208102 run scp-cfg-to-remote(pid=24569): Launched 09:37:01.391435 run scp-cfg-to-remote(pid=24569): Terminated: ok {rc=0} 09:37:01.707056 run scp-db-to-remote(pid=24571): Launched 09:37:02.951348 run scp-db-to-remote(pid=24571): Terminated: ok {rc=0} 09:37:03.085043 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:37:03.398843 run patchelf(pid=24573): Launched 09:37:04.577874 run patchelf(pid=24573): Terminated: ok {rc=0} 09:37:04.712006 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:37:05.027525 run setcap-netadm(pid=24574): Launched 09:37:06.206320 run setcap-netadm(pid=24574): Terminated: ok {rc=0} 09:37:06.534264 run srsepc(pid=24575): Launched 09:37:06.650426 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:37:07.777337 run rm-remote-dir(pid=24576): Launched 09:37:07.954724 run srsepc(pid=24575): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24575)] 09:37:08.090394 run srsepc(pid=24575): stdout: | (launched: 2022-12-10_09:37:06.477567) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:08.226815 run srsepc(pid=24575): stderr: | (launched: 2022-12-10_09:37:06.523830) | Connection to 10.42.42.116 closed. 09:37:08.363301 run srsepc(pid=24575): stdout: | (launched: 2022-12-10_09:37:06.477567) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:08.494647 run srsepc(pid=24575): stderr: | (launched: 2022-12-10_09:37:06.523830) | Connection to 10.42.42.116 closed. 09:37:08.649538 run rm-remote-dir(pid=24576): Terminating (SIGINT) 09:37:08.828521 run rm-remote-dir(pid=24576): Terminated: ok {rc=0} 09:37:08.958487 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=24575): Process ended prematurely: srsepc(pid=24575) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24575)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 09:37:08.968284 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 09:37:09.044447 run scp-back-log(pid=24577): Launched 09:37:10.120498 run scp-back-log(pid=24577): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24577)] 09:37:10.180635 run scp-back-log(pid=24577): stdout: | (launched: 2022-12-10_09:37:09.014642) 09:37:10.242260 run scp-back-log(pid=24577): stderr: | (launched: 2022-12-10_09:37:09.034155) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:37:10.311275 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24577): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24577)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 09:37:10.356361 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:37:10.372858 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:37:10.396151 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:37:10.445444 tst ping.py: using MSISDN 7674 09:37:10.560686 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7674', subscriber_id=0} 09:37:10.669556 run srsepc_10.42.42.118: Starting srsepc 09:37:11.307563 run rm-remote-dir(pid=24579): Launched 09:37:12.488377 run rm-remote-dir(pid=24579): Terminated: ok {rc=0} 09:37:12.827641 run mk-remote-dir(pid=24580): Launched 09:37:14.007118 run mk-remote-dir(pid=24580): Terminated: ok {rc=0} 09:37:14.297459 run scp-inst-to-remote(pid=24581): Launched 09:37:16.491122 run scp-inst-to-remote(pid=24581): Terminated: ok {rc=0} 09:37:16.905714 run rm-remote-dir(pid=24583): Launched 09:37:18.166831 run rm-remote-dir(pid=24583): Terminated: ok {rc=0} 09:37:18.526598 run mk-remote-dir(pid=24584): Launched 09:37:19.716242 run mk-remote-dir(pid=24584): Terminated: ok {rc=0} 09:37:20.006032 run scp-cfg-to-remote(pid=24585): Launched 09:37:21.183253 run scp-cfg-to-remote(pid=24585): Terminated: ok {rc=0} 09:37:21.471592 run scp-db-to-remote(pid=24587): Launched 09:37:22.648370 run scp-db-to-remote(pid=24587): Terminated: ok {rc=0} 09:37:22.781108 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:37:23.093535 run patchelf(pid=24589): Launched 09:37:24.270878 run patchelf(pid=24589): Terminated: ok {rc=0} 09:37:24.403229 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:37:24.715153 run setcap-netadm(pid=24590): Launched 09:37:25.892381 run setcap-netadm(pid=24590): Terminated: ok {rc=0} 09:37:26.219212 run srsepc(pid=24591): Launched 09:37:26.334711 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:37:27.454592 run rm-remote-dir(pid=24592): Launched 09:37:27.632846 run srsepc(pid=24591): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24591)] 09:37:27.769350 run srsepc(pid=24591): stdout: | (launched: 2022-12-10_09:37:26.162306) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:27.906389 run srsepc(pid=24591): stderr: | (launched: 2022-12-10_09:37:26.208483) | Connection to 10.42.42.116 closed. 09:37:28.042786 run srsepc(pid=24591): stdout: | (launched: 2022-12-10_09:37:26.162306) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:28.174094 run srsepc(pid=24591): stderr: | (launched: 2022-12-10_09:37:26.208483) | Connection to 10.42.42.116 closed. 09:37:28.329572 run rm-remote-dir(pid=24592): Terminating (SIGINT) 09:37:28.509683 run rm-remote-dir(pid=24592): Terminated: ok {rc=0} 09:37:28.639809 tst ping.py:16: ERR: Error: srsepc(pid=24591): Process ended prematurely: srsepc(pid=24591) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24591)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 09:37:28.649704 tst ping.py:16: Test FAILED (18.3 sec) 09:37:28.726537 run scp-back-log(pid=24593): Launched 09:37:29.801202 run scp-back-log(pid=24593): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24593)] 09:37:29.861407 run scp-back-log(pid=24593): stdout: | (launched: 2022-12-10_09:37:28.696186) 09:37:29.922713 run scp-back-log(pid=24593): stderr: | (launched: 2022-12-10_09:37:28.715779) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:37:29.991780 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24593): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24593)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 09:37:30.036828 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:37:30.053396 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:37:30.076544 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:37:30.127624 tst rrc_idle_mo_ping.py: using MSISDN 7675 09:37:30.244087 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7675', subscriber_id=0} 09:37:30.352675 run srsepc_10.42.42.118: Starting srsepc 09:37:31.011194 run rm-remote-dir(pid=24595): Launched 09:37:32.247120 run rm-remote-dir(pid=24595): Terminated: ok {rc=0} 09:37:32.594078 run mk-remote-dir(pid=24596): Launched 09:37:33.776606 run mk-remote-dir(pid=24596): Terminated: ok {rc=0} 09:37:34.066084 run scp-inst-to-remote(pid=24597): Launched 09:37:36.249438 run scp-inst-to-remote(pid=24597): Terminated: ok {rc=0} 09:37:36.607675 run rm-remote-dir(pid=24602): Launched 09:37:37.799671 run rm-remote-dir(pid=24602): Terminated: ok {rc=0} 09:37:38.159084 run mk-remote-dir(pid=24603): Launched 09:37:39.352429 run mk-remote-dir(pid=24603): Terminated: ok {rc=0} 09:37:39.658344 run scp-cfg-to-remote(pid=24604): Launched 09:37:40.847555 run scp-cfg-to-remote(pid=24604): Terminated: ok {rc=0} 09:37:41.151896 run scp-db-to-remote(pid=24606): Launched 09:37:42.341990 run scp-db-to-remote(pid=24606): Terminated: ok {rc=0} 09:37:42.482899 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:37:42.814327 run patchelf(pid=24608): Launched 09:37:44.003864 run patchelf(pid=24608): Terminated: ok {rc=0} 09:37:44.144428 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:37:44.475324 run setcap-netadm(pid=24609): Launched 09:37:45.664602 run setcap-netadm(pid=24609): Terminated: ok {rc=0} 09:37:46.037069 run srsepc(pid=24610): Launched 09:37:46.205187 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:37:47.430599 run rm-remote-dir(pid=24611): Launched 09:37:47.619435 run srsepc(pid=24610): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24610)] 09:37:47.765909 run srsepc(pid=24610): stdout: | (launched: 2022-12-10_09:37:45.972413) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:47.911046 run srsepc(pid=24610): stderr: | (launched: 2022-12-10_09:37:46.023225) | Connection to 10.42.42.116 closed. 09:37:48.056117 run srsepc(pid=24610): stdout: | (launched: 2022-12-10_09:37:45.972413) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:37:48.195028 run srsepc(pid=24610): stderr: | (launched: 2022-12-10_09:37:46.023225) | Connection to 10.42.42.116 closed. 09:37:48.359425 run rm-remote-dir(pid=24611): Terminating (SIGINT) 09:37:48.549375 run rm-remote-dir(pid=24611): Terminated: ok {rc=0} 09:37:48.687104 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=24610): Process ended prematurely: srsepc(pid=24610) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24610)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 09:37:48.697623 tst rrc_idle_mo_ping.py:16: Test FAILED (18.7 sec) 09:37:48.777934 run scp-back-log(pid=24612): Launched 09:37:49.857979 run scp-back-log(pid=24612): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24612)] 09:37:49.921059 run scp-back-log(pid=24612): stdout: | (launched: 2022-12-10_09:37:48.746436) 09:37:49.985831 run scp-back-log(pid=24612): stderr: | (launched: 2022-12-10_09:37:48.767171) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:37:50.058794 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24612): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24612)]') ---------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 09:37:50.106471 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 09:37:50.123589 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 09:37:50.147291 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 09:37:50.200184 tst rrc_idle_mt_ping.py: using MSISDN 7676 09:37:50.317525 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7676', subscriber_id=0} 09:37:50.427043 run srsepc_10.42.42.118: Starting srsepc 09:37:51.065880 run rm-remote-dir(pid=24614): Launched 09:37:52.246916 run rm-remote-dir(pid=24614): Terminated: ok {rc=0} 09:37:52.587117 run mk-remote-dir(pid=24615): Launched 09:37:53.767592 run mk-remote-dir(pid=24615): Terminated: ok {rc=0} 09:37:54.058773 run scp-inst-to-remote(pid=24616): Launched 09:37:56.243316 run scp-inst-to-remote(pid=24616): Terminated: ok {rc=0} 09:37:56.602058 run rm-remote-dir(pid=24618): Launched 09:37:57.795631 run rm-remote-dir(pid=24618): Terminated: ok {rc=0} 09:37:58.156246 run mk-remote-dir(pid=24619): Launched 09:37:59.348419 run mk-remote-dir(pid=24619): Terminated: ok {rc=0} 09:37:59.655632 run scp-cfg-to-remote(pid=24620): Launched 09:38:00.867845 run scp-cfg-to-remote(pid=24620): Terminated: ok {rc=0} 09:38:01.194044 run scp-db-to-remote(pid=24622): Launched 09:38:02.419231 run scp-db-to-remote(pid=24622): Terminated: ok {rc=0} 09:38:02.553243 run srsepc_10.42.42.118: Setting RPATH for srsepc 09:38:02.865934 run patchelf(pid=24624): Launched 09:38:04.044420 run patchelf(pid=24624): Terminated: ok {rc=0} 09:38:04.178629 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 09:38:04.492231 run setcap-netadm(pid=24625): Launched 09:38:05.670607 run setcap-netadm(pid=24625): Terminated: ok {rc=0} 09:38:05.998625 run srsepc(pid=24626): Launched 09:38:06.117907 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 09:38:07.243154 run rm-remote-dir(pid=24627): Launched 09:38:07.421469 run srsepc(pid=24626): ERR: Terminated: ERROR {rc=127} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24626)] 09:38:07.557344 run srsepc(pid=24626): stdout: | (launched: 2022-12-10_09:38:05.941782) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:07.693959 run srsepc(pid=24626): stderr: | (launched: 2022-12-10_09:38:05.988064) | Connection to 10.42.42.116 closed. 09:38:07.830333 run srsepc(pid=24626): stdout: | (launched: 2022-12-10_09:38:05.941782) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 09:38:07.961145 run srsepc(pid=24626): stderr: | (launched: 2022-12-10_09:38:05.988064) | Connection to 10.42.42.116 closed. 09:38:08.116838 run rm-remote-dir(pid=24627): Terminating (SIGINT) 09:38:08.296239 run rm-remote-dir(pid=24627): Terminated: ok {rc=0} 09:38:08.426770 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=24626): Process ended prematurely: srsepc(pid=24626) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24626)] [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 09:38:08.436585 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 09:38:08.513439 run scp-back-log(pid=24628): Launched 09:38:09.589436 run scp-back-log(pid=24628): ERR: Terminated: ERROR {rc=1} [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24628)] 09:38:09.649999 run scp-back-log(pid=24628): stdout: | (launched: 2022-12-10_09:38:08.483077) 09:38:09.712371 run scp-back-log(pid=24628): stderr: | (launched: 2022-12-10_09:38:08.502714) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 09:38:09.782502 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24628): launch_sync(): local process exited with status 1 [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24628)]') --------------------------------------------------------------------- trial-2372 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 09:38:09.912216 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:09.917146 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 09:38:09.958447 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 09:38:09.985350 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 09:38:10.037652 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 09:38:10.080847 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 09:38:10.107897 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 09:38:10.655225 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 09:38:10.660457 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:10.671280 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:38:10.709693 tst handover.py: using LAC 27485 09:38:10.835637 tst handover.py: using RAC 200 09:38:10.958418 tst handover.py: using CellId 27485 09:38:11.081301 tst handover.py: using BVCI 27486 09:38:11.193362 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 09:38:11.228597 tst handover.py: using LAC 27486 09:38:11.348733 tst handover.py: using RAC 201 09:38:11.469606 tst handover.py: using CellId 27486 09:38:11.589097 tst handover.py: using BVCI 27487 09:38:11.710201 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:11.721653 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:11.732887 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:11.744540 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:11.756487 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 09:38:11.767906 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:38:11.888168 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 09:38:12.007918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:12.517832 run create_hlr_db(pid=24633): Launched 09:38:13.700265 run create_hlr_db(pid=24633): Terminated: ok {rc=0} 09:38:14.048600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24635): Launched 09:38:14.377623 run osmo-hlr_10.42.42.2(pid=24636): Launched 09:38:14.502013 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:15.065085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24638): Launched 09:38:15.393475 run osmo-stp_10.42.42.5(pid=24639): Launched 09:38:15.517463 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:16.145809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24641): Launched 09:38:16.517586 run osmo-msc_10.42.42.6(pid=24654): Launched 09:38:16.908700 run osmo-stp_10.42.42.5(pid=24639): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24639)] 09:38:17.210407 run osmo-stp_10.42.42.5(pid=24639): stdout: | (launched: 2022-12-10_09:38:15.330182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:17.486538 run osmo-stp_10.42.42.5(pid=24639): stderr: | 20221210093815524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093815524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093815524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093815525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093815525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093815525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093815525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:17.643976 run osmo-stp_10.42.42.5(pid=24639): stdout: | (launched: 2022-12-10_09:38:15.330182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:17.795387 run osmo-stp_10.42.42.5(pid=24639): stderr: | 20221210093815524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093815524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093815524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093815525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093815525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093815525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093815525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:17.966245 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24639): Process ended prematurely: osmo-stp_10.42.42.5(pid=24639) [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24639)] [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 09:38:17.979050 tst handover.py:18: Test FAILED (7.3 sec) 09:38:18.009965 run osmo-hlr_10.42.42.2(pid=24636): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24636)] 09:38:18.071479 run osmo-hlr_10.42.42.2(pid=24636): stdout: | (launched: 2022-12-10_09:38:14.314443) 09:38:18.128501 run osmo-hlr_10.42.42.2(pid=24636): stderr: | 20221210093814515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093814515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093814515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093814515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093814515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093814516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093814528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093814536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093814537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093814537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:18.209909 run osmo-msc_10.42.42.6(pid=24654): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24654)] 09:38:18.271294 run osmo-msc_10.42.42.6(pid=24654): stdout: | (launched: 2022-12-10_09:38:16.428276) 09:38:18.327359 run osmo-msc_10.42.42.6(pid=24654): stderr: | 20221210093817003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093817003 DLGLOBAL DEBUG validating counter group 0x7f8d0a4a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093817003 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093817003 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093817004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093817004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093817010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093817011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093817011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093817011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:18.389532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24635): Terminating (SIGTERM) 09:38:18.443079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24638): Terminating (SIGTERM) 09:38:18.493454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24641): Terminating (SIGTERM) 09:38:18.547815 --- ParallelTerminationStrategy: PID 24635 died... 09:38:18.575859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24635): Terminated: ok {rc=0} 09:38:18.631853 --- ParallelTerminationStrategy: PID 24638 died... 09:38:18.657524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24638): Terminated: ok {rc=0} 09:38:18.717481 --- ParallelTerminationStrategy: PID 24641 died... 09:38:18.742752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24641): Terminated: ok {rc=0} 09:38:18.851441 bus /sierra_3: Setting Powered False 09:38:19.963960 bus /sierra_3: Setting Powered False 09:38:21.078421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 09:38:22.323077 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:22.328164 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:38:22.368355 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:38:22.396492 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:38:22.446809 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:38:22.487680 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:38:22.515618 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:38:23.070484 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 09:38:23.077198 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:23.089060 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:38:23.125641 tst handover.py: using LAC 27487 09:38:23.249680 tst handover.py: using RAC 202 09:38:23.378430 tst handover.py: using CellId 27487 09:38:23.501833 tst handover.py: using BVCI 27488 09:38:23.618049 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 09:38:23.654515 tst handover.py: using LAC 27488 09:38:23.777161 tst handover.py: using RAC 203 09:38:23.899199 tst handover.py: using CellId 27488 09:38:24.023789 tst handover.py: using BVCI 27489 09:38:24.140515 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:24.152361 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:24.164162 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:24.176287 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:24.188251 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:38:24.201864 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:38:24.322766 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 09:38:24.442670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:24.913369 run create_hlr_db(pid=24919): Launched 09:38:25.068034 bus /sierra_2: Setting Powered False 09:38:26.128718 run create_hlr_db(pid=24919): Terminated: ok {rc=0} 09:38:26.549448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Launched 09:38:26.893682 run osmo-hlr_10.42.42.2(pid=24922): Launched 09:38:27.136380 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:27.847143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Launched 09:38:28.184108 run osmo-stp_10.42.42.5(pid=24925): Launched 09:38:28.431414 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:29.161780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24927): Launched 09:38:29.495849 run osmo-msc_10.42.42.6(pid=24928): Launched 09:38:29.859288 run osmo-stp_10.42.42.5(pid=24925): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] 09:38:30.133594 run osmo-stp_10.42.42.5(pid=24925): stdout: | (launched: 2022-12-10_09:38:28.118615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:30.402814 run osmo-stp_10.42.42.5(pid=24925): stderr: | 20221210093828456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093828456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093828456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093828457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093828457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093828457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093828457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:30.578079 run osmo-stp_10.42.42.5(pid=24925): stdout: | (launched: 2022-12-10_09:38:28.118615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:30.706114 run osmo-stp_10.42.42.5(pid=24925): stderr: | 20221210093828456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093828456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093828456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093828457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093828457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093828457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093828457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:30.880450 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24925): Process ended prematurely: osmo-stp_10.42.42.5(pid=24925) [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 09:38:30.890342 tst handover.py:18: Test FAILED (7.8 sec) 09:38:30.923143 run osmo-hlr_10.42.42.2(pid=24922): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24922)] 09:38:30.975873 run osmo-hlr_10.42.42.2(pid=24922): stdout: | (launched: 2022-12-10_09:38:26.823571) 09:38:31.029718 run osmo-hlr_10.42.42.2(pid=24922): stderr: | 20221210093827169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093827169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093827169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093827169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093827169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093827170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093827189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093827203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093827203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093827203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:31.104175 run osmo-msc_10.42.42.6(pid=24928): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24928)] 09:38:31.156373 run osmo-msc_10.42.42.6(pid=24928): stdout: | (launched: 2022-12-10_09:38:29.425830) 09:38:31.209897 run osmo-msc_10.42.42.6(pid=24928): stderr: | 20221210093830018 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093830018 DLGLOBAL DEBUG validating counter group 0x7f57aa113c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093830019 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093830019 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093830019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093830019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093830033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093830033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093830034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093830034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:31.264895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Terminating (SIGTERM) 09:38:31.309160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Terminating (SIGTERM) 09:38:31.353925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24927): Terminating (SIGTERM) 09:38:31.400381 --- ParallelTerminationStrategy: PID 24921 died... 09:38:31.421249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24921): Terminated: ok {rc=0} 09:38:31.472596 --- ParallelTerminationStrategy: PID 24924 died... 09:38:31.493334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24924): Terminated: ok {rc=0} 09:38:31.543208 --- ParallelTerminationStrategy: PID 24927 died... 09:38:31.563840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24927): Terminated: ok {rc=0} 09:38:31.662811 bus /sierra_3: Setting Powered False 09:38:32.808877 bus /sierra_3: Setting Powered False 09:38:33.952117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 09:38:35.203035 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:35.209374 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:38:35.264529 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:38:35.292646 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:38:35.344705 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:38:35.400533 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:38:35.428367 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:38:35.977752 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 09:38:35.984375 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:35.997994 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:38:36.037367 tst handover.py: using LAC 27489 09:38:36.163892 tst handover.py: using RAC 204 09:38:36.288572 tst handover.py: using CellId 27489 09:38:36.416791 tst handover.py: using BVCI 27490 09:38:36.533488 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:38:36.582854 tst handover.py: using LAC 27490 09:38:36.710763 tst handover.py: using RAC 205 09:38:36.836837 tst handover.py: using CellId 27490 09:38:36.962386 tst handover.py: using BVCI 27491 09:38:37.083124 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:37.094521 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:37.106290 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:37.117608 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:37.128801 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:38:37.140139 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:38:37.259946 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:38:37.380621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:37.862470 run create_hlr_db(pid=24933): Launched 09:38:38.028394 bus /sierra_2: Setting Powered False 09:38:39.092227 run create_hlr_db(pid=24933): Terminated: ok {rc=0} 09:38:39.509120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Launched 09:38:39.821056 run osmo-hlr_10.42.42.2(pid=24937): Launched 09:38:39.937864 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:40.444757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Launched 09:38:40.754691 run osmo-stp_10.42.42.5(pid=24940): Launched 09:38:40.872770 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:41.406123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Launched 09:38:41.716208 run osmo-msc_10.42.42.6(pid=24943): Launched 09:38:41.888731 run osmo-stp_10.42.42.5(pid=24940): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] 09:38:42.018695 run osmo-stp_10.42.42.5(pid=24940): stdout: | (launched: 2022-12-10_09:38:40.695447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:42.150103 run osmo-stp_10.42.42.5(pid=24940): stderr: | 20221210093840870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093840870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093840870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093840871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093840871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093840871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093840871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:42.278291 run osmo-stp_10.42.42.5(pid=24940): stdout: | (launched: 2022-12-10_09:38:40.695447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:42.401113 run osmo-stp_10.42.42.5(pid=24940): stderr: | 20221210093840870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093840870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093840870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093840871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093840871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093840871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093840871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:42.546789 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24940): Process ended prematurely: osmo-stp_10.42.42.5(pid=24940) [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 09:38:42.554806 tst handover.py:18: Test FAILED (6.6 sec) 09:38:42.580523 run osmo-hlr_10.42.42.2(pid=24937): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24937)] 09:38:42.628009 run osmo-hlr_10.42.42.2(pid=24937): stdout: | (launched: 2022-12-10_09:38:39.761056) 09:38:42.677373 run osmo-hlr_10.42.42.2(pid=24937): stderr: | 20221210093839942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093839943 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093839943 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093839943 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093839943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093839943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093839954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093839963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093839964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093839964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:42.745922 run osmo-msc_10.42.42.6(pid=24943): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24943)] 09:38:42.793421 run osmo-msc_10.42.42.6(pid=24943): stdout: | (launched: 2022-12-10_09:38:41.656771) 09:38:42.842360 run osmo-msc_10.42.42.6(pid=24943): stderr: | 20221210093841930 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093841930 DLGLOBAL DEBUG validating counter group 0x7fb1ac9a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093841930 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093841930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093841930 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093841931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093841932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093841933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093841933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093841933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:42.891647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Terminating (SIGTERM) 09:38:42.930915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Terminating (SIGTERM) 09:38:42.970039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Terminating (SIGTERM) 09:38:43.009360 --- ParallelTerminationStrategy: PID 24936 died... 09:38:43.028214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24936): Terminated: ok {rc=0} 09:38:43.071809 --- ParallelTerminationStrategy: PID 24939 died... 09:38:43.090192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24939): Terminated: ok {rc=0} 09:38:43.134141 --- ParallelTerminationStrategy: PID 24942 died... 09:38:43.152537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24942): Terminated: ok {rc=0} 09:38:43.238352 bus /sierra_3: Setting Powered False 09:38:44.337713 bus /sierra_3: Setting Powered False 09:38:45.452502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:38:46.752457 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:46.758036 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:38:46.810619 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:38:46.838292 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:38:46.890088 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:38:46.955851 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:38:46.995107 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:38:47.519209 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:38:47.524521 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:47.535583 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:38:47.572833 tst handover.py: using LAC 27491 09:38:47.692588 tst handover.py: using RAC 206 09:38:47.816187 tst handover.py: using CellId 27491 09:38:47.936676 tst handover.py: using BVCI 27492 09:38:48.048159 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:38:48.091531 tst handover.py: using LAC 27492 09:38:48.210231 tst handover.py: using RAC 207 09:38:48.332136 tst handover.py: using CellId 27492 09:38:48.453630 tst handover.py: using BVCI 27493 09:38:48.565200 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:48.576170 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:48.587008 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:48.597929 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:48.608725 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:38:48.619712 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:38:48.738578 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:38:48.856193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:38:49.305938 run create_hlr_db(pid=24948): Launched 09:38:49.430009 bus /sierra_2: Setting Powered False 09:38:50.490579 run create_hlr_db(pid=24948): Terminated: ok {rc=0} 09:38:50.909376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24950): Launched 09:38:51.235293 run osmo-hlr_10.42.42.2(pid=24951): Launched 09:38:51.360830 run osmo-stp_10.42.42.5: Starting osmo-stp 09:38:51.898961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24953): Launched 09:38:52.224843 run osmo-stp_10.42.42.5(pid=24954): Launched 09:38:52.350488 run osmo-msc_10.42.42.6: Starting osmo-msc 09:38:52.917492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24956): Launched 09:38:53.244206 run osmo-msc_10.42.42.6(pid=24957): Launched 09:38:53.427081 run osmo-stp_10.42.42.5(pid=24954): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24954)] 09:38:53.564710 run osmo-stp_10.42.42.5(pid=24954): stdout: | (launched: 2022-12-10_09:38:52.165560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:53.702903 run osmo-stp_10.42.42.5(pid=24954): stderr: | 20221210093852359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093852359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093852360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093852360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093852361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093852361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093852361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:53.841230 run osmo-stp_10.42.42.5(pid=24954): stdout: | (launched: 2022-12-10_09:38:52.165560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:38:53.971077 run osmo-stp_10.42.42.5(pid=24954): stderr: | 20221210093852359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093852359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093852360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093852360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093852361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093852361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093852361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:38:54.127116 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24954): Process ended prematurely: osmo-stp_10.42.42.5(pid=24954) [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24954)] [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 09:38:54.135847 tst handover.py:18: Test FAILED (6.6 sec) 09:38:54.163604 run osmo-hlr_10.42.42.2(pid=24951): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24951)] 09:38:54.213642 run osmo-hlr_10.42.42.2(pid=24951): stdout: | (launched: 2022-12-10_09:38:51.176130) 09:38:54.265456 run osmo-hlr_10.42.42.2(pid=24951): stderr: | 20221210093851373 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093851373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093851373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093851374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093851374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093851374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093851386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093851395 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093851395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093851395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:38:54.337353 run osmo-msc_10.42.42.6(pid=24957): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24957)] 09:38:54.387536 run osmo-msc_10.42.42.6(pid=24957): stdout: | (launched: 2022-12-10_09:38:53.184754) 09:38:54.439114 run osmo-msc_10.42.42.6(pid=24957): stderr: | 20221210093853508 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093853508 DLGLOBAL DEBUG validating counter group 0x7f2cf26dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093853508 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093853508 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093853508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093853508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093853510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093853511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093853511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093853511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:38:54.491449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24950): Terminating (SIGTERM) 09:38:54.533237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24953): Terminating (SIGTERM) 09:38:54.575051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24956): Terminating (SIGTERM) 09:38:54.617272 --- ParallelTerminationStrategy: PID 24950 died... 09:38:54.637142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24950): Terminated: ok {rc=0} 09:38:54.683458 --- ParallelTerminationStrategy: PID 24953 died... 09:38:54.702907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24953): Terminated: ok {rc=0} 09:38:54.749237 --- ParallelTerminationStrategy: PID 24956 died... 09:38:54.768504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24956): Terminated: ok {rc=0} 09:38:54.857824 bus /sierra_3: Setting Powered False 09:38:55.953899 bus /sierra_3: Setting Powered False 09:38:57.068563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:38:58.328884 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:38:58.334252 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:38:58.387809 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:38:58.414310 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:38:58.463655 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:38:58.517873 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:38:58.544309 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:38:59.098764 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:38:59.103818 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:38:59.114800 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:38:59.151598 tst handover.py: using LAC 27493 09:38:59.270596 tst handover.py: using RAC 208 09:38:59.390559 tst handover.py: using CellId 27493 09:38:59.511619 tst handover.py: using BVCI 27494 09:38:59.624872 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:38:59.675715 tst handover.py: using LAC 27494 09:38:59.806501 tst handover.py: using RAC 209 09:38:59.938695 tst handover.py: using CellId 27494 09:39:00.059502 tst handover.py: using BVCI 27495 09:39:00.172996 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:39:00.184014 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:39:00.194877 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:39:00.206485 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:39:00.217324 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:39:00.228073 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:39:00.347910 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:39:00.468812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:00.957032 run create_hlr_db(pid=24963): Launched 09:39:01.118039 bus /sierra_2: Setting Powered False 09:39:02.181167 run create_hlr_db(pid=24963): Terminated: ok {rc=0} 09:39:02.615958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24965): Launched 09:39:02.946301 run osmo-hlr_10.42.42.2(pid=24966): Launched 09:39:03.071942 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:03.586830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24968): Launched 09:39:03.897463 run osmo-stp_10.42.42.5(pid=24969): Launched 09:39:04.015631 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:04.549396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24971): Launched 09:39:04.861491 run osmo-msc_10.42.42.6(pid=24972): Launched 09:39:05.035073 run osmo-stp_10.42.42.5(pid=24969): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24969)] 09:39:05.166267 run osmo-stp_10.42.42.5(pid=24969): stdout: | (launched: 2022-12-10_09:39:03.838093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:05.296764 run osmo-stp_10.42.42.5(pid=24969): stderr: | 20221210093904012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093904012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093904012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093904013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093904013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093904013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093904013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:05.424781 run osmo-stp_10.42.42.5(pid=24969): stdout: | (launched: 2022-12-10_09:39:03.838093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:05.546771 run osmo-stp_10.42.42.5(pid=24969): stderr: | 20221210093904012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093904012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093904012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093904013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093904013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093904013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093904013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:05.692402 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24969): Process ended prematurely: osmo-stp_10.42.42.5(pid=24969) [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24969)] [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 09:39:05.700471 tst handover.py:18: Test FAILED (6.6 sec) 09:39:05.726133 run osmo-hlr_10.42.42.2(pid=24966): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24966)] 09:39:05.773732 run osmo-hlr_10.42.42.2(pid=24966): stdout: | (launched: 2022-12-10_09:39:02.882714) 09:39:05.822987 run osmo-hlr_10.42.42.2(pid=24966): stderr: | 20221210093903086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093903086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093903086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093903086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093903086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093903086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093903099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093903109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093903109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093903109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:05.891503 run osmo-msc_10.42.42.6(pid=24972): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24972)] 09:39:05.938990 run osmo-msc_10.42.42.6(pid=24972): stdout: | (launched: 2022-12-10_09:39:04.800641) 09:39:05.987942 run osmo-msc_10.42.42.6(pid=24972): stderr: | 20221210093905075 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093905075 DLGLOBAL DEBUG validating counter group 0x7fe991bdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093905075 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093905075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093905075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093905075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093905077 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093905077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093905078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093905078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:06.037633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24965): Terminating (SIGTERM) 09:39:06.077126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24968): Terminating (SIGTERM) 09:39:06.116703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24971): Terminating (SIGTERM) 09:39:06.156447 --- ParallelTerminationStrategy: PID 24965 died... 09:39:06.175384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24965): Terminated: ok {rc=0} 09:39:06.218979 --- ParallelTerminationStrategy: PID 24968 died... 09:39:06.237341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24968): Terminated: ok {rc=0} 09:39:06.281017 --- ParallelTerminationStrategy: PID 24971 died... 09:39:06.299416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24971): Terminated: ok {rc=0} 09:39:06.384593 bus /sierra_3: Setting Powered False 09:39:07.484389 bus /sierra_3: Setting Powered False 09:39:08.599145 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 09:39:09.866881 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:09.872674 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:39:09.913396 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:39:09.939789 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:39:09.990557 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:39:10.031507 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:39:10.057840 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:39:10.614652 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 09:39:10.620300 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:10.631617 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:39:10.670265 tst handover.py: using LAC 27495 09:39:10.800456 tst handover.py: using RAC 210 09:39:10.922974 tst handover.py: using CellId 27495 09:39:11.052367 tst handover.py: using BVCI 27496 09:39:11.164533 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 09:39:11.198869 tst handover.py: using LAC 27496 09:39:11.318402 tst handover.py: using RAC 211 09:39:11.438892 tst handover.py: using CellId 27496 09:39:11.559022 tst handover.py: using BVCI 27497 09:39:11.671755 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:11.682575 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:11.693198 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:11.703818 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:11.714481 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:39:11.725074 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:39:11.843977 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 09:39:11.964770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:12.442905 run create_hlr_db(pid=24977): Launched 09:39:12.568680 bus /sierra_2: Setting Powered False 09:39:13.632853 run create_hlr_db(pid=24977): Terminated: ok {rc=0} 09:39:14.059052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24979): Launched 09:39:14.385197 run osmo-hlr_10.42.42.2(pid=24980): Launched 09:39:14.510277 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:15.043986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24982): Launched 09:39:15.369081 run osmo-stp_10.42.42.5(pid=24983): Launched 09:39:15.494435 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:16.069791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24985): Launched 09:39:16.403449 run osmo-msc_10.42.42.6(pid=24986): Launched 09:39:16.785607 run osmo-stp_10.42.42.5(pid=24983): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24983)] 09:39:17.073567 run osmo-stp_10.42.42.5(pid=24983): stdout: | (launched: 2022-12-10_09:39:15.309705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:17.255657 run osmo-stp_10.42.42.5(pid=24983): stderr: | 20221210093915500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093915500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093915500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093915501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093915503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093915503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093915503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:17.385508 run osmo-stp_10.42.42.5(pid=24983): stdout: | (launched: 2022-12-10_09:39:15.309705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:17.507921 run osmo-stp_10.42.42.5(pid=24983): stderr: | 20221210093915500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093915500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093915500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093915501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093915503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093915503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093915503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:17.654462 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24983): Process ended prematurely: osmo-stp_10.42.42.5(pid=24983) [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24983)] [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 09:39:17.662740 tst handover.py:18: Test FAILED (7.0 sec) 09:39:17.688694 run osmo-hlr_10.42.42.2(pid=24980): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24980)] 09:39:17.736453 run osmo-hlr_10.42.42.2(pid=24980): stdout: | (launched: 2022-12-10_09:39:14.325814) 09:39:17.785879 run osmo-hlr_10.42.42.2(pid=24980): stderr: | 20221210093914523 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093914523 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093914523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093914523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093914523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093914523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093914536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093914544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093914545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093914545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:17.854721 run osmo-msc_10.42.42.6(pid=24986): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24986)] 09:39:17.902401 run osmo-msc_10.42.42.6(pid=24986): stdout: | (launched: 2022-12-10_09:39:16.337065) 09:39:17.953109 run osmo-msc_10.42.42.6(pid=24986): stderr: | 20221210093916829 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093916830 DLGLOBAL DEBUG validating counter group 0x7f792652fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093916830 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093916830 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093916830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093916830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093916832 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093916832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093916832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093916832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:18.002713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24979): Terminating (SIGTERM) 09:39:18.042216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24982): Terminating (SIGTERM) 09:39:18.081568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24985): Terminating (SIGTERM) 09:39:18.121354 --- ParallelTerminationStrategy: PID 24979 died... 09:39:18.140158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24979): Terminated: ok {rc=0} 09:39:18.184289 --- ParallelTerminationStrategy: PID 24982 died... 09:39:18.202762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24982): Terminated: ok {rc=0} 09:39:18.246360 --- ParallelTerminationStrategy: PID 24985 died... 09:39:18.264781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24985): Terminated: ok {rc=0} 09:39:18.348037 bus /sierra_3: Setting Powered False 09:39:19.443305 bus /sierra_3: Setting Powered False 09:39:20.556592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 09:39:21.799512 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:21.804811 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:39:21.857681 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:39:21.883949 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:39:21.934459 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:39:21.987216 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:39:22.013509 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:39:22.565849 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 09:39:22.570882 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:22.581837 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:39:22.618864 tst handover.py: using LAC 27497 09:39:22.749757 tst handover.py: using RAC 212 09:39:22.870669 tst handover.py: using CellId 27497 09:39:22.990987 tst handover.py: using BVCI 27498 09:39:23.112867 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:39:23.162011 tst handover.py: using LAC 27498 09:39:23.290396 tst handover.py: using RAC 213 09:39:23.419148 tst handover.py: using CellId 27498 09:39:23.546045 tst handover.py: using BVCI 27499 09:39:23.666737 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:23.678340 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:23.689825 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:23.701602 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:23.713996 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:39:23.725360 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:39:23.844074 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:39:23.963770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:24.445716 run create_hlr_db(pid=24991): Launched 09:39:24.570934 bus /sierra_2: Setting Powered False 09:39:25.635099 run create_hlr_db(pid=24991): Terminated: ok {rc=0} 09:39:26.066068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24993): Launched 09:39:26.398643 run osmo-hlr_10.42.42.2(pid=24994): Launched 09:39:26.523886 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:27.062365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24996): Launched 09:39:27.392612 run osmo-stp_10.42.42.5(pid=24997): Launched 09:39:27.518739 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:28.087323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24999): Launched 09:39:28.418062 run osmo-msc_10.42.42.6(pid=25000): Launched 09:39:28.600243 run osmo-stp_10.42.42.5(pid=24997): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24997)] 09:39:28.738939 run osmo-stp_10.42.42.5(pid=24997): stdout: | (launched: 2022-12-10_09:39:27.329192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:28.878193 run osmo-stp_10.42.42.5(pid=24997): stderr: | 20221210093927526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093927526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093927526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093927527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093927527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093927527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093927527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:29.015783 run osmo-stp_10.42.42.5(pid=24997): stdout: | (launched: 2022-12-10_09:39:27.329192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:29.145862 run osmo-stp_10.42.42.5(pid=24997): stderr: | 20221210093927526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093927526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093927526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093927527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093927527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093927527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093927527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:29.301306 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=24997): Process ended prematurely: osmo-stp_10.42.42.5(pid=24997) [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24997)] [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 09:39:29.310236 tst handover.py:18: Test FAILED (6.7 sec) 09:39:29.338244 run osmo-hlr_10.42.42.2(pid=24994): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24994)] 09:39:29.388777 run osmo-hlr_10.42.42.2(pid=24994): stdout: | (launched: 2022-12-10_09:39:26.334251) 09:39:29.440761 run osmo-hlr_10.42.42.2(pid=24994): stderr: | 20221210093926537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093926537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093926537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093926537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093926537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093926537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093926550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093926558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093926558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093926559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:29.513137 run osmo-msc_10.42.42.6(pid=25000): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25000)] 09:39:29.563381 run osmo-msc_10.42.42.6(pid=25000): stdout: | (launched: 2022-12-10_09:39:28.354763) 09:39:29.614789 run osmo-msc_10.42.42.6(pid=25000): stderr: | 20221210093928679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093928679 DLGLOBAL DEBUG validating counter group 0x7f2a10a93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093928679 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093928679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093928680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093928680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093928683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093928684 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093928684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093928684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:29.666918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24993): Terminating (SIGTERM) 09:39:29.708753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24996): Terminating (SIGTERM) 09:39:29.750742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24999): Terminating (SIGTERM) 09:39:29.793271 --- ParallelTerminationStrategy: PID 24993 died... 09:39:29.813099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24993): Terminated: ok {rc=0} 09:39:29.859762 --- ParallelTerminationStrategy: PID 24996 died... 09:39:29.879175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24996): Terminated: ok {rc=0} 09:39:29.925421 --- ParallelTerminationStrategy: PID 24999 died... 09:39:29.944855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24999): Terminated: ok {rc=0} 09:39:30.033007 bus /sierra_3: Setting Powered False 09:39:31.128834 bus /sierra_3: Setting Powered False 09:39:32.246045 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 09:39:33.506198 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:33.511876 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:39:33.567540 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:39:33.595262 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:39:33.647916 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:39:33.702608 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:39:33.730341 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:39:34.283197 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 09:39:34.288815 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:34.300568 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:39:34.339939 tst handover.py: using LAC 27499 09:39:34.468058 tst handover.py: using RAC 214 09:39:34.596222 tst handover.py: using CellId 27499 09:39:34.725711 tst handover.py: using BVCI 27500 09:39:34.838880 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:39:34.887712 tst handover.py: using LAC 27500 09:39:35.011328 tst handover.py: using RAC 215 09:39:35.134339 tst handover.py: using CellId 27500 09:39:35.256923 tst handover.py: using BVCI 27501 09:39:35.370355 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:35.381268 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:35.391902 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:35.402692 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:35.413458 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:39:35.424237 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:39:35.541399 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:39:35.660279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:36.109744 run create_hlr_db(pid=25005): Launched 09:39:36.234712 bus /sierra_2: Setting Powered False 09:39:37.295548 run create_hlr_db(pid=25005): Terminated: ok {rc=0} 09:39:37.714464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Launched 09:39:38.040916 run osmo-hlr_10.42.42.2(pid=25008): Launched 09:39:38.166468 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:38.702146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Launched 09:39:39.027414 run osmo-stp_10.42.42.5(pid=25011): Launched 09:39:39.151868 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:39.711637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Launched 09:39:40.038603 run osmo-msc_10.42.42.6(pid=25014): Launched 09:39:40.220743 run osmo-stp_10.42.42.5(pid=25011): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] 09:39:40.359248 run osmo-stp_10.42.42.5(pid=25011): stdout: | (launched: 2022-12-10_09:39:38.968254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:40.498195 run osmo-stp_10.42.42.5(pid=25011): stderr: | 20221210093939161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093939161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093939161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093939161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093939162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093939162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093939162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:40.635877 run osmo-stp_10.42.42.5(pid=25011): stdout: | (launched: 2022-12-10_09:39:38.968254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:40.766009 run osmo-stp_10.42.42.5(pid=25011): stderr: | 20221210093939161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093939161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093939161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093939161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093939162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093939162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093939162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:40.922205 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25011): Process ended prematurely: osmo-stp_10.42.42.5(pid=25011) [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 09:39:40.930952 tst handover.py:18: Test FAILED (6.6 sec) 09:39:40.958526 run osmo-hlr_10.42.42.2(pid=25008): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25008)] 09:39:41.008476 run osmo-hlr_10.42.42.2(pid=25008): stdout: | (launched: 2022-12-10_09:39:37.981961) 09:39:41.060800 run osmo-hlr_10.42.42.2(pid=25008): stderr: | 20221210093938180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093938180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093938180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093938180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093938180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093938180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093938193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093938202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093938202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093938202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:41.132789 run osmo-msc_10.42.42.6(pid=25014): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25014)] 09:39:41.182723 run osmo-msc_10.42.42.6(pid=25014): stdout: | (launched: 2022-12-10_09:39:39.979266) 09:39:41.234287 run osmo-msc_10.42.42.6(pid=25014): stderr: | 20221210093940299 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093940299 DLGLOBAL DEBUG validating counter group 0x7f9747fdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093940300 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093940300 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093940300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093940300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093940302 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093940302 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093940302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093940302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:41.286449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Terminating (SIGTERM) 09:39:41.327951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Terminating (SIGTERM) 09:39:41.369626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Terminating (SIGTERM) 09:39:41.411443 --- ParallelTerminationStrategy: PID 25007 died... 09:39:41.431244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25007): Terminated: ok {rc=0} 09:39:41.477716 --- ParallelTerminationStrategy: PID 25010 died... 09:39:41.496825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25010): Terminated: ok {rc=0} 09:39:41.543066 --- ParallelTerminationStrategy: PID 25013 died... 09:39:41.562376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25013): Terminated: ok {rc=0} 09:39:41.649744 bus /sierra_3: Setting Powered False 09:39:42.749284 bus /sierra_3: Setting Powered False 09:39:43.867140 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 09:39:45.125110 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:45.130331 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 09:39:45.166636 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 09:39:45.193127 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 09:39:45.245600 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 09:39:45.282592 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 09:39:45.309196 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 09:39:45.865488 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 09:39:45.870853 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:45.882155 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:39:45.923088 tst handover.py: using LAC 27501 09:39:46.058231 tst handover.py: using RAC 216 09:39:46.210064 tst handover.py: using CellId 27501 09:39:46.370446 tst handover.py: using BVCI 27502 09:39:46.484304 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 09:39:46.518184 tst handover.py: using LAC 27502 09:39:46.653893 tst handover.py: using RAC 217 09:39:46.777454 tst handover.py: using CellId 27502 09:39:46.914954 tst handover.py: using BVCI 27503 09:39:47.062515 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:47.074283 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:47.085969 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:47.099560 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:47.110889 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 09:39:47.122702 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:39:47.240147 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 09:39:47.359220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:47.813816 run create_hlr_db(pid=25019): Launched 09:39:47.939593 bus /sierra_2: Setting Powered False 09:39:49.000229 run create_hlr_db(pid=25019): Terminated: ok {rc=0} 09:39:49.422731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25021): Launched 09:39:49.738671 run osmo-hlr_10.42.42.2(pid=25022): Launched 09:39:49.855665 run osmo-stp_10.42.42.5: Starting osmo-stp 09:39:50.360264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25024): Launched 09:39:50.671425 run osmo-stp_10.42.42.5(pid=25025): Launched 09:39:50.789468 run osmo-msc_10.42.42.6: Starting osmo-msc 09:39:51.322445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25027): Launched 09:39:51.633493 run osmo-msc_10.42.42.6(pid=25028): Launched 09:39:51.805359 run osmo-stp_10.42.42.5(pid=25025): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25025)] 09:39:51.935434 run osmo-stp_10.42.42.5(pid=25025): stdout: | (launched: 2022-12-10_09:39:50.611070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:52.065309 run osmo-stp_10.42.42.5(pid=25025): stderr: | 20221210093950785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093950785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093950786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093950786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093950786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093950786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093950786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:52.193248 run osmo-stp_10.42.42.5(pid=25025): stdout: | (launched: 2022-12-10_09:39:50.611070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:39:52.314574 run osmo-stp_10.42.42.5(pid=25025): stderr: | 20221210093950785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210093950785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210093950786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210093950786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210093950786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210093950786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210093950786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:39:52.460293 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25025): Process ended prematurely: osmo-stp_10.42.42.5(pid=25025) [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25025)] [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 09:39:52.468395 tst handover.py:18: Test FAILED (6.6 sec) 09:39:52.493783 run osmo-hlr_10.42.42.2(pid=25022): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25022)] 09:39:52.540469 run osmo-hlr_10.42.42.2(pid=25022): stdout: | (launched: 2022-12-10_09:39:49.678461) 09:39:52.588900 run osmo-hlr_10.42.42.2(pid=25022): stderr: | 20221210093949856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210093949856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210093949857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210093949857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210093949857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210093949857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210093949869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210093949877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210093949878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210093949878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:39:52.656684 run osmo-msc_10.42.42.6(pid=25028): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25028)] 09:39:52.703739 run osmo-msc_10.42.42.6(pid=25028): stdout: | (launched: 2022-12-10_09:39:51.572868) 09:39:52.752301 run osmo-msc_10.42.42.6(pid=25028): stderr: | 20221210093951848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210093951848 DLGLOBAL DEBUG validating counter group 0x7efecfe62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210093951849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210093951849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210093951849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210093951849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210093951851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210093951851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210093951851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210093951852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:39:52.801204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25021): Terminating (SIGTERM) 09:39:52.840007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25024): Terminating (SIGTERM) 09:39:52.878986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25027): Terminating (SIGTERM) 09:39:52.918507 --- ParallelTerminationStrategy: PID 25021 died... 09:39:52.937544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25021): Terminated: ok {rc=0} 09:39:52.980716 --- ParallelTerminationStrategy: PID 25024 died... 09:39:52.999007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25024): Terminated: ok {rc=0} 09:39:53.041917 --- ParallelTerminationStrategy: PID 25027 died... 09:39:53.060019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25027): Terminated: ok {rc=0} 09:39:53.144560 bus /sierra_3: Setting Powered False 09:39:54.242743 bus /sierra_3: Setting Powered False 09:39:55.356326 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 09:39:56.593528 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:39:56.598838 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:39:56.648351 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:39:56.674730 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:39:56.727384 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:39:56.777082 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:39:56.803295 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:39:57.353166 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 09:39:57.358110 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:57.368935 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:39:57.402413 tst handover.py: using LAC 27503 09:39:57.525366 tst handover.py: using RAC 218 09:39:57.646335 tst handover.py: using CellId 27503 09:39:57.769194 tst handover.py: using BVCI 27504 09:39:57.881843 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:39:57.929810 tst handover.py: using LAC 27504 09:39:58.053270 tst handover.py: using RAC 219 09:39:58.174511 tst handover.py: using CellId 27504 09:39:58.296746 tst handover.py: using BVCI 27505 09:39:58.409973 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:58.420655 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:58.431317 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:58.441885 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:58.452522 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:39:58.463158 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:39:58.583258 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:39:58.700269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:39:59.151909 run create_hlr_db(pid=25033): Launched 09:39:59.277351 bus /sierra_2: Setting Powered False 09:40:00.338624 run create_hlr_db(pid=25033): Terminated: ok {rc=0} 09:40:00.758058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Launched 09:40:01.119403 run osmo-hlr_10.42.42.2(pid=25036): Launched 09:40:01.378416 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:02.030431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25041): Launched 09:40:02.367519 run osmo-stp_10.42.42.5(pid=25042): Launched 09:40:02.493269 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:03.055656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25044): Launched 09:40:03.381579 run osmo-msc_10.42.42.6(pid=25045): Launched 09:40:03.563797 run osmo-stp_10.42.42.5(pid=25042): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25042)] 09:40:03.702677 run osmo-stp_10.42.42.5(pid=25042): stdout: | (launched: 2022-12-10_09:40:02.308184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:03.842595 run osmo-stp_10.42.42.5(pid=25042): stderr: | 20221210094002498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094002498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094002499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094002499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094002499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094002500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094002500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:03.980255 run osmo-stp_10.42.42.5(pid=25042): stdout: | (launched: 2022-12-10_09:40:02.308184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:04.110242 run osmo-stp_10.42.42.5(pid=25042): stderr: | 20221210094002498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094002498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094002499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094002499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094002499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094002500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094002500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:04.265519 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25042): Process ended prematurely: osmo-stp_10.42.42.5(pid=25042) [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25042)] [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 09:40:04.274343 tst handover.py:18: Test FAILED (6.9 sec) 09:40:04.301745 run osmo-hlr_10.42.42.2(pid=25036): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25036)] 09:40:04.351863 run osmo-hlr_10.42.42.2(pid=25036): stdout: | (launched: 2022-12-10_09:40:01.045903) 09:40:04.403315 run osmo-hlr_10.42.42.2(pid=25036): stderr: | 20221210094001332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094001332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094001332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094001332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094001332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094001333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094001349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094001374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094001375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094001375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:04.475108 run osmo-msc_10.42.42.6(pid=25045): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25045)] 09:40:04.525111 run osmo-msc_10.42.42.6(pid=25045): stdout: | (launched: 2022-12-10_09:40:03.322262) 09:40:04.576561 run osmo-msc_10.42.42.6(pid=25045): stderr: | 20221210094003642 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094003642 DLGLOBAL DEBUG validating counter group 0x7ff643401c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094003642 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094003642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094003643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094003643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094003644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094003645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094003645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094003645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:04.628512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Terminating (SIGTERM) 09:40:04.670042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25041): Terminating (SIGTERM) 09:40:04.711448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25044): Terminating (SIGTERM) 09:40:04.753187 --- ParallelTerminationStrategy: PID 25035 died... 09:40:04.772838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25035): Terminated: ok {rc=0} 09:40:04.819268 --- ParallelTerminationStrategy: PID 25041 died... 09:40:04.838503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25041): Terminated: ok {rc=0} 09:40:04.884358 --- ParallelTerminationStrategy: PID 25044 died... 09:40:04.903588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25044): Terminated: ok {rc=0} 09:40:04.990453 bus /sierra_3: Setting Powered False 09:40:06.087487 bus /sierra_3: Setting Powered False 09:40:07.203496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:40:08.462818 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:08.468193 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:40:08.516682 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:40:08.544366 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:40:08.597389 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:40:08.645419 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:40:08.673173 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:40:09.226839 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:40:09.232213 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:09.243628 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:40:09.279549 tst handover.py: using LAC 27505 09:40:09.402807 tst handover.py: using RAC 220 09:40:09.523736 tst handover.py: using CellId 27505 09:40:09.646390 tst handover.py: using BVCI 27506 09:40:09.760434 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:40:09.805034 tst handover.py: using LAC 27506 09:40:09.927353 tst handover.py: using RAC 221 09:40:10.049588 tst handover.py: using CellId 27506 09:40:10.172467 tst handover.py: using BVCI 27507 09:40:10.285683 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:10.296599 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:10.307436 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:10.318413 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:10.329206 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:40:10.339995 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:40:10.457596 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:40:10.574967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:11.029831 run create_hlr_db(pid=25050): Launched 09:40:11.156091 bus /sierra_2: Setting Powered False 09:40:12.221456 run create_hlr_db(pid=25050): Terminated: ok {rc=0} 09:40:12.651560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25052): Launched 09:40:12.983430 run osmo-hlr_10.42.42.2(pid=25053): Launched 09:40:13.108912 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:13.651148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25055): Launched 09:40:13.982984 run osmo-stp_10.42.42.5(pid=25056): Launched 09:40:14.107973 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:14.674521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25058): Launched 09:40:15.008046 run osmo-msc_10.42.42.6(pid=25059): Launched 09:40:15.192094 run osmo-stp_10.42.42.5(pid=25056): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25056)] 09:40:15.331387 run osmo-stp_10.42.42.5(pid=25056): stdout: | (launched: 2022-12-10_09:40:13.918028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:15.471034 run osmo-stp_10.42.42.5(pid=25056): stderr: | 20221210094014116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094014116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094014116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094014117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094014117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094014117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094014117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:15.607784 run osmo-stp_10.42.42.5(pid=25056): stdout: | (launched: 2022-12-10_09:40:13.918028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:15.737809 run osmo-stp_10.42.42.5(pid=25056): stderr: | 20221210094014116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094014116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094014116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094014117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094014117 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094014117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094014117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:15.899288 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25056): Process ended prematurely: osmo-stp_10.42.42.5(pid=25056) [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25056)] [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 09:40:15.908578 tst handover.py:18: Test FAILED (6.7 sec) 09:40:15.938455 run osmo-hlr_10.42.42.2(pid=25053): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25053)] 09:40:15.990449 run osmo-hlr_10.42.42.2(pid=25053): stdout: | (launched: 2022-12-10_09:40:12.918573) 09:40:16.043918 run osmo-hlr_10.42.42.2(pid=25053): stderr: | 20221210094013121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094013121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094013122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094013122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094013122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094013122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094013134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094013143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094013144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094013144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:16.117930 run osmo-msc_10.42.42.6(pid=25059): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25059)] 09:40:16.169887 run osmo-msc_10.42.42.6(pid=25059): stdout: | (launched: 2022-12-10_09:40:14.942885) 09:40:16.223892 run osmo-msc_10.42.42.6(pid=25059): stderr: | 20221210094015269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094015270 DLGLOBAL DEBUG validating counter group 0x7fcf95934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094015270 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094015270 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094015270 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094015270 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094015272 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094015272 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094015272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094015272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:16.278502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25052): Terminating (SIGTERM) 09:40:16.322620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25055): Terminating (SIGTERM) 09:40:16.366755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25058): Terminating (SIGTERM) 09:40:16.410614 --- ParallelTerminationStrategy: PID 25052 died... 09:40:16.430981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25052): Terminated: ok {rc=0} 09:40:16.479940 --- ParallelTerminationStrategy: PID 25055 died... 09:40:16.500259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25055): Terminated: ok {rc=0} 09:40:16.549410 --- ParallelTerminationStrategy: PID 25058 died... 09:40:16.569618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25058): Terminated: ok {rc=0} 09:40:16.660539 bus /sierra_3: Setting Powered False 09:40:17.755643 bus /sierra_3: Setting Powered False 09:40:18.869908 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:40:20.122955 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:20.128043 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:40:20.178690 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:40:20.205321 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:40:20.257458 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:40:20.308543 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:40:20.335028 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:40:20.885694 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:40:20.891015 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:20.902256 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:40:20.936659 tst handover.py: using LAC 27507 09:40:21.061498 tst handover.py: using RAC 222 09:40:21.183942 tst handover.py: using CellId 27507 09:40:21.303566 tst handover.py: using BVCI 27508 09:40:21.415919 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:40:21.463598 tst handover.py: using LAC 27508 09:40:21.585331 tst handover.py: using RAC 223 09:40:21.712435 tst handover.py: using CellId 27508 09:40:21.839314 tst handover.py: using BVCI 27509 09:40:21.953567 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:21.964518 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:21.975441 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:21.986612 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:21.997856 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:40:22.008817 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:40:22.128594 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:40:22.247612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:22.699449 run create_hlr_db(pid=25064): Launched 09:40:22.824359 bus /sierra_2: Setting Powered False 09:40:23.886148 run create_hlr_db(pid=25064): Terminated: ok {rc=0} 09:40:24.287551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Launched 09:40:24.595128 run osmo-hlr_10.42.42.2(pid=25067): Launched 09:40:24.712101 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:25.215787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Launched 09:40:25.525857 run osmo-stp_10.42.42.5(pid=25070): Launched 09:40:25.643841 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:26.173736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Launched 09:40:26.481373 run osmo-msc_10.42.42.6(pid=25073): Launched 09:40:26.654385 run osmo-stp_10.42.42.5(pid=25070): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] 09:40:26.784546 run osmo-stp_10.42.42.5(pid=25070): stdout: | (launched: 2022-12-10_09:40:25.466254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:26.915572 run osmo-stp_10.42.42.5(pid=25070): stderr: | 20221210094025638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094025638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094025638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094025639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094025639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094025639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094025639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:27.044058 run osmo-stp_10.42.42.5(pid=25070): stdout: | (launched: 2022-12-10_09:40:25.466254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:27.166717 run osmo-stp_10.42.42.5(pid=25070): stderr: | 20221210094025638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094025638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094025638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094025639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094025639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094025639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094025639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:27.314199 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25070): Process ended prematurely: osmo-stp_10.42.42.5(pid=25070) [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 09:40:27.322460 tst handover.py:18: Test FAILED (6.4 sec) 09:40:27.348407 run osmo-hlr_10.42.42.2(pid=25067): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25067)] 09:40:27.396117 run osmo-hlr_10.42.42.2(pid=25067): stdout: | (launched: 2022-12-10_09:40:24.539103) 09:40:27.445596 run osmo-hlr_10.42.42.2(pid=25067): stderr: | 20221210094024717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094024717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094024718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094024718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094024718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094024718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094024730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094024739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094024740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094024740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:27.513978 run osmo-msc_10.42.42.6(pid=25073): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25073)] 09:40:27.561211 run osmo-msc_10.42.42.6(pid=25073): stdout: | (launched: 2022-12-10_09:40:26.425350) 09:40:27.609705 run osmo-msc_10.42.42.6(pid=25073): stderr: | 20221210094026696 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094026696 DLGLOBAL DEBUG validating counter group 0x7f089cee9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094026696 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094026696 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094026696 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094026696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094026698 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094026699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094026699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094026699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:27.658995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Terminating (SIGTERM) 09:40:27.698471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Terminating (SIGTERM) 09:40:27.737806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Terminating (SIGTERM) 09:40:27.777404 --- ParallelTerminationStrategy: PID 25066 died... 09:40:27.796269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25066): Terminated: ok {rc=0} 09:40:27.840644 --- ParallelTerminationStrategy: PID 25069 died... 09:40:27.859251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25069): Terminated: ok {rc=0} 09:40:27.902889 --- ParallelTerminationStrategy: PID 25072 died... 09:40:27.921476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25072): Terminated: ok {rc=0} 09:40:28.007020 bus /sierra_3: Setting Powered False 09:40:29.106414 bus /sierra_3: Setting Powered False 09:40:30.222740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 09:40:31.530608 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:31.538539 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:40:31.583163 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:40:31.613905 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:40:31.667331 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:40:31.713647 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:40:31.742732 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:40:32.285257 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 09:40:32.290604 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:32.301856 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:40:32.338883 tst handover.py: using LAC 27509 09:40:32.468705 tst handover.py: using RAC 224 09:40:32.597388 tst handover.py: using CellId 27509 09:40:32.731367 tst handover.py: using BVCI 27510 09:40:32.851774 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 09:40:32.886254 tst handover.py: using LAC 27510 09:40:33.014843 tst handover.py: using RAC 225 09:40:33.140673 tst handover.py: using CellId 27510 09:40:33.267973 tst handover.py: using BVCI 27511 09:40:33.387089 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:33.398314 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:33.409428 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:33.420647 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:33.431929 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:40:33.443212 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:40:33.561500 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 09:40:33.681419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:34.165547 run create_hlr_db(pid=25078): Launched 09:40:34.290264 bus /sierra_2: Setting Powered False 09:40:35.354408 run create_hlr_db(pid=25078): Terminated: ok {rc=0} 09:40:35.770341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Launched 09:40:36.082721 run osmo-hlr_10.42.42.2(pid=25081): Launched 09:40:36.200358 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:36.707834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Launched 09:40:37.018518 run osmo-stp_10.42.42.5(pid=25084): Launched 09:40:37.135636 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:37.670726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Launched 09:40:37.982794 run osmo-msc_10.42.42.6(pid=25087): Launched 09:40:38.156174 run osmo-stp_10.42.42.5(pid=25084): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] 09:40:38.286949 run osmo-stp_10.42.42.5(pid=25084): stdout: | (launched: 2022-12-10_09:40:36.958705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:38.417421 run osmo-stp_10.42.42.5(pid=25084): stderr: | 20221210094037132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094037132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094037132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094037133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094037133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094037133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094037133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:38.546262 run osmo-stp_10.42.42.5(pid=25084): stdout: | (launched: 2022-12-10_09:40:36.958705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:38.668364 run osmo-stp_10.42.42.5(pid=25084): stderr: | 20221210094037132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094037132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094037132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094037133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094037133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094037133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094037133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:38.814843 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25084): Process ended prematurely: osmo-stp_10.42.42.5(pid=25084) [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 09:40:38.823206 tst handover.py:18: Test FAILED (6.5 sec) 09:40:38.849262 run osmo-hlr_10.42.42.2(pid=25081): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25081)] 09:40:38.896782 run osmo-hlr_10.42.42.2(pid=25081): stdout: | (launched: 2022-12-10_09:40:36.022343) 09:40:38.945923 run osmo-hlr_10.42.42.2(pid=25081): stderr: | 20221210094036203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094036203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094036203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094036203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094036203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094036203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094036215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094036224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094036224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094036224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:39.014246 run osmo-msc_10.42.42.6(pid=25087): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25087)] 09:40:39.061200 run osmo-msc_10.42.42.6(pid=25087): stdout: | (launched: 2022-12-10_09:40:37.922025) 09:40:39.109588 run osmo-msc_10.42.42.6(pid=25087): stderr: | 20221210094038199 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094038199 DLGLOBAL DEBUG validating counter group 0x7febcd0bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094038199 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094038199 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094038199 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094038200 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094038201 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094038202 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094038202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094038202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:39.158592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Terminating (SIGTERM) 09:40:39.197599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Terminating (SIGTERM) 09:40:39.237075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Terminating (SIGTERM) 09:40:39.276826 --- ParallelTerminationStrategy: PID 25080 died... 09:40:39.295881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25080): Terminated: ok {rc=0} 09:40:39.339721 --- ParallelTerminationStrategy: PID 25083 died... 09:40:39.358070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25083): Terminated: ok {rc=0} 09:40:39.401395 --- ParallelTerminationStrategy: PID 25086 died... 09:40:39.419727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25086): Terminated: ok {rc=0} 09:40:39.503947 bus /sierra_3: Setting Powered False 09:40:40.603202 bus /sierra_3: Setting Powered False 09:40:41.718198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 09:40:42.962552 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:42.968304 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:40:43.020817 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:40:43.048582 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:40:43.101562 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:40:43.153226 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:40:43.180481 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:40:43.734904 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 09:40:43.740452 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:43.751752 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:40:43.786559 tst handover.py: using LAC 27511 09:40:43.918693 tst handover.py: using RAC 226 09:40:44.047129 tst handover.py: using CellId 27511 09:40:44.174309 tst handover.py: using BVCI 27512 09:40:44.293858 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:40:44.342524 tst handover.py: using LAC 27512 09:40:44.471532 tst handover.py: using RAC 227 09:40:44.598277 tst handover.py: using CellId 27512 09:40:44.719119 tst handover.py: using BVCI 27513 09:40:44.832443 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:44.843251 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:44.853981 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:44.864573 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:44.875285 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:40:44.885898 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:40:45.004581 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:40:45.122605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:45.574674 run create_hlr_db(pid=25092): Launched 09:40:45.700038 bus /sierra_2: Setting Powered False 09:40:46.760667 run create_hlr_db(pid=25092): Terminated: ok {rc=0} 09:40:47.221942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25094): Launched 09:40:47.553583 run osmo-hlr_10.42.42.2(pid=25095): Launched 09:40:47.679555 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:48.218070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25097): Launched 09:40:48.544307 run osmo-stp_10.42.42.5(pid=25098): Launched 09:40:48.671309 run osmo-msc_10.42.42.6: Starting osmo-msc 09:40:49.234898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25100): Launched 09:40:49.561478 run osmo-msc_10.42.42.6(pid=25101): Launched 09:40:49.744914 run osmo-stp_10.42.42.5(pid=25098): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25098)] 09:40:49.884376 run osmo-stp_10.42.42.5(pid=25098): stdout: | (launched: 2022-12-10_09:40:48.485023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:50.023441 run osmo-stp_10.42.42.5(pid=25098): stderr: | 20221210094048677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094048677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094048678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094048678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094048678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094048679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094048679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:50.160902 run osmo-stp_10.42.42.5(pid=25098): stdout: | (launched: 2022-12-10_09:40:48.485023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:40:50.290720 run osmo-stp_10.42.42.5(pid=25098): stderr: | 20221210094048677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094048677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094048678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094048678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094048678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094048679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094048679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:40:50.445892 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25098): Process ended prematurely: osmo-stp_10.42.42.5(pid=25098) [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25098)] [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 09:40:50.454690 tst handover.py:18: Test FAILED (6.7 sec) 09:40:50.482224 run osmo-hlr_10.42.42.2(pid=25095): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25095)] 09:40:50.532089 run osmo-hlr_10.42.42.2(pid=25095): stdout: | (launched: 2022-12-10_09:40:47.493891) 09:40:50.583664 run osmo-hlr_10.42.42.2(pid=25095): stderr: | 20221210094047694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094047695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094047695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094047695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094047695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094047695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094047707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094047715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094047716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094047716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:40:50.655449 run osmo-msc_10.42.42.6(pid=25101): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25101)] 09:40:50.705491 run osmo-msc_10.42.42.6(pid=25101): stdout: | (launched: 2022-12-10_09:40:49.501920) 09:40:50.757104 run osmo-msc_10.42.42.6(pid=25101): stderr: | 20221210094049824 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094049824 DLGLOBAL DEBUG validating counter group 0x7f50eeb2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094049824 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094049824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094049824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094049824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094049826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094049827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094049827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094049827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:40:50.808901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25094): Terminating (SIGTERM) 09:40:50.850898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25097): Terminating (SIGTERM) 09:40:50.892698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25100): Terminating (SIGTERM) 09:40:50.935459 --- ParallelTerminationStrategy: PID 25094 died... 09:40:50.955240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25094): Terminated: ok {rc=0} 09:40:51.001656 --- ParallelTerminationStrategy: PID 25097 died... 09:40:51.020806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25097): Terminated: ok {rc=0} 09:40:51.066875 --- ParallelTerminationStrategy: PID 25100 died... 09:40:51.086143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25100): Terminated: ok {rc=0} 09:40:51.173102 bus /sierra_3: Setting Powered False 09:40:52.271798 bus /sierra_3: Setting Powered False 09:40:53.387993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 09:40:54.648679 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:40:54.654188 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:40:54.706233 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:40:54.733858 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:40:54.787182 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:40:54.837241 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:40:54.863903 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:40:55.420205 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 09:40:55.425923 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:55.439294 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:40:55.474738 tst handover.py: using LAC 27513 09:40:55.601380 tst handover.py: using RAC 228 09:40:55.727827 tst handover.py: using CellId 27513 09:40:55.856252 tst handover.py: using BVCI 27514 09:40:55.976740 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:40:56.024295 tst handover.py: using LAC 27514 09:40:56.150497 tst handover.py: using RAC 229 09:40:56.277309 tst handover.py: using CellId 27514 09:40:56.404101 tst handover.py: using BVCI 27515 09:40:56.524436 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:56.535790 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:56.546904 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:56.558387 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:56.569888 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:40:56.581250 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:40:56.697339 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:40:56.816603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:40:57.300625 run create_hlr_db(pid=25106): Launched 09:40:57.424568 bus /sierra_2: Setting Powered False 09:40:58.489227 run create_hlr_db(pid=25106): Terminated: ok {rc=0} 09:40:58.921159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25108): Launched 09:40:59.252357 run osmo-hlr_10.42.42.2(pid=25109): Launched 09:40:59.378526 run osmo-stp_10.42.42.5: Starting osmo-stp 09:40:59.920699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25111): Launched 09:41:00.252421 run osmo-stp_10.42.42.5(pid=25112): Launched 09:41:00.380240 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:00.959114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25114): Launched 09:41:01.308050 run osmo-msc_10.42.42.6(pid=25115): Launched 09:41:01.565279 run osmo-stp_10.42.42.5(pid=25112): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25112)] 09:41:01.731732 run osmo-stp_10.42.42.5(pid=25112): stdout: | (launched: 2022-12-10_09:41:00.187823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:01.898812 run osmo-stp_10.42.42.5(pid=25112): stderr: | 20221210094100386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094100386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094100386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094100387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094100387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094100387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094100387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:02.147795 run osmo-stp_10.42.42.5(pid=25112): stdout: | (launched: 2022-12-10_09:41:00.187823) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:02.325623 run osmo-stp_10.42.42.5(pid=25112): stderr: | 20221210094100386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094100386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094100386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094100387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094100387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094100387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094100387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:02.496813 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25112): Process ended prematurely: osmo-stp_10.42.42.5(pid=25112) [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25112)] [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 09:41:02.505052 tst handover.py:18: Test FAILED (7.1 sec) 09:41:02.531308 run osmo-hlr_10.42.42.2(pid=25109): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25109)] 09:41:02.578840 run osmo-hlr_10.42.42.2(pid=25109): stdout: | (launched: 2022-12-10_09:40:59.188906) 09:41:02.627743 run osmo-hlr_10.42.42.2(pid=25109): stderr: | 20221210094059389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094059389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094059389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094059389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094059389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094059389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094059401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094059410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094059410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094059410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:02.696387 run osmo-msc_10.42.42.6(pid=25115): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25115)] 09:41:02.743724 run osmo-msc_10.42.42.6(pid=25115): stdout: | (launched: 2022-12-10_09:41:01.241651) 09:41:02.792691 run osmo-msc_10.42.42.6(pid=25115): stderr: | 20221210094101906 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094101906 DLGLOBAL DEBUG validating counter group 0x7feac59b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094101906 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094101906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094101906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094101906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094101908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094101908 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094101910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094101913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:02.842198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25108): Terminating (SIGTERM) 09:41:02.881537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25111): Terminating (SIGTERM) 09:41:02.921199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25114): Terminating (SIGTERM) 09:41:02.960826 --- ParallelTerminationStrategy: PID 25108 died... 09:41:02.979868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25108): Terminated: ok {rc=0} 09:41:03.023650 --- ParallelTerminationStrategy: PID 25111 died... 09:41:03.042159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25111): Terminated: ok {rc=0} 09:41:03.086016 --- ParallelTerminationStrategy: PID 25114 died... 09:41:03.104495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25114): Terminated: ok {rc=0} 09:41:03.188997 bus /sierra_3: Setting Powered False 09:41:04.286234 bus /sierra_3: Setting Powered False 09:41:05.403112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 09:41:06.660485 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:06.666139 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 09:41:06.717883 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 09:41:06.745382 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 09:41:06.797043 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 09:41:06.845482 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 09:41:06.871744 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 09:41:07.428129 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 09:41:07.433456 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:07.444663 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:41:07.479917 tst handover.py: using LAC 27515 09:41:07.607897 tst handover.py: using RAC 230 09:41:07.734354 tst handover.py: using CellId 27515 09:41:07.860745 tst handover.py: using BVCI 27516 09:41:07.979948 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 09:41:08.027596 tst handover.py: using LAC 27516 09:41:08.154440 tst handover.py: using RAC 231 09:41:08.280914 tst handover.py: using CellId 27516 09:41:08.408645 tst handover.py: using BVCI 27517 09:41:08.521905 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:08.532540 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:08.543161 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:08.553765 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:08.564588 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 09:41:08.575177 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:41:08.690657 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 09:41:08.810810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:09.290241 run create_hlr_db(pid=25120): Launched 09:41:09.415597 bus /sierra_2: Setting Powered False 09:41:10.480670 run create_hlr_db(pid=25120): Terminated: ok {rc=0} 09:41:10.908093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Launched 09:41:11.234444 run osmo-hlr_10.42.42.2(pid=25123): Launched 09:41:11.360163 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:11.898427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Launched 09:41:12.225710 run osmo-stp_10.42.42.5(pid=25126): Launched 09:41:12.350930 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:12.919769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Launched 09:41:13.247616 run osmo-msc_10.42.42.6(pid=25129): Launched 09:41:13.430840 run osmo-stp_10.42.42.5(pid=25126): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] 09:41:13.569864 run osmo-stp_10.42.42.5(pid=25126): stdout: | (launched: 2022-12-10_09:41:12.166172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:13.708503 run osmo-stp_10.42.42.5(pid=25126): stderr: | 20221210094112357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094112357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094112357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094112358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094112358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094112358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094112358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:13.846974 run osmo-stp_10.42.42.5(pid=25126): stdout: | (launched: 2022-12-10_09:41:12.166172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:13.977163 run osmo-stp_10.42.42.5(pid=25126): stderr: | 20221210094112357 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094112357 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094112357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094112358 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094112358 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094112358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094112358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:14.132467 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25126): Process ended prematurely: osmo-stp_10.42.42.5(pid=25126) [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 09:41:14.141333 tst handover.py:18: Test FAILED (6.7 sec) 09:41:14.169057 run osmo-hlr_10.42.42.2(pid=25123): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25123)] 09:41:14.218955 run osmo-hlr_10.42.42.2(pid=25123): stdout: | (launched: 2022-12-10_09:41:11.175276) 09:41:14.270646 run osmo-hlr_10.42.42.2(pid=25123): stderr: | 20221210094111372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094111372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094111372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094111373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094111373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094111373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094111388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094111398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094111398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094111398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:14.342571 run osmo-msc_10.42.42.6(pid=25129): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25129)] 09:41:14.392374 run osmo-msc_10.42.42.6(pid=25129): stdout: | (launched: 2022-12-10_09:41:13.187953) 09:41:14.443539 run osmo-msc_10.42.42.6(pid=25129): stderr: | 20221210094113510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094113511 DLGLOBAL DEBUG validating counter group 0x7f500cf6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094113511 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094113511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094113511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094113511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094113513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094113513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094113514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094113514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:14.495152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Terminating (SIGTERM) 09:41:14.536336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Terminating (SIGTERM) 09:41:14.578168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Terminating (SIGTERM) 09:41:14.620206 --- ParallelTerminationStrategy: PID 25122 died... 09:41:14.639440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Terminated: ok {rc=0} 09:41:14.685794 --- ParallelTerminationStrategy: PID 25125 died... 09:41:14.705122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Terminated: ok {rc=0} 09:41:14.751038 --- ParallelTerminationStrategy: PID 25128 died... 09:41:14.770411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Terminated: ok {rc=0} 09:41:14.858192 bus /sierra_3: Setting Powered False 09:41:15.961401 bus /sierra_3: Setting Powered False 09:41:17.079909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:41:18.340380 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:18.346070 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:41:18.393216 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:41:18.420752 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:41:18.474360 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:41:18.521106 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:41:18.548250 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:41:19.100878 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:41:19.106447 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:19.118288 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:41:19.153625 tst handover.py: using LAC 27517 09:41:19.277791 tst handover.py: using RAC 232 09:41:19.401375 tst handover.py: using CellId 27517 09:41:19.532492 tst handover.py: using BVCI 27518 09:41:19.652598 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:41:19.698468 tst handover.py: using LAC 27518 09:41:19.829111 tst handover.py: using RAC 233 09:41:19.952622 tst handover.py: using CellId 27518 09:41:20.076443 tst handover.py: using BVCI 27519 09:41:20.190336 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:20.201510 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:20.212893 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:20.223945 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:20.235012 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:41:20.246004 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:41:20.361264 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:41:20.477393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:20.935234 run create_hlr_db(pid=25134): Launched 09:41:21.061831 bus /sierra_2: Setting Powered False 09:41:22.123460 run create_hlr_db(pid=25134): Terminated: ok {rc=0} 09:41:22.532782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Launched 09:41:22.846388 run osmo-hlr_10.42.42.2(pid=25137): Launched 09:41:22.965226 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:23.487163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Launched 09:41:23.799005 run osmo-stp_10.42.42.5(pid=25140): Launched 09:41:23.916205 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:24.449633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Launched 09:41:24.760824 run osmo-msc_10.42.42.6(pid=25143): Launched 09:41:24.934262 run osmo-stp_10.42.42.5(pid=25140): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] 09:41:25.065172 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-10_09:41:23.739439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:25.195543 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221210094123914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094123915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094123915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094123915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094123916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094123916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094123916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:25.324092 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-10_09:41:23.739439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:25.446030 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221210094123914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094123915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094123915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094123915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094123916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094123916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094123916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:25.592011 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 09:41:25.600108 tst handover.py:18: Test FAILED (6.5 sec) 09:41:25.626385 run osmo-hlr_10.42.42.2(pid=25137): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25137)] 09:41:25.673992 run osmo-hlr_10.42.42.2(pid=25137): stdout: | (launched: 2022-12-10_09:41:22.785956) 09:41:25.723057 run osmo-hlr_10.42.42.2(pid=25137): stderr: | 20221210094122966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094122966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094122966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094122966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094122966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094122966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094122978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094122988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094122989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094122989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:25.791107 run osmo-msc_10.42.42.6(pid=25143): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25143)] 09:41:25.838354 run osmo-msc_10.42.42.6(pid=25143): stdout: | (launched: 2022-12-10_09:41:24.701396) 09:41:25.887152 run osmo-msc_10.42.42.6(pid=25143): stderr: | 20221210094124976 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094124977 DLGLOBAL DEBUG validating counter group 0x7fae1b9bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094124977 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094124977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094124977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094124977 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094124979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094124979 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094124979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094124980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:25.936559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminating (SIGTERM) 09:41:25.975909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminating (SIGTERM) 09:41:26.015320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Terminating (SIGTERM) 09:41:26.054846 --- ParallelTerminationStrategy: PID 25136 died... 09:41:26.073759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminated: ok {rc=0} 09:41:26.117379 --- ParallelTerminationStrategy: PID 25139 died... 09:41:26.135723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminated: ok {rc=0} 09:41:26.179331 --- ParallelTerminationStrategy: PID 25142 died... 09:41:26.197827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Terminated: ok {rc=0} 09:41:26.282923 bus /sierra_3: Setting Powered False 09:41:27.382763 bus /sierra_3: Setting Powered False 09:41:28.497773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:41:29.750659 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:29.756182 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:41:29.805312 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:41:29.831666 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:41:29.883228 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:41:29.934701 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:41:29.962454 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:41:30.509998 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:41:30.515305 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:30.526387 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:41:30.559485 tst handover.py: using LAC 27519 09:41:30.680927 tst handover.py: using RAC 234 09:41:30.803321 tst handover.py: using CellId 27519 09:41:30.933307 tst handover.py: using BVCI 27520 09:41:31.093612 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:41:31.150773 tst handover.py: using LAC 27520 09:41:31.278289 tst handover.py: using RAC 235 09:41:31.402083 tst handover.py: using CellId 27520 09:41:31.528025 tst handover.py: using BVCI 27521 09:41:31.642787 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:31.654752 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:31.666483 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:31.678332 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:31.690074 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:41:31.701468 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:41:31.823356 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:41:31.971441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:32.465476 run create_hlr_db(pid=25148): Launched 09:41:32.591795 bus /sierra_2: Setting Powered False 09:41:33.656677 run create_hlr_db(pid=25148): Terminated: ok {rc=0} 09:41:34.084496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25150): Launched 09:41:34.410886 run osmo-hlr_10.42.42.2(pid=25151): Launched 09:41:34.536074 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:35.069021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25153): Launched 09:41:35.395009 run osmo-stp_10.42.42.5(pid=25154): Launched 09:41:35.519718 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:36.082079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25156): Launched 09:41:36.409377 run osmo-msc_10.42.42.6(pid=25157): Launched 09:41:36.592486 run osmo-stp_10.42.42.5(pid=25154): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25154)] 09:41:36.730957 run osmo-stp_10.42.42.5(pid=25154): stdout: | (launched: 2022-12-10_09:41:35.335694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:36.870807 run osmo-stp_10.42.42.5(pid=25154): stderr: | 20221210094135527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094135527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094135528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094135528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094135528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094135529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094135529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:37.009259 run osmo-stp_10.42.42.5(pid=25154): stdout: | (launched: 2022-12-10_09:41:35.335694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:37.139316 run osmo-stp_10.42.42.5(pid=25154): stderr: | 20221210094135527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094135527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094135528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094135528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094135528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094135529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094135529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:37.294980 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25154): Process ended prematurely: osmo-stp_10.42.42.5(pid=25154) [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25154)] [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 09:41:37.303762 tst handover.py:18: Test FAILED (6.8 sec) 09:41:37.331507 run osmo-hlr_10.42.42.2(pid=25151): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25151)] 09:41:37.381489 run osmo-hlr_10.42.42.2(pid=25151): stdout: | (launched: 2022-12-10_09:41:34.351702) 09:41:37.433205 run osmo-hlr_10.42.42.2(pid=25151): stderr: | 20221210094134548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094134548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094134548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094134548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094134548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094134548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094134561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094134569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094134569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094134569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:37.505049 run osmo-msc_10.42.42.6(pid=25157): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25157)] 09:41:37.554807 run osmo-msc_10.42.42.6(pid=25157): stdout: | (launched: 2022-12-10_09:41:36.349482) 09:41:37.606256 run osmo-msc_10.42.42.6(pid=25157): stderr: | 20221210094136670 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094136670 DLGLOBAL DEBUG validating counter group 0x7fe18b01bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094136670 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094136670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094136670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094136671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094136672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094136673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094136673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094136673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:37.658192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25150): Terminating (SIGTERM) 09:41:37.699711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25153): Terminating (SIGTERM) 09:41:37.741303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25156): Terminating (SIGTERM) 09:41:37.783186 --- ParallelTerminationStrategy: PID 25150 died... 09:41:37.802926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25150): Terminated: ok {rc=0} 09:41:37.849028 --- ParallelTerminationStrategy: PID 25153 died... 09:41:37.868651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25153): Terminated: ok {rc=0} 09:41:37.914972 --- ParallelTerminationStrategy: PID 25156 died... 09:41:37.934290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25156): Terminated: ok {rc=0} 09:41:38.021145 bus /sierra_3: Setting Powered False 09:41:39.119512 bus /sierra_3: Setting Powered False 09:41:40.234499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 09:41:41.494888 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:41.500257 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:41:41.538651 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:41:41.566179 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:41:41.618895 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:41:41.656675 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:41:41.683825 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:41:42.236895 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 09:41:42.242264 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:42.253525 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:41:42.287457 tst handover.py: using LAC 27521 09:41:42.415212 tst handover.py: using RAC 236 09:41:42.546905 tst handover.py: using CellId 27521 09:41:42.673369 tst handover.py: using BVCI 27522 09:41:42.792712 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 09:41:42.827177 tst handover.py: using LAC 27522 09:41:42.953999 tst handover.py: using RAC 237 09:41:43.080826 tst handover.py: using CellId 27522 09:41:43.207077 tst handover.py: using BVCI 27523 09:41:43.326189 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:43.337359 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:43.348229 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:43.359588 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:43.370917 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:41:43.382214 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:41:43.499718 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 09:41:43.615178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:44.071568 run create_hlr_db(pid=25162): Launched 09:41:44.197992 bus /sierra_2: Setting Powered False 09:41:45.259035 run create_hlr_db(pid=25162): Terminated: ok {rc=0} 09:41:45.666148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25164): Launched 09:41:46.038759 run osmo-hlr_10.42.42.2(pid=25165): Launched 09:41:46.288782 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:46.975025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25167): Launched 09:41:47.301395 run osmo-stp_10.42.42.5(pid=25168): Launched 09:41:47.419838 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:47.955376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25170): Launched 09:41:48.266699 run osmo-msc_10.42.42.6(pid=25171): Launched 09:41:48.438301 run osmo-stp_10.42.42.5(pid=25168): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25168)] 09:41:48.568868 run osmo-stp_10.42.42.5(pid=25168): stdout: | (launched: 2022-12-10_09:41:47.240489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:48.699514 run osmo-stp_10.42.42.5(pid=25168): stderr: | 20221210094147415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094147416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094147416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094147416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094147417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094147417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094147417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:48.827739 run osmo-stp_10.42.42.5(pid=25168): stdout: | (launched: 2022-12-10_09:41:47.240489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:41:48.949923 run osmo-stp_10.42.42.5(pid=25168): stderr: | 20221210094147415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094147416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094147416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094147416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094147417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094147417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094147417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:41:49.095923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25168): Process ended prematurely: osmo-stp_10.42.42.5(pid=25168) [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25168)] [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 09:41:49.104485 tst handover.py:18: Test FAILED (6.9 sec) 09:41:49.130107 run osmo-hlr_10.42.42.2(pid=25165): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25165)] 09:41:49.177279 run osmo-hlr_10.42.42.2(pid=25165): stdout: | (launched: 2022-12-10_09:41:45.970956) 09:41:49.225755 run osmo-hlr_10.42.42.2(pid=25165): stderr: | 20221210094146290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094146290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094146290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094146290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094146290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094146290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094146306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094146323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094146323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094146323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:41:49.293742 run osmo-msc_10.42.42.6(pid=25171): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25171)] 09:41:49.340723 run osmo-msc_10.42.42.6(pid=25171): stdout: | (launched: 2022-12-10_09:41:48.206589) 09:41:49.389349 run osmo-msc_10.42.42.6(pid=25171): stderr: | 20221210094148481 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094148481 DLGLOBAL DEBUG validating counter group 0x7f82b0dbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094148481 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094148481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094148482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094148482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094148483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094148484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094148484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094148484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:41:49.438115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25164): Terminating (SIGTERM) 09:41:49.477020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25167): Terminating (SIGTERM) 09:41:49.515806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25170): Terminating (SIGTERM) 09:41:49.554915 --- ParallelTerminationStrategy: PID 25164 died... 09:41:49.573633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25164): Terminated: ok {rc=0} 09:41:49.616762 --- ParallelTerminationStrategy: PID 25167 died... 09:41:49.635121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25167): Terminated: ok {rc=0} 09:41:49.678575 --- ParallelTerminationStrategy: PID 25170 died... 09:41:49.696911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25170): Terminated: ok {rc=0} 09:41:49.779682 bus /sierra_3: Setting Powered False 09:41:50.877369 bus /sierra_3: Setting Powered False 09:41:51.992098 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 09:41:53.228477 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:41:53.233309 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:41:53.281579 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:41:53.307977 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:41:53.359398 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:41:53.409921 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:41:53.437717 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:41:53.985626 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 09:41:53.990629 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:54.001485 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:41:54.040295 tst handover.py: using LAC 27523 09:41:54.162519 tst handover.py: using RAC 238 09:41:54.284420 tst handover.py: using CellId 27523 09:41:54.404341 tst handover.py: using BVCI 27524 09:41:54.525552 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:41:54.573849 tst handover.py: using LAC 27524 09:41:54.702963 tst handover.py: using RAC 239 09:41:54.830229 tst handover.py: using CellId 27524 09:41:54.958303 tst handover.py: using BVCI 27525 09:41:55.079052 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:55.090312 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:55.101378 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:55.112704 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:55.124157 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:41:55.135696 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:41:55.252698 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:41:55.372633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:41:55.852156 run create_hlr_db(pid=25176): Launched 09:41:55.977162 bus /sierra_2: Setting Powered False 09:41:57.041319 run create_hlr_db(pid=25176): Terminated: ok {rc=0} 09:41:57.467376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25178): Launched 09:41:57.792892 run osmo-hlr_10.42.42.2(pid=25179): Launched 09:41:57.918568 run osmo-stp_10.42.42.5: Starting osmo-stp 09:41:58.454762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25181): Launched 09:41:58.781051 run osmo-stp_10.42.42.5(pid=25182): Launched 09:41:58.906986 run osmo-msc_10.42.42.6: Starting osmo-msc 09:41:59.468137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25184): Launched 09:41:59.794050 run osmo-msc_10.42.42.6(pid=25185): Launched 09:41:59.976242 run osmo-stp_10.42.42.5(pid=25182): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25182)] 09:42:00.114798 run osmo-stp_10.42.42.5(pid=25182): stdout: | (launched: 2022-12-10_09:41:58.721796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:00.253182 run osmo-stp_10.42.42.5(pid=25182): stderr: | 20221210094158914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094158914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094158914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094158915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094158915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094158915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094158915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:00.390556 run osmo-stp_10.42.42.5(pid=25182): stdout: | (launched: 2022-12-10_09:41:58.721796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:00.519991 run osmo-stp_10.42.42.5(pid=25182): stderr: | 20221210094158914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094158914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094158914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094158915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094158915 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094158915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094158915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:00.675155 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25182): Process ended prematurely: osmo-stp_10.42.42.5(pid=25182) [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25182)] [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 09:42:00.683751 tst handover.py:18: Test FAILED (6.7 sec) 09:42:00.711257 run osmo-hlr_10.42.42.2(pid=25179): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25179)] 09:42:00.761466 run osmo-hlr_10.42.42.2(pid=25179): stdout: | (launched: 2022-12-10_09:41:57.733611) 09:42:00.813186 run osmo-hlr_10.42.42.2(pid=25179): stderr: | 20221210094157933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094157933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094157933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094157933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094157933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094157933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094157946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094157954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094157954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094157954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:00.925134 run osmo-msc_10.42.42.6(pid=25185): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25185)] 09:42:00.997665 run osmo-msc_10.42.42.6(pid=25185): stdout: | (launched: 2022-12-10_09:41:59.734819) 09:42:01.093477 run osmo-msc_10.42.42.6(pid=25185): stderr: | 20221210094200058 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094200058 DLGLOBAL DEBUG validating counter group 0x7f90d0959c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094200058 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094200058 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094200059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094200059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094200060 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094200061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094200061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094200061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:01.152369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25178): Terminating (SIGTERM) 09:42:01.199081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25181): Terminating (SIGTERM) 09:42:01.245311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25184): Terminating (SIGTERM) 09:42:01.295702 --- ParallelTerminationStrategy: PID 25178 died... 09:42:01.331796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25178): Terminated: ok {rc=0} 09:42:01.388834 --- ParallelTerminationStrategy: PID 25181 died... 09:42:01.409747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25181): Terminated: ok {rc=0} 09:42:01.456632 --- ParallelTerminationStrategy: PID 25184 died... 09:42:01.487626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25184): Terminated: ok {rc=0} 09:42:01.655277 bus /sierra_3: Setting Powered False 09:42:02.794436 bus /sierra_3: Setting Powered False 09:42:03.910482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 09:42:05.166555 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:05.171895 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:42:05.222588 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:42:05.250197 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:42:05.302988 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:42:05.353138 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:42:05.380771 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:42:05.933174 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 09:42:05.938522 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:05.949846 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:42:05.984122 tst handover.py: using LAC 27525 09:42:06.122197 tst handover.py: using RAC 240 09:42:06.257097 tst handover.py: using CellId 27525 09:42:06.377075 tst handover.py: using BVCI 27526 09:42:06.489095 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:42:06.534979 tst handover.py: using LAC 27526 09:42:06.655198 tst handover.py: using RAC 241 09:42:06.776918 tst handover.py: using CellId 27526 09:42:06.897452 tst handover.py: using BVCI 27527 09:42:07.019246 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:07.030735 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:07.042288 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:07.054318 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:07.066354 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:42:07.078432 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:42:07.198087 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:42:07.320713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:07.807602 run create_hlr_db(pid=25196): Launched 09:42:07.933765 bus /sierra_2: Setting Powered False 09:42:08.998748 run create_hlr_db(pid=25196): Terminated: ok {rc=0} 09:42:09.431500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25198): Launched 09:42:09.763023 run osmo-hlr_10.42.42.2(pid=25199): Launched 09:42:09.890162 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:10.430385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25201): Launched 09:42:10.761600 run osmo-stp_10.42.42.5(pid=25202): Launched 09:42:10.887550 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:11.458171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25204): Launched 09:42:11.790218 run osmo-msc_10.42.42.6(pid=25205): Launched 09:42:11.974317 run osmo-stp_10.42.42.5(pid=25202): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25202)] 09:42:12.115243 run osmo-stp_10.42.42.5(pid=25202): stdout: | (launched: 2022-12-10_09:42:10.698027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:12.254482 run osmo-stp_10.42.42.5(pid=25202): stderr: | 20221210094210893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094210893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094210893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094210894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094210896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094210896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094210896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:12.391905 run osmo-stp_10.42.42.5(pid=25202): stdout: | (launched: 2022-12-10_09:42:10.698027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:12.522418 run osmo-stp_10.42.42.5(pid=25202): stderr: | 20221210094210893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094210893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094210893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094210894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094210896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094210896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094210896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:12.678589 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25202): Process ended prematurely: osmo-stp_10.42.42.5(pid=25202) [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25202)] [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 09:42:12.687346 tst handover.py:18: Test FAILED (6.7 sec) 09:42:12.714926 run osmo-hlr_10.42.42.2(pid=25199): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25199)] 09:42:12.765088 run osmo-hlr_10.42.42.2(pid=25199): stdout: | (launched: 2022-12-10_09:42:09.699524) 09:42:12.817037 run osmo-hlr_10.42.42.2(pid=25199): stderr: | 20221210094209900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094209900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094209900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094209900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094209900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094209900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094209913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094209921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094209921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094209921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:12.889876 run osmo-msc_10.42.42.6(pid=25205): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25205)] 09:42:12.939831 run osmo-msc_10.42.42.6(pid=25205): stdout: | (launched: 2022-12-10_09:42:11.726525) 09:42:12.991744 run osmo-msc_10.42.42.6(pid=25205): stderr: | 20221210094212051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094212052 DLGLOBAL DEBUG validating counter group 0x7f20add09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094212052 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094212052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094212052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094212052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094212054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094212054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094212054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094212055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:13.043947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25198): Terminating (SIGTERM) 09:42:13.085774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25201): Terminating (SIGTERM) 09:42:13.127694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25204): Terminating (SIGTERM) 09:42:13.169832 --- ParallelTerminationStrategy: PID 25198 died... 09:42:13.189698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25198): Terminated: ok {rc=0} 09:42:13.236001 --- ParallelTerminationStrategy: PID 25201 died... 09:42:13.255400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25201): Terminated: ok {rc=0} 09:42:13.301610 --- ParallelTerminationStrategy: PID 25204 died... 09:42:13.320879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25204): Terminated: ok {rc=0} 09:42:13.408542 bus /sierra_3: Setting Powered False 09:42:14.506928 bus /sierra_3: Setting Powered False 09:42:15.622559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 09:42:16.881587 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:16.890406 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 09:42:16.968479 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 09:42:17.002501 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 09:42:17.064114 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 09:42:17.166122 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 09:42:17.196066 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 09:42:17.708398 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 09:42:17.714267 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:17.725947 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:42:17.775229 tst handover.py: using LAC 27527 09:42:17.903373 tst handover.py: using RAC 242 09:42:18.031850 tst handover.py: using CellId 27527 09:42:18.158947 tst handover.py: using BVCI 27528 09:42:18.277885 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 09:42:18.322266 tst handover.py: using LAC 27528 09:42:18.450448 tst handover.py: using RAC 243 09:42:18.576678 tst handover.py: using CellId 27528 09:42:18.702674 tst handover.py: using BVCI 27529 09:42:18.823747 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:18.835340 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:18.846709 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:18.858410 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:18.870139 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 09:42:18.882004 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:42:19.002249 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 09:42:19.122756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:19.601773 run create_hlr_db(pid=25210): Launched 09:42:19.725983 bus /sierra_2: Setting Powered False 09:42:20.790580 run create_hlr_db(pid=25210): Terminated: ok {rc=0} 09:42:21.204009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Launched 09:42:21.512926 run osmo-hlr_10.42.42.2(pid=25213): Launched 09:42:21.632387 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:22.138452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Launched 09:42:22.446454 run osmo-stp_10.42.42.5(pid=25216): Launched 09:42:22.564514 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:23.096023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Launched 09:42:23.404684 run osmo-msc_10.42.42.6(pid=25219): Launched 09:42:23.577771 run osmo-stp_10.42.42.5(pid=25216): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] 09:42:23.708282 run osmo-stp_10.42.42.5(pid=25216): stdout: | (launched: 2022-12-10_09:42:22.389938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:23.838182 run osmo-stp_10.42.42.5(pid=25216): stderr: | 20221210094222561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094222561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094222562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094222562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094222562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094222562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094222563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:23.966480 run osmo-stp_10.42.42.5(pid=25216): stdout: | (launched: 2022-12-10_09:42:22.389938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:24.088267 run osmo-stp_10.42.42.5(pid=25216): stderr: | 20221210094222561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094222561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094222562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094222562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094222562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094222562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094222563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:24.235154 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25216): Process ended prematurely: osmo-stp_10.42.42.5(pid=25216) [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 09:42:24.243471 tst handover.py:18: Test FAILED (6.5 sec) 09:42:24.269233 run osmo-hlr_10.42.42.2(pid=25213): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25213)] 09:42:24.316232 run osmo-hlr_10.42.42.2(pid=25213): stdout: | (launched: 2022-12-10_09:42:21.456266) 09:42:24.365315 run osmo-hlr_10.42.42.2(pid=25213): stderr: | 20221210094221634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094221635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094221635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094221635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094221635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094221635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094221647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094221657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094221658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094221658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:24.433093 run osmo-msc_10.42.42.6(pid=25219): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25219)] 09:42:24.480062 run osmo-msc_10.42.42.6(pid=25219): stdout: | (launched: 2022-12-10_09:42:23.348160) 09:42:24.528503 run osmo-msc_10.42.42.6(pid=25219): stderr: | 20221210094223622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094223622 DLGLOBAL DEBUG validating counter group 0x7ff3e2ae1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094223623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094223623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094223623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094223623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094223625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094223625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094223625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094223625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:24.577515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Terminating (SIGTERM) 09:42:24.616344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Terminating (SIGTERM) 09:42:24.655083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Terminating (SIGTERM) 09:42:24.694838 --- ParallelTerminationStrategy: PID 25212 died... 09:42:24.713445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Terminated: ok {rc=0} 09:42:24.756878 --- ParallelTerminationStrategy: PID 25215 died... 09:42:24.775445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Terminated: ok {rc=0} 09:42:24.818178 --- ParallelTerminationStrategy: PID 25218 died... 09:42:24.836544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Terminated: ok {rc=0} 09:42:24.919354 bus /sierra_3: Setting Powered False 09:42:26.017075 bus /sierra_3: Setting Powered False 09:42:27.135495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:42:28.407788 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:28.412854 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:42:28.476134 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:42:28.502601 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:42:28.552432 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:42:28.616094 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:42:28.642541 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:42:29.196577 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:42:29.201633 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:29.212420 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:42:29.259646 tst handover.py: using LAC 27529 09:42:29.379690 tst handover.py: using RAC 244 09:42:29.500676 tst handover.py: using CellId 27529 09:42:29.620694 tst handover.py: using BVCI 27530 09:42:29.741013 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:42:29.790103 tst handover.py: using LAC 27530 09:42:29.917799 tst handover.py: using RAC 245 09:42:30.038380 tst handover.py: using CellId 27530 09:42:30.159618 tst handover.py: using BVCI 27531 09:42:30.272335 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:30.283422 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:30.294457 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:30.305527 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:30.316308 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:42:30.327103 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:42:30.447963 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:42:30.571057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:31.091499 run create_hlr_db(pid=25224): Launched 09:42:31.251134 bus /sierra_2: Setting Powered False 09:42:32.315679 run create_hlr_db(pid=25224): Terminated: ok {rc=0} 09:42:32.746654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25226): Launched 09:42:33.078472 run osmo-hlr_10.42.42.2(pid=25227): Launched 09:42:33.203860 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:33.739310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25229): Launched 09:42:34.054502 run osmo-stp_10.42.42.5(pid=25230): Launched 09:42:34.171736 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:34.707132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25232): Launched 09:42:35.020044 run osmo-msc_10.42.42.6(pid=25233): Launched 09:42:35.193423 run osmo-stp_10.42.42.5(pid=25230): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25230)] 09:42:35.324540 run osmo-stp_10.42.42.5(pid=25230): stdout: | (launched: 2022-12-10_09:42:33.994827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:35.454307 run osmo-stp_10.42.42.5(pid=25230): stderr: | 20221210094234169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094234169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094234169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094234169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094234170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094234170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094234170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:35.582195 run osmo-stp_10.42.42.5(pid=25230): stdout: | (launched: 2022-12-10_09:42:33.994827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:35.704189 run osmo-stp_10.42.42.5(pid=25230): stderr: | 20221210094234169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094234169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094234169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094234169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094234170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094234170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094234170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:35.850181 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25230): Process ended prematurely: osmo-stp_10.42.42.5(pid=25230) [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25230)] [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 09:42:35.858234 tst handover.py:18: Test FAILED (6.7 sec) 09:42:35.883862 run osmo-hlr_10.42.42.2(pid=25227): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25227)] 09:42:35.931595 run osmo-hlr_10.42.42.2(pid=25227): stdout: | (launched: 2022-12-10_09:42:33.014098) 09:42:35.981134 run osmo-hlr_10.42.42.2(pid=25227): stderr: | 20221210094233217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094233217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094233217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094233217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094233217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094233218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094233233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094233242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094233242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094233243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:36.049109 run osmo-msc_10.42.42.6(pid=25233): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25233)] 09:42:36.096266 run osmo-msc_10.42.42.6(pid=25233): stdout: | (launched: 2022-12-10_09:42:34.958547) 09:42:36.144904 run osmo-msc_10.42.42.6(pid=25233): stderr: | 20221210094235237 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094235238 DLGLOBAL DEBUG validating counter group 0x7f8290acbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094235238 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094235238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094235238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094235238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094235240 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094235240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094235240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094235241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:36.193907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25226): Terminating (SIGTERM) 09:42:36.233565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25229): Terminating (SIGTERM) 09:42:36.272574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25232): Terminating (SIGTERM) 09:42:36.311782 --- ParallelTerminationStrategy: PID 25226 died... 09:42:36.330592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25226): Terminated: ok {rc=0} 09:42:36.374286 --- ParallelTerminationStrategy: PID 25229 died... 09:42:36.392543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25229): Terminated: ok {rc=0} 09:42:36.435608 --- ParallelTerminationStrategy: PID 25232 died... 09:42:36.454085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25232): Terminated: ok {rc=0} 09:42:36.536651 bus /sierra_3: Setting Powered False 09:42:37.631567 bus /sierra_3: Setting Powered False 09:42:38.745695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 09:42:40.016599 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:40.021709 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:42:40.071880 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:42:40.098221 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:42:40.150562 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:42:40.201230 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:42:40.227653 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:42:40.776592 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 09:42:40.781701 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:40.792425 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:42:40.840776 tst handover.py: using LAC 27531 09:42:40.964246 tst handover.py: using RAC 246 09:42:41.086659 tst handover.py: using CellId 27531 09:42:41.209701 tst handover.py: using BVCI 27532 09:42:41.322866 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 09:42:41.358409 tst handover.py: using LAC 27532 09:42:41.489291 tst handover.py: using RAC 247 09:42:41.620038 tst handover.py: using CellId 27532 09:42:41.749688 tst handover.py: using BVCI 27533 09:42:41.863880 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:41.874916 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:41.885793 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:41.896587 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:41.907458 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:42:41.918127 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:42:42.037339 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 09:42:42.157514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:42.636927 run create_hlr_db(pid=25238): Launched 09:42:42.762675 bus /sierra_2: Setting Powered False 09:42:43.827876 run create_hlr_db(pid=25238): Terminated: ok {rc=0} 09:42:44.255326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25240): Launched 09:42:44.583697 run osmo-hlr_10.42.42.2(pid=25241): Launched 09:42:44.709270 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:45.248650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25243): Launched 09:42:45.575471 run osmo-stp_10.42.42.5(pid=25244): Launched 09:42:45.700618 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:46.321904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25246): Launched 09:42:46.729724 run osmo-msc_10.42.42.6(pid=25247): Launched 09:42:47.162545 run osmo-stp_10.42.42.5(pid=25244): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25244)] 09:42:47.342105 run osmo-stp_10.42.42.5(pid=25244): stdout: | (launched: 2022-12-10_09:42:45.515877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:47.479480 run osmo-stp_10.42.42.5(pid=25244): stderr: | 20221210094245710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094245710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094245711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094245711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094245711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094245711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094245712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:47.616750 run osmo-stp_10.42.42.5(pid=25244): stdout: | (launched: 2022-12-10_09:42:45.515877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:47.747075 run osmo-stp_10.42.42.5(pid=25244): stderr: | 20221210094245710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094245710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094245711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094245711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094245711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094245711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094245712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:47.904122 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25244): Process ended prematurely: osmo-stp_10.42.42.5(pid=25244) [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25244)] [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 09:42:47.913152 tst handover.py:18: Test FAILED (7.1 sec) 09:42:47.941338 run osmo-hlr_10.42.42.2(pid=25241): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25241)] 09:42:47.992248 run osmo-hlr_10.42.42.2(pid=25241): stdout: | (launched: 2022-12-10_09:42:44.523873) 09:42:48.044739 run osmo-hlr_10.42.42.2(pid=25241): stderr: | 20221210094244723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094244723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094244724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094244724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094244724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094244724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094244737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094244745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094244745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094244745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:48.118315 run osmo-msc_10.42.42.6(pid=25247): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25247)] 09:42:48.169236 run osmo-msc_10.42.42.6(pid=25247): stdout: | (launched: 2022-12-10_09:42:46.657806) 09:42:48.221400 run osmo-msc_10.42.42.6(pid=25247): stderr: | 20221210094247050 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094247051 DLGLOBAL DEBUG validating counter group 0x7f4d2e8d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094247051 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094247051 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094247051 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094247051 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094247053 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094247053 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094247054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094247054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:42:48.274175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25240): Terminating (SIGTERM) 09:42:48.316624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25243): Terminating (SIGTERM) 09:42:48.359177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25246): Terminating (SIGTERM) 09:42:48.401930 --- ParallelTerminationStrategy: PID 25240 died... 09:42:48.421979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25240): Terminated: ok {rc=0} 09:42:48.468792 --- ParallelTerminationStrategy: PID 25243 died... 09:42:48.488840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25243): Terminated: ok {rc=0} 09:42:48.535583 --- ParallelTerminationStrategy: PID 25246 died... 09:42:48.555183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25246): Terminated: ok {rc=0} 09:42:48.643228 bus /sierra_3: Setting Powered False 09:42:49.741329 bus /sierra_3: Setting Powered False 09:42:50.856498 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 09:42:52.118593 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:42:52.124585 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:42:52.186825 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:42:52.213340 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:42:52.266118 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:42:52.329342 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:42:52.355882 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:42:52.904650 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 09:42:52.910029 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:52.920691 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:42:52.968744 tst handover.py: using LAC 27533 09:42:53.098681 tst handover.py: using RAC 248 09:42:53.226774 tst handover.py: using CellId 27533 09:42:53.356740 tst handover.py: using BVCI 27534 09:42:53.475692 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:42:53.525671 tst handover.py: using LAC 27534 09:42:53.655562 tst handover.py: using RAC 249 09:42:53.786368 tst handover.py: using CellId 27534 09:42:53.909810 tst handover.py: using BVCI 27535 09:42:54.023457 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:54.034501 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:54.045418 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:54.056277 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:54.066907 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:42:54.077526 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:42:54.195228 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:42:54.315134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:42:54.797924 run create_hlr_db(pid=25252): Launched 09:42:54.923472 bus /sierra_2: Setting Powered False 09:42:55.987915 run create_hlr_db(pid=25252): Terminated: ok {rc=0} 09:42:56.418563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25254): Launched 09:42:56.751158 run osmo-hlr_10.42.42.2(pid=25255): Launched 09:42:56.876702 run osmo-stp_10.42.42.5: Starting osmo-stp 09:42:57.419154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25257): Launched 09:42:57.750579 run osmo-stp_10.42.42.5(pid=25258): Launched 09:42:57.876156 run osmo-msc_10.42.42.6: Starting osmo-msc 09:42:58.447527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25260): Launched 09:42:58.779369 run osmo-msc_10.42.42.6(pid=25261): Launched 09:42:58.963386 run osmo-stp_10.42.42.5(pid=25258): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25258)] 09:42:59.102666 run osmo-stp_10.42.42.5(pid=25258): stdout: | (launched: 2022-12-10_09:42:57.686917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:59.241915 run osmo-stp_10.42.42.5(pid=25258): stderr: | 20221210094257884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094257884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094257884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094257884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094257885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094257885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094257885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:59.380406 run osmo-stp_10.42.42.5(pid=25258): stdout: | (launched: 2022-12-10_09:42:57.686917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:42:59.511063 run osmo-stp_10.42.42.5(pid=25258): stderr: | 20221210094257884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094257884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094257884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094257884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094257885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094257885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094257885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:42:59.667428 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25258): Process ended prematurely: osmo-stp_10.42.42.5(pid=25258) [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25258)] [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 09:42:59.676076 tst handover.py:18: Test FAILED (6.8 sec) 09:42:59.704061 run osmo-hlr_10.42.42.2(pid=25255): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25255)] 09:42:59.753875 run osmo-hlr_10.42.42.2(pid=25255): stdout: | (launched: 2022-12-10_09:42:56.686668) 09:42:59.805713 run osmo-hlr_10.42.42.2(pid=25255): stderr: | 20221210094256888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094256888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094256888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094256888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094256888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094256888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094256901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094256909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094256909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094256909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:42:59.877450 run osmo-msc_10.42.42.6(pid=25261): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25261)] 09:42:59.927585 run osmo-msc_10.42.42.6(pid=25261): stdout: | (launched: 2022-12-10_09:42:58.715333) 09:42:59.979009 run osmo-msc_10.42.42.6(pid=25261): stderr: | 20221210094259041 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094259042 DLGLOBAL DEBUG validating counter group 0x7fbc8d4d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094259042 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094259042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094259042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094259042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094259044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094259044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094259044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094259044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:00.031310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25254): Terminating (SIGTERM) 09:43:00.072709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25257): Terminating (SIGTERM) 09:43:00.114218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25260): Terminating (SIGTERM) 09:43:00.156025 --- ParallelTerminationStrategy: PID 25254 died... 09:43:00.175745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25254): Terminated: ok {rc=0} 09:43:00.221671 --- ParallelTerminationStrategy: PID 25257 died... 09:43:00.240599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25257): Terminated: ok {rc=0} 09:43:00.286640 --- ParallelTerminationStrategy: PID 25260 died... 09:43:00.306099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25260): Terminated: ok {rc=0} 09:43:00.394565 bus /sierra_3: Setting Powered False 09:43:01.490485 bus /sierra_3: Setting Powered False 09:43:02.608802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 09:43:03.878689 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:03.883847 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:43:03.945559 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:43:03.971965 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:43:04.023816 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:43:04.086811 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:43:04.113446 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:43:04.661694 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 09:43:04.666675 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:04.677633 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:04.724877 tst handover.py: using LAC 27535 09:43:04.848029 tst handover.py: using RAC 250 09:43:04.971782 tst handover.py: using CellId 27535 09:43:05.094652 tst handover.py: using BVCI 27536 09:43:05.208287 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:05.259339 tst handover.py: using LAC 27536 09:43:05.379371 tst handover.py: using RAC 251 09:43:05.500468 tst handover.py: using CellId 27536 09:43:05.619840 tst handover.py: using BVCI 27537 09:43:05.731446 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:05.742301 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:05.752883 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:05.763617 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:05.774311 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:05.784857 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:05.904157 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:06.023940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:06.503311 run create_hlr_db(pid=25267): Launched 09:43:06.630002 bus /sierra_2: Setting Powered False 09:43:07.694954 run create_hlr_db(pid=25267): Terminated: ok {rc=0} 09:43:08.107270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25269): Launched 09:43:08.416392 run osmo-hlr_10.42.42.2(pid=25270): Launched 09:43:08.535780 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:09.052229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25272): Launched 09:43:09.361682 run osmo-stp_10.42.42.5(pid=25273): Launched 09:43:09.479973 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:10.010781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25275): Launched 09:43:10.319615 run osmo-msc_10.42.42.6(pid=25276): Launched 09:43:10.493114 run osmo-stp_10.42.42.5(pid=25273): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25273)] 09:43:10.622993 run osmo-stp_10.42.42.5(pid=25273): stdout: | (launched: 2022-12-10_09:43:09.305055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:10.753037 run osmo-stp_10.42.42.5(pid=25273): stderr: | 20221210094309476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094309477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094309477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094309477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094309478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094309478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094309478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:10.881586 run osmo-stp_10.42.42.5(pid=25273): stdout: | (launched: 2022-12-10_09:43:09.305055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:11.003885 run osmo-stp_10.42.42.5(pid=25273): stderr: | 20221210094309476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094309477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094309477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094309477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094309478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094309478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094309478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:11.150568 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25273): Process ended prematurely: osmo-stp_10.42.42.5(pid=25273) [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25273)] [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 09:43:11.158841 tst handover.py:18: Test FAILED (6.5 sec) 09:43:11.185424 run osmo-hlr_10.42.42.2(pid=25270): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25270)] 09:43:11.233413 run osmo-hlr_10.42.42.2(pid=25270): stdout: | (launched: 2022-12-10_09:43:08.359932) 09:43:11.282731 run osmo-hlr_10.42.42.2(pid=25270): stderr: | 20221210094308538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094308538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094308538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094308538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094308538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094308538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094308550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094308558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094308559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094308559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:11.351347 run osmo-msc_10.42.42.6(pid=25276): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25276)] 09:43:11.398248 run osmo-msc_10.42.42.6(pid=25276): stdout: | (launched: 2022-12-10_09:43:10.262541) 09:43:11.446700 run osmo-msc_10.42.42.6(pid=25276): stderr: | 20221210094310534 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094310534 DLGLOBAL DEBUG validating counter group 0x7f7026e5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094310534 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094310534 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094310534 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094310534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094310536 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094310537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094310537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094310537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:11.495668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25269): Terminating (SIGTERM) 09:43:11.534515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25272): Terminating (SIGTERM) 09:43:11.573683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25275): Terminating (SIGTERM) 09:43:11.613108 --- ParallelTerminationStrategy: PID 25269 died... 09:43:11.631965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25269): Terminated: ok {rc=0} 09:43:11.675496 --- ParallelTerminationStrategy: PID 25272 died... 09:43:11.693967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25272): Terminated: ok {rc=0} 09:43:11.737546 --- ParallelTerminationStrategy: PID 25275 died... 09:43:11.755984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25275): Terminated: ok {rc=0} 09:43:11.839136 bus /sierra_3: Setting Powered False 09:43:12.934215 bus /sierra_3: Setting Powered False 09:43:14.050675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 09:43:15.318770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:15.325520 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 09:43:15.387629 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 09:43:15.414914 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 09:43:15.469251 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 09:43:15.533098 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 09:43:15.560895 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 09:43:16.152670 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 09:43:16.158789 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:16.173157 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:16.220433 tst handover.py: using LAC 27537 09:43:16.383129 tst handover.py: using RAC 252 09:43:16.545329 tst handover.py: using CellId 27537 09:43:16.713050 tst handover.py: using BVCI 27538 09:43:16.850008 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 09:43:16.898251 tst handover.py: using LAC 27538 09:43:17.020201 tst handover.py: using RAC 253 09:43:17.170761 tst handover.py: using CellId 27538 09:43:17.304343 tst handover.py: using BVCI 27539 09:43:17.423441 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:17.435521 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:17.447074 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:17.458990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:17.471135 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 09:43:17.482672 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:17.600437 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 09:43:17.721619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:18.207413 run create_hlr_db(pid=25281): Launched 09:43:18.332086 bus /sierra_2: Setting Powered False 09:43:19.396816 run create_hlr_db(pid=25281): Terminated: ok {rc=0} 09:43:19.829638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25283): Launched 09:43:20.161750 run osmo-hlr_10.42.42.2(pid=25284): Launched 09:43:20.287316 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:20.831653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25286): Launched 09:43:21.164655 run osmo-stp_10.42.42.5(pid=25287): Launched 09:43:21.290103 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:21.860896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25289): Launched 09:43:22.193618 run osmo-msc_10.42.42.6(pid=25290): Launched 09:43:22.376518 run osmo-stp_10.42.42.5(pid=25287): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25287)] 09:43:22.514966 run osmo-stp_10.42.42.5(pid=25287): stdout: | (launched: 2022-12-10_09:43:21.100100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:22.653704 run osmo-stp_10.42.42.5(pid=25287): stderr: | 20221210094321299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094321299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094321299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094321299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094321300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094321300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094321300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:22.791887 run osmo-stp_10.42.42.5(pid=25287): stdout: | (launched: 2022-12-10_09:43:21.100100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:22.922509 run osmo-stp_10.42.42.5(pid=25287): stderr: | 20221210094321299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094321299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094321299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094321299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094321300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094321300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094321300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:23.078211 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25287): Process ended prematurely: osmo-stp_10.42.42.5(pid=25287) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25287)] [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 09:43:23.086916 tst handover.py:18: Test FAILED (6.9 sec) 09:43:23.114621 run osmo-hlr_10.42.42.2(pid=25284): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25284)] 09:43:23.164272 run osmo-hlr_10.42.42.2(pid=25284): stdout: | (launched: 2022-12-10_09:43:20.097018) 09:43:23.215885 run osmo-hlr_10.42.42.2(pid=25284): stderr: | 20221210094320301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094320301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094320301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094320301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094320301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094320301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094320315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094320325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094320326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094320326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:23.287555 run osmo-msc_10.42.42.6(pid=25290): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25290)] 09:43:23.337300 run osmo-msc_10.42.42.6(pid=25290): stdout: | (launched: 2022-12-10_09:43:22.129053) 09:43:23.388562 run osmo-msc_10.42.42.6(pid=25290): stderr: | 20221210094322456 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094322456 DLGLOBAL DEBUG validating counter group 0x7ffad42f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094322456 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094322456 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094322457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094322457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094322458 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094322459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094322459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094322459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:23.440187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25283): Terminating (SIGTERM) 09:43:23.481390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25286): Terminating (SIGTERM) 09:43:23.522757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25289): Terminating (SIGTERM) 09:43:23.564448 --- ParallelTerminationStrategy: PID 25283 died... 09:43:23.584076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25283): Terminated: ok {rc=0} 09:43:23.630315 --- ParallelTerminationStrategy: PID 25286 died... 09:43:23.649587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25286): Terminated: ok {rc=0} 09:43:23.695577 --- ParallelTerminationStrategy: PID 25289 died... 09:43:23.714817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25289): Terminated: ok {rc=0} 09:43:23.801296 bus /sierra_3: Setting Powered False 09:43:24.900610 bus /sierra_3: Setting Powered False 09:43:26.017630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 09:43:27.289951 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:27.295532 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:43:27.343994 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:43:27.371526 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:43:27.424394 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:43:27.472790 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:43:27.500516 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:43:28.051432 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 09:43:28.056866 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:28.068397 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:43:28.112455 tst handover.py: using LAC 27539 09:43:28.234023 tst handover.py: using RAC 254 09:43:28.360108 tst handover.py: using CellId 27539 09:43:28.481469 tst handover.py: using BVCI 27540 09:43:28.593778 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 09:43:28.627141 tst handover.py: using LAC 27540 09:43:28.746663 tst handover.py: using RAC 255 09:43:28.868537 tst handover.py: using CellId 27540 09:43:28.987863 tst handover.py: using BVCI 27541 09:43:29.099575 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:29.110738 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:29.121862 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:29.133242 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:29.144363 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:43:29.155632 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:43:29.274861 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 09:43:29.394024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:29.845958 run create_hlr_db(pid=25296): Launched 09:43:29.970811 bus /sierra_2: Setting Powered False 09:43:31.046717 run create_hlr_db(pid=25296): Terminated: ok {rc=0} 09:43:31.502760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25298): Launched 09:43:31.851692 run osmo-hlr_10.42.42.2(pid=25299): Launched 09:43:32.074838 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:32.646185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25301): Launched 09:43:32.974408 run osmo-stp_10.42.42.5(pid=25302): Launched 09:43:33.099547 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:33.662483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25304): Launched 09:43:33.990705 run osmo-msc_10.42.42.6(pid=25305): Launched 09:43:34.173316 run osmo-stp_10.42.42.5(pid=25302): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25302)] 09:43:34.310911 run osmo-stp_10.42.42.5(pid=25302): stdout: | (launched: 2022-12-10_09:43:32.914652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:34.449399 run osmo-stp_10.42.42.5(pid=25302): stderr: | 20221210094333106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094333106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094333107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094333107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094333108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094333108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094333108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:34.587148 run osmo-stp_10.42.42.5(pid=25302): stdout: | (launched: 2022-12-10_09:43:32.914652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:34.717708 run osmo-stp_10.42.42.5(pid=25302): stderr: | 20221210094333106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094333106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094333107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094333107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094333108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094333108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094333108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:34.873470 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25302): Process ended prematurely: osmo-stp_10.42.42.5(pid=25302) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25302)] [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 09:43:34.882325 tst handover.py:18: Test FAILED (6.8 sec) 09:43:34.910094 run osmo-hlr_10.42.42.2(pid=25299): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25299)] 09:43:34.960539 run osmo-hlr_10.42.42.2(pid=25299): stdout: | (launched: 2022-12-10_09:43:31.788900) 09:43:35.012571 run osmo-hlr_10.42.42.2(pid=25299): stderr: | 20221210094332124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094332124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094332125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094332125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094332125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094332125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094332147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094332160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094332160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094332160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:35.084414 run osmo-msc_10.42.42.6(pid=25305): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25305)] 09:43:35.134254 run osmo-msc_10.42.42.6(pid=25305): stdout: | (launched: 2022-12-10_09:43:33.930841) 09:43:35.185400 run osmo-msc_10.42.42.6(pid=25305): stderr: | 20221210094334252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094334252 DLGLOBAL DEBUG validating counter group 0x7f9950776c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094334253 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094334253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094334253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094334253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094334255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094334255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094334255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094334255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:35.236850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25298): Terminating (SIGTERM) 09:43:35.278633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25301): Terminating (SIGTERM) 09:43:35.320495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25304): Terminating (SIGTERM) 09:43:35.362599 --- ParallelTerminationStrategy: PID 25298 died... 09:43:35.382414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25298): Terminated: ok {rc=0} 09:43:35.429085 --- ParallelTerminationStrategy: PID 25301 died... 09:43:35.448521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25301): Terminated: ok {rc=0} 09:43:35.494949 --- ParallelTerminationStrategy: PID 25304 died... 09:43:35.514405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25304): Terminated: ok {rc=0} 09:43:35.602260 bus /sierra_3: Setting Powered False 09:43:36.701248 bus /sierra_3: Setting Powered False 09:43:37.817052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 09:43:39.068366 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:39.073390 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:43:39.132032 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:43:39.158402 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:43:39.210726 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:43:39.272249 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:43:39.300233 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:43:39.851795 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 09:43:39.857843 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:39.869605 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:39.915998 tst handover.py: using LAC 27541 09:43:40.036813 tst handover.py: using RAC 1 09:43:40.156486 tst handover.py: using CellId 27541 09:43:40.275695 tst handover.py: using BVCI 27542 09:43:40.387527 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:43:40.434363 tst handover.py: using LAC 27542 09:43:40.555551 tst handover.py: using RAC 2 09:43:40.674485 tst handover.py: using CellId 27542 09:43:40.795486 tst handover.py: using BVCI 27543 09:43:40.907084 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:40.918122 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:40.929026 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:40.939938 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:40.950765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:43:40.961578 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:41.079531 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:43:41.198084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:41.653770 run create_hlr_db(pid=25310): Launched 09:43:41.779940 bus /sierra_2: Setting Powered False 09:43:42.841889 run create_hlr_db(pid=25310): Terminated: ok {rc=0} 09:43:43.249421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Launched 09:43:43.561656 run osmo-hlr_10.42.42.2(pid=25313): Launched 09:43:43.679733 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:44.186356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Launched 09:43:44.497423 run osmo-stp_10.42.42.5(pid=25316): Launched 09:43:44.615743 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:45.151483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25318): Launched 09:43:45.463729 run osmo-msc_10.42.42.6(pid=25319): Launched 09:43:45.636156 run osmo-stp_10.42.42.5(pid=25316): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] 09:43:45.766887 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-10_09:43:44.437786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:45.902836 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221210094344612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094344612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094344612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094344613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094344613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094344613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094344613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:46.035325 run osmo-stp_10.42.42.5(pid=25316): stdout: | (launched: 2022-12-10_09:43:44.437786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:46.161681 run osmo-stp_10.42.42.5(pid=25316): stderr: | 20221210094344612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094344612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094344612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094344613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094344613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094344613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094344613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:46.313434 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 09:43:46.322575 tst handover.py:18: Test FAILED (6.5 sec) 09:43:46.349937 run osmo-hlr_10.42.42.2(pid=25313): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25313)] 09:43:46.398429 run osmo-hlr_10.42.42.2(pid=25313): stdout: | (launched: 2022-12-10_09:43:43.501310) 09:43:46.448259 run osmo-hlr_10.42.42.2(pid=25313): stderr: | 20221210094343683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094343683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094343683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094343683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094343684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094343684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094343696 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094343705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094343705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094343705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:46.517679 run osmo-msc_10.42.42.6(pid=25319): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25319)] 09:43:46.566254 run osmo-msc_10.42.42.6(pid=25319): stdout: | (launched: 2022-12-10_09:43:45.403481) 09:43:46.616205 run osmo-msc_10.42.42.6(pid=25319): stderr: | 20221210094345678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094345679 DLGLOBAL DEBUG validating counter group 0x7f8f1be43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094345679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094345679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094345679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094345679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094345681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094345681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094345682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094345682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:46.666719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminating (SIGTERM) 09:43:46.706533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminating (SIGTERM) 09:43:46.746445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25318): Terminating (SIGTERM) 09:43:46.788688 --- ParallelTerminationStrategy: PID 25312 died... 09:43:46.808262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25312): Terminated: ok {rc=0} 09:43:46.854483 --- ParallelTerminationStrategy: PID 25315 died... 09:43:46.873870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25315): Terminated: ok {rc=0} 09:43:46.919667 --- ParallelTerminationStrategy: PID 25318 died... 09:43:46.939150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25318): Terminated: ok {rc=0} 09:43:47.023310 bus /sierra_3: Setting Powered False 09:43:48.119602 bus /sierra_3: Setting Powered False 09:43:49.231491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 09:43:50.509533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:43:50.515165 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:43:50.575991 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:43:50.603663 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:43:50.655069 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:43:50.714701 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:43:50.742325 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:43:51.298750 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 09:43:51.304387 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:51.316128 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:51.361997 tst handover.py: using LAC 27543 09:43:51.490676 tst handover.py: using RAC 3 09:43:51.617796 tst handover.py: using CellId 27543 09:43:51.746498 tst handover.py: using BVCI 27544 09:43:51.865795 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:43:51.913455 tst handover.py: using LAC 27544 09:43:52.035190 tst handover.py: using RAC 4 09:43:52.155314 tst handover.py: using CellId 27544 09:43:52.277396 tst handover.py: using BVCI 27545 09:43:52.392135 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:52.403323 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:52.414456 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:52.425832 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:52.436826 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:43:52.447933 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:52.567347 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:43:52.686928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:43:53.167445 run create_hlr_db(pid=25324): Launched 09:43:53.293272 bus /sierra_2: Setting Powered False 09:43:54.358492 run create_hlr_db(pid=25324): Terminated: ok {rc=0} 09:43:54.772934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25326): Launched 09:43:55.083475 run osmo-hlr_10.42.42.2(pid=25327): Launched 09:43:55.202152 run osmo-stp_10.42.42.5: Starting osmo-stp 09:43:55.708301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25329): Launched 09:43:56.017529 run osmo-stp_10.42.42.5(pid=25330): Launched 09:43:56.148112 run osmo-msc_10.42.42.6: Starting osmo-msc 09:43:56.714073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25332): Launched 09:43:57.042561 run osmo-msc_10.42.42.6(pid=25333): Launched 09:43:57.224325 run osmo-stp_10.42.42.5(pid=25330): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25330)] 09:43:57.363029 run osmo-stp_10.42.42.5(pid=25330): stdout: | (launched: 2022-12-10_09:43:55.960480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:57.502622 run osmo-stp_10.42.42.5(pid=25330): stderr: | 20221210094356145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094356145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094356145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094356146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094356146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094356146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094356146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:57.640265 run osmo-stp_10.42.42.5(pid=25330): stdout: | (launched: 2022-12-10_09:43:55.960480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:43:57.770108 run osmo-stp_10.42.42.5(pid=25330): stderr: | 20221210094356145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094356145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094356145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094356146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094356146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094356146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094356146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:43:57.925948 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25330): Process ended prematurely: osmo-stp_10.42.42.5(pid=25330) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25330)] [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 09:43:57.934745 tst handover.py:18: Test FAILED (6.6 sec) 09:43:57.962829 run osmo-hlr_10.42.42.2(pid=25327): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25327)] 09:43:58.013191 run osmo-hlr_10.42.42.2(pid=25327): stdout: | (launched: 2022-12-10_09:43:55.026508) 09:43:58.065144 run osmo-hlr_10.42.42.2(pid=25327): stderr: | 20221210094355206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094355206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094355206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094355206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094355206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094355206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094355218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094355226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094355226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094355227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:43:58.137287 run osmo-msc_10.42.42.6(pid=25333): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25333)] 09:43:58.187323 run osmo-msc_10.42.42.6(pid=25333): stdout: | (launched: 2022-12-10_09:43:56.982853) 09:43:58.238584 run osmo-msc_10.42.42.6(pid=25333): stderr: | 20221210094357303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094357303 DLGLOBAL DEBUG validating counter group 0x7f56abe1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094357303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094357303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094357303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094357304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094357306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094357306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094357306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094357306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:43:58.290676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25326): Terminating (SIGTERM) 09:43:58.332380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25329): Terminating (SIGTERM) 09:43:58.374063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25332): Terminating (SIGTERM) 09:43:58.415872 --- ParallelTerminationStrategy: PID 25326 died... 09:43:58.435765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25326): Terminated: ok {rc=0} 09:43:58.482616 --- ParallelTerminationStrategy: PID 25329 died... 09:43:58.502132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25329): Terminated: ok {rc=0} 09:43:58.549060 --- ParallelTerminationStrategy: PID 25332 died... 09:43:58.568437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25332): Terminated: ok {rc=0} 09:43:58.656703 bus /sierra_3: Setting Powered False 09:43:59.754438 bus /sierra_3: Setting Powered False 09:44:00.881144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 09:44:02.167343 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:02.177891 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 09:44:02.243575 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 09:44:02.271481 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 09:44:02.330990 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 09:44:02.384134 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 09:44:02.411902 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 09:44:02.958324 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 09:44:02.963886 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:02.975309 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:44:03.025877 tst handover.py: using LAC 27545 09:44:03.154482 tst handover.py: using RAC 5 09:44:03.281501 tst handover.py: using CellId 27545 09:44:03.410522 tst handover.py: using BVCI 27546 09:44:03.529984 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 09:44:03.564498 tst handover.py: using LAC 27546 09:44:03.691027 tst handover.py: using RAC 6 09:44:03.817355 tst handover.py: using CellId 27546 09:44:03.945843 tst handover.py: using BVCI 27547 09:44:04.058633 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:04.069863 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:04.080703 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:04.091699 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:04.102842 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 09:44:04.114099 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:44:04.233845 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 09:44:04.349479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:04.806442 run create_hlr_db(pid=25338): Launched 09:44:04.933331 bus /sierra_2: Setting Powered False 09:44:05.996893 run create_hlr_db(pid=25338): Terminated: ok {rc=0} 09:44:06.429070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25340): Launched 09:44:06.761069 run osmo-hlr_10.42.42.2(pid=25341): Launched 09:44:06.886393 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:07.425459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25343): Launched 09:44:07.757643 run osmo-stp_10.42.42.5(pid=25344): Launched 09:44:07.882904 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:08.451606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25346): Launched 09:44:08.782992 run osmo-msc_10.42.42.6(pid=25347): Launched 09:44:08.966260 run osmo-stp_10.42.42.5(pid=25344): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25344)] 09:44:09.104653 run osmo-stp_10.42.42.5(pid=25344): stdout: | (launched: 2022-12-10_09:44:07.693516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:09.247920 run osmo-stp_10.42.42.5(pid=25344): stderr: | 20221210094407889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094407889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094407889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094407889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094407890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094407890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094407890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:09.377368 run osmo-stp_10.42.42.5(pid=25344): stdout: | (launched: 2022-12-10_09:44:07.693516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:09.499858 run osmo-stp_10.42.42.5(pid=25344): stderr: | 20221210094407889 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094407889 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094407889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094407889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094407890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094407890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094407890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:09.646832 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25344): Process ended prematurely: osmo-stp_10.42.42.5(pid=25344) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25344)] [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 09:44:09.655305 tst handover.py:18: Test FAILED (6.7 sec) 09:44:09.681615 run osmo-hlr_10.42.42.2(pid=25341): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25341)] 09:44:09.729478 run osmo-hlr_10.42.42.2(pid=25341): stdout: | (launched: 2022-12-10_09:44:06.697291) 09:44:09.779377 run osmo-hlr_10.42.42.2(pid=25341): stderr: | 20221210094406898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094406898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094406898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094406898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094406898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094406898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094406911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094406919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094406919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094406919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:09.848541 run osmo-msc_10.42.42.6(pid=25347): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25347)] 09:44:09.896331 run osmo-msc_10.42.42.6(pid=25347): stdout: | (launched: 2022-12-10_09:44:08.719274) 09:44:09.945834 run osmo-msc_10.42.42.6(pid=25347): stderr: | 20221210094409044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094409044 DLGLOBAL DEBUG validating counter group 0x7f0ef1eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094409044 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094409044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094409044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094409045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094409046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094409047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094409047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094409047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:09.995810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25340): Terminating (SIGTERM) 09:44:10.035642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25343): Terminating (SIGTERM) 09:44:10.075633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25346): Terminating (SIGTERM) 09:44:10.116263 --- ParallelTerminationStrategy: PID 25340 died... 09:44:10.135414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25340): Terminated: ok {rc=0} 09:44:10.179404 --- ParallelTerminationStrategy: PID 25343 died... 09:44:10.198077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25343): Terminated: ok {rc=0} 09:44:10.242108 --- ParallelTerminationStrategy: PID 25346 died... 09:44:10.260732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25346): Terminated: ok {rc=0} 09:44:10.344538 bus /sierra_3: Setting Powered False 09:44:11.442522 bus /sierra_3: Setting Powered False 09:44:12.560231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 09:44:13.822473 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:13.828276 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:44:13.894686 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:44:13.922543 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:44:13.975402 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:44:14.043946 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:44:14.071643 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:44:14.622448 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 09:44:14.627993 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:14.639583 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:14.689366 tst handover.py: using LAC 27547 09:44:14.818111 tst handover.py: using RAC 7 09:44:14.945372 tst handover.py: using CellId 27547 09:44:15.074633 tst handover.py: using BVCI 27548 09:44:15.196173 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:15.246569 tst handover.py: using LAC 27548 09:44:15.376089 tst handover.py: using RAC 8 09:44:15.505761 tst handover.py: using CellId 27548 09:44:15.634244 tst handover.py: using BVCI 27549 09:44:15.753971 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.765412 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.776533 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.788205 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.799837 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:15.811571 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:15.946846 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:16.068939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:16.603644 run create_hlr_db(pid=25352): Launched 09:44:16.761885 bus /sierra_2: Setting Powered False 09:44:17.826775 run create_hlr_db(pid=25352): Terminated: ok {rc=0} 09:44:18.255478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25354): Launched 09:44:18.584145 run osmo-hlr_10.42.42.2(pid=25355): Launched 09:44:18.710020 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:19.249499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Launched 09:44:19.577057 run osmo-stp_10.42.42.5(pid=25358): Launched 09:44:19.702744 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:20.267491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25360): Launched 09:44:20.595746 run osmo-msc_10.42.42.6(pid=25361): Launched 09:44:20.779399 run osmo-stp_10.42.42.5(pid=25358): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25358)] 09:44:20.917975 run osmo-stp_10.42.42.5(pid=25358): stdout: | (launched: 2022-12-10_09:44:19.517355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:21.057565 run osmo-stp_10.42.42.5(pid=25358): stderr: | 20221210094419712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094419712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094419713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094419713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094419713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094419714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094419714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:21.195038 run osmo-stp_10.42.42.5(pid=25358): stdout: | (launched: 2022-12-10_09:44:19.517355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:21.324907 run osmo-stp_10.42.42.5(pid=25358): stderr: | 20221210094419712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094419712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094419713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094419713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094419713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094419714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094419714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:21.480832 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25358): Process ended prematurely: osmo-stp_10.42.42.5(pid=25358) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25358)] [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 09:44:21.489488 tst handover.py:18: Test FAILED (6.9 sec) 09:44:21.517313 run osmo-hlr_10.42.42.2(pid=25355): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25355)] 09:44:21.567159 run osmo-hlr_10.42.42.2(pid=25355): stdout: | (launched: 2022-12-10_09:44:18.524236) 09:44:21.618843 run osmo-hlr_10.42.42.2(pid=25355): stderr: | 20221210094418724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094418724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094418724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094418724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094418724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094418725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094418738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094418747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094418747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094418747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:21.690308 run osmo-msc_10.42.42.6(pid=25361): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25361)] 09:44:21.739970 run osmo-msc_10.42.42.6(pid=25361): stdout: | (launched: 2022-12-10_09:44:20.535917) 09:44:21.791251 run osmo-msc_10.42.42.6(pid=25361): stderr: | 20221210094420857 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094420857 DLGLOBAL DEBUG validating counter group 0x7f0581d62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094420857 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094420857 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094420857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094420857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094420859 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094420859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094420860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094420860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:21.843255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25354): Terminating (SIGTERM) 09:44:21.884742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Terminating (SIGTERM) 09:44:21.926380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25360): Terminating (SIGTERM) 09:44:21.968452 --- ParallelTerminationStrategy: PID 25354 died... 09:44:21.988369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25354): Terminated: ok {rc=0} 09:44:22.034505 --- ParallelTerminationStrategy: PID 25357 died... 09:44:22.053716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Terminated: ok {rc=0} 09:44:22.099829 --- ParallelTerminationStrategy: PID 25360 died... 09:44:22.119110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25360): Terminated: ok {rc=0} 09:44:22.206005 bus /sierra_3: Setting Powered False 09:44:23.303951 bus /sierra_3: Setting Powered False 09:44:24.419129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 09:44:25.694908 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:25.700666 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:44:25.765689 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:44:25.793274 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:44:25.847374 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:44:25.912887 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:44:25.940766 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:44:26.491985 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 09:44:26.497403 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:26.509235 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:26.558890 tst handover.py: using LAC 27549 09:44:26.689150 tst handover.py: using RAC 9 09:44:26.819234 tst handover.py: using CellId 27549 09:44:26.949570 tst handover.py: using BVCI 27550 09:44:27.063223 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:27.111988 tst handover.py: using LAC 27550 09:44:27.236077 tst handover.py: using RAC 10 09:44:27.359606 tst handover.py: using CellId 27550 09:44:27.483735 tst handover.py: using BVCI 27551 09:44:27.597940 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:27.609103 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:27.620142 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:27.631447 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:27.642822 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:27.654005 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:27.775347 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:27.895235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:28.379730 run create_hlr_db(pid=25367): Launched 09:44:28.504491 bus /sierra_2: Setting Powered False 09:44:29.569702 run create_hlr_db(pid=25367): Terminated: ok {rc=0} 09:44:29.986059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25369): Launched 09:44:30.297741 run osmo-hlr_10.42.42.2(pid=25370): Launched 09:44:30.415950 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:30.961730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25372): Launched 09:44:31.292185 run osmo-stp_10.42.42.5(pid=25373): Launched 09:44:31.521663 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:32.116614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25375): Launched 09:44:32.481054 run osmo-msc_10.42.42.6(pid=25376): Launched 09:44:32.665910 run osmo-stp_10.42.42.5(pid=25373): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25373)] 09:44:32.804613 run osmo-stp_10.42.42.5(pid=25373): stdout: | (launched: 2022-12-10_09:44:31.225182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:32.944346 run osmo-stp_10.42.42.5(pid=25373): stderr: | 20221210094431451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094431451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094431452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094431452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094431461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094431461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094431461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:33.083422 run osmo-stp_10.42.42.5(pid=25373): stdout: | (launched: 2022-12-10_09:44:31.225182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:33.214609 run osmo-stp_10.42.42.5(pid=25373): stderr: | 20221210094431451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094431451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094431452 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094431452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094431461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094431461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094431461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:33.370488 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25373): Process ended prematurely: osmo-stp_10.42.42.5(pid=25373) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25373)] [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 09:44:33.379211 tst handover.py:18: Test FAILED (6.9 sec) 09:44:33.406814 run osmo-hlr_10.42.42.2(pid=25370): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25370)] 09:44:33.456547 run osmo-hlr_10.42.42.2(pid=25370): stdout: | (launched: 2022-12-10_09:44:30.237543) 09:44:33.507833 run osmo-hlr_10.42.42.2(pid=25370): stderr: | 20221210094430416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094430416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094430416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094430416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094430416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094430416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094430431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094430440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094430441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094430441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:33.579648 run osmo-msc_10.42.42.6(pid=25376): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25376)] 09:44:33.629573 run osmo-msc_10.42.42.6(pid=25376): stdout: | (launched: 2022-12-10_09:44:32.417045) 09:44:33.680921 run osmo-msc_10.42.42.6(pid=25376): stderr: | 20221210094432742 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094432742 DLGLOBAL DEBUG validating counter group 0x7fde756d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094432742 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094432742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094432742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094432742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094432744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094432744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094432745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094432745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:33.732861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25369): Terminating (SIGTERM) 09:44:33.774289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25372): Terminating (SIGTERM) 09:44:33.815688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25375): Terminating (SIGTERM) 09:44:33.857437 --- ParallelTerminationStrategy: PID 25369 died... 09:44:33.877344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25369): Terminated: ok {rc=0} 09:44:33.923613 --- ParallelTerminationStrategy: PID 25372 died... 09:44:33.943361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25372): Terminated: ok {rc=0} 09:44:33.989507 --- ParallelTerminationStrategy: PID 25375 died... 09:44:34.008939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25375): Terminated: ok {rc=0} 09:44:34.096127 bus /sierra_3: Setting Powered False 09:44:35.193582 bus /sierra_3: Setting Powered False 09:44:36.309343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 09:44:37.584868 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:37.590616 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 09:44:37.643426 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 09:44:37.671676 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 09:44:37.726000 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 09:44:37.778508 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 09:44:37.806243 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 09:44:38.359023 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 09:44:38.364621 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:38.376064 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:38.411839 tst handover.py: using LAC 27551 09:44:38.542616 tst handover.py: using RAC 11 09:44:38.677273 tst handover.py: using CellId 27551 09:44:38.805064 tst handover.py: using BVCI 27552 09:44:38.924640 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 09:44:38.972635 tst handover.py: using LAC 27552 09:44:39.100923 tst handover.py: using RAC 12 09:44:39.224194 tst handover.py: using CellId 27552 09:44:39.344257 tst handover.py: using BVCI 27553 09:44:39.456709 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:39.467717 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:39.478559 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:39.489719 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:39.500831 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 09:44:39.511924 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:39.631872 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 09:44:39.749412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:40.202295 run create_hlr_db(pid=25381): Launched 09:44:40.327685 bus /sierra_2: Setting Powered False 09:44:41.388453 run create_hlr_db(pid=25381): Terminated: ok {rc=0} 09:44:41.807942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25383): Launched 09:44:42.136520 run osmo-hlr_10.42.42.2(pid=25384): Launched 09:44:42.263008 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:42.804814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25386): Launched 09:44:43.133683 run osmo-stp_10.42.42.5(pid=25387): Launched 09:44:43.259919 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:43.825710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25389): Launched 09:44:44.154298 run osmo-msc_10.42.42.6(pid=25390): Launched 09:44:44.336774 run osmo-stp_10.42.42.5(pid=25387): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25387)] 09:44:44.475818 run osmo-stp_10.42.42.5(pid=25387): stdout: | (launched: 2022-12-10_09:44:43.073632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:44.614958 run osmo-stp_10.42.42.5(pid=25387): stderr: | 20221210094443269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094443269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094443269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094443270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094443270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094443270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094443270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:44.753432 run osmo-stp_10.42.42.5(pid=25387): stdout: | (launched: 2022-12-10_09:44:43.073632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:44.883935 run osmo-stp_10.42.42.5(pid=25387): stderr: | 20221210094443269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094443269 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094443269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094443270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094443270 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094443270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094443270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:45.040665 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25387): Process ended prematurely: osmo-stp_10.42.42.5(pid=25387) [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25387)] [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 09:44:45.049742 tst handover.py:18: Test FAILED (6.7 sec) 09:44:45.078152 run osmo-hlr_10.42.42.2(pid=25384): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25384)] 09:44:45.128790 run osmo-hlr_10.42.42.2(pid=25384): stdout: | (launched: 2022-12-10_09:44:42.076566) 09:44:45.181216 run osmo-hlr_10.42.42.2(pid=25384): stderr: | 20221210094442278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094442278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094442278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094442278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094442278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094442278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094442290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094442298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094442298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094442298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:45.254219 run osmo-msc_10.42.42.6(pid=25390): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25390)] 09:44:45.304839 run osmo-msc_10.42.42.6(pid=25390): stdout: | (launched: 2022-12-10_09:44:44.094697) 09:44:45.357142 run osmo-msc_10.42.42.6(pid=25390): stderr: | 20221210094444417 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094444418 DLGLOBAL DEBUG validating counter group 0x7fa9af738c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094444418 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094444418 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094444418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094444418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094444420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094444420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094444420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094444420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:45.409716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25383): Terminating (SIGTERM) 09:44:45.451690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25386): Terminating (SIGTERM) 09:44:45.494009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25389): Terminating (SIGTERM) 09:44:45.536535 --- ParallelTerminationStrategy: PID 25383 died... 09:44:45.556463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25383): Terminated: ok {rc=0} 09:44:45.603377 --- ParallelTerminationStrategy: PID 25386 died... 09:44:45.623059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25386): Terminated: ok {rc=0} 09:44:45.669734 --- ParallelTerminationStrategy: PID 25389 died... 09:44:45.689292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25389): Terminated: ok {rc=0} 09:44:45.777097 bus /sierra_3: Setting Powered False 09:44:46.880271 bus /sierra_3: Setting Powered False 09:44:48.003959 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 09:44:49.261213 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:44:49.266820 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:44:49.319230 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:44:49.347205 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:44:49.400896 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:44:49.452358 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:44:49.480196 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:44:50.032483 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 09:44:50.038110 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:50.049598 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:50.085299 tst handover.py: using LAC 27553 09:44:50.213916 tst handover.py: using RAC 13 09:44:50.342328 tst handover.py: using CellId 27553 09:44:50.470457 tst handover.py: using BVCI 27554 09:44:50.591560 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:44:50.640754 tst handover.py: using LAC 27554 09:44:50.773437 tst handover.py: using RAC 14 09:44:50.902389 tst handover.py: using CellId 27554 09:44:51.034172 tst handover.py: using BVCI 27555 09:44:51.155947 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:51.167353 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:51.178629 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:51.190393 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:51.202156 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:44:51.213854 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:51.334484 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:44:51.454523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:44:51.940840 run create_hlr_db(pid=25395): Launched 09:44:52.066129 bus /sierra_2: Setting Powered False 09:44:53.131317 run create_hlr_db(pid=25395): Terminated: ok {rc=0} 09:44:53.563939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25397): Launched 09:44:53.896846 run osmo-hlr_10.42.42.2(pid=25398): Launched 09:44:54.023483 run osmo-stp_10.42.42.5: Starting osmo-stp 09:44:54.561702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25400): Launched 09:44:54.893397 run osmo-stp_10.42.42.5(pid=25401): Launched 09:44:55.019663 run osmo-msc_10.42.42.6: Starting osmo-msc 09:44:55.589650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25403): Launched 09:44:55.921983 run osmo-msc_10.42.42.6(pid=25404): Launched 09:44:56.106155 run osmo-stp_10.42.42.5(pid=25401): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25401)] 09:44:56.244790 run osmo-stp_10.42.42.5(pid=25401): stdout: | (launched: 2022-12-10_09:44:54.829420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:56.383714 run osmo-stp_10.42.42.5(pid=25401): stderr: | 20221210094455026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094455026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094455026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094455026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094455027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094455027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094455027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:56.521841 run osmo-stp_10.42.42.5(pid=25401): stdout: | (launched: 2022-12-10_09:44:54.829420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:44:56.652118 run osmo-stp_10.42.42.5(pid=25401): stderr: | 20221210094455026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094455026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094455026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094455026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094455027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094455027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094455027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:44:56.808123 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25401): Process ended prematurely: osmo-stp_10.42.42.5(pid=25401) [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25401)] [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 09:44:56.817107 tst handover.py:18: Test FAILED (6.8 sec) 09:44:56.845031 run osmo-hlr_10.42.42.2(pid=25398): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25398)] 09:44:56.895394 run osmo-hlr_10.42.42.2(pid=25398): stdout: | (launched: 2022-12-10_09:44:53.831205) 09:44:56.947587 run osmo-hlr_10.42.42.2(pid=25398): stderr: | 20221210094454035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094454035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094454035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094454035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094454035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094454035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094454048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094454056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094454056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094454056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:44:57.020370 run osmo-msc_10.42.42.6(pid=25404): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25404)] 09:44:57.070541 run osmo-msc_10.42.42.6(pid=25404): stdout: | (launched: 2022-12-10_09:44:55.857847) 09:44:57.122391 run osmo-msc_10.42.42.6(pid=25404): stderr: | 20221210094456184 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094456184 DLGLOBAL DEBUG validating counter group 0x7f64b8f57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094456184 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094456184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094456185 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094456185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094456187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094456187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094456187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094456187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:44:57.174535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25397): Terminating (SIGTERM) 09:44:57.216321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25400): Terminating (SIGTERM) 09:44:57.258521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25403): Terminating (SIGTERM) 09:44:57.300862 --- ParallelTerminationStrategy: PID 25397 died... 09:44:57.320904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25397): Terminated: ok {rc=0} 09:44:57.367922 --- ParallelTerminationStrategy: PID 25400 died... 09:44:57.387569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25400): Terminated: ok {rc=0} 09:44:57.434231 --- ParallelTerminationStrategy: PID 25403 died... 09:44:57.453900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25403): Terminated: ok {rc=0} 09:44:57.542402 bus /sierra_3: Setting Powered False 09:44:58.641843 bus /sierra_3: Setting Powered False 09:44:59.759129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2372 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 09:45:01.051013 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 09:45:01.057301 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 09:45:01.125151 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 09:45:01.155036 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 09:45:01.209515 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 09:45:01.275143 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 09:45:01.302497 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 09:45:01.885443 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2372 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 09:45:01.891195 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:01.916128 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:01.998403 tst handover.py: using LAC 27555 09:45:02.155541 tst handover.py: using RAC 15 09:45:02.285272 tst handover.py: using CellId 27555 09:45:02.412329 tst handover.py: using BVCI 27556 09:45:02.524919 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 09:45:02.571606 tst handover.py: using LAC 27556 09:45:02.691418 tst handover.py: using RAC 16 09:45:02.810735 tst handover.py: using CellId 27556 09:45:02.930294 tst handover.py: using BVCI 27557 09:45:03.042714 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:03.053743 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:03.064610 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:03.075562 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:03.086382 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 09:45:03.097178 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:03.216545 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 09:45:03.341170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 09:45:03.821706 run create_hlr_db(pid=25412): Launched 09:45:03.947208 bus /sierra_2: Setting Powered False 09:45:05.011729 run create_hlr_db(pid=25412): Terminated: ok {rc=0} 09:45:05.439917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25414): Launched 09:45:05.768589 run osmo-hlr_10.42.42.2(pid=25415): Launched 09:45:05.895193 run osmo-stp_10.42.42.5: Starting osmo-stp 09:45:06.433229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25417): Launched 09:45:06.760916 run osmo-stp_10.42.42.5(pid=25418): Launched 09:45:06.886419 run osmo-msc_10.42.42.6: Starting osmo-msc 09:45:07.452405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25420): Launched 09:45:07.781038 run osmo-msc_10.42.42.6(pid=25421): Launched 09:45:07.964681 run osmo-stp_10.42.42.5(pid=25418): ERR: Terminated: ERROR {rc=1} [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25418)] 09:45:08.103270 run osmo-stp_10.42.42.5(pid=25418): stdout: | (launched: 2022-12-10_09:45:06.701205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:08.242117 run osmo-stp_10.42.42.5(pid=25418): stderr: | 20221210094506895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094506895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094506895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094506896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094506896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094506896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094506896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:08.379096 run osmo-stp_10.42.42.5(pid=25418): stdout: | (launched: 2022-12-10_09:45:06.701205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 09:45:08.509320 run osmo-stp_10.42.42.5(pid=25418): stderr: | 20221210094506895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210094506895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210094506895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210094506896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210094506896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210094506896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210094506896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 09:45:08.664812 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25418): Process ended prematurely: osmo-stp_10.42.42.5(pid=25418) [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25418)] [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 09:45:08.673586 tst handover.py:18: Test FAILED (6.8 sec) 09:45:08.701320 run osmo-hlr_10.42.42.2(pid=25415): ERR: Terminated: ERROR {rc=237} [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25415)] 09:45:08.751337 run osmo-hlr_10.42.42.2(pid=25415): stdout: | (launched: 2022-12-10_09:45:05.708782) 09:45:08.803118 run osmo-hlr_10.42.42.2(pid=25415): stderr: | 20221210094505908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210094505908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210094505908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210094505908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210094505908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210094505908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210094505920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210094505928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210094505929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210094505929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 09:45:08.875027 run osmo-msc_10.42.42.6(pid=25421): ERR: Terminated: ERROR {rc=2} [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25421)] 09:45:08.924941 run osmo-msc_10.42.42.6(pid=25421): stdout: | (launched: 2022-12-10_09:45:07.721308) 09:45:08.976701 run osmo-msc_10.42.42.6(pid=25421): stderr: | 20221210094508042 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210094508042 DLGLOBAL DEBUG validating counter group 0x7fd3d4564c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210094508043 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210094508043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210094508043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210094508043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210094508046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210094508046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210094508046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210094508046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 09:45:09.028940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25414): Terminating (SIGTERM) 09:45:09.070549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25417): Terminating (SIGTERM) 09:45:09.112468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25420): Terminating (SIGTERM) 09:45:09.154126 --- ParallelTerminationStrategy: PID 25414 died... 09:45:09.173937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25414): Terminated: ok {rc=0} 09:45:09.220353 --- ParallelTerminationStrategy: PID 25417 died... 09:45:09.239768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25417): Terminated: ok {rc=0} 09:45:09.285916 --- ParallelTerminationStrategy: PID 25420 died... 09:45:09.305446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25420): Terminated: ok {rc=0} 09:45:09.394131 bus /sierra_3: Setting Powered False 09:45:10.491608 bus /sierra_3: Setting Powered False 09:45:11.606521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2372 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 09:45:12.877523 tst trial-2372: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372/run.2022-12-10_08-20-36/trial-2372.xml -------------------------------------------------------------------------------------------- trial-2372 FAIL -------------------------------------------------------------------------------------------- 09:45:14.784775 tst trial-2372: trial-2372: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=16397): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16397) [trial-2372↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16397)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=16408): Process ended prematurely: osmo-stp_10.42.42.5(pid=16408) [trial-2372↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16408)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=16417): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16417) [trial-2372↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16417)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16699): Process ended prematurely: osmo-stp_10.42.42.5(pid=16699) [trial-2372↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16699)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16713): Process ended prematurely: osmo-stp_10.42.42.5(pid=16713) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16713)] FAIL: mo_mt_call_osmux.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=16725): Process ended prematurely: osmo-stp_10.42.42.5(pid=16725) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16725)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16739): Process ended prematurely: osmo-stp_10.42.42.5(pid=16739) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16739)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16750): Process ended prematurely: osmo-stp_10.42.42.5(pid=16750) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16750)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16765): Process ended prematurely: osmo-stp_10.42.42.5(pid=16765) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16765)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16776): Process ended prematurely: osmo-stp_10.42.42.5(pid=16776) [trial-2372↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16776)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16790): Process ended prematurely: osmo-stp_10.42.42.5(pid=16790) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16790)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16801): Process ended prematurely: osmo-stp_10.42.42.5(pid=16801) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16801)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16819): Process ended prematurely: osmo-stp_10.42.42.5(pid=16819) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16819)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16830): Process ended prematurely: osmo-stp_10.42.42.5(pid=16830) [trial-2372↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16830)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16844): Process ended prematurely: osmo-stp_10.42.42.5(pid=16844) [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16844)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16855): Process ended prematurely: osmo-stp_10.42.42.5(pid=16855) [trial-2372↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16855)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16869): Process ended prematurely: osmo-stp_10.42.42.5(pid=16869) [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16869)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16880): Process ended prematurely: osmo-stp_10.42.42.5(pid=16880) [trial-2372↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16880)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16894): Process ended prematurely: osmo-stp_10.42.42.5(pid=16894) [trial-2372↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16894)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16905): Process ended prematurely: osmo-stp_10.42.42.5(pid=16905) [trial-2372↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16905)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=16923): Process ended prematurely: osmo-stp_10.42.42.5(pid=16923) [trial-2372↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16923)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16935): Process ended prematurely: osmo-stp_10.42.42.5(pid=16935) [trial-2372↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=16953): Process ended prematurely: osmo-stp_10.42.42.5(pid=16953) [trial-2372↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16953)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16964): Process ended prematurely: osmo-stp_10.42.42.5(pid=16964) [trial-2372↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16964)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16974): Process ended prematurely: osmo-stp_10.42.42.5(pid=16974) [trial-2372↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16974)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=16993): Process ended prematurely: osmo-stp_10.42.42.5(pid=16993) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16993)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17005): Process ended prematurely: osmo-stp_10.42.42.5(pid=17005) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17005)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17023): Process ended prematurely: osmo-stp_10.42.42.5(pid=17023) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17033): Process ended prematurely: osmo-stp_10.42.42.5(pid=17033) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17033)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17043): Process ended prematurely: osmo-stp_10.42.42.5(pid=17043) [trial-2372↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17043)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17061): Process ended prematurely: osmo-stp_10.42.42.5(pid=17061) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17061)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17074): Process ended prematurely: osmo-stp_10.42.42.5(pid=17074) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17074)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=17101): Process ended prematurely: osmo-stp_10.42.42.5(pid=17101) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17101)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17111): Process ended prematurely: osmo-stp_10.42.42.5(pid=17111) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17111)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17121): Process ended prematurely: osmo-stp_10.42.42.5(pid=17121) [trial-2372↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17121)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17138): Process ended prematurely: osmo-stp_10.42.42.5(pid=17138) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17138)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17150): Process ended prematurely: osmo-stp_10.42.42.5(pid=17150) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17150)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17171): Process ended prematurely: osmo-stp_10.42.42.5(pid=17171) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17171)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17181): Process ended prematurely: osmo-stp_10.42.42.5(pid=17181) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17181)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17191): Process ended prematurely: osmo-stp_10.42.42.5(pid=17191) [trial-2372↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17191)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=17205): Process ended prematurely: osmo-stp_10.42.42.5(pid=17205) [trial-2372↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17205)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=17218): Process ended prematurely: osmo-stp_10.42.42.5(pid=17218) [trial-2372↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=17226): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17226) [trial-2372↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17226)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17236): Process ended prematurely: osmo-stp_10.42.42.5(pid=17236) [trial-2372↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17236)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=17245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17245) [trial-2372↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17245)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17256): Process ended prematurely: osmo-stp_10.42.42.5(pid=17256) [trial-2372↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17256)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17270): Process ended prematurely: osmo-stp_10.42.42.5(pid=17270) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17270)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17281): Process ended prematurely: osmo-stp_10.42.42.5(pid=17281) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17281)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17295): Process ended prematurely: osmo-stp_10.42.42.5(pid=17295) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17295)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17306): Process ended prematurely: osmo-stp_10.42.42.5(pid=17306) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17306)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17320): Process ended prematurely: osmo-stp_10.42.42.5(pid=17320) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17320)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17331): Process ended prematurely: osmo-stp_10.42.42.5(pid=17331) [trial-2372↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17331)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17345): Process ended prematurely: osmo-stp_10.42.42.5(pid=17345) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17345)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17359): Process ended prematurely: osmo-stp_10.42.42.5(pid=17359) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17359)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17373): Process ended prematurely: osmo-stp_10.42.42.5(pid=17373) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17373)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17385): Process ended prematurely: osmo-stp_10.42.42.5(pid=17385) [trial-2372↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17385)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17399): Process ended prematurely: osmo-stp_10.42.42.5(pid=17399) [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17399)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17410): Process ended prematurely: osmo-stp_10.42.42.5(pid=17410) [trial-2372↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17410)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17424): Process ended prematurely: osmo-stp_10.42.42.5(pid=17424) [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17424)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17435): Process ended prematurely: osmo-stp_10.42.42.5(pid=17435) [trial-2372↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17435)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17450): Process ended prematurely: osmo-stp_10.42.42.5(pid=17450) [trial-2372↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17450)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17461): Process ended prematurely: osmo-stp_10.42.42.5(pid=17461) [trial-2372↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17461)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17479): Process ended prematurely: osmo-stp_10.42.42.5(pid=17479) [trial-2372↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17479)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17491): Process ended prematurely: osmo-stp_10.42.42.5(pid=17491) [trial-2372↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17491)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=17509): Process ended prematurely: osmo-stp_10.42.42.5(pid=17509) [trial-2372↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17509)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17523): Process ended prematurely: osmo-stp_10.42.42.5(pid=17523) [trial-2372↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17523)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17533): Process ended prematurely: osmo-stp_10.42.42.5(pid=17533) [trial-2372↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17533)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17551): Process ended prematurely: osmo-stp_10.42.42.5(pid=17551) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17551)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17563): Process ended prematurely: osmo-stp_10.42.42.5(pid=17563) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17563)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=17581): Process ended prematurely: osmo-stp_10.42.42.5(pid=17581) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17581)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17591): Process ended prematurely: osmo-stp_10.42.42.5(pid=17591) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17591)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17601): Process ended prematurely: osmo-stp_10.42.42.5(pid=17601) [trial-2372↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17601)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=17622): Process ended prematurely: osmo-stp_10.42.42.5(pid=17622) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17622)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17634): Process ended prematurely: osmo-stp_10.42.42.5(pid=17634) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17634)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=17652): Process ended prematurely: osmo-stp_10.42.42.5(pid=17652) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17652)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17662): Process ended prematurely: osmo-stp_10.42.42.5(pid=17662) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17662)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17672): Process ended prematurely: osmo-stp_10.42.42.5(pid=17672) [trial-2372↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17672)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=17689): Process ended prematurely: osmo-stp_10.42.42.5(pid=17689) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17689)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17703): Process ended prematurely: osmo-stp_10.42.42.5(pid=17703) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17703)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=17721): Process ended prematurely: osmo-stp_10.42.42.5(pid=17721) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17721)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17731): Process ended prematurely: osmo-stp_10.42.42.5(pid=17731) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17731)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=17763): Process ended prematurely: osmo-stp_10.42.42.5(pid=17763) [trial-2372↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17763)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=18026): Process ended prematurely: osmo-stp_10.42.42.5(pid=18026) [trial-2372↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18026)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=18039): Process ended prematurely: osmo-stp_10.42.42.5(pid=18039) [trial-2372↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18039)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18049): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18049) [trial-2372↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18049)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=18059): Process ended prematurely: osmo-stp_10.42.42.5(pid=18059) [trial-2372↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18059)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=18072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18072) [trial-2372↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18072)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=18082): Process ended prematurely: osmo-stp_10.42.42.5(pid=18082) [trial-2372↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18082)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18096): Process ended prematurely: osmo-stp_10.42.42.5(pid=18096) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18096)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18107): Process ended prematurely: osmo-stp_10.42.42.5(pid=18107) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18107)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18121): Process ended prematurely: osmo-stp_10.42.42.5(pid=18121) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18121)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18132): Process ended prematurely: osmo-stp_10.42.42.5(pid=18132) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18132)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18149): Process ended prematurely: osmo-stp_10.42.42.5(pid=18149) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18149)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18160): Process ended prematurely: osmo-stp_10.42.42.5(pid=18160) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18160)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18174): Process ended prematurely: osmo-stp_10.42.42.5(pid=18174) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18174)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=18185): Process ended prematurely: osmo-stp_10.42.42.5(pid=18185) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18185)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18199): Process ended prematurely: osmo-stp_10.42.42.5(pid=18199) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18199)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18210): Process ended prematurely: osmo-stp_10.42.42.5(pid=18210) [trial-2372↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18210)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18225): Process ended prematurely: osmo-stp_10.42.42.5(pid=18225) [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18225)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18236): Process ended prematurely: osmo-stp_10.42.42.5(pid=18236) [trial-2372↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18236)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18252): Process ended prematurely: osmo-stp_10.42.42.5(pid=18252) [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18252)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18263): Process ended prematurely: osmo-stp_10.42.42.5(pid=18263) [trial-2372↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18263)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18277): Process ended prematurely: osmo-stp_10.42.42.5(pid=18277) [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18277)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18290): Process ended prematurely: osmo-stp_10.42.42.5(pid=18290) [trial-2372↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18290)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18304): Process ended prematurely: osmo-stp_10.42.42.5(pid=18304) [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18304)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18315): Process ended prematurely: osmo-stp_10.42.42.5(pid=18315) [trial-2372↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18315)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18329): Process ended prematurely: osmo-stp_10.42.42.5(pid=18329) [trial-2372↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18329)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18340): Process ended prematurely: osmo-stp_10.42.42.5(pid=18340) [trial-2372↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18359): Process ended prematurely: osmo-stp_10.42.42.5(pid=18359) [trial-2372↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18359)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=18371): Process ended prematurely: osmo-stp_10.42.42.5(pid=18371) [trial-2372↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18371)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=18389): Process ended prematurely: osmo-stp_10.42.42.5(pid=18389) [trial-2372↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18389)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18399): Process ended prematurely: osmo-stp_10.42.42.5(pid=18399) [trial-2372↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18399)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18409): Process ended prematurely: osmo-stp_10.42.42.5(pid=18409) [trial-2372↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18409)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=18427): Process ended prematurely: osmo-stp_10.42.42.5(pid=18427) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18427)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18458): Process ended prematurely: osmo-stp_10.42.42.5(pid=18458) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18458)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18468): Process ended prematurely: osmo-stp_10.42.42.5(pid=18468) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18468)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18478): Process ended prematurely: osmo-stp_10.42.42.5(pid=18478) [trial-2372↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18478)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18505): Process ended prematurely: osmo-stp_10.42.42.5(pid=18505) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18505)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=19064): Process ended prematurely: osmo-stp_10.42.42.5(pid=19064) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19064)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19074): Process ended prematurely: osmo-stp_10.42.42.5(pid=19074) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19074)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19084): Process ended prematurely: osmo-stp_10.42.42.5(pid=19084) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19084)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=19113): Process ended prematurely: osmo-stp_10.42.42.5(pid=19113) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19113)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19131): Process ended prematurely: osmo-stp_10.42.42.5(pid=19131) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19131)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=19141): Process ended prematurely: osmo-stp_10.42.42.5(pid=19141) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19141)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19151): Process ended prematurely: osmo-stp_10.42.42.5(pid=19151) [trial-2372↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19151)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19169): Process ended prematurely: osmo-stp_10.42.42.5(pid=19169) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19169)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19181): Process ended prematurely: osmo-stp_10.42.42.5(pid=19181) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=19200): Process ended prematurely: osmo-stp_10.42.42.5(pid=19200) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19200)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19210): Process ended prematurely: osmo-stp_10.42.42.5(pid=19210) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19210)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19220): Process ended prematurely: osmo-stp_10.42.42.5(pid=19220) [trial-2372↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19220)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19234): Process ended prematurely: osmo-stp_10.42.42.5(pid=19234) [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19234)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19247): Process ended prematurely: osmo-stp_10.42.42.5(pid=19247) [trial-2372↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19247)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=19256): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19256) [trial-2372↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19256)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19266): Process ended prematurely: osmo-stp_10.42.42.5(pid=19266) [trial-2372↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19266)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19275): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19275) [trial-2372↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19275)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19285): Process ended prematurely: osmo-stp_10.42.42.5(pid=19285) [trial-2372↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19285)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19299): Process ended prematurely: osmo-stp_10.42.42.5(pid=19299) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19299)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19311): Process ended prematurely: osmo-stp_10.42.42.5(pid=19311) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19311)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19327): Process ended prematurely: osmo-stp_10.42.42.5(pid=19327) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19327)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19338): Process ended prematurely: osmo-stp_10.42.42.5(pid=19338) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19338)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19352): Process ended prematurely: osmo-stp_10.42.42.5(pid=19352) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19352)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19363): Process ended prematurely: osmo-stp_10.42.42.5(pid=19363) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19363)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19380): Process ended prematurely: osmo-stp_10.42.42.5(pid=19380) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19380)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19391): Process ended prematurely: osmo-stp_10.42.42.5(pid=19391) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19391)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19405): Process ended prematurely: osmo-stp_10.42.42.5(pid=19405) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19405)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19416): Process ended prematurely: osmo-stp_10.42.42.5(pid=19416) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19416)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19430): Process ended prematurely: osmo-stp_10.42.42.5(pid=19430) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19430)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19441): Process ended prematurely: osmo-stp_10.42.42.5(pid=19441) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19441)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19455): Process ended prematurely: osmo-stp_10.42.42.5(pid=19455) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19455)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19466): Process ended prematurely: osmo-stp_10.42.42.5(pid=19466) [trial-2372↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19466)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19480): Process ended prematurely: osmo-stp_10.42.42.5(pid=19480) [trial-2372↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19480)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19491): Process ended prematurely: osmo-stp_10.42.42.5(pid=19491) [trial-2372↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19491)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19510): Process ended prematurely: osmo-stp_10.42.42.5(pid=19510) [trial-2372↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19510)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19522): Process ended prematurely: osmo-stp_10.42.42.5(pid=19522) [trial-2372↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19522)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=19541): Process ended prematurely: osmo-stp_10.42.42.5(pid=19541) [trial-2372↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19541)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19554): Process ended prematurely: osmo-stp_10.42.42.5(pid=19554) [trial-2372↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19554)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19564): Process ended prematurely: osmo-stp_10.42.42.5(pid=19564) [trial-2372↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19564)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19581): Process ended prematurely: osmo-stp_10.42.42.5(pid=19581) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19581)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=19593): Process ended prematurely: osmo-stp_10.42.42.5(pid=19593) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19593)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19902): Process ended prematurely: osmo-stp_10.42.42.5(pid=19902) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19902)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19912): Process ended prematurely: osmo-stp_10.42.42.5(pid=19912) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19912)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19930): Process ended prematurely: osmo-stp_10.42.42.5(pid=19930) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19930)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=19942): Process ended prematurely: osmo-stp_10.42.42.5(pid=19942) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19961): Process ended prematurely: osmo-stp_10.42.42.5(pid=19961) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19961)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19971): Process ended prematurely: osmo-stp_10.42.42.5(pid=19971) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19971)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19981): Process ended prematurely: osmo-stp_10.42.42.5(pid=19981) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19981)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20001): Process ended prematurely: osmo-stp_10.42.42.5(pid=20001) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20001)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20016): Process ended prematurely: osmo-stp_10.42.42.5(pid=20016) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20016)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=20034): Process ended prematurely: osmo-stp_10.42.42.5(pid=20034) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20034)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20054): Process ended prematurely: osmo-stp_10.42.42.5(pid=20054) [trial-2372↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20054)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20067): Process ended prematurely: osmo-stp_10.42.42.5(pid=20067) [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20067)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20080): Process ended prematurely: osmo-stp_10.42.42.5(pid=20080) [trial-2372↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20080)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20088): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20088) [trial-2372↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20088)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20100): Process ended prematurely: osmo-stp_10.42.42.5(pid=20100) [trial-2372↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20100)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20109) [trial-2372↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20109)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20119): Process ended prematurely: osmo-stp_10.42.42.5(pid=20119) [trial-2372↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20119)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20133): Process ended prematurely: osmo-stp_10.42.42.5(pid=20133) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20133)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20144): Process ended prematurely: osmo-stp_10.42.42.5(pid=20144) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20144)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20158): Process ended prematurely: osmo-stp_10.42.42.5(pid=20158) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20158)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20169): Process ended prematurely: osmo-stp_10.42.42.5(pid=20169) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20185): Process ended prematurely: osmo-stp_10.42.42.5(pid=20185) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20185)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20196): Process ended prematurely: osmo-stp_10.42.42.5(pid=20196) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20210): Process ended prematurely: osmo-stp_10.42.42.5(pid=20210) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20210)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20221): Process ended prematurely: osmo-stp_10.42.42.5(pid=20221) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20221)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20235): Process ended prematurely: osmo-stp_10.42.42.5(pid=20235) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20235)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20247): Process ended prematurely: osmo-stp_10.42.42.5(pid=20247) [trial-2372↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20261): Process ended prematurely: osmo-stp_10.42.42.5(pid=20261) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20261)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20272): Process ended prematurely: osmo-stp_10.42.42.5(pid=20272) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20287): Process ended prematurely: osmo-stp_10.42.42.5(pid=20287) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20287)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2372↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20313): Process ended prematurely: osmo-stp_10.42.42.5(pid=20313) [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20313)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2372↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20339): Process ended prematurely: osmo-stp_10.42.42.5(pid=20339) [trial-2372↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20339)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20354): Process ended prematurely: osmo-stp_10.42.42.5(pid=20354) [trial-2372↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20354)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20415): Process ended prematurely: osmo-stp_10.42.42.5(pid=20415) [trial-2372↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20415)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20427): Process ended prematurely: osmo-stp_10.42.42.5(pid=20427) [trial-2372↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20427)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20445): Process ended prematurely: osmo-stp_10.42.42.5(pid=20445) [trial-2372↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20445)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20455): Process ended prematurely: osmo-stp_10.42.42.5(pid=20455) [trial-2372↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20455)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20465): Process ended prematurely: osmo-stp_10.42.42.5(pid=20465) [trial-2372↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20465)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20494): Process ended prematurely: osmo-stp_10.42.42.5(pid=20494) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20494)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20512): Process ended prematurely: osmo-stp_10.42.42.5(pid=20512) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20512)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20522): Process ended prematurely: osmo-stp_10.42.42.5(pid=20522) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20522)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2372↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=20549): Process ended prematurely: osmo-stp_10.42.42.5(pid=20549) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20549)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20561): Process ended prematurely: osmo-stp_10.42.42.5(pid=20561) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20561)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=20580): Process ended prematurely: osmo-stp_10.42.42.5(pid=20580) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20580)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20601): Process ended prematurely: osmo-stp_10.42.42.5(pid=20601) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20618): Process ended prematurely: osmo-stp_10.42.42.5(pid=20618) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20618)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20630): Process ended prematurely: osmo-stp_10.42.42.5(pid=20630) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20630)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20648): Process ended prematurely: osmo-stp_10.42.42.5(pid=20648) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20648)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20658): Process ended prematurely: osmo-stp_10.42.42.5(pid=20658) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20658)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20668): Process ended prematurely: osmo-stp_10.42.42.5(pid=20668) [trial-2372↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20685): Process ended prematurely: osmo-stp_10.42.42.5(pid=20685) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20685)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20697): Process ended prematurely: osmo-stp_10.42.42.5(pid=20697) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20697)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20715): Process ended prematurely: osmo-stp_10.42.42.5(pid=20715) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20715)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20727): Process ended prematurely: osmo-stp_10.42.42.5(pid=20727) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20727)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20740): Process ended prematurely: osmo-stp_10.42.42.5(pid=20740) [trial-2372↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20740)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20754): Process ended prematurely: osmo-stp_10.42.42.5(pid=20754) [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20754)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20768): Process ended prematurely: osmo-stp_10.42.42.5(pid=20768) [trial-2372↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20768)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20776): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20776) [trial-2372↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20776)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20786): Process ended prematurely: osmo-stp_10.42.42.5(pid=20786) [trial-2372↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20786)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=20795): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20795) [trial-2372↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20795)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2372↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20819): Process ended prematurely: osmo-stp_10.42.42.5(pid=20819) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20819)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20830): Process ended prematurely: osmo-stp_10.42.42.5(pid=20830) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20830)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20844): Process ended prematurely: osmo-stp_10.42.42.5(pid=20844) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20844)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20855): Process ended prematurely: osmo-stp_10.42.42.5(pid=20855) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20855)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20869): Process ended prematurely: osmo-stp_10.42.42.5(pid=20869) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20869)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20880): Process ended prematurely: osmo-stp_10.42.42.5(pid=20880) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20880)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20894): Process ended prematurely: osmo-stp_10.42.42.5(pid=20894) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20894)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20905): Process ended prematurely: osmo-stp_10.42.42.5(pid=20905) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20905)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20919): Process ended prematurely: osmo-stp_10.42.42.5(pid=20919) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20919)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20932): Process ended prematurely: osmo-stp_10.42.42.5(pid=20932) [trial-2372↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20932)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20946): Process ended prematurely: osmo-stp_10.42.42.5(pid=20946) [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20946)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20957): Process ended prematurely: osmo-stp_10.42.42.5(pid=20957) [trial-2372↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20957)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=20971): Process ended prematurely: osmo-stp_10.42.42.5(pid=20971) [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20971)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=21255): Process ended prematurely: osmo-stp_10.42.42.5(pid=21255) [trial-2372↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21269): Process ended prematurely: osmo-stp_10.42.42.5(pid=21269) [trial-2372↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21269)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21280): Process ended prematurely: osmo-stp_10.42.42.5(pid=21280) [trial-2372↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21280)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21300): Process ended prematurely: osmo-stp_10.42.42.5(pid=21300) [trial-2372↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21300)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21312): Process ended prematurely: osmo-stp_10.42.42.5(pid=21312) [trial-2372↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21312)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21330): Process ended prematurely: osmo-stp_10.42.42.5(pid=21330) [trial-2372↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21330)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21340): Process ended prematurely: osmo-stp_10.42.42.5(pid=21340) [trial-2372↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21340)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21351): Process ended prematurely: osmo-stp_10.42.42.5(pid=21351) [trial-2372↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21351)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21378): Process ended prematurely: osmo-stp_10.42.42.5(pid=21378) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21378)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21746): Process ended prematurely: osmo-stp_10.42.42.5(pid=21746) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21746)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=21940): Process ended prematurely: osmo-stp_10.42.42.5(pid=21940) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21950): Process ended prematurely: osmo-stp_10.42.42.5(pid=21950) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21950)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21960): Process ended prematurely: osmo-stp_10.42.42.5(pid=21960) [trial-2372↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21960)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21977): Process ended prematurely: osmo-stp_10.42.42.5(pid=21977) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21977)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21989): Process ended prematurely: osmo-stp_10.42.42.5(pid=21989) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21989)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22007): Process ended prematurely: osmo-stp_10.42.42.5(pid=22007) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22007)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22017): Process ended prematurely: osmo-stp_10.42.42.5(pid=22017) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22017)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22028): Process ended prematurely: osmo-stp_10.42.42.5(pid=22028) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22028)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22046): Process ended prematurely: osmo-stp_10.42.42.5(pid=22046) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22046)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=22076): Process ended prematurely: osmo-stp_10.42.42.5(pid=22076) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22076)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22089): Process ended prematurely: osmo-stp_10.42.42.5(pid=22089) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22089)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22099): Process ended prematurely: osmo-stp_10.42.42.5(pid=22099) [trial-2372↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22099)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22112): Process ended prematurely: osmo-stp_10.42.42.5(pid=22112) [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22112)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22126): Process ended prematurely: osmo-stp_10.42.42.5(pid=22126) [trial-2372↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22126)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22134): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22134) [trial-2372↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22134)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22144): Process ended prematurely: osmo-stp_10.42.42.5(pid=22144) [trial-2372↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22144)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22153): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22153) [trial-2372↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22153)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=22163): Process ended prematurely: osmo-stp_10.42.42.5(pid=22163) [trial-2372↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22163)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22177): Process ended prematurely: osmo-stp_10.42.42.5(pid=22177) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22177)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22188): Process ended prematurely: osmo-stp_10.42.42.5(pid=22188) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22188)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22202): Process ended prematurely: osmo-stp_10.42.42.5(pid=22202) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22202)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22213): Process ended prematurely: osmo-stp_10.42.42.5(pid=22213) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22213)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22227): Process ended prematurely: osmo-stp_10.42.42.5(pid=22227) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22227)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22238): Process ended prematurely: osmo-stp_10.42.42.5(pid=22238) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22238)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22257): Process ended prematurely: osmo-stp_10.42.42.5(pid=22257) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22257)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22268): Process ended prematurely: osmo-stp_10.42.42.5(pid=22268) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22268)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22282): Process ended prematurely: osmo-stp_10.42.42.5(pid=22282) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22282)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22293): Process ended prematurely: osmo-stp_10.42.42.5(pid=22293) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22293)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22307): Process ended prematurely: osmo-stp_10.42.42.5(pid=22307) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22307)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22318): Process ended prematurely: osmo-stp_10.42.42.5(pid=22318) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22318)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22332): Process ended prematurely: osmo-stp_10.42.42.5(pid=22332) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22343): Process ended prematurely: osmo-stp_10.42.42.5(pid=22343) [trial-2372↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22343)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22357): Process ended prematurely: osmo-stp_10.42.42.5(pid=22357) [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22357)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22369): Process ended prematurely: osmo-stp_10.42.42.5(pid=22369) [trial-2372↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22369)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=22387): Process ended prematurely: osmo-stp_10.42.42.5(pid=22387) [trial-2372↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22387)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22402): Process ended prematurely: osmo-stp_10.42.42.5(pid=22402) [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22402)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22420): Process ended prematurely: osmo-stp_10.42.42.5(pid=22420) [trial-2372↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22420)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22432): Process ended prematurely: osmo-stp_10.42.42.5(pid=22432) [trial-2372↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22432)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22442): Process ended prematurely: osmo-stp_10.42.42.5(pid=22442) [trial-2372↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22442)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22471): Process ended prematurely: osmo-stp_10.42.42.5(pid=22471) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22471)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22489): Process ended prematurely: osmo-stp_10.42.42.5(pid=22489) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22489)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22499): Process ended prematurely: osmo-stp_10.42.42.5(pid=22499) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22499)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22509): Process ended prematurely: osmo-stp_10.42.42.5(pid=22509) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22509)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22527): Process ended prematurely: osmo-stp_10.42.42.5(pid=22527) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22527)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22539): Process ended prematurely: osmo-stp_10.42.42.5(pid=22539) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22539)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=22557): Process ended prematurely: osmo-stp_10.42.42.5(pid=22557) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22557)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22567): Process ended prematurely: osmo-stp_10.42.42.5(pid=22567) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22567)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22577): Process ended prematurely: osmo-stp_10.42.42.5(pid=22577) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22577)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22596): Process ended prematurely: osmo-stp_10.42.42.5(pid=22596) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22596)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22630): Process ended prematurely: osmo-stp_10.42.42.5(pid=22630) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22652): Process ended prematurely: osmo-stp_10.42.42.5(pid=22652) [trial-2372↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22665): Process ended prematurely: osmo-stp_10.42.42.5(pid=22665) [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22665)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22678): Process ended prematurely: osmo-stp_10.42.42.5(pid=22678) [trial-2372↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22678)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22686): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22686) [trial-2372↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22686)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22696): Process ended prematurely: osmo-stp_10.42.42.5(pid=22696) [trial-2372↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22696)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22705): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22705) [trial-2372↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22705)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2372↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22729): Process ended prematurely: osmo-stp_10.42.42.5(pid=22729) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22729)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22740): Process ended prematurely: osmo-stp_10.42.42.5(pid=22740) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22754): Process ended prematurely: osmo-stp_10.42.42.5(pid=22754) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22765): Process ended prematurely: osmo-stp_10.42.42.5(pid=22765) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22765)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22779): Process ended prematurely: osmo-stp_10.42.42.5(pid=22779) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22779)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22791): Process ended prematurely: osmo-stp_10.42.42.5(pid=22791) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22791)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22805): Process ended prematurely: osmo-stp_10.42.42.5(pid=22805) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22805)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22816): Process ended prematurely: osmo-stp_10.42.42.5(pid=22816) [trial-2372↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22816)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=22880): Process ended prematurely: osmo-stp_10.42.42.5(pid=22880) [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2372↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23127): Process ended prematurely: osmo-stp_10.42.42.5(pid=23127) [trial-2372↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23138): Process ended prematurely: osmo-stp_10.42.42.5(pid=23138) [trial-2372↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23138)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23156): Process ended prematurely: osmo-stp_10.42.42.5(pid=23156) [trial-2372↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23156)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2372↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23186): Process ended prematurely: osmo-stp_10.42.42.5(pid=23186) [trial-2372↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23186)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2372↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23206): Process ended prematurely: osmo-stp_10.42.42.5(pid=23206) [trial-2372↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23206)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23226): Process ended prematurely: osmo-stp_10.42.42.5(pid=23226) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23226)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23238): Process ended prematurely: osmo-stp_10.42.42.5(pid=23238) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23238)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=23256): Process ended prematurely: osmo-stp_10.42.42.5(pid=23256) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23256)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23268): Process ended prematurely: osmo-stp_10.42.42.5(pid=23268) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23268)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23278): Process ended prematurely: osmo-stp_10.42.42.5(pid=23278) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23295): Process ended prematurely: osmo-stp_10.42.42.5(pid=23295) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23295)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23307): Process ended prematurely: osmo-stp_10.42.42.5(pid=23307) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23307)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23325): Process ended prematurely: osmo-stp_10.42.42.5(pid=23325) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23325)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23335): Process ended prematurely: osmo-stp_10.42.42.5(pid=23335) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23335)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23345): Process ended prematurely: osmo-stp_10.42.42.5(pid=23345) [trial-2372↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23345)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23358): Process ended prematurely: osmo-stp_10.42.42.5(pid=23358) [trial-2372↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23372): Process ended prematurely: osmo-stp_10.42.42.5(pid=23372) [trial-2372↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23372)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23382): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23382) [trial-2372↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23382)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23392): Process ended prematurely: osmo-stp_10.42.42.5(pid=23392) [trial-2372↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23392)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23409): Process ended prematurely: osmo-stp_10.42.42.5(pid=23409) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23409)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23420): Process ended prematurely: osmo-stp_10.42.42.5(pid=23420) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23420)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23434): Process ended prematurely: osmo-stp_10.42.42.5(pid=23434) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23434)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23445): Process ended prematurely: osmo-stp_10.42.42.5(pid=23445) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23459): Process ended prematurely: osmo-stp_10.42.42.5(pid=23459) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23459)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23470): Process ended prematurely: osmo-stp_10.42.42.5(pid=23470) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23470)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23484): Process ended prematurely: osmo-stp_10.42.42.5(pid=23484) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23484)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23496): Process ended prematurely: osmo-stp_10.42.42.5(pid=23496) [trial-2372↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23496)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23510): Process ended prematurely: osmo-stp_10.42.42.5(pid=23510) [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23510)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23521): Process ended prematurely: osmo-stp_10.42.42.5(pid=23521) [trial-2372↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23521)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23535): Process ended prematurely: osmo-stp_10.42.42.5(pid=23535) [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23535)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23546): Process ended prematurely: osmo-stp_10.42.42.5(pid=23546) [trial-2372↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23546)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23560): Process ended prematurely: osmo-stp_10.42.42.5(pid=23560) [trial-2372↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23560)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23574): Process ended prematurely: osmo-stp_10.42.42.5(pid=23574) [trial-2372↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23574)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23592): Process ended prematurely: osmo-stp_10.42.42.5(pid=23592) [trial-2372↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23592)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23604): Process ended prematurely: osmo-stp_10.42.42.5(pid=23604) [trial-2372↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23604)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=23622): Process ended prematurely: osmo-stp_10.42.42.5(pid=23622) [trial-2372↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23622)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23637): Process ended prematurely: osmo-stp_10.42.42.5(pid=23637) [trial-2372↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23647): Process ended prematurely: osmo-stp_10.42.42.5(pid=23647) [trial-2372↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23647)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23664): Process ended prematurely: osmo-stp_10.42.42.5(pid=23664) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23664)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=23676): Process ended prematurely: osmo-stp_10.42.42.5(pid=23676) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23676)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=23694): Process ended prematurely: osmo-stp_10.42.42.5(pid=23694) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23694)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23704): Process ended prematurely: osmo-stp_10.42.42.5(pid=23704) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23704)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23714): Process ended prematurely: osmo-stp_10.42.42.5(pid=23714) [trial-2372↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23714)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23731): Process ended prematurely: osmo-stp_10.42.42.5(pid=23731) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23731)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=23743): Process ended prematurely: osmo-stp_10.42.42.5(pid=23743) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23743)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23773): Process ended prematurely: osmo-stp_10.42.42.5(pid=23773) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23773)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23783): Process ended prematurely: osmo-stp_10.42.42.5(pid=23783) [trial-2372↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23801): Process ended prematurely: osmo-stp_10.42.42.5(pid=23801) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23813): Process ended prematurely: osmo-stp_10.42.42.5(pid=23813) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23813)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=23831): Process ended prematurely: osmo-stp_10.42.42.5(pid=23831) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23831)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23841): Process ended prematurely: osmo-stp_10.42.42.5(pid=23841) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23841)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23852): Process ended prematurely: osmo-stp_10.42.42.5(pid=23852) [trial-2372↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23852)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23866): Process ended prematurely: osmo-stp_10.42.42.5(pid=23866) [trial-2372↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23866)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=23874): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23874) [trial-2372↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23874)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=23876): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23876) [trial-2372↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23876)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=23878): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23878) [trial-2372↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23878)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23880): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23880) [trial-2372↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23880)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=23889): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23889) [trial-2372↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23889)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=23900): Process ended prematurely: osmo-hlr_10.42.42.2(pid=23900) [trial-2372↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23900)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23912): Process ended prematurely: osmo-stp_10.42.42.5(pid=23912) [trial-2372↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23912)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2372↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24298): Process ended prematurely: osmo-stp_10.42.42.5(pid=24298) [trial-2372↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24298)] FAIL: register_a5_0_authreq.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24484): Process ended prematurely: osmo-stp_10.42.42.5(pid=24484) [trial-2372↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24484)] FAIL: register_a5_1_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24496): Process ended prematurely: osmo-stp_10.42.42.5(pid=24496) [trial-2372↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24507): Process ended prematurely: osmo-stp_10.42.42.5(pid=24507) [trial-2372↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24507)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=24527): Process ended prematurely: srsepc(pid=24527) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24527)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=24543): Process ended prematurely: srsepc(pid=24543) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24543)] FAIL: iperf3_dl.py (18.9 sec) Error: srsepc(pid=24559): Process ended prematurely: srsepc(pid=24559) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24559)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=24575): Process ended prematurely: srsepc(pid=24575) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24575)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=24591): Process ended prematurely: srsepc(pid=24591) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24591)] FAIL: rrc_idle_mo_ping.py (18.7 sec) Error: srsepc(pid=24610): Process ended prematurely: srsepc(pid=24610) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24610)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=24626): Process ended prematurely: srsepc(pid=24626) [trial-2372↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24626)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=24639): Process ended prematurely: osmo-stp_10.42.42.5(pid=24639) [trial-2372↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24639)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24925): Process ended prematurely: osmo-stp_10.42.42.5(pid=24925) [trial-2372↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24925)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24940): Process ended prematurely: osmo-stp_10.42.42.5(pid=24940) [trial-2372↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24940)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24954): Process ended prematurely: osmo-stp_10.42.42.5(pid=24954) [trial-2372↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24954)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24969): Process ended prematurely: osmo-stp_10.42.42.5(pid=24969) [trial-2372↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24969)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=24983): Process ended prematurely: osmo-stp_10.42.42.5(pid=24983) [trial-2372↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24983)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24997): Process ended prematurely: osmo-stp_10.42.42.5(pid=24997) [trial-2372↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24997)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25011): Process ended prematurely: osmo-stp_10.42.42.5(pid=25011) [trial-2372↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25011)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25025): Process ended prematurely: osmo-stp_10.42.42.5(pid=25025) [trial-2372↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25025)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25042): Process ended prematurely: osmo-stp_10.42.42.5(pid=25042) [trial-2372↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25042)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25056): Process ended prematurely: osmo-stp_10.42.42.5(pid=25056) [trial-2372↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25056)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25070): Process ended prematurely: osmo-stp_10.42.42.5(pid=25070) [trial-2372↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25070)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25084): Process ended prematurely: osmo-stp_10.42.42.5(pid=25084) [trial-2372↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25084)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25098): Process ended prematurely: osmo-stp_10.42.42.5(pid=25098) [trial-2372↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25098)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25112): Process ended prematurely: osmo-stp_10.42.42.5(pid=25112) [trial-2372↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25112)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25126): Process ended prematurely: osmo-stp_10.42.42.5(pid=25126) [trial-2372↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2372↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25154): Process ended prematurely: osmo-stp_10.42.42.5(pid=25154) [trial-2372↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25154)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25168): Process ended prematurely: osmo-stp_10.42.42.5(pid=25168) [trial-2372↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25168)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25182): Process ended prematurely: osmo-stp_10.42.42.5(pid=25182) [trial-2372↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25182)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25202): Process ended prematurely: osmo-stp_10.42.42.5(pid=25202) [trial-2372↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25202)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25216): Process ended prematurely: osmo-stp_10.42.42.5(pid=25216) [trial-2372↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25230): Process ended prematurely: osmo-stp_10.42.42.5(pid=25230) [trial-2372↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25230)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25244): Process ended prematurely: osmo-stp_10.42.42.5(pid=25244) [trial-2372↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25244)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25258): Process ended prematurely: osmo-stp_10.42.42.5(pid=25258) [trial-2372↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25258)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25273): Process ended prematurely: osmo-stp_10.42.42.5(pid=25273) [trial-2372↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25273)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25287): Process ended prematurely: osmo-stp_10.42.42.5(pid=25287) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25287)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25302): Process ended prematurely: osmo-stp_10.42.42.5(pid=25302) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25302)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25316): Process ended prematurely: osmo-stp_10.42.42.5(pid=25316) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25316)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25330): Process ended prematurely: osmo-stp_10.42.42.5(pid=25330) [trial-2372↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25330)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25344): Process ended prematurely: osmo-stp_10.42.42.5(pid=25344) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25344)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25358): Process ended prematurely: osmo-stp_10.42.42.5(pid=25358) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25358)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25373): Process ended prematurely: osmo-stp_10.42.42.5(pid=25373) [trial-2372↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25373)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25387): Process ended prematurely: osmo-stp_10.42.42.5(pid=25387) [trial-2372↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25387)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25401): Process ended prematurely: osmo-stp_10.42.42.5(pid=25401) [trial-2372↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25401)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25418): Process ended prematurely: osmo-stp_10.42.42.5(pid=25418) [trial-2372↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25418)] + rm -rf trial-2372/inst + cd trial-2372 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 08:20:25 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372-run.tgz run.2022-12-10_08-20-36 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2372-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17659.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2955.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29269.tgz osmo-nitb.build-12971.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30046.tgz osmo-stp.build-9242.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE