Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8960 originally caused by: Started by upstream project "master-osmo-mgw" build number 9192 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8714 originally caused by: Started by upstream project "master-osmo-hlr" build number 8849 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30090 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37258 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37259 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29306 originally caused by: Started by upstream project "master-osmo-msc" build number 34267 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34268 originally caused by: Started by upstream project "master-osmo-mgw" build number 9192 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17681 originally caused by: Started by upstream project "master-osmo-bsc" build number 20143 originally caused by: Started by upstream project "master-osmo-mgw" build number 9192 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20142 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12990 originally caused by: Started by upstream project "master-openbsc" build number 13187 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29307 originally caused by: Started by upstream project "master-osmo-msc" build number 34269 originally caused by: Started by upstream project "master-osmo-iuh" build number 12874 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30091 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37260 originally caused by: Started by upstream project "master-osmo-iuh" build number 12874 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9127 originally caused by: Started by upstream project "master-libosmo-netif" build number 6967 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8715 originally caused by: Started by upstream project "master-osmo-hlr" build number 8850 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17681 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7510 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8715 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8960 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2987 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29307 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30091 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4683 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12990 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9256 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4710 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8041 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5537 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15231609686307898590.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-13 18:38:21 + trial_dir_prefix=trial- + rm -rf trial-2392 trial-2392-bin.tgz trial-2392-run.tgz + trial_dir=trial-2393 + mkdir -p trial-2393 + mv open5gs.build-8.tgz osmo-bsc.build-17681.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8715.tgz osmo-hnbgw.build-2987.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29307.tgz osmo-nitb.build-12990.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30091.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz trial-2393 + cat open5gs.build-8.md5 osmo-bsc.build-17681.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8715.md5 osmo-hnbgw.build-2987.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29307.md5 osmo-nitb.build-12990.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30091.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17681.md5 osmo-bts-oc2g.build-5537.md5 osmo-bts-sysmo.build-8041.md5 osmo-bts.build-7510.md5 osmo-ggsn.build-6690.md5 osmo-hlr.build-8715.md5 osmo-hnbgw.build-2987.md5 osmo-mgw.build-8960.md5 osmo-msc.build-29307.md5 osmo-nitb.build-12990.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30091.md5 osmo-stp.build-9256.md5 osmo-trx.build-4683.md5 osmocom-bb.build-4710.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2393 combinations: None trial: 'trial-2393' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2393 -------------------------------------------------------------------------------------------- 18:38:33.015069 tst trial-2393: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/log --------------------------------------------------------------------- trial-2393 nitb_sms:sysmo --------------------------------------------------------------------- 18:40:43.752410 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:43.756844 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 18:40:43.778898 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 18:40:43.786496 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 18:40:43.846383 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 18:40:43.868515 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 18:40:43.875662 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 18:40:44.413516 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 18:40:44.418614 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 18:40:44.430053 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 18:40:44.816559 tst mo_mt_sms.py: using LAC 35508 18:40:45.062405 tst mo_mt_sms.py: using RAC 63 18:40:45.184742 tst mo_mt_sms.py: using CellId 35508 18:40:45.306340 tst mo_mt_sms.py: using BVCI 35509 18:40:45.422126 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 18:40:45.601708 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 18:40:45.721557 tst mo_mt_sms.py:9: start nitb and bts... 18:40:45.951283 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:40:48.380643 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18438): Launched 18:40:48.708637 run osmo-nitb_10.42.42.2(pid=18439): Launched 18:40:48.886750 run osmo-nitb_10.42.42.2(pid=18439): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18439)] 18:40:49.020265 run osmo-nitb_10.42.42.2(pid=18439): stdout: | (launched: 2022-12-13_18:40:48.648096) 18:40:49.155704 run osmo-nitb_10.42.42.2(pid=18439): stderr: | (launched: 2022-12-13_18:40:48.696567) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:40:49.290485 run osmo-nitb_10.42.42.2(pid=18439): stdout: | (launched: 2022-12-13_18:40:48.648096) 18:40:49.420082 run osmo-nitb_10.42.42.2(pid=18439): stderr: | (launched: 2022-12-13_18:40:48.696567) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:40:49.575162 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18439) [trial-2393↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18439)] [trial-2393↪nitb_sms:sysmo↪mo_mt_sms.py:11] 18:40:49.583860 tst mo_mt_sms.py:11: Test FAILED (5.2 sec) 18:40:49.590894 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18438): Terminating (SIGTERM) 18:40:49.802339 --- ParallelTerminationStrategy: PID 18438 died... 18:40:49.824150 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18438): Terminated: ok {rc=0} 18:40:49.914238 bus /sierra_3: Setting Powered False 18:40:51.014994 bus /sierra_3: Setting Powered False 18:40:52.133869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:sysmo --------------------------------------------------------------------- 18:40:53.323346 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:53.327846 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 18:40:53.350009 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 18:40:53.379037 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 18:40:53.432209 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 18:40:53.453651 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 18:40:53.481133 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 18:40:54.028592 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:sysmo mo_mt_sms.py ---------------------------------------------- 18:40:54.033552 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.044158 tst sms:sysmo: Using 1 x bts (candidates: 1) 18:40:54.078370 tst mo_mt_sms.py: using LAC 35509 18:40:54.199460 tst mo_mt_sms.py: using RAC 64 18:40:54.317739 tst mo_mt_sms.py: using CellId 35509 18:40:54.435517 tst mo_mt_sms.py: using BVCI 35510 18:40:54.543738 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.554393 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.564931 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.575822 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.586527 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 18:40:54.596924 tst sms:sysmo: Using 1 x modem (candidates: 2) 18:40:54.716547 tst sms:sysmo: Using 1 x modem (candidates: 2) 18:40:54.835974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:56.544653 run create_hlr_db(pid=18443): Launched 18:40:56.659323 bus /sierra_2: Setting Powered False 18:40:57.720378 run create_hlr_db(pid=18443): Terminated: ok {rc=0} 18:40:58.167532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Launched 18:40:58.496130 run osmo-hlr_10.42.42.2(pid=18446): Launched 18:40:58.623382 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:01.204341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Launched 18:41:01.529625 run osmo-stp_10.42.42.5(pid=18449): Launched 18:41:01.771291 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:07.175107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Launched 18:41:07.478853 run osmo-msc_10.42.42.6(pid=18452): Launched 18:41:07.648723 run osmo-stp_10.42.42.5(pid=18449): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] 18:41:07.776038 run osmo-stp_10.42.42.5(pid=18449): stdout: | (launched: 2022-12-13_18:41:01.471355) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:07.904442 run osmo-stp_10.42.42.5(pid=18449): stderr: | 20221213184101784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184101784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184101785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184101785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184101786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184101786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184101786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:08.029932 run osmo-stp_10.42.42.5(pid=18449): stdout: | (launched: 2022-12-13_18:41:01.471355) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:08.150384 run osmo-stp_10.42.42.5(pid=18449): stderr: | 20221213184101784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184101784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184101785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184101785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184101786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184101786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184101786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:08.294104 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=18449): Process ended prematurely: osmo-stp_10.42.42.5(pid=18449) [trial-2393↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] [trial-2393↪sms:sysmo↪mo_mt_sms.py:16] 18:41:08.302324 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 18:41:08.328454 run osmo-hlr_10.42.42.2(pid=18446): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18446)] 18:41:08.377105 run osmo-hlr_10.42.42.2(pid=18446): stdout: | (launched: 2022-12-13_18:40:58.435352) 18:41:08.427100 run osmo-hlr_10.42.42.2(pid=18446): stderr: | 20221213184058635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184058635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184058635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184058635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184058635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184058635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184058693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184058702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184058702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184058702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:08.496769 run osmo-msc_10.42.42.6(pid=18452): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18452)] 18:41:08.545038 run osmo-msc_10.42.42.6(pid=18452): stdout: | (launched: 2022-12-13_18:41:07.421778) 18:41:08.594802 run osmo-msc_10.42.42.6(pid=18452): stderr: | 20221213184107697 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184107697 DLGLOBAL DEBUG validating counter group 0x7f4a82d96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184107698 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184107698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184107698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184107698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184107700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184107700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184107700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184107700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:08.645185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Terminating (SIGTERM) 18:41:08.686205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Terminating (SIGTERM) 18:41:08.726600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Terminating (SIGTERM) 18:41:08.766981 --- ParallelTerminationStrategy: PID 18445 died... 18:41:08.786288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18445): Terminated: ok {rc=0} 18:41:08.831012 --- ParallelTerminationStrategy: PID 18448 died... 18:41:08.849841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18448): Terminated: ok {rc=0} 18:41:08.894164 --- ParallelTerminationStrategy: PID 18451 died... 18:41:08.913028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18451): Terminated: ok {rc=0} 18:41:08.999036 bus /sierra_3: Setting Powered False 18:41:10.100292 bus /sierra_3: Setting Powered False 18:41:11.216798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:sysmo --------------------------------------------------------------------- 18:41:12.438853 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:12.443676 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 18:41:12.466427 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 18:41:12.473610 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 18:41:12.513565 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 18:41:12.535418 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 18:41:12.542554 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 18:41:13.060254 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 18:41:13.065548 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 18:41:13.076821 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 18:41:13.112161 tst assert_extension.py: using LAC 35510 18:41:13.232210 tst assert_extension.py: using RAC 65 18:41:13.352213 tst assert_extension.py: using CellId 35510 18:41:13.473098 tst assert_extension.py: using BVCI 35511 18:41:13.583884 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 18:41:13.702098 tst assert_extension.py:10: start nitb and bts... 18:41:13.921939 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:41:14.586067 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18457): Launched 18:41:14.911666 run osmo-nitb_10.42.42.2(pid=18458): Launched 18:41:15.092620 run osmo-nitb_10.42.42.2(pid=18458): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18458)] 18:41:15.238158 run osmo-nitb_10.42.42.2(pid=18458): stdout: | (launched: 2022-12-13_18:41:14.851253) 18:41:15.384810 run osmo-nitb_10.42.42.2(pid=18458): stderr: | (launched: 2022-12-13_18:41:14.899317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:41:15.531393 run osmo-nitb_10.42.42.2(pid=18458): stdout: | (launched: 2022-12-13_18:41:14.851253) 18:41:15.672394 run osmo-nitb_10.42.42.2(pid=18458): stderr: | (launched: 2022-12-13_18:41:14.899317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18458) [trial-2393↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18458)] 18:41:16.035395 tst osmo-nitb_10.42.42.2(pid=18458): stdout: | (launched: 2022-12-13_18:41:14.851253) 18:41:16.161843 tst osmo-nitb_10.42.42.2(pid=18458): stderr: | (launched: 2022-12-13_18:41:14.899317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:41:16.311116 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=18458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18458) [trial-2393↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18458)] [trial-2393↪nitb_ussd:sysmo↪assert_extension.py:12] 18:41:16.320586 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:41:16.328335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18457): Terminating (SIGTERM) 18:41:16.540397 --- ParallelTerminationStrategy: PID 18457 died... 18:41:16.560802 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18457): Terminated: ok {rc=0} 18:41:16.654999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:sysmo --------------------------------------------------------------------- 18:41:17.827615 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:17.831772 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 18:41:17.853312 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 18:41:17.881146 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 18:41:17.916535 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 18:41:17.937535 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 18:41:17.964297 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 18:41:18.492928 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:sysmo assert_extension.py ---------------------------------------------- 18:41:18.497933 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:18.508603 tst ussd:sysmo: Using 1 x bts (candidates: 1) 18:41:18.542251 tst assert_extension.py: using LAC 35511 18:41:18.663706 tst assert_extension.py: using RAC 66 18:41:18.782803 tst assert_extension.py: using CellId 35511 18:41:18.902868 tst assert_extension.py: using BVCI 35512 18:41:19.013587 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:19.024152 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:19.034814 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:19.045306 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:19.055677 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 18:41:19.066127 tst ussd:sysmo: Using 1 x modem (candidates: 1) 18:41:19.179496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:19.650314 run create_hlr_db(pid=18464): Launched 18:41:19.780101 bus /sierra_2: Setting Powered False 18:41:20.843882 run create_hlr_db(pid=18464): Terminated: ok {rc=0} 18:41:21.298836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Launched 18:41:21.626249 run osmo-hlr_10.42.42.2(pid=18467): Launched 18:41:21.752930 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:22.320534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Launched 18:41:22.647997 run osmo-stp_10.42.42.5(pid=18470): Launched 18:41:22.771745 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:23.359658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18472): Launched 18:41:23.687283 run osmo-msc_10.42.42.6(pid=18473): Launched 18:41:23.870999 run osmo-stp_10.42.42.5(pid=18470): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] 18:41:24.009169 run osmo-stp_10.42.42.5(pid=18470): stdout: | (launched: 2022-12-13_18:41:22.587246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:24.147862 run osmo-stp_10.42.42.5(pid=18470): stderr: | 20221213184122782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184122783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184122783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184122783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184122784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184122784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184122784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:24.285185 run osmo-stp_10.42.42.5(pid=18470): stdout: | (launched: 2022-12-13_18:41:22.587246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:24.415461 run osmo-stp_10.42.42.5(pid=18470): stderr: | 20221213184122782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184122783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184122783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184122783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184122784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184122784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184122784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:24.570984 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=18470): Process ended prematurely: osmo-stp_10.42.42.5(pid=18470) [trial-2393↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] [trial-2393↪ussd:sysmo↪assert_extension.py:17] 18:41:24.579721 tst assert_extension.py:17: Test FAILED (6.1 sec) 18:41:24.607085 run osmo-hlr_10.42.42.2(pid=18467): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18467)] 18:41:24.658325 run osmo-hlr_10.42.42.2(pid=18467): stdout: | (launched: 2022-12-13_18:41:21.564908) 18:41:24.710846 run osmo-hlr_10.42.42.2(pid=18467): stderr: | 20221213184121769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184121769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184121769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184121769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184121769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184121770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184121788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184121797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184121797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184121797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:24.783519 run osmo-msc_10.42.42.6(pid=18473): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18473)] 18:41:24.833863 run osmo-msc_10.42.42.6(pid=18473): stdout: | (launched: 2022-12-13_18:41:23.626281) 18:41:24.886424 run osmo-msc_10.42.42.6(pid=18473): stderr: | 20221213184123950 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184123951 DLGLOBAL DEBUG validating counter group 0x7f0448405c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184123951 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184123951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184123951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184123951 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184123953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184123953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184123954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184123954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:24.939133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Terminating (SIGTERM) 18:41:24.981155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Terminating (SIGTERM) 18:41:25.023634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18472): Terminating (SIGTERM) 18:41:25.066176 --- ParallelTerminationStrategy: PID 18466 died... 18:41:25.086762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18466): Terminated: ok {rc=0} 18:41:25.134108 --- ParallelTerminationStrategy: PID 18469 died... 18:41:25.154359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18469): Terminated: ok {rc=0} 18:41:25.201430 --- ParallelTerminationStrategy: PID 18472 died... 18:41:25.221392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18472): Terminated: ok {rc=0} 18:41:25.310731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:41:26.505166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:26.511996 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:41:26.533582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:41:26.561298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:41:26.612917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:41:26.633830 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:41:26.660873 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:41:27.212527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:41:27.264683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.276119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:41:27.334264 tst mo_mt_call.py: using LAC 35512 18:41:27.457048 tst mo_mt_call.py: using RAC 67 18:41:27.580942 tst mo_mt_call.py: using CellId 35512 18:41:27.703873 tst mo_mt_call.py: using BVCI 35513 18:41:27.817290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.828444 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.839459 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.850422 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.861541 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:27.872555 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:41:27.993865 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:41:28.109279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:28.589648 run create_hlr_db(pid=18478): Launched 18:41:28.716164 bus /sierra_2: Setting Powered False 18:41:29.777697 run create_hlr_db(pid=18478): Terminated: ok {rc=0} 18:41:30.234804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18480): Launched 18:41:30.574860 run osmo-hlr_10.42.42.2(pid=18481): Launched 18:41:30.704507 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:31.365644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18483): Launched 18:41:31.717635 run osmo-stp_10.42.42.5(pid=18484): Launched 18:41:31.989158 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:32.678613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18486): Launched 18:41:32.989613 run osmo-msc_10.42.42.6(pid=18487): Launched 18:41:33.160864 run osmo-stp_10.42.42.5(pid=18484): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18484)] 18:41:33.290447 run osmo-stp_10.42.42.5(pid=18484): stdout: | (launched: 2022-12-13_18:41:31.651445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:33.420622 run osmo-stp_10.42.42.5(pid=18484): stderr: | 20221213184131894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184131895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184131895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184131895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184131896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184131896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184131896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:33.548840 run osmo-stp_10.42.42.5(pid=18484): stdout: | (launched: 2022-12-13_18:41:31.651445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:33.671992 run osmo-stp_10.42.42.5(pid=18484): stderr: | 20221213184131894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184131895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184131895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184131895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184131896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184131896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184131896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:33.819366 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18484): Process ended prematurely: osmo-stp_10.42.42.5(pid=18484) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18484)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:41:33.828119 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:41:33.854353 run osmo-hlr_10.42.42.2(pid=18481): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18481)] 18:41:33.902854 run osmo-hlr_10.42.42.2(pid=18481): stdout: | (launched: 2022-12-13_18:41:30.512751) 18:41:33.953181 run osmo-hlr_10.42.42.2(pid=18481): stderr: | 20221213184130717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184130717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184130717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184130717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184130717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184130717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184130730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184130740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184130740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184130740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:34.023502 run osmo-msc_10.42.42.6(pid=18487): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18487)] 18:41:34.071987 run osmo-msc_10.42.42.6(pid=18487): stdout: | (launched: 2022-12-13_18:41:32.931614) 18:41:34.121907 run osmo-msc_10.42.42.6(pid=18487): stderr: | 20221213184133209 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184133209 DLGLOBAL DEBUG validating counter group 0x7fb536260c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184133209 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184133209 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184133209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184133210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184133211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184133212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184133212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184133212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:34.172366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18480): Terminating (SIGTERM) 18:41:34.212665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18483): Terminating (SIGTERM) 18:41:34.252737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18486): Terminating (SIGTERM) 18:41:34.293201 --- ParallelTerminationStrategy: PID 18480 died... 18:41:34.312486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18480): Terminated: ok {rc=0} 18:41:34.357086 --- ParallelTerminationStrategy: PID 18483 died... 18:41:34.375887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18483): Terminated: ok {rc=0} 18:41:34.420285 --- ParallelTerminationStrategy: PID 18486 died... 18:41:34.439026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18486): Terminated: ok {rc=0} 18:41:34.525359 bus /sierra_3: Setting Powered False 18:41:35.630545 bus /sierra_3: Setting Powered False 18:41:36.749948 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:41:37.902057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:37.914480 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:41:38.010569 tst mo_mt_call_osmux.py: using LAC 35513 18:41:38.141220 tst mo_mt_call_osmux.py: using RAC 68 18:41:38.268540 tst mo_mt_call_osmux.py: using CellId 35513 18:41:38.392587 tst mo_mt_call_osmux.py: using BVCI 35514 18:41:38.507169 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:38.518553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:38.529588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:38.540505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:38.552015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:41:38.563544 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:41:38.683648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:41:38.802422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:39.284643 run create_hlr_db(pid=18489): Launched 18:41:39.413437 bus /sierra_2: Setting Powered False 18:41:40.475255 run create_hlr_db(pid=18489): Terminated: ok {rc=0} 18:41:40.934048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18491): Launched 18:41:41.262001 run osmo-hlr_10.42.42.2(pid=18492): Launched 18:41:41.380564 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:41.913857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18494): Launched 18:41:42.226366 run osmo-stp_10.42.42.5(pid=18495): Launched 18:41:42.344777 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:42.903989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18497): Launched 18:41:43.215573 run osmo-msc_10.42.42.6(pid=18498): Launched 18:41:43.388858 run osmo-stp_10.42.42.5(pid=18495): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18495)] 18:41:43.519359 run osmo-stp_10.42.42.5(pid=18495): stdout: | (launched: 2022-12-13_18:41:42.168280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:43.649414 run osmo-stp_10.42.42.5(pid=18495): stderr: | 20221213184142342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184142342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184142342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184142342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184142343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184142343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184142343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:43.777805 run osmo-stp_10.42.42.5(pid=18495): stdout: | (launched: 2022-12-13_18:41:42.168280) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:43.900774 run osmo-stp_10.42.42.5(pid=18495): stderr: | 20221213184142342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184142342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184142342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184142342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184142343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184142343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184142343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:44.048369 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18495): Process ended prematurely: osmo-stp_10.42.42.5(pid=18495) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18495)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:41:44.057268 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:41:44.083929 run osmo-hlr_10.42.42.2(pid=18492): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18492)] 18:41:44.132377 run osmo-hlr_10.42.42.2(pid=18492): stdout: | (launched: 2022-12-13_18:41:41.203554) 18:41:44.182131 run osmo-hlr_10.42.42.2(pid=18492): stderr: | 20221213184141382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184141383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184141383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184141383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184141383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184141383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184141395 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184141404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184141404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184141404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:44.251331 run osmo-msc_10.42.42.6(pid=18498): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18498)] 18:41:44.299500 run osmo-msc_10.42.42.6(pid=18498): stdout: | (launched: 2022-12-13_18:41:43.157364) 18:41:44.349296 run osmo-msc_10.42.42.6(pid=18498): stderr: | 20221213184143432 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184143432 DLGLOBAL DEBUG validating counter group 0x7f37d1cfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184143432 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184143432 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184143433 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184143433 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184143435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184143435 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184143435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184143435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:44.399161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18491): Terminating (SIGTERM) 18:41:44.439014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18494): Terminating (SIGTERM) 18:41:44.478997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18497): Terminating (SIGTERM) 18:41:44.519014 --- ParallelTerminationStrategy: PID 18491 died... 18:41:44.538316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18491): Terminated: ok {rc=0} 18:41:44.582660 --- ParallelTerminationStrategy: PID 18494 died... 18:41:44.601431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18494): Terminated: ok {rc=0} 18:41:44.645394 --- ParallelTerminationStrategy: PID 18497 died... 18:41:44.663955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18497): Terminated: ok {rc=0} 18:41:44.749715 bus /sierra_3: Setting Powered False 18:41:45.854911 bus /sierra_3: Setting Powered False 18:41:46.992298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:41:48.226070 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:48.232217 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:41:48.253147 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:41:48.281133 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:41:48.333098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:41:48.354467 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:41:48.382025 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:41:48.941593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:41:48.991560 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.002887 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:41:49.063507 tst mo_mt_call.py: using LAC 35514 18:41:49.184415 tst mo_mt_call.py: using RAC 69 18:41:49.305748 tst mo_mt_call.py: using CellId 35514 18:41:49.427617 tst mo_mt_call.py: using BVCI 35515 18:41:49.541304 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.552429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.563460 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.574426 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.586002 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:49.597551 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:41:49.719341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:41:49.839075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:50.320660 run create_hlr_db(pid=18503): Launched 18:41:50.446184 bus /sierra_2: Setting Powered False 18:41:51.511751 run create_hlr_db(pid=18503): Terminated: ok {rc=0} 18:41:51.955181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18505): Launched 18:41:52.267635 run osmo-hlr_10.42.42.2(pid=18506): Launched 18:41:52.386449 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:52.917981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18508): Launched 18:41:53.227224 run osmo-stp_10.42.42.5(pid=18509): Launched 18:41:53.345549 run osmo-msc_10.42.42.6: Starting osmo-msc 18:41:53.902710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18511): Launched 18:41:54.216109 run osmo-msc_10.42.42.6(pid=18512): Launched 18:41:54.388040 run osmo-stp_10.42.42.5(pid=18509): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18509)] 18:41:54.518279 run osmo-stp_10.42.42.5(pid=18509): stdout: | (launched: 2022-12-13_18:41:53.169405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:54.647812 run osmo-stp_10.42.42.5(pid=18509): stderr: | 20221213184153342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184153342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184153343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184153343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184153344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184153344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184153344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:54.775715 run osmo-stp_10.42.42.5(pid=18509): stdout: | (launched: 2022-12-13_18:41:53.169405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:54.898689 run osmo-stp_10.42.42.5(pid=18509): stderr: | 20221213184153342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184153342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184153343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184153343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184153344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184153344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184153344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:55.046075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18509): Process ended prematurely: osmo-stp_10.42.42.5(pid=18509) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18509)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:41:55.054786 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:41:55.080754 run osmo-hlr_10.42.42.2(pid=18506): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18506)] 18:41:55.129305 run osmo-hlr_10.42.42.2(pid=18506): stdout: | (launched: 2022-12-13_18:41:52.209471) 18:41:55.178742 run osmo-hlr_10.42.42.2(pid=18506): stderr: | 20221213184152390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184152390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184152390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184152390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184152391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184152391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184152403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184152413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184152413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184152413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:55.247464 run osmo-msc_10.42.42.6(pid=18512): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18512)] 18:41:55.295004 run osmo-msc_10.42.42.6(pid=18512): stdout: | (launched: 2022-12-13_18:41:54.157637) 18:41:55.344204 run osmo-msc_10.42.42.6(pid=18512): stderr: | 20221213184154435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184154435 DLGLOBAL DEBUG validating counter group 0x7fc6231a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184154435 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184154435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184154435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184154435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184154437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184154437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184154438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184154438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:41:55.393692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18505): Terminating (SIGTERM) 18:41:55.433037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18508): Terminating (SIGTERM) 18:41:55.472398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18511): Terminating (SIGTERM) 18:41:55.512113 --- ParallelTerminationStrategy: PID 18505 died... 18:41:55.531218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18505): Terminated: ok {rc=0} 18:41:55.574894 --- ParallelTerminationStrategy: PID 18508 died... 18:41:55.593420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18508): Terminated: ok {rc=0} 18:41:55.637633 --- ParallelTerminationStrategy: PID 18511 died... 18:41:55.656322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18511): Terminated: ok {rc=0} 18:41:55.742740 bus /sierra_3: Setting Powered False 18:41:56.843931 bus /sierra_3: Setting Powered False 18:41:57.957432 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:41:59.106908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.119292 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:41:59.181627 tst mo_mt_call_osmux.py: using LAC 35515 18:41:59.310237 tst mo_mt_call_osmux.py: using RAC 70 18:41:59.437470 tst mo_mt_call_osmux.py: using CellId 35515 18:41:59.558656 tst mo_mt_call_osmux.py: using BVCI 35516 18:41:59.671994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.683413 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.694630 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.705746 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.716882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:41:59.728269 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:41:59.849330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:41:59.970952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:00.487251 run create_hlr_db(pid=18514): Launched 18:42:00.614388 bus /sierra_2: Setting Powered False 18:42:01.678062 run create_hlr_db(pid=18514): Terminated: ok {rc=0} 18:42:02.148374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18518): Launched 18:42:02.493682 run osmo-hlr_10.42.42.2(pid=18519): Launched 18:42:02.621323 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:03.196095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18521): Launched 18:42:03.555585 run osmo-stp_10.42.42.5(pid=18522): Launched 18:42:03.683867 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:04.283902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18524): Launched 18:42:04.618475 run osmo-msc_10.42.42.6(pid=18525): Launched 18:42:04.804030 run osmo-stp_10.42.42.5(pid=18522): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18522)] 18:42:04.943391 run osmo-stp_10.42.42.5(pid=18522): stdout: | (launched: 2022-12-13_18:42:03.493870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:05.083411 run osmo-stp_10.42.42.5(pid=18522): stderr: | 20221213184203691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184203691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184203691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184203691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184203692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184203692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184203692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:05.223251 run osmo-stp_10.42.42.5(pid=18522): stdout: | (launched: 2022-12-13_18:42:03.493870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:05.355773 run osmo-stp_10.42.42.5(pid=18522): stderr: | 20221213184203691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184203691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184203691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184203691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184203692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184203692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184203692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:05.514541 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18522): Process ended prematurely: osmo-stp_10.42.42.5(pid=18522) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18522)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:42:05.524087 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:42:05.551553 run osmo-hlr_10.42.42.2(pid=18519): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18519)] 18:42:05.602781 run osmo-hlr_10.42.42.2(pid=18519): stdout: | (launched: 2022-12-13_18:42:02.431623) 18:42:05.654673 run osmo-hlr_10.42.42.2(pid=18519): stderr: | 20221213184202634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184202634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184202634 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184202634 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184202634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184202635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184202647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184202655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184202655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184202655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:05.727108 run osmo-msc_10.42.42.6(pid=18525): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18525)] 18:42:05.777401 run osmo-msc_10.42.42.6(pid=18525): stdout: | (launched: 2022-12-13_18:42:04.556491) 18:42:05.829418 run osmo-msc_10.42.42.6(pid=18525): stderr: | 20221213184204883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184204884 DLGLOBAL DEBUG validating counter group 0x7f982862dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184204884 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184204884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184204884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184204884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184204886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184204886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184204886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184204886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:05.881875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18518): Terminating (SIGTERM) 18:42:05.923907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18521): Terminating (SIGTERM) 18:42:05.966089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18524): Terminating (SIGTERM) 18:42:06.008441 --- ParallelTerminationStrategy: PID 18518 died... 18:42:06.028839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18518): Terminated: ok {rc=0} 18:42:06.075374 --- ParallelTerminationStrategy: PID 18521 died... 18:42:06.095327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18521): Terminated: ok {rc=0} 18:42:06.142126 --- ParallelTerminationStrategy: PID 18524 died... 18:42:06.162061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18524): Terminated: ok {rc=0} 18:42:06.250987 bus /sierra_3: Setting Powered False 18:42:07.351051 bus /sierra_3: Setting Powered False 18:42:08.468668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:42:09.706454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:09.713390 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:42:09.735066 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:42:09.763603 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:42:09.817988 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:42:09.839616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:42:09.867510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:42:10.419637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:42:10.473127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:10.484752 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:42:10.543105 tst mo_mt_call.py: using LAC 35516 18:42:10.671832 tst mo_mt_call.py: using RAC 71 18:42:10.800144 tst mo_mt_call.py: using CellId 35516 18:42:10.928796 tst mo_mt_call.py: using BVCI 35517 18:42:11.049227 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:11.061048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:11.072436 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:11.083903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:11.095702 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:11.108043 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:42:11.225256 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:42:11.347618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:11.864810 run create_hlr_db(pid=18530): Launched 18:42:11.992680 bus /sierra_2: Setting Powered False 18:42:13.057790 run create_hlr_db(pid=18530): Terminated: ok {rc=0} 18:42:13.501577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Launched 18:42:13.813544 run osmo-hlr_10.42.42.2(pid=18533): Launched 18:42:13.931249 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:14.465585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18535): Launched 18:42:14.775443 run osmo-stp_10.42.42.5(pid=18536): Launched 18:42:14.894865 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:15.455609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18538): Launched 18:42:15.767868 run osmo-msc_10.42.42.6(pid=18539): Launched 18:42:16.074348 run osmo-stp_10.42.42.5(pid=18536): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18536)] 18:42:16.334744 run osmo-stp_10.42.42.5(pid=18536): stdout: | (launched: 2022-12-13_18:42:14.717259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:16.478765 run osmo-stp_10.42.42.5(pid=18536): stderr: | 20221213184214890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184214890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184214891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184214891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184214893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184214894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184214894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:16.622688 run osmo-stp_10.42.42.5(pid=18536): stdout: | (launched: 2022-12-13_18:42:14.717259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:16.761437 run osmo-stp_10.42.42.5(pid=18536): stderr: | 20221213184214890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184214890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184214891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184214891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184214893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184214894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184214894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:16.928078 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18536): Process ended prematurely: osmo-stp_10.42.42.5(pid=18536) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18536)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:42:16.938836 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:42:16.968173 run osmo-hlr_10.42.42.2(pid=18533): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18533)] 18:42:17.024475 run osmo-hlr_10.42.42.2(pid=18533): stdout: | (launched: 2022-12-13_18:42:13.755466) 18:42:17.081334 run osmo-hlr_10.42.42.2(pid=18533): stderr: | 20221213184213936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184213936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184213936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184213936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184213936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184213936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184213948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184213957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184213957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184213957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:17.158134 run osmo-msc_10.42.42.6(pid=18539): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18539)] 18:42:17.212325 run osmo-msc_10.42.42.6(pid=18539): stdout: | (launched: 2022-12-13_18:42:15.708904) 18:42:17.269034 run osmo-msc_10.42.42.6(pid=18539): stderr: | 20221213184215998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184215998 DLGLOBAL DEBUG validating counter group 0x7f3406993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184215998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184215998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184215999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184215999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184216000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184216009 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184216009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184216009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:17.325498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Terminating (SIGTERM) 18:42:17.368080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18535): Terminating (SIGTERM) 18:42:17.411597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18538): Terminating (SIGTERM) 18:42:17.455175 --- ParallelTerminationStrategy: PID 18532 died... 18:42:17.476424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Terminated: ok {rc=0} 18:42:17.524811 --- ParallelTerminationStrategy: PID 18535 died... 18:42:17.545837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18535): Terminated: ok {rc=0} 18:42:17.593547 --- ParallelTerminationStrategy: PID 18538 died... 18:42:17.614176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18538): Terminated: ok {rc=0} 18:42:17.705749 bus /sierra_3: Setting Powered False 18:42:18.805515 bus /sierra_3: Setting Powered False 18:42:19.926865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:42:21.079611 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.092075 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:42:21.151021 tst mo_mt_call_osmux.py: using LAC 35517 18:42:21.282505 tst mo_mt_call_osmux.py: using RAC 72 18:42:21.411800 tst mo_mt_call_osmux.py: using CellId 35517 18:42:21.541118 tst mo_mt_call_osmux.py: using BVCI 35518 18:42:21.663333 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.675104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.686722 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.698343 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.710186 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:42:21.722049 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:42:21.840708 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:42:21.961592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:22.481896 run create_hlr_db(pid=18541): Launched 18:42:22.610308 bus /sierra_2: Setting Powered False 18:42:23.675494 run create_hlr_db(pid=18541): Terminated: ok {rc=0} 18:42:24.119846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18543): Launched 18:42:24.432026 run osmo-hlr_10.42.42.2(pid=18544): Launched 18:42:24.549799 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:25.083727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18546): Launched 18:42:25.395220 run osmo-stp_10.42.42.5(pid=18547): Launched 18:42:25.513177 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:26.074079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18549): Launched 18:42:26.384913 run osmo-msc_10.42.42.6(pid=18550): Launched 18:42:26.558633 run osmo-stp_10.42.42.5(pid=18547): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18547)] 18:42:26.689107 run osmo-stp_10.42.42.5(pid=18547): stdout: | (launched: 2022-12-13_18:42:25.336156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:26.820048 run osmo-stp_10.42.42.5(pid=18547): stderr: | 20221213184225509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184225510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184225510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184225510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184225512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184225513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184225513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:26.948410 run osmo-stp_10.42.42.5(pid=18547): stdout: | (launched: 2022-12-13_18:42:25.336156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:27.072114 run osmo-stp_10.42.42.5(pid=18547): stderr: | 20221213184225509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184225510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184225510 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184225510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184225512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184225513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184225513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:27.219907 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18547): Process ended prematurely: osmo-stp_10.42.42.5(pid=18547) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18547)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:42:27.228852 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:42:27.255201 run osmo-hlr_10.42.42.2(pid=18544): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18544)] 18:42:27.303543 run osmo-hlr_10.42.42.2(pid=18544): stdout: | (launched: 2022-12-13_18:42:24.372783) 18:42:27.353315 run osmo-hlr_10.42.42.2(pid=18544): stderr: | 20221213184224552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184224552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184224552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184224552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184224553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184224553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184224567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184224576 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184224577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184224577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:27.422616 run osmo-msc_10.42.42.6(pid=18550): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18550)] 18:42:27.470479 run osmo-msc_10.42.42.6(pid=18550): stdout: | (launched: 2022-12-13_18:42:26.326128) 18:42:27.521171 run osmo-msc_10.42.42.6(pid=18550): stderr: | 20221213184226600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184226601 DLGLOBAL DEBUG validating counter group 0x7fecfe564c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184226601 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184226601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184226601 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184226601 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184226603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184226603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184226603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184226604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:27.570955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18543): Terminating (SIGTERM) 18:42:27.610898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18546): Terminating (SIGTERM) 18:42:27.650617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18549): Terminating (SIGTERM) 18:42:27.690779 --- ParallelTerminationStrategy: PID 18543 died... 18:42:27.710108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18543): Terminated: ok {rc=0} 18:42:27.754534 --- ParallelTerminationStrategy: PID 18546 died... 18:42:27.773396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18546): Terminated: ok {rc=0} 18:42:27.817853 --- ParallelTerminationStrategy: PID 18549 died... 18:42:27.836695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18549): Terminated: ok {rc=0} 18:42:27.923783 bus /sierra_3: Setting Powered False 18:42:29.025807 bus /sierra_3: Setting Powered False 18:42:30.145306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:42:31.424279 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:31.435942 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:42:31.464406 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:42:31.496186 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:42:31.549586 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:42:31.579698 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:42:31.614796 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:42:32.186032 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:42:32.244260 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.257250 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:42:32.319930 tst mo_mt_call.py: using LAC 35518 18:42:32.449262 tst mo_mt_call.py: using RAC 73 18:42:32.581378 tst mo_mt_call.py: using CellId 35518 18:42:32.710592 tst mo_mt_call.py: using BVCI 35519 18:42:32.832387 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.844276 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.855977 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.867684 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.879415 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:32.891179 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:42:33.008037 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:42:33.129622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:33.647044 run create_hlr_db(pid=18555): Launched 18:42:33.773524 bus /sierra_2: Setting Powered False 18:42:34.838474 run create_hlr_db(pid=18555): Terminated: ok {rc=0} 18:42:35.301640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18557): Launched 18:42:35.633983 run osmo-hlr_10.42.42.2(pid=18558): Launched 18:42:35.761108 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:36.337081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18560): Launched 18:42:36.670833 run osmo-stp_10.42.42.5(pid=18561): Launched 18:42:36.798404 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:37.400083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18563): Launched 18:42:37.733277 run osmo-msc_10.42.42.6(pid=18564): Launched 18:42:37.917561 run osmo-stp_10.42.42.5(pid=18561): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18561)] 18:42:38.058428 run osmo-stp_10.42.42.5(pid=18561): stdout: | (launched: 2022-12-13_18:42:36.608235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:38.199617 run osmo-stp_10.42.42.5(pid=18561): stderr: | 20221213184236802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184236802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184236803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184236803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184236805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184236805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184236806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:38.339305 run osmo-stp_10.42.42.5(pid=18561): stdout: | (launched: 2022-12-13_18:42:36.608235) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:38.472465 run osmo-stp_10.42.42.5(pid=18561): stderr: | 20221213184236802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184236802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184236803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184236803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184236805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184236805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184236806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:38.632178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18561): Process ended prematurely: osmo-stp_10.42.42.5(pid=18561) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18561)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:42:38.641811 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:42:38.669994 run osmo-hlr_10.42.42.2(pid=18558): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18558)] 18:42:38.721152 run osmo-hlr_10.42.42.2(pid=18558): stdout: | (launched: 2022-12-13_18:42:35.571760) 18:42:38.773755 run osmo-hlr_10.42.42.2(pid=18558): stderr: | 20221213184235774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184235774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184235774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184235774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184235774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184235774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184235791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184235800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184235800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184235800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:38.846262 run osmo-msc_10.42.42.6(pid=18564): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18564)] 18:42:38.896423 run osmo-msc_10.42.42.6(pid=18564): stdout: | (launched: 2022-12-13_18:42:37.671054) 18:42:38.948734 run osmo-msc_10.42.42.6(pid=18564): stderr: | 20221213184237997 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184237998 DLGLOBAL DEBUG validating counter group 0x7fe9704a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184237998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184237998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184237998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184237998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184238002 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184238002 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184238002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184238002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:39.001654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18557): Terminating (SIGTERM) 18:42:39.043389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18560): Terminating (SIGTERM) 18:42:39.086163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18563): Terminating (SIGTERM) 18:42:39.128626 --- ParallelTerminationStrategy: PID 18557 died... 18:42:39.149023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18557): Terminated: ok {rc=0} 18:42:39.195908 --- ParallelTerminationStrategy: PID 18560 died... 18:42:39.215839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18560): Terminated: ok {rc=0} 18:42:39.262888 --- ParallelTerminationStrategy: PID 18563 died... 18:42:39.282869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18563): Terminated: ok {rc=0} 18:42:39.372188 bus /sierra_3: Setting Powered False 18:42:40.473249 bus /sierra_3: Setting Powered False 18:42:41.588818 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:42:42.740021 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:42.752456 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:42:42.811471 tst mo_mt_call_osmux.py: using LAC 35519 18:42:42.942620 tst mo_mt_call_osmux.py: using RAC 74 18:42:43.072857 tst mo_mt_call_osmux.py: using CellId 35519 18:42:43.211978 tst mo_mt_call_osmux.py: using BVCI 35520 18:42:43.335402 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:43.347078 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:43.358568 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:43.370114 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:43.382247 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:42:43.394114 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:42:43.511125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:42:43.631844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:44.151503 run create_hlr_db(pid=18566): Launched 18:42:44.281126 bus /sierra_2: Setting Powered False 18:42:45.346354 run create_hlr_db(pid=18566): Terminated: ok {rc=0} 18:42:45.811020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18568): Launched 18:42:46.176676 run osmo-hlr_10.42.42.2(pid=18569): Launched 18:42:46.319790 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:47.058157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18571): Launched 18:42:47.405635 run osmo-stp_10.42.42.5(pid=18572): Launched 18:42:47.532752 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:48.134860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18574): Launched 18:42:48.470233 run osmo-msc_10.42.42.6(pid=18575): Launched 18:42:48.655602 run osmo-stp_10.42.42.5(pid=18572): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18572)] 18:42:48.795474 run osmo-stp_10.42.42.5(pid=18572): stdout: | (launched: 2022-12-13_18:42:47.343239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:48.935507 run osmo-stp_10.42.42.5(pid=18572): stderr: | 20221213184247542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184247542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184247542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184247542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184247543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184247543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184247543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:49.074879 run osmo-stp_10.42.42.5(pid=18572): stdout: | (launched: 2022-12-13_18:42:47.343239) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:49.208352 run osmo-stp_10.42.42.5(pid=18572): stderr: | 20221213184247542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184247542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184247542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184247542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184247543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184247543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184247543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:49.367801 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18572): Process ended prematurely: osmo-stp_10.42.42.5(pid=18572) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18572)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:42:49.377549 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 18:42:49.405402 run osmo-hlr_10.42.42.2(pid=18569): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18569)] 18:42:49.457300 run osmo-hlr_10.42.42.2(pid=18569): stdout: | (launched: 2022-12-13_18:42:46.111218) 18:42:49.510294 run osmo-hlr_10.42.42.2(pid=18569): stderr: | 20221213184246527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184246527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184246528 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184246528 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184246528 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184246528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184246551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184246567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184246568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184246568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:49.583635 run osmo-msc_10.42.42.6(pid=18575): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18575)] 18:42:49.634485 run osmo-msc_10.42.42.6(pid=18575): stdout: | (launched: 2022-12-13_18:42:48.407416) 18:42:49.687681 run osmo-msc_10.42.42.6(pid=18575): stderr: | 20221213184248738 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184248739 DLGLOBAL DEBUG validating counter group 0x7f84a5d6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184248739 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184248739 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184248739 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184248739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184248741 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184248741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184248741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184248742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:49.740791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18568): Terminating (SIGTERM) 18:42:49.782991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18571): Terminating (SIGTERM) 18:42:49.825956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18574): Terminating (SIGTERM) 18:42:49.868588 --- ParallelTerminationStrategy: PID 18568 died... 18:42:49.889238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18568): Terminated: ok {rc=0} 18:42:49.935995 --- ParallelTerminationStrategy: PID 18571 died... 18:42:49.955990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18571): Terminated: ok {rc=0} 18:42:50.002769 --- ParallelTerminationStrategy: PID 18574 died... 18:42:50.022811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18574): Terminated: ok {rc=0} 18:42:50.111867 bus /sierra_3: Setting Powered False 18:42:51.211493 bus /sierra_3: Setting Powered False 18:42:52.330315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:42:53.566871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:53.573685 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:42:53.595269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:42:53.622824 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:42:53.676149 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:42:53.697868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:42:53.724304 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:42:54.274239 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:42:54.324025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.335409 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:42:54.392091 tst mo_mt_call.py: using LAC 35520 18:42:54.525203 tst mo_mt_call.py: using RAC 75 18:42:54.647708 tst mo_mt_call.py: using CellId 35520 18:42:54.778506 tst mo_mt_call.py: using BVCI 35521 18:42:54.899213 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.910972 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.922542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.934007 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.945912 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:42:54.957822 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:42:55.075565 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:42:55.197523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:55.714520 run create_hlr_db(pid=18580): Launched 18:42:55.840884 bus /sierra_2: Setting Powered False 18:42:56.906713 run create_hlr_db(pid=18580): Terminated: ok {rc=0} 18:42:57.351201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18582): Launched 18:42:57.663441 run osmo-hlr_10.42.42.2(pid=18583): Launched 18:42:57.782020 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:58.331879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18585): Launched 18:42:58.644682 run osmo-stp_10.42.42.5(pid=18586): Launched 18:42:58.764264 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:59.326967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18588): Launched 18:42:59.638155 run osmo-msc_10.42.42.6(pid=18589): Launched 18:42:59.810466 run osmo-stp_10.42.42.5(pid=18586): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18586)] 18:42:59.940887 run osmo-stp_10.42.42.5(pid=18586): stdout: | (launched: 2022-12-13_18:42:58.585142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:00.070761 run osmo-stp_10.42.42.5(pid=18586): stderr: | 20221213184258758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184258758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184258758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184258759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184258759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184258759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184258759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:00.199623 run osmo-stp_10.42.42.5(pid=18586): stdout: | (launched: 2022-12-13_18:42:58.585142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:00.323307 run osmo-stp_10.42.42.5(pid=18586): stderr: | 20221213184258758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184258758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184258758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184258759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184258759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184258759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184258759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:00.471212 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18586): Process ended prematurely: osmo-stp_10.42.42.5(pid=18586) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18586)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:43:00.479978 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:43:00.506086 run osmo-hlr_10.42.42.2(pid=18583): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18583)] 18:43:00.554118 run osmo-hlr_10.42.42.2(pid=18583): stdout: | (launched: 2022-12-13_18:42:57.604365) 18:43:00.603499 run osmo-hlr_10.42.42.2(pid=18583): stderr: | 20221213184257785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184257785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184257786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184257786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184257786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184257786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184257798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184257807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184257807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184257807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:00.672505 run osmo-msc_10.42.42.6(pid=18589): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18589)] 18:43:00.720801 run osmo-msc_10.42.42.6(pid=18589): stdout: | (launched: 2022-12-13_18:42:59.579427) 18:43:00.770178 run osmo-msc_10.42.42.6(pid=18589): stderr: | 20221213184259856 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184259856 DLGLOBAL DEBUG validating counter group 0x7ff30a947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184259856 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184259856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184259856 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184259856 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184259858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184259858 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184259859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184259859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:00.819869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18582): Terminating (SIGTERM) 18:43:00.867748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18585): Terminating (SIGTERM) 18:43:00.914872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18588): Terminating (SIGTERM) 18:43:00.961364 --- ParallelTerminationStrategy: PID 18582 died... 18:43:00.983636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18582): Terminated: ok {rc=0} 18:43:01.033256 --- ParallelTerminationStrategy: PID 18585 died... 18:43:01.056536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18585): Terminated: ok {rc=0} 18:43:01.105630 --- ParallelTerminationStrategy: PID 18588 died... 18:43:01.127100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18588): Terminated: ok {rc=0} 18:43:01.220859 bus /sierra_3: Setting Powered False 18:43:02.323149 bus /sierra_3: Setting Powered False 18:43:03.440243 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:43:04.591754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:04.604162 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:43:04.662907 tst mo_mt_call_osmux.py: using LAC 35521 18:43:04.793374 tst mo_mt_call_osmux.py: using RAC 76 18:43:04.922620 tst mo_mt_call_osmux.py: using CellId 35521 18:43:05.054203 tst mo_mt_call_osmux.py: using BVCI 35522 18:43:05.174763 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:05.186665 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:05.198218 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:05.209694 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:05.221673 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:05.233592 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:43:05.350769 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:43:05.475256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:05.992562 run create_hlr_db(pid=18591): Launched 18:43:06.119464 bus /sierra_2: Setting Powered False 18:43:07.184788 run create_hlr_db(pid=18591): Terminated: ok {rc=0} 18:43:07.628776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18593): Launched 18:43:07.940156 run osmo-hlr_10.42.42.2(pid=18594): Launched 18:43:08.057769 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:08.590791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18596): Launched 18:43:08.902785 run osmo-stp_10.42.42.5(pid=18597): Launched 18:43:09.020655 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:09.581447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18599): Launched 18:43:09.893201 run osmo-msc_10.42.42.6(pid=18600): Launched 18:43:10.066282 run osmo-stp_10.42.42.5(pid=18597): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18597)] 18:43:10.197113 run osmo-stp_10.42.42.5(pid=18597): stdout: | (launched: 2022-12-13_18:43:08.843864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:10.327110 run osmo-stp_10.42.42.5(pid=18597): stderr: | 20221213184309017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184309017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184309017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184309018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184309018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184309018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184309018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:10.455393 run osmo-stp_10.42.42.5(pid=18597): stdout: | (launched: 2022-12-13_18:43:08.843864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:10.579036 run osmo-stp_10.42.42.5(pid=18597): stderr: | 20221213184309017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184309017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184309017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184309018 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184309018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184309018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184309018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:10.726403 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18597): Process ended prematurely: osmo-stp_10.42.42.5(pid=18597) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18597)] [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:43:10.735401 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:43:10.761971 run osmo-hlr_10.42.42.2(pid=18594): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18594)] 18:43:10.810042 run osmo-hlr_10.42.42.2(pid=18594): stdout: | (launched: 2022-12-13_18:43:07.881546) 18:43:10.859300 run osmo-hlr_10.42.42.2(pid=18594): stderr: | 20221213184308062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184308062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184308062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184308062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184308062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184308063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184308075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184308086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184308086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184308086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:10.927895 run osmo-msc_10.42.42.6(pid=18600): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18600)] 18:43:10.975558 run osmo-msc_10.42.42.6(pid=18600): stdout: | (launched: 2022-12-13_18:43:09.834230) 18:43:11.024768 run osmo-msc_10.42.42.6(pid=18600): stderr: | 20221213184310111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184310111 DLGLOBAL DEBUG validating counter group 0x7fd9fbd4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184310111 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184310111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184310111 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184310111 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184310113 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184310113 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184310114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184310114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:11.074274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18593): Terminating (SIGTERM) 18:43:11.113743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18596): Terminating (SIGTERM) 18:43:11.152926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18599): Terminating (SIGTERM) 18:43:11.192532 --- ParallelTerminationStrategy: PID 18593 died... 18:43:11.211652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18593): Terminated: ok {rc=0} 18:43:11.255464 --- ParallelTerminationStrategy: PID 18596 died... 18:43:11.274177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18596): Terminated: ok {rc=0} 18:43:11.317848 --- ParallelTerminationStrategy: PID 18599 died... 18:43:11.336374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18599): Terminated: ok {rc=0} 18:43:11.423003 bus /sierra_3: Setting Powered False 18:43:12.521897 bus /sierra_3: Setting Powered False 18:43:13.638058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:43:14.872761 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:14.879244 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:43:14.900221 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:43:14.927368 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:43:14.979842 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:43:15.000765 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:43:15.027890 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:43:15.578915 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:43:15.629569 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:15.640809 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:43:15.697814 tst mo_mt_call.py: using LAC 35522 18:43:15.820028 tst mo_mt_call.py: using RAC 77 18:43:15.963572 tst mo_mt_call.py: using CellId 35522 18:43:16.104652 tst mo_mt_call.py: using BVCI 35523 18:43:16.229759 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:16.242660 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:16.256273 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:16.269311 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:16.282933 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:16.296525 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:43:16.445187 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:43:16.564299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:17.101676 run create_hlr_db(pid=18605): Launched 18:43:17.263874 bus /sierra_2: Setting Powered False 18:43:18.325343 run create_hlr_db(pid=18605): Terminated: ok {rc=0} 18:43:18.772016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18607): Launched 18:43:19.085398 run osmo-hlr_10.42.42.2(pid=18608): Launched 18:43:19.202812 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:19.735524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18610): Launched 18:43:20.048298 run osmo-stp_10.42.42.5(pid=18611): Launched 18:43:20.166943 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:20.727316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18613): Launched 18:43:21.039643 run osmo-msc_10.42.42.6(pid=18614): Launched 18:43:21.212031 run osmo-stp_10.42.42.5(pid=18611): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18611)] 18:43:21.342800 run osmo-stp_10.42.42.5(pid=18611): stdout: | (launched: 2022-12-13_18:43:19.988570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:21.473197 run osmo-stp_10.42.42.5(pid=18611): stderr: | 20221213184320161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184320161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184320161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184320162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184320162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184320162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184320162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:21.602112 run osmo-stp_10.42.42.5(pid=18611): stdout: | (launched: 2022-12-13_18:43:19.988570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:21.725559 run osmo-stp_10.42.42.5(pid=18611): stderr: | 20221213184320161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184320161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184320161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184320162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184320162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184320162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184320162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:21.873415 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18611): Process ended prematurely: osmo-stp_10.42.42.5(pid=18611) [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18611)] [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:43:21.882547 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:43:21.908786 run osmo-hlr_10.42.42.2(pid=18608): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18608)] 18:43:21.957110 run osmo-hlr_10.42.42.2(pid=18608): stdout: | (launched: 2022-12-13_18:43:19.026509) 18:43:22.006843 run osmo-hlr_10.42.42.2(pid=18608): stderr: | 20221213184319207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184319207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184319207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184319207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184319207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184319207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184319219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184319228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184319229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184319229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:22.076126 run osmo-msc_10.42.42.6(pid=18614): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18614)] 18:43:22.124068 run osmo-msc_10.42.42.6(pid=18614): stdout: | (launched: 2022-12-13_18:43:20.980721) 18:43:22.173559 run osmo-msc_10.42.42.6(pid=18614): stderr: | 20221213184321258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184321258 DLGLOBAL DEBUG validating counter group 0x7f2aa90fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184321259 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184321259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184321259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184321259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184321261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184321261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184321261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184321261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:22.223715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18607): Terminating (SIGTERM) 18:43:22.263867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18610): Terminating (SIGTERM) 18:43:22.303927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18613): Terminating (SIGTERM) 18:43:22.344034 --- ParallelTerminationStrategy: PID 18607 died... 18:43:22.363410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18607): Terminated: ok {rc=0} 18:43:22.407450 --- ParallelTerminationStrategy: PID 18610 died... 18:43:22.426220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18610): Terminated: ok {rc=0} 18:43:22.470241 --- ParallelTerminationStrategy: PID 18613 died... 18:43:22.488830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18613): Terminated: ok {rc=0} 18:43:22.572233 bus /sierra_3: Setting Powered False 18:43:23.670982 bus /sierra_3: Setting Powered False 18:43:24.790381 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:43:25.938687 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:25.950710 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:43:26.008431 tst mo_mt_call_osmux.py: using LAC 35523 18:43:26.131299 tst mo_mt_call_osmux.py: using RAC 78 18:43:26.254413 tst mo_mt_call_osmux.py: using CellId 35523 18:43:26.376759 tst mo_mt_call_osmux.py: using BVCI 35524 18:43:26.490123 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:26.501722 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:26.512619 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:26.523640 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:26.535229 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:43:26.546576 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:43:26.663186 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:43:26.785259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:27.276627 run create_hlr_db(pid=18616): Launched 18:43:27.403311 bus /sierra_2: Setting Powered False 18:43:28.465779 run create_hlr_db(pid=18616): Terminated: ok {rc=0} 18:43:28.920089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18618): Launched 18:43:29.256146 run osmo-hlr_10.42.42.2(pid=18619): Launched 18:43:29.383652 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:29.921331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18621): Launched 18:43:30.233478 run osmo-stp_10.42.42.5(pid=18622): Launched 18:43:30.351011 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:30.943987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18624): Launched 18:43:31.282920 run osmo-msc_10.42.42.6(pid=18625): Launched 18:43:31.487528 run osmo-stp_10.42.42.5(pid=18622): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18622)] 18:43:31.689651 run osmo-stp_10.42.42.5(pid=18622): stdout: | (launched: 2022-12-13_18:43:30.174253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:31.970403 run osmo-stp_10.42.42.5(pid=18622): stderr: | 20221213184330351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184330352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184330352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184330352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184330353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184330353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184330353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:32.245274 run osmo-stp_10.42.42.5(pid=18622): stdout: | (launched: 2022-12-13_18:43:30.174253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:32.379493 run osmo-stp_10.42.42.5(pid=18622): stderr: | 20221213184330351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184330352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184330352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184330352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184330353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184330353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184330353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:32.527943 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18622): Process ended prematurely: osmo-stp_10.42.42.5(pid=18622) [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18622)] [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:43:32.537088 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:43:32.563709 run osmo-hlr_10.42.42.2(pid=18619): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18619)] 18:43:32.612073 run osmo-hlr_10.42.42.2(pid=18619): stdout: | (launched: 2022-12-13_18:43:29.193740) 18:43:32.662071 run osmo-hlr_10.42.42.2(pid=18619): stderr: | 20221213184329395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184329395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184329395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184329395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184329395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184329395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184329407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184329418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184329418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184329418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:32.731836 run osmo-msc_10.42.42.6(pid=18625): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18625)] 18:43:32.779868 run osmo-msc_10.42.42.6(pid=18625): stdout: | (launched: 2022-12-13_18:43:31.221084) 18:43:32.829679 run osmo-msc_10.42.42.6(pid=18625): stderr: | 20221213184331838 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184331838 DLGLOBAL DEBUG validating counter group 0x7f39594f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184331838 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184331838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184331839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184331839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184331840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184331841 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184331841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184331841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:32.879743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18618): Terminating (SIGTERM) 18:43:32.919652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18621): Terminating (SIGTERM) 18:43:32.960077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18624): Terminating (SIGTERM) 18:43:33.000130 --- ParallelTerminationStrategy: PID 18618 died... 18:43:33.019652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18618): Terminated: ok {rc=0} 18:43:33.064354 --- ParallelTerminationStrategy: PID 18621 died... 18:43:33.083296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18621): Terminated: ok {rc=0} 18:43:33.127406 --- ParallelTerminationStrategy: PID 18624 died... 18:43:33.146162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18624): Terminated: ok {rc=0} 18:43:33.232157 bus /sierra_3: Setting Powered False 18:43:34.331169 bus /sierra_3: Setting Powered False 18:43:35.447376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:43:36.682937 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:36.688516 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:43:36.709436 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:43:36.736400 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:43:36.788180 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:43:36.809404 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:43:36.836596 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:43:37.384824 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:43:37.435437 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:37.446672 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:43:37.505046 tst mo_mt_call.py: using LAC 35524 18:43:37.626519 tst mo_mt_call.py: using RAC 79 18:43:37.750186 tst mo_mt_call.py: using CellId 35524 18:43:37.876033 tst mo_mt_call.py: using BVCI 35525 18:43:37.989732 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:38.001033 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:38.011813 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:38.022782 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:38.033805 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:38.044863 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:43:38.162186 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:43:38.285848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:38.803343 run create_hlr_db(pid=18630): Launched 18:43:38.930418 bus /sierra_2: Setting Powered False 18:43:39.995651 run create_hlr_db(pid=18630): Terminated: ok {rc=0} 18:43:40.440260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18632): Launched 18:43:40.752053 run osmo-hlr_10.42.42.2(pid=18633): Launched 18:43:40.870629 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:41.422441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18635): Launched 18:43:41.734890 run osmo-stp_10.42.42.5(pid=18636): Launched 18:43:41.852624 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:42.415402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18638): Launched 18:43:42.727359 run osmo-msc_10.42.42.6(pid=18639): Launched 18:43:42.900419 run osmo-stp_10.42.42.5(pid=18636): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18636)] 18:43:43.032074 run osmo-stp_10.42.42.5(pid=18636): stdout: | (launched: 2022-12-13_18:43:41.675454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:43.162737 run osmo-stp_10.42.42.5(pid=18636): stderr: | 20221213184341851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184341851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184341851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184341852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184341852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184341852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184341852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:43.291562 run osmo-stp_10.42.42.5(pid=18636): stdout: | (launched: 2022-12-13_18:43:41.675454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:43.414907 run osmo-stp_10.42.42.5(pid=18636): stderr: | 20221213184341851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184341851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184341851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184341852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184341852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184341852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184341852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:43.562584 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18636): Process ended prematurely: osmo-stp_10.42.42.5(pid=18636) [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18636)] [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:43:43.571611 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:43:43.597747 run osmo-hlr_10.42.42.2(pid=18633): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18633)] 18:43:43.645911 run osmo-hlr_10.42.42.2(pid=18633): stdout: | (launched: 2022-12-13_18:43:40.693454) 18:43:43.695733 run osmo-hlr_10.42.42.2(pid=18633): stderr: | 20221213184340875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184340875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184340875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184340875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184340875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184340875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184340887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184340896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184340896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184340896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:43.765047 run osmo-msc_10.42.42.6(pid=18639): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18639)] 18:43:43.813024 run osmo-msc_10.42.42.6(pid=18639): stdout: | (launched: 2022-12-13_18:43:42.668536) 18:43:43.862299 run osmo-msc_10.42.42.6(pid=18639): stderr: | 20221213184342944 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184342944 DLGLOBAL DEBUG validating counter group 0x7efe5e3e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184342944 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184342944 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184342944 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184342945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184342946 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184342947 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184342947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184342947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:43.911771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18632): Terminating (SIGTERM) 18:43:43.951579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18635): Terminating (SIGTERM) 18:43:43.991163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18638): Terminating (SIGTERM) 18:43:44.031488 --- ParallelTerminationStrategy: PID 18632 died... 18:43:44.051003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18632): Terminated: ok {rc=0} 18:43:44.095225 --- ParallelTerminationStrategy: PID 18635 died... 18:43:44.113986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18635): Terminated: ok {rc=0} 18:43:44.158012 --- ParallelTerminationStrategy: PID 18638 died... 18:43:44.176789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18638): Terminated: ok {rc=0} 18:43:44.261265 bus /sierra_3: Setting Powered False 18:43:45.359648 bus /sierra_3: Setting Powered False 18:43:46.478693 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:43:47.632444 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:47.644813 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:43:47.709734 tst mo_mt_call_osmux.py: using LAC 35525 18:43:47.839359 tst mo_mt_call_osmux.py: using RAC 80 18:43:47.969328 tst mo_mt_call_osmux.py: using CellId 35525 18:43:48.097570 tst mo_mt_call_osmux.py: using BVCI 35526 18:43:48.220642 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:48.232388 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:48.244065 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:48.255547 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:48.267598 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:43:48.279700 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:43:48.399817 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:43:48.521215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:49.038505 run create_hlr_db(pid=18641): Launched 18:43:49.165054 bus /sierra_2: Setting Powered False 18:43:50.230786 run create_hlr_db(pid=18641): Terminated: ok {rc=0} 18:43:50.675989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Launched 18:43:50.987357 run osmo-hlr_10.42.42.2(pid=18644): Launched 18:43:51.106241 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:51.639286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Launched 18:43:51.954245 run osmo-stp_10.42.42.5(pid=18647): Launched 18:43:52.069425 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:52.615781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18649): Launched 18:43:52.918784 run osmo-msc_10.42.42.6(pid=18650): Launched 18:43:53.086935 run osmo-stp_10.42.42.5(pid=18647): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] 18:43:53.215119 run osmo-stp_10.42.42.5(pid=18647): stdout: | (launched: 2022-12-13_18:43:51.896729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:53.342160 run osmo-stp_10.42.42.5(pid=18647): stderr: | 20221213184352070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184352070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184352070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184352070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184352071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184352071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184352071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:53.467325 run osmo-stp_10.42.42.5(pid=18647): stdout: | (launched: 2022-12-13_18:43:51.896729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:53.587578 run osmo-stp_10.42.42.5(pid=18647): stderr: | 20221213184352070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184352070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184352070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184352070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184352071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184352071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184352071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:53.731272 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18647): Process ended prematurely: osmo-stp_10.42.42.5(pid=18647) [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:43:53.739869 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:43:53.765963 run osmo-hlr_10.42.42.2(pid=18644): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18644)] 18:43:53.813583 run osmo-hlr_10.42.42.2(pid=18644): stdout: | (launched: 2022-12-13_18:43:50.928695) 18:43:53.862574 run osmo-hlr_10.42.42.2(pid=18644): stderr: | 20221213184351110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184351110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184351110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184351110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184351110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184351110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184351122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184351133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184351133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184351133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:53.930769 run osmo-msc_10.42.42.6(pid=18650): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18650)] 18:43:53.977988 run osmo-msc_10.42.42.6(pid=18650): stdout: | (launched: 2022-12-13_18:43:52.861705) 18:43:54.026719 run osmo-msc_10.42.42.6(pid=18650): stderr: | 20221213184353135 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184353135 DLGLOBAL DEBUG validating counter group 0x7fab61432c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184353136 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184353136 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184353136 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184353136 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184353138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184353138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184353138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184353138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:54.076225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Terminating (SIGTERM) 18:43:54.115527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Terminating (SIGTERM) 18:43:54.154839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18649): Terminating (SIGTERM) 18:43:54.194429 --- ParallelTerminationStrategy: PID 18643 died... 18:43:54.213261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18643): Terminated: ok {rc=0} 18:43:54.256523 --- ParallelTerminationStrategy: PID 18646 died... 18:43:54.274930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18646): Terminated: ok {rc=0} 18:43:54.318523 --- ParallelTerminationStrategy: PID 18649 died... 18:43:54.336993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18649): Terminated: ok {rc=0} 18:43:54.421145 bus /sierra_3: Setting Powered False 18:43:55.518260 bus /sierra_3: Setting Powered False 18:43:56.633789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:sysmo --------------------------------------------------------------------- 18:43:57.875118 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:57.879733 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 18:43:57.901457 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 18:43:57.930094 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 18:43:58.017362 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 18:43:58.038894 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 18:43:58.066552 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 18:43:58.650704 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 18:43:58.655848 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:58.666997 tst emergency:sysmo: Using 1 x bts (candidates: 1) 18:43:58.703589 tst emergency_mo_mt_call.py: using LAC 35526 18:43:58.822578 tst emergency_mo_mt_call.py: using RAC 81 18:43:58.938850 tst emergency_mo_mt_call.py: using CellId 35526 18:43:59.058994 tst emergency_mo_mt_call.py: using BVCI 35527 18:43:59.169627 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:59.180476 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:59.191230 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:59.201967 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:59.212805 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:43:59.223339 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:43:59.342047 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:43:59.460652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:59.925780 run create_hlr_db(pid=18655): Launched 18:44:00.047882 bus /sierra_2: Setting Powered False 18:44:01.111397 run create_hlr_db(pid=18655): Terminated: ok {rc=0} 18:44:01.572483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Launched 18:44:01.951945 run osmo-hlr_10.42.42.2(pid=18658): Launched 18:44:02.202733 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:02.716485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Launched 18:44:03.017488 run osmo-stp_10.42.42.5(pid=18661): Launched 18:44:03.141397 tst emergency_mo_mt_call.py: using MSISDN 8280 18:44:03.296263 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:03.832920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Launched 18:44:04.131398 run osmo-msc_10.42.42.6(pid=18664): Launched 18:44:04.298971 run osmo-stp_10.42.42.5(pid=18661): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] 18:44:04.432417 run osmo-stp_10.42.42.5(pid=18661): stdout: | (launched: 2022-12-13_18:44:02.960466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:04.571634 run osmo-stp_10.42.42.5(pid=18661): stderr: | 20221213184403132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184403132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184403133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184403133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184403134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184403134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184403134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.705862 run osmo-stp_10.42.42.5(pid=18661): stdout: | (launched: 2022-12-13_18:44:02.960466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:04.835321 run osmo-stp_10.42.42.5(pid=18661): stderr: | 20221213184403132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184403132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184403133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184403133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184403134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184403134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184403134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.989139 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=18661): Process ended prematurely: osmo-stp_10.42.42.5(pid=18661) [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py:19] 18:44:04.998172 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 18:44:05.025852 run osmo-hlr_10.42.42.2(pid=18658): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18658)] 18:44:05.078248 run osmo-hlr_10.42.42.2(pid=18658): stdout: | (launched: 2022-12-13_18:44:01.884311) 18:44:05.130580 run osmo-hlr_10.42.42.2(pid=18658): stderr: | 20221213184402182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184402182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184402182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184402182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184402182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184402182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184402194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184402204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184402204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184402204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:05.204402 run osmo-msc_10.42.42.6(pid=18664): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18664)] 18:44:05.255349 run osmo-msc_10.42.42.6(pid=18664): stdout: | (launched: 2022-12-13_18:44:04.075024) 18:44:05.308024 run osmo-msc_10.42.42.6(pid=18664): stderr: | 20221213184404351 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184404352 DLGLOBAL DEBUG validating counter group 0x7f65df4bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184404352 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184404352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184404352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184404352 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184404354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184404355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184404355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184404355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:05.361573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Terminating (SIGTERM) 18:44:05.404015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Terminating (SIGTERM) 18:44:05.447304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Terminating (SIGTERM) 18:44:05.490677 --- ParallelTerminationStrategy: PID 18657 died... 18:44:05.511471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18657): Terminated: ok {rc=0} 18:44:05.558852 --- ParallelTerminationStrategy: PID 18660 died... 18:44:05.579724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18660): Terminated: ok {rc=0} 18:44:05.626726 --- ParallelTerminationStrategy: PID 18663 died... 18:44:05.647085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18663): Terminated: ok {rc=0} 18:44:05.736322 bus /sierra_3: Setting Powered False 18:44:06.835454 bus /sierra_3: Setting Powered False 18:44:07.955589 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 18:44:09.045708 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.059057 tst emergency:sysmo: Using 1 x bts (candidates: 1) 18:44:09.097499 tst emergency_preemptive_call.py: using LAC 35527 18:44:09.225177 tst emergency_preemptive_call.py: using RAC 82 18:44:09.342427 tst emergency_preemptive_call.py: using CellId 35527 18:44:09.458612 tst emergency_preemptive_call.py: using BVCI 35528 18:44:09.566307 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.577233 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.587914 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.598434 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.608837 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 18:44:09.619899 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:44:09.736692 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:44:09.857215 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:44:09.971465 tst emergency:sysmo: Using 1 x modem (candidates: 4) 18:44:10.090049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:10.590236 run create_hlr_db(pid=18666): Launched 18:44:10.712366 bus /sierra_2: Setting Powered False 18:44:11.775758 run create_hlr_db(pid=18666): Terminated: ok {rc=0} 18:44:12.231778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18668): Launched 18:44:12.555364 run osmo-hlr_10.42.42.2(pid=18669): Launched 18:44:12.678453 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:13.234034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18671): Launched 18:44:13.539182 run osmo-stp_10.42.42.5(pid=18672): Launched 18:44:13.663304 tst emergency_preemptive_call.py: using MSISDN 8281 18:44:13.816727 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:14.353455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18674): Launched 18:44:14.653051 run osmo-msc_10.42.42.6(pid=18675): Launched 18:44:14.824874 run osmo-stp_10.42.42.5(pid=18672): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18672)] 18:44:14.950307 run osmo-stp_10.42.42.5(pid=18672): stdout: | (launched: 2022-12-13_18:44:13.483002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:15.075908 run osmo-stp_10.42.42.5(pid=18672): stderr: | 20221213184413654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184413655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184413655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184413655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184413657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184413657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184413657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.200323 run osmo-stp_10.42.42.5(pid=18672): stdout: | (launched: 2022-12-13_18:44:13.483002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:15.320206 run osmo-stp_10.42.42.5(pid=18672): stderr: | 20221213184413654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184413655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184413655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184413655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184413657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184413657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184413657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.462566 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=18672): Process ended prematurely: osmo-stp_10.42.42.5(pid=18672) [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18672)] [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py:32] 18:44:15.470871 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 18:44:15.496785 run osmo-hlr_10.42.42.2(pid=18669): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18669)] 18:44:15.544940 run osmo-hlr_10.42.42.2(pid=18669): stdout: | (launched: 2022-12-13_18:44:12.494940) 18:44:15.594652 run osmo-hlr_10.42.42.2(pid=18669): stderr: | 20221213184412696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184412696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184412696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184412697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184412697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184412697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184412708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184412717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184412717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184412717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:15.663913 run osmo-msc_10.42.42.6(pid=18675): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18675)] 18:44:15.711760 run osmo-msc_10.42.42.6(pid=18675): stdout: | (launched: 2022-12-13_18:44:14.596000) 18:44:15.761254 run osmo-msc_10.42.42.6(pid=18675): stderr: | 20221213184414868 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184414868 DLGLOBAL DEBUG validating counter group 0x7fa0c53d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184414868 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184414869 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184414869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184414869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184414871 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184414871 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184414871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184414871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:15.810908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18668): Terminating (SIGTERM) 18:44:15.870996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18671): Terminating (SIGTERM) 18:44:15.918774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18674): Terminating (SIGTERM) 18:44:15.963673 --- ParallelTerminationStrategy: PID 18668 died... 18:44:15.985546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18668): Terminated: ok {rc=0} 18:44:16.034762 --- ParallelTerminationStrategy: PID 18671 died... 18:44:16.057186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18671): Terminated: ok {rc=0} 18:44:16.105894 --- ParallelTerminationStrategy: PID 18674 died... 18:44:16.127266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18674): Terminated: ok {rc=0} 18:44:16.221235 bus /sierra_9: Setting Powered False 18:44:17.320942 bus /sierra_9: Setting Powered False 18:44:18.436182 bus /sierra_8: Setting Powered False 18:44:19.532813 bus /sierra_8: Setting Powered False 18:44:20.647129 bus /sierra_3: Setting Powered False 18:44:21.744096 bus /sierra_3: Setting Powered False 18:44:22.860303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:sysmo --------------------------------------------------------------------- 18:44:24.126479 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:44:24.131244 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 18:44:24.152926 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 18:44:24.193674 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 18:44:24.282672 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 18:44:24.304151 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 18:44:24.343849 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 18:44:24.936111 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 18:44:24.988278 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:24.999152 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:44:25.032806 tst cs_paging_gprs_active.py: using LAC 35528 18:44:25.150258 tst cs_paging_gprs_active.py: using RAC 83 18:44:25.273337 tst cs_paging_gprs_active.py: using CellId 35528 18:44:25.390325 tst cs_paging_gprs_active.py: using BVCI 35529 18:44:25.498817 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.509381 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.519784 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.530162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.540369 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.550883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.561466 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.571908 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:25.582632 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:25.701091 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:25.820041 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:44:26.040261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:26.366988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18681): Launched 18:44:26.649062 run iperf3-srv_10.42.42.10(pid=18682): Launched 18:44:26.770572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:44:26.990211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:27.315720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Launched 18:44:27.597632 run iperf3-srv_10.42.42.10(pid=18684): Launched 18:44:27.718141 tst cs_paging_gprs_active.py:38: start network... 18:44:27.935966 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:28.436187 run create_hlr_db(pid=18685): Launched 18:44:28.560173 bus /sierra_2: Setting Powered False 18:44:29.624544 run create_hlr_db(pid=18685): Terminated: ok {rc=0} 18:44:30.056931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Launched 18:44:30.358459 run osmo-hlr_10.42.42.2(pid=18688): Launched 18:44:30.472290 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:31.013742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Launched 18:44:31.333019 run osmo-stp_10.42.42.5(pid=18691): Launched 18:44:31.570651 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:33.188718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Launched 18:44:33.304176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:33.559934 run patchelf(pid=18694): Launched 18:44:33.729285 run osmo-stp_10.42.42.5(pid=18691): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] 18:44:33.857307 run osmo-stp_10.42.42.5(pid=18691): stdout: | (launched: 2022-12-13_18:44:31.275904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:33.987096 run osmo-stp_10.42.42.5(pid=18691): stderr: | 20221213184431601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184431602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184431602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184431602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184431603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184431603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184431603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:34.116479 run osmo-stp_10.42.42.5(pid=18691): stdout: | (launched: 2022-12-13_18:44:31.275904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:34.240477 run osmo-stp_10.42.42.5(pid=18691): stderr: | 20221213184431601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184431602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184431602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184431602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184431603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184431603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184431603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:34.387204 run patchelf(pid=18694): Terminating (SIGINT) 18:44:34.556330 run patchelf(pid=18694): Terminated: ok {rc=0} 18:44:34.678125 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18691): Process ended prematurely: osmo-stp_10.42.42.5(pid=18691) [trial-2393↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] [trial-2393↪gprs:sysmo↪cs_paging_gprs_active.py:38] 18:44:34.687250 tst cs_paging_gprs_active.py:38: Test FAILED (9.7 sec) 18:44:34.714089 run osmo-hlr_10.42.42.2(pid=18688): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18688)] 18:44:34.761653 run osmo-hlr_10.42.42.2(pid=18688): stdout: | (launched: 2022-12-13_18:44:30.302781) 18:44:34.810882 run osmo-hlr_10.42.42.2(pid=18688): stderr: | 20221213184430476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184430476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184430476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184430476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184430476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184430476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184430488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184430497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184430498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184430498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:34.860367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18681): Terminating (SIGTERM) 18:44:34.900165 run iperf3-srv_10.42.42.10(pid=18682): Terminating (SIGTERM) 18:44:34.939822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Terminating (SIGTERM) 18:44:34.979625 run iperf3-srv_10.42.42.10(pid=18684): Terminating (SIGTERM) 18:44:35.019630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminating (SIGTERM) 18:44:35.059391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Terminating (SIGTERM) 18:44:35.099138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Terminating (SIGTERM) 18:44:35.139200 --- ParallelTerminationStrategy: PID 18681 died... 18:44:35.158450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18681): Terminated: ok {rc=0} 18:44:35.202417 --- ParallelTerminationStrategy: PID 18682 died... 18:44:35.221277 run iperf3-srv_10.42.42.10(pid=18682): Terminated {rc=256} 18:44:35.265218 --- ParallelTerminationStrategy: PID 18683 died... 18:44:35.284155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18683): Terminated: ok {rc=0} 18:44:35.328015 --- ParallelTerminationStrategy: PID 18684 died... 18:44:35.346796 run iperf3-srv_10.42.42.10(pid=18684): Terminated {rc=256} 18:44:35.390668 --- ParallelTerminationStrategy: PID 18687 died... 18:44:35.409521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18687): Terminated: ok {rc=0} 18:44:35.453793 --- ParallelTerminationStrategy: PID 18690 died... 18:44:35.472552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18690): Terminated: ok {rc=0} 18:44:35.517192 --- ParallelTerminationStrategy: PID 18693 died... 18:44:35.535991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18693): Terminated: ok {rc=0} 18:44:35.622176 bus /gobi_0: Setting Powered False 18:44:36.721257 bus /gobi_0: Setting Powered False 18:44:37.834729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo iperf3.py ---------------------------------------------- 18:44:38.984911 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:38.997087 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:44:39.033745 tst iperf3.py: using LAC 35529 18:44:39.161272 tst iperf3.py: using RAC 84 18:44:39.289681 tst iperf3.py: using CellId 35529 18:44:39.418369 tst iperf3.py: using BVCI 35530 18:44:39.537812 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.548773 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.559783 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.570676 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.581952 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.593219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.604549 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.615829 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:39.627253 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:39.742907 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:44:39.947016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:40.251468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Launched 18:44:40.513355 run iperf3-srv_10.42.42.10(pid=18696): Launched 18:44:40.626575 tst iperf3.py:8: start network... 18:44:40.827969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:41.294288 run create_hlr_db(pid=18697): Launched 18:44:41.417920 bus /gobi_6: Setting Powered False 18:44:42.477772 run create_hlr_db(pid=18697): Terminated: ok {rc=0} 18:44:42.919472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Launched 18:44:43.245727 run osmo-hlr_10.42.42.2(pid=18700): Launched 18:44:43.370223 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:43.932153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Launched 18:44:44.255347 run osmo-stp_10.42.42.5(pid=18703): Launched 18:44:44.378936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:44.938675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18705): Launched 18:44:45.064440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:45.338951 run patchelf(pid=18706): Launched 18:44:45.518952 run osmo-stp_10.42.42.5(pid=18703): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] 18:44:45.657299 run osmo-stp_10.42.42.5(pid=18703): stdout: | (launched: 2022-12-13_18:44:44.196259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:45.795993 run osmo-stp_10.42.42.5(pid=18703): stderr: | 20221213184444382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184444383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184444383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184444383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184444384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184444384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184444384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:45.960435 run osmo-stp_10.42.42.5(pid=18703): stdout: | (launched: 2022-12-13_18:44:44.196259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:46.096277 run osmo-stp_10.42.42.5(pid=18703): stderr: | 20221213184444382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184444383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184444383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184444383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184444384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184444384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184444384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:46.258441 run patchelf(pid=18706): Terminating (SIGINT) 18:44:46.444112 run patchelf(pid=18706): Terminated: ok {rc=0} 18:44:46.578925 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18703): Process ended prematurely: osmo-stp_10.42.42.5(pid=18703) [trial-2393↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] [trial-2393↪gprs:sysmo↪iperf3.py:8] 18:44:46.590264 tst iperf3.py:8: Test FAILED (7.6 sec) 18:44:46.619904 run osmo-hlr_10.42.42.2(pid=18700): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18700)] 18:44:46.674180 run osmo-hlr_10.42.42.2(pid=18700): stdout: | (launched: 2022-12-13_18:44:43.185869) 18:44:46.729857 run osmo-hlr_10.42.42.2(pid=18700): stderr: | 20221213184443381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184443381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184443381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184443381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184443381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184443381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184443392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184443401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184443401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184443402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:46.784936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Terminating (SIGTERM) 18:44:46.828555 run iperf3-srv_10.42.42.10(pid=18696): Terminating (SIGTERM) 18:44:46.875525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Terminating (SIGTERM) 18:44:46.920303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Terminating (SIGTERM) 18:44:46.964442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18705): Terminating (SIGTERM) 18:44:47.008912 --- ParallelTerminationStrategy: PID 18695 died... 18:44:47.031046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18695): Terminated: ok {rc=0} 18:44:47.079620 --- ParallelTerminationStrategy: PID 18696 died... 18:44:47.101417 run iperf3-srv_10.42.42.10(pid=18696): Terminated {rc=256} 18:44:47.149856 --- ParallelTerminationStrategy: PID 18699 died... 18:44:47.170899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18699): Terminated: ok {rc=0} 18:44:47.219644 --- ParallelTerminationStrategy: PID 18702 died... 18:44:47.240518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18702): Terminated: ok {rc=0} 18:44:47.287592 --- ParallelTerminationStrategy: PID 18705 died... 18:44:47.308163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18705): Terminated: ok {rc=0} 18:44:47.397531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo iperf3m4.py ---------------------------------------------- 18:44:48.547419 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:48.559197 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:44:48.595757 tst iperf3m4.py: using LAC 35530 18:44:48.714477 tst iperf3m4.py: using RAC 85 18:44:48.834372 tst iperf3m4.py: using CellId 35530 18:44:48.953047 tst iperf3m4.py: using BVCI 35531 18:44:49.063292 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.073990 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.084586 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.095196 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.105649 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.116434 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.127108 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.138037 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:44:49.148853 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:49.269555 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:49.388033 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:49.505869 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:44:49.622957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:44:49.825721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:50.129249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Launched 18:44:50.391963 run iperf3-srv_10.42.42.10(pid=18708): Launched 18:44:50.505608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:44:50.707910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:51.010880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Launched 18:44:51.273628 run iperf3-srv_10.42.42.10(pid=18710): Launched 18:44:51.386370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:44:51.587864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:51.889309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Launched 18:44:52.151988 run iperf3-srv_10.42.42.10(pid=18712): Launched 18:44:52.264890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:44:52.465923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:44:52.768078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18713): Launched 18:44:53.045245 run iperf3-srv_10.42.42.10(pid=18714): Launched 18:44:53.167492 tst iperf3m4.py:8: start network... 18:44:53.386552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:53.889005 run create_hlr_db(pid=18715): Launched 18:44:54.012296 bus /gobi_6: Setting Powered False 18:44:55.076725 run create_hlr_db(pid=18715): Terminated: ok {rc=0} 18:44:55.507757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18717): Launched 18:44:55.809597 run osmo-hlr_10.42.42.2(pid=18718): Launched 18:44:55.923147 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:56.454843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18720): Launched 18:44:56.758975 run osmo-stp_10.42.42.5(pid=18721): Launched 18:44:56.874075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:44:57.397339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18723): Launched 18:44:57.513716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:44:57.772165 run patchelf(pid=18724): Launched 18:44:57.941489 run osmo-stp_10.42.42.5(pid=18721): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18721)] 18:44:58.070769 run osmo-stp_10.42.42.5(pid=18721): stdout: | (launched: 2022-12-13_18:44:56.702746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:58.201228 run osmo-stp_10.42.42.5(pid=18721): stderr: | 20221213184456875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184456876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184456876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184456876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184456877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184456877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184456877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:58.331904 run osmo-stp_10.42.42.5(pid=18721): stdout: | (launched: 2022-12-13_18:44:56.702746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:58.456781 run osmo-stp_10.42.42.5(pid=18721): stderr: | 20221213184456875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184456876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184456876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184456876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184456877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184456877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184456877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:58.605072 run patchelf(pid=18724): Terminating (SIGINT) 18:44:58.774965 run patchelf(pid=18724): Terminated: ok {rc=0} 18:44:58.897553 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18721): Process ended prematurely: osmo-stp_10.42.42.5(pid=18721) [trial-2393↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18721)] [trial-2393↪gprs:sysmo↪iperf3m4.py:8] 18:44:58.906978 tst iperf3m4.py:8: Test FAILED (10.4 sec) 18:44:58.934322 run osmo-hlr_10.42.42.2(pid=18718): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18718)] 18:44:58.982050 run osmo-hlr_10.42.42.2(pid=18718): stdout: | (launched: 2022-12-13_18:44:55.754074) 18:44:59.031526 run osmo-hlr_10.42.42.2(pid=18718): stderr: | 20221213184455931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184455931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184455931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184455931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184455931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184455931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184455944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184455955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184455955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184455955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:59.081545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Terminating (SIGTERM) 18:44:59.121578 run iperf3-srv_10.42.42.10(pid=18708): Terminating (SIGTERM) 18:44:59.161339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Terminating (SIGTERM) 18:44:59.201571 run iperf3-srv_10.42.42.10(pid=18710): Terminating (SIGTERM) 18:44:59.241115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Terminating (SIGTERM) 18:44:59.280789 run iperf3-srv_10.42.42.10(pid=18712): Terminating (SIGTERM) 18:44:59.320562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18713): Terminating (SIGTERM) 18:44:59.360381 run iperf3-srv_10.42.42.10(pid=18714): Terminating (SIGTERM) 18:44:59.400008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18717): Terminating (SIGTERM) 18:44:59.439973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18720): Terminating (SIGTERM) 18:44:59.479762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18723): Terminating (SIGTERM) 18:44:59.519769 --- ParallelTerminationStrategy: PID 18707 died... 18:44:59.539217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18707): Terminated: ok {rc=0} 18:44:59.583354 --- ParallelTerminationStrategy: PID 18708 died... 18:44:59.602180 run iperf3-srv_10.42.42.10(pid=18708): Terminated {rc=256} 18:44:59.645912 --- ParallelTerminationStrategy: PID 18709 died... 18:44:59.664661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18709): Terminated: ok {rc=0} 18:44:59.708429 --- ParallelTerminationStrategy: PID 18710 died... 18:44:59.727083 run iperf3-srv_10.42.42.10(pid=18710): Terminated {rc=256} 18:44:59.771005 --- ParallelTerminationStrategy: PID 18711 died... 18:44:59.789778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18711): Terminated: ok {rc=0} 18:44:59.833778 --- ParallelTerminationStrategy: PID 18712 died... 18:44:59.852487 run iperf3-srv_10.42.42.10(pid=18712): Terminated {rc=256} 18:44:59.896623 --- ParallelTerminationStrategy: PID 18713 died... 18:44:59.915474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18713): Terminated: ok {rc=0} 18:44:59.959236 --- ParallelTerminationStrategy: PID 18714 died... 18:44:59.977772 run iperf3-srv_10.42.42.10(pid=18714): Terminated {rc=256} 18:45:00.021454 --- ParallelTerminationStrategy: PID 18717 died... 18:45:00.040233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18717): Terminated: ok {rc=0} 18:45:00.083929 --- ParallelTerminationStrategy: PID 18720 died... 18:45:00.102706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18720): Terminated: ok {rc=0} 18:45:00.146450 --- ParallelTerminationStrategy: PID 18723 died... 18:45:00.165344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18723): Terminated: ok {rc=0} 18:45:00.251773 bus /gobi_4: Setting Powered False 18:45:01.352501 bus /gobi_4: Setting Powered False 18:45:02.469783 bus /gobi_1: Setting Powered False 18:45:03.568068 bus /gobi_1: Setting Powered False 18:45:04.683335 bus /gobi_0: Setting Powered False 18:45:05.787618 bus /gobi_0: Setting Powered False 18:45:06.903625 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo ping.py ---------------------------------------------- 18:45:08.007410 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.018835 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:45:08.056908 tst ping.py: using LAC 35531 18:45:08.185356 tst ping.py: using RAC 86 18:45:08.311587 tst ping.py: using CellId 35531 18:45:08.437530 tst ping.py: using BVCI 35532 18:45:08.554716 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.565936 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.576933 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.587938 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.599040 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.610197 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.621548 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:08.632754 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:45:08.749256 tst ping.py:19: start network... 18:45:08.949814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:09.415589 run create_hlr_db(pid=18728): Launched 18:45:09.538341 bus /gobi_6: Setting Powered False 18:45:10.598142 run create_hlr_db(pid=18728): Terminated: ok {rc=0} 18:45:11.037371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18730): Launched 18:45:11.361623 run osmo-hlr_10.42.42.2(pid=18731): Launched 18:45:11.483731 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:12.002893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18733): Launched 18:45:12.300784 run osmo-stp_10.42.42.5(pid=18734): Launched 18:45:12.413905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:12.927745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18736): Launched 18:45:13.041717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:13.294996 run patchelf(pid=18737): Launched 18:45:13.461232 run osmo-stp_10.42.42.5(pid=18734): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18734)] 18:45:13.588165 run osmo-stp_10.42.42.5(pid=18734): stdout: | (launched: 2022-12-13_18:45:12.245702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:13.716402 run osmo-stp_10.42.42.5(pid=18734): stderr: | 20221213184512415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184512415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184512415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184512416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184512416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184512416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184512416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:13.845215 run osmo-stp_10.42.42.5(pid=18734): stdout: | (launched: 2022-12-13_18:45:12.245702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:13.968203 run osmo-stp_10.42.42.5(pid=18734): stderr: | 20221213184512415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184512415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184512415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184512416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184512416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184512416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184512416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:14.113831 run patchelf(pid=18737): Terminating (SIGINT) 18:45:14.281268 run patchelf(pid=18737): Terminated: ok {rc=0} 18:45:14.401720 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18734): Process ended prematurely: osmo-stp_10.42.42.5(pid=18734) [trial-2393↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18734)] [trial-2393↪gprs:sysmo↪ping.py:22] 18:45:14.410583 tst ping.py:22: Test FAILED (6.4 sec) 18:45:14.437235 run osmo-hlr_10.42.42.2(pid=18731): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18731)] 18:45:14.484941 run osmo-hlr_10.42.42.2(pid=18731): stdout: | (launched: 2022-12-13_18:45:11.302470) 18:45:14.534297 run osmo-hlr_10.42.42.2(pid=18731): stderr: | 20221213184511499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184511499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184511499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184511499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184511499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184511499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184511511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184511519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184511520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184511520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:14.584310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18730): Terminating (SIGTERM) 18:45:14.623950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18733): Terminating (SIGTERM) 18:45:14.663633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18736): Terminating (SIGTERM) 18:45:14.703490 --- ParallelTerminationStrategy: PID 18730 died... 18:45:14.722306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18730): Terminated: ok {rc=0} 18:45:14.766567 --- ParallelTerminationStrategy: PID 18733 died... 18:45:14.785492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18733): Terminated: ok {rc=0} 18:45:14.830005 --- ParallelTerminationStrategy: PID 18736 died... 18:45:14.848929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18736): Terminated: ok {rc=0} 18:45:14.935212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 18:45:16.022675 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.035112 tst gprs:sysmo: Using 1 x bts (candidates: 1) 18:45:16.073282 tst ping_idle_ping.py: using LAC 35532 18:45:16.235145 tst ping_idle_ping.py: using RAC 87 18:45:16.369238 tst ping_idle_ping.py: using CellId 35532 18:45:16.491315 tst ping_idle_ping.py: using BVCI 35533 18:45:16.603858 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.615695 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.627438 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.639197 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.651402 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.663599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.676023 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 18:45:16.688396 tst gprs:sysmo: Using 1 x modem (candidates: 4) 18:45:16.813218 tst ping_idle_ping.py:24: start network... 18:45:17.019798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:17.490678 run create_hlr_db(pid=18738): Launched 18:45:17.615245 bus /gobi_6: Setting Powered False 18:45:18.675664 run create_hlr_db(pid=18738): Terminated: ok {rc=0} 18:45:19.093502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18740): Launched 18:45:19.392539 run osmo-hlr_10.42.42.2(pid=18741): Launched 18:45:19.506164 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:20.025212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18743): Launched 18:45:20.325360 run osmo-stp_10.42.42.5(pid=18744): Launched 18:45:20.439324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:20.958683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18746): Launched 18:45:21.073740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:21.327465 run patchelf(pid=18747): Launched 18:45:21.493538 run osmo-stp_10.42.42.5(pid=18744): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18744)] 18:45:21.620510 run osmo-stp_10.42.42.5(pid=18744): stdout: | (launched: 2022-12-13_18:45:20.269581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:21.749541 run osmo-stp_10.42.42.5(pid=18744): stderr: | 20221213184520440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184520440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184520440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184520441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184520441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184520441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184520441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:21.879184 run osmo-stp_10.42.42.5(pid=18744): stdout: | (launched: 2022-12-13_18:45:20.269581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:22.002549 run osmo-stp_10.42.42.5(pid=18744): stderr: | 20221213184520440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184520440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184520440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184520441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184520441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184520441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184520441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:22.148786 run patchelf(pid=18747): Terminating (SIGINT) 18:45:22.317224 run patchelf(pid=18747): Terminated: ok {rc=0} 18:45:22.438465 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18744): Process ended prematurely: osmo-stp_10.42.42.5(pid=18744) [trial-2393↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18744)] [trial-2393↪gprs:sysmo↪ping_idle_ping.py:27] 18:45:22.447108 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:45:22.473615 run osmo-hlr_10.42.42.2(pid=18741): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18741)] 18:45:22.521577 run osmo-hlr_10.42.42.2(pid=18741): stdout: | (launched: 2022-12-13_18:45:19.337603) 18:45:22.570756 run osmo-hlr_10.42.42.2(pid=18741): stderr: | 20221213184519511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184519511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184519511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184519511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184519511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184519511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184519525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184519534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184519534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184519534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:22.620369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18740): Terminating (SIGTERM) 18:45:22.660077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18743): Terminating (SIGTERM) 18:45:22.699672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18746): Terminating (SIGTERM) 18:45:22.739694 --- ParallelTerminationStrategy: PID 18740 died... 18:45:22.758960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18740): Terminated: ok {rc=0} 18:45:22.803136 --- ParallelTerminationStrategy: PID 18743 died... 18:45:22.822178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18743): Terminated: ok {rc=0} 18:45:22.866682 --- ParallelTerminationStrategy: PID 18746 died... 18:45:22.885569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18746): Terminated: ok {rc=0} 18:45:22.968659 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 18:45:24.260782 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:45:24.267079 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:45:24.288915 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:45:24.330187 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:45:24.418802 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:45:24.440412 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:45:24.480759 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:45:25.077715 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:45:25.130896 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.142269 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:45:25.178333 tst cs_paging_gprs_active.py: using LAC 35533 18:45:25.308609 tst cs_paging_gprs_active.py: using RAC 88 18:45:25.435282 tst cs_paging_gprs_active.py: using CellId 35533 18:45:25.561966 tst cs_paging_gprs_active.py: using BVCI 35534 18:45:25.681736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.693233 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.704321 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.715559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.726884 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.738282 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.749878 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.761258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:25.772886 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:25.891779 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:26.009091 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:45:26.216727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:26.525672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Launched 18:45:26.792531 run iperf3-srv_10.42.42.10(pid=18753): Launched 18:45:26.907540 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:45:27.113928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:27.421804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Launched 18:45:27.688251 run iperf3-srv_10.42.42.10(pid=18755): Launched 18:45:27.803460 tst cs_paging_gprs_active.py:38: start network... 18:45:28.010427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:28.485265 run create_hlr_db(pid=18756): Launched 18:45:28.611163 bus /gobi_6: Setting Powered False 18:45:29.671517 run create_hlr_db(pid=18756): Terminated: ok {rc=0} 18:45:30.119897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18759): Launched 18:45:30.450019 run osmo-hlr_10.42.42.2(pid=18760): Launched 18:45:30.577814 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:31.154858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18762): Launched 18:45:31.477687 run osmo-stp_10.42.42.5(pid=18763): Launched 18:45:31.645713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:32.397892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18765): Launched 18:45:32.525433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:32.783764 run patchelf(pid=18766): Launched 18:45:32.954125 run osmo-stp_10.42.42.5(pid=18763): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18763)] 18:45:33.083522 run osmo-stp_10.42.42.5(pid=18763): stdout: | (launched: 2022-12-13_18:45:31.417392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:33.214662 run osmo-stp_10.42.42.5(pid=18763): stderr: | 20221213184531808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184531808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184531808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184531809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184531809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184531809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184531809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:33.345787 run osmo-stp_10.42.42.5(pid=18763): stdout: | (launched: 2022-12-13_18:45:31.417392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:33.470826 run osmo-stp_10.42.42.5(pid=18763): stderr: | 20221213184531808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184531808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184531808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184531809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184531809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184531809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184531809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:33.619022 run patchelf(pid=18766): Terminating (SIGINT) 18:45:33.789897 run patchelf(pid=18766): Terminated: ok {rc=0} 18:45:33.913669 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18763): Process ended prematurely: osmo-stp_10.42.42.5(pid=18763) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18763)] [trial-2393↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:45:33.923260 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:45:33.950605 run osmo-hlr_10.42.42.2(pid=18760): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18760)] 18:45:33.998912 run osmo-hlr_10.42.42.2(pid=18760): stdout: | (launched: 2022-12-13_18:45:30.390249) 18:45:34.049114 run osmo-hlr_10.42.42.2(pid=18760): stderr: | 20221213184530587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184530587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184530587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184530587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184530587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184530587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184530600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184530609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184530609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184530609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:34.099440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Terminating (SIGTERM) 18:45:34.139934 run iperf3-srv_10.42.42.10(pid=18753): Terminating (SIGTERM) 18:45:34.180114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Terminating (SIGTERM) 18:45:34.220380 run iperf3-srv_10.42.42.10(pid=18755): Terminating (SIGTERM) 18:45:34.260462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18759): Terminating (SIGTERM) 18:45:34.300888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18762): Terminating (SIGTERM) 18:45:34.341176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18765): Terminating (SIGTERM) 18:45:34.381840 --- ParallelTerminationStrategy: PID 18752 died... 18:45:34.401371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18752): Terminated: ok {rc=0} 18:45:34.446023 --- ParallelTerminationStrategy: PID 18753 died... 18:45:34.464789 run iperf3-srv_10.42.42.10(pid=18753): Terminated {rc=256} 18:45:34.509076 --- ParallelTerminationStrategy: PID 18754 died... 18:45:34.528054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18754): Terminated: ok {rc=0} 18:45:34.572125 --- ParallelTerminationStrategy: PID 18755 died... 18:45:34.590851 run iperf3-srv_10.42.42.10(pid=18755): Terminated {rc=256} 18:45:34.634834 --- ParallelTerminationStrategy: PID 18759 died... 18:45:34.653662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18759): Terminated: ok {rc=0} 18:45:34.697841 --- ParallelTerminationStrategy: PID 18762 died... 18:45:34.716668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18762): Terminated: ok {rc=0} 18:45:34.760915 --- ParallelTerminationStrategy: PID 18765 died... 18:45:34.780146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18765): Terminated: ok {rc=0} 18:45:34.866793 bus /gobi_0: Setting Powered False 18:45:35.968851 bus /gobi_0: Setting Powered False 18:45:37.085758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:45:38.237804 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.250115 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:45:38.289783 tst iperf3.py: using LAC 35534 18:45:38.409731 tst iperf3.py: using RAC 89 18:45:38.531056 tst iperf3.py: using CellId 35534 18:45:38.651285 tst iperf3.py: using BVCI 35535 18:45:38.763234 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.774111 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.784771 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.795439 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.806086 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.817129 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.828022 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.838618 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:38.849515 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:38.971031 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:39.193394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:39.523091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18767): Launched 18:45:39.810190 run iperf3-srv_10.42.42.10(pid=18768): Launched 18:45:39.935262 tst iperf3.py:8: start network... 18:45:40.157225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:40.666464 run create_hlr_db(pid=18769): Launched 18:45:40.793578 bus /gobi_6: Setting Powered False 18:45:41.858266 run create_hlr_db(pid=18769): Terminated: ok {rc=0} 18:45:42.295431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18771): Launched 18:45:42.600773 run osmo-hlr_10.42.42.2(pid=18772): Launched 18:45:42.718112 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:43.242523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18774): Launched 18:45:43.549209 run osmo-stp_10.42.42.5(pid=18775): Launched 18:45:43.666834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:44.192833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18777): Launched 18:45:44.309430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:44.567290 run patchelf(pid=18778): Launched 18:45:44.736283 run osmo-stp_10.42.42.5(pid=18775): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18775)] 18:45:44.865178 run osmo-stp_10.42.42.5(pid=18775): stdout: | (launched: 2022-12-13_18:45:43.493236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:44.995509 run osmo-stp_10.42.42.5(pid=18775): stderr: | 20221213184543664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184543665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184543665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184543665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184543666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184543666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184543666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:45.126254 run osmo-stp_10.42.42.5(pid=18775): stdout: | (launched: 2022-12-13_18:45:43.493236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:45.251627 run osmo-stp_10.42.42.5(pid=18775): stderr: | 20221213184543664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184543665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184543665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184543665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184543666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184543666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184543666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:45.400163 run patchelf(pid=18778): Terminating (SIGINT) 18:45:45.570949 run patchelf(pid=18778): Terminated: ok {rc=0} 18:45:45.694246 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18775): Process ended prematurely: osmo-stp_10.42.42.5(pid=18775) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18775)] [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 18:45:45.703569 tst iperf3.py:8: Test FAILED (7.5 sec) 18:45:45.730642 run osmo-hlr_10.42.42.2(pid=18772): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18772)] 18:45:45.778851 run osmo-hlr_10.42.42.2(pid=18772): stdout: | (launched: 2022-12-13_18:45:42.544569) 18:45:45.828341 run osmo-hlr_10.42.42.2(pid=18772): stderr: | 20221213184542721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184542721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184542721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184542721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184542721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184542722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184542756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184542766 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184542766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184542766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:45.883880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18767): Terminating (SIGTERM) 18:45:45.941701 run iperf3-srv_10.42.42.10(pid=18768): Terminating (SIGTERM) 18:45:45.985667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18771): Terminating (SIGTERM) 18:45:46.027536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18774): Terminating (SIGTERM) 18:45:46.077749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18777): Terminating (SIGTERM) 18:45:46.127584 --- ParallelTerminationStrategy: PID 18767 died... 18:45:46.150818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18767): Terminated: ok {rc=0} 18:45:46.205836 --- ParallelTerminationStrategy: PID 18768 died... 18:45:46.229497 run iperf3-srv_10.42.42.10(pid=18768): Terminated {rc=256} 18:45:46.283972 --- ParallelTerminationStrategy: PID 18771 died... 18:45:46.307687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18771): Terminated: ok {rc=0} 18:45:46.363607 --- ParallelTerminationStrategy: PID 18774 died... 18:45:46.387355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18774): Terminated: ok {rc=0} 18:45:46.442756 --- ParallelTerminationStrategy: PID 18777 died... 18:45:46.464461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18777): Terminated: ok {rc=0} 18:45:46.567992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:45:47.721909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:47.733468 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:45:47.771737 tst iperf3m4.py: using LAC 35535 18:45:47.891536 tst iperf3m4.py: using RAC 90 18:45:48.012670 tst iperf3m4.py: using CellId 35535 18:45:48.143330 tst iperf3m4.py: using BVCI 35536 18:45:48.262898 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.274293 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.285628 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.296732 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.308210 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.319570 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.331290 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.342610 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:45:48.354396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:48.472540 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:48.593533 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:48.709739 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:45:48.826685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:49.031828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:49.341382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18779): Launched 18:45:49.608788 run iperf3-srv_10.42.42.10(pid=18780): Launched 18:45:49.723294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:45:49.927550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:50.235949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Launched 18:45:50.502541 run iperf3-srv_10.42.42.10(pid=18782): Launched 18:45:50.617288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:45:50.821252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:51.129217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Launched 18:45:51.394862 run iperf3-srv_10.42.42.10(pid=18784): Launched 18:45:51.509447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:45:51.713731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:52.036814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18788): Launched 18:45:52.323595 run iperf3-srv_10.42.42.10(pid=18789): Launched 18:45:52.449285 tst iperf3m4.py:8: start network... 18:45:52.671200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:53.180148 run create_hlr_db(pid=18790): Launched 18:45:53.305406 bus /gobi_6: Setting Powered False 18:45:54.370315 run create_hlr_db(pid=18790): Terminated: ok {rc=0} 18:45:54.807081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18792): Launched 18:45:55.111856 run osmo-hlr_10.42.42.2(pid=18793): Launched 18:45:55.227367 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:55.751476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18795): Launched 18:45:56.057402 run osmo-stp_10.42.42.5(pid=18796): Launched 18:45:56.174682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:56.702988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18798): Launched 18:45:56.819350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:57.076656 run patchelf(pid=18799): Launched 18:45:57.245253 run osmo-stp_10.42.42.5(pid=18796): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18796)] 18:45:57.373803 run osmo-stp_10.42.42.5(pid=18796): stdout: | (launched: 2022-12-13_18:45:56.001252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:57.503485 run osmo-stp_10.42.42.5(pid=18796): stderr: | 20221213184556168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184556168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184556168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184556169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184556169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184556169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184556169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:57.633215 run osmo-stp_10.42.42.5(pid=18796): stdout: | (launched: 2022-12-13_18:45:56.001252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:57.757832 run osmo-stp_10.42.42.5(pid=18796): stderr: | 20221213184556168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184556168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184556168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184556169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184556169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184556169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184556169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:57.905412 run patchelf(pid=18799): Terminating (SIGINT) 18:45:58.075493 run patchelf(pid=18799): Terminated: ok {rc=0} 18:45:58.198878 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18796): Process ended prematurely: osmo-stp_10.42.42.5(pid=18796) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18796)] [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 18:45:58.208235 tst iperf3m4.py:8: Test FAILED (10.5 sec) 18:45:58.235520 run osmo-hlr_10.42.42.2(pid=18793): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18793)] 18:45:58.283946 run osmo-hlr_10.42.42.2(pid=18793): stdout: | (launched: 2022-12-13_18:45:55.055871) 18:45:58.333425 run osmo-hlr_10.42.42.2(pid=18793): stderr: | 20221213184555231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184555231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184555231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184555231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184555231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184555231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184555243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184555255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184555255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184555255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:58.383551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18779): Terminating (SIGTERM) 18:45:58.423151 run iperf3-srv_10.42.42.10(pid=18780): Terminating (SIGTERM) 18:45:58.462603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminating (SIGTERM) 18:45:58.502169 run iperf3-srv_10.42.42.10(pid=18782): Terminating (SIGTERM) 18:45:58.541516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminating (SIGTERM) 18:45:58.581059 run iperf3-srv_10.42.42.10(pid=18784): Terminating (SIGTERM) 18:45:58.620395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18788): Terminating (SIGTERM) 18:45:58.659847 run iperf3-srv_10.42.42.10(pid=18789): Terminating (SIGTERM) 18:45:58.699098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18792): Terminating (SIGTERM) 18:45:58.738628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18795): Terminating (SIGTERM) 18:45:58.778170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18798): Terminating (SIGTERM) 18:45:58.818149 --- ParallelTerminationStrategy: PID 18779 died... 18:45:58.837369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18779): Terminated: ok {rc=0} 18:45:58.881587 --- ParallelTerminationStrategy: PID 18780 died... 18:45:58.900149 run iperf3-srv_10.42.42.10(pid=18780): Terminated {rc=256} 18:45:58.944185 --- ParallelTerminationStrategy: PID 18781 died... 18:45:58.962890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18781): Terminated: ok {rc=0} 18:45:59.006920 --- ParallelTerminationStrategy: PID 18782 died... 18:45:59.025677 run iperf3-srv_10.42.42.10(pid=18782): Terminated {rc=256} 18:45:59.069481 --- ParallelTerminationStrategy: PID 18783 died... 18:45:59.088157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18783): Terminated: ok {rc=0} 18:45:59.132490 --- ParallelTerminationStrategy: PID 18784 died... 18:45:59.151315 run iperf3-srv_10.42.42.10(pid=18784): Terminated {rc=256} 18:45:59.195182 --- ParallelTerminationStrategy: PID 18788 died... 18:45:59.213919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18788): Terminated: ok {rc=0} 18:45:59.258069 --- ParallelTerminationStrategy: PID 18789 died... 18:45:59.277012 run iperf3-srv_10.42.42.10(pid=18789): Terminated {rc=256} 18:45:59.320918 --- ParallelTerminationStrategy: PID 18792 died... 18:45:59.339562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18792): Terminated: ok {rc=0} 18:45:59.383436 --- ParallelTerminationStrategy: PID 18795 died... 18:45:59.402301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18795): Terminated: ok {rc=0} 18:45:59.446211 --- ParallelTerminationStrategy: PID 18798 died... 18:45:59.465103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18798): Terminated: ok {rc=0} 18:45:59.551511 bus /gobi_4: Setting Powered False 18:46:00.652402 bus /gobi_4: Setting Powered False 18:46:01.766091 bus /gobi_1: Setting Powered False 18:46:02.864056 bus /gobi_1: Setting Powered False 18:46:03.980232 bus /gobi_0: Setting Powered False 18:46:05.080170 bus /gobi_0: Setting Powered False 18:46:06.196738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 18:46:07.298430 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.309910 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:07.346966 tst ping.py: using LAC 35536 18:46:07.473944 tst ping.py: using RAC 91 18:46:07.599856 tst ping.py: using CellId 35536 18:46:07.726568 tst ping.py: using BVCI 35537 18:46:07.844775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.856331 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.867794 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.879034 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.890438 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.902018 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.913831 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:07.925613 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:08.042759 tst ping.py:19: start network... 18:46:08.244635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:08.711227 run create_hlr_db(pid=18800): Launched 18:46:08.834111 bus /gobi_6: Setting Powered False 18:46:09.894491 run create_hlr_db(pid=18800): Terminated: ok {rc=0} 18:46:10.335531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18802): Launched 18:46:10.658163 run osmo-hlr_10.42.42.2(pid=18803): Launched 18:46:10.781213 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:11.338056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18805): Launched 18:46:11.660816 run osmo-stp_10.42.42.5(pid=18806): Launched 18:46:11.785787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:12.344325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18808): Launched 18:46:12.467575 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:12.739130 run patchelf(pid=18809): Launched 18:46:12.920295 run osmo-stp_10.42.42.5(pid=18806): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18806)] 18:46:13.057453 run osmo-stp_10.42.42.5(pid=18806): stdout: | (launched: 2022-12-13_18:46:11.601984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:13.195452 run osmo-stp_10.42.42.5(pid=18806): stderr: | 20221213184611790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184611791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184611791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184611791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184611792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184611792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184611792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:13.334630 run osmo-stp_10.42.42.5(pid=18806): stdout: | (launched: 2022-12-13_18:46:11.601984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:13.467450 run osmo-stp_10.42.42.5(pid=18806): stderr: | 20221213184611790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184611791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184611791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184611791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184611792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184611792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184611792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:13.624514 run patchelf(pid=18809): Terminating (SIGINT) 18:46:13.804270 run patchelf(pid=18809): Terminated: ok {rc=0} 18:46:13.934070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18806): Process ended prematurely: osmo-stp_10.42.42.5(pid=18806) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18806)] [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 18:46:13.943885 tst ping.py:22: Test FAILED (6.6 sec) 18:46:13.972170 run osmo-hlr_10.42.42.2(pid=18803): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18803)] 18:46:14.023019 run osmo-hlr_10.42.42.2(pid=18803): stdout: | (launched: 2022-12-13_18:46:10.599303) 18:46:14.075854 run osmo-hlr_10.42.42.2(pid=18803): stderr: | 20221213184610795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184610795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184610795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184610795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184610795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184610795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184610807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184610816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184610816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184610816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:14.128560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18802): Terminating (SIGTERM) 18:46:14.170640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18805): Terminating (SIGTERM) 18:46:14.213344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18808): Terminating (SIGTERM) 18:46:14.255904 --- ParallelTerminationStrategy: PID 18802 died... 18:46:14.276755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18802): Terminated: ok {rc=0} 18:46:14.323805 --- ParallelTerminationStrategy: PID 18805 died... 18:46:14.343846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18805): Terminated: ok {rc=0} 18:46:14.390447 --- ParallelTerminationStrategy: PID 18808 died... 18:46:14.410628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18808): Terminated: ok {rc=0} 18:46:14.498764 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:46:15.587025 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:15.599326 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:15.639162 tst ping_idle_ping.py: using LAC 35537 18:46:15.766421 tst ping_idle_ping.py: using RAC 92 18:46:15.898007 tst ping_idle_ping.py: using CellId 35537 18:46:16.039872 tst ping_idle_ping.py: using BVCI 35538 18:46:16.162157 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.174524 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.186836 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.199117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.212303 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.225499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.238841 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:16.251907 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:16.407071 tst ping_idle_ping.py:24: start network... 18:46:16.615027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:17.094631 run create_hlr_db(pid=18810): Launched 18:46:17.249154 bus /gobi_6: Setting Powered False 18:46:18.309207 run create_hlr_db(pid=18810): Terminated: ok {rc=0} 18:46:18.728085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Launched 18:46:19.028192 run osmo-hlr_10.42.42.2(pid=18813): Launched 18:46:19.142221 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:19.674950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Launched 18:46:19.973978 run osmo-stp_10.42.42.5(pid=18816): Launched 18:46:20.088916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:20.609179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Launched 18:46:20.724050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:20.978095 run patchelf(pid=18819): Launched 18:46:21.144787 run osmo-stp_10.42.42.5(pid=18816): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] 18:46:21.271791 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-13_18:46:19.919028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:21.400112 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221213184620088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184620088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184620088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184620089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184620089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184620089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184620089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:21.528347 run osmo-stp_10.42.42.5(pid=18816): stdout: | (launched: 2022-12-13_18:46:19.919028) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:21.651345 run osmo-stp_10.42.42.5(pid=18816): stderr: | 20221213184620088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184620088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184620088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184620089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184620089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184620089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184620089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:21.796848 run patchelf(pid=18819): Terminating (SIGINT) 18:46:21.965627 run patchelf(pid=18819): Terminated: ok {rc=0} 18:46:22.086830 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 18:46:22.095771 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:46:22.122306 run osmo-hlr_10.42.42.2(pid=18813): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18813)] 18:46:22.170288 run osmo-hlr_10.42.42.2(pid=18813): stdout: | (launched: 2022-12-13_18:46:18.972934) 18:46:22.219565 run osmo-hlr_10.42.42.2(pid=18813): stderr: | 20221213184619150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184619150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184619150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184619150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184619150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184619150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184619162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184619171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184619171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184619171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:22.270040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminating (SIGTERM) 18:46:22.310499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminating (SIGTERM) 18:46:22.350270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Terminating (SIGTERM) 18:46:22.390399 --- ParallelTerminationStrategy: PID 18812 died... 18:46:22.409825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18812): Terminated: ok {rc=0} 18:46:22.454261 --- ParallelTerminationStrategy: PID 18815 died... 18:46:22.473165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18815): Terminated: ok {rc=0} 18:46:22.518408 --- ParallelTerminationStrategy: PID 18818 died... 18:46:22.537394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18818): Terminated: ok {rc=0} 18:46:22.621518 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:46:23.901918 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:46:23.907937 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:46:23.928688 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:46:23.968700 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:46:24.058506 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:46:24.080842 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:46:24.122045 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:46:24.709511 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:46:24.759242 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:24.770236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:46:24.827393 tst cs_paging_gprs_active.py: using LAC 35538 18:46:24.949331 tst cs_paging_gprs_active.py: using RAC 93 18:46:25.070179 tst cs_paging_gprs_active.py: using CellId 35538 18:46:25.192230 tst cs_paging_gprs_active.py: using BVCI 35539 18:46:25.304542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.315611 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.326429 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.337109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.348273 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.359544 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.370959 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.382083 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:25.393473 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:25.508242 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:25.623533 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:46:25.829097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:26.135177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18824): Launched 18:46:26.401302 run iperf3-srv_10.42.42.10(pid=18825): Launched 18:46:26.515331 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:46:26.720254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:27.026835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18826): Launched 18:46:27.294475 run iperf3-srv_10.42.42.10(pid=18827): Launched 18:46:27.408602 tst cs_paging_gprs_active.py:38: start network... 18:46:27.613633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:28.087078 run create_hlr_db(pid=18828): Launched 18:46:28.212017 bus /gobi_6: Setting Powered False 18:46:29.273665 run create_hlr_db(pid=18828): Terminated: ok {rc=0} 18:46:29.699895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18830): Launched 18:46:30.006579 run osmo-hlr_10.42.42.2(pid=18831): Launched 18:46:30.125075 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:30.651879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18833): Launched 18:46:30.967009 run osmo-stp_10.42.42.5(pid=18834): Launched 18:46:31.433497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:31.985711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18836): Launched 18:46:32.118314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:32.382274 run patchelf(pid=18837): Launched 18:46:32.567544 run osmo-stp_10.42.42.5(pid=18834): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18834)] 18:46:32.707128 run osmo-stp_10.42.42.5(pid=18834): stdout: | (launched: 2022-12-13_18:46:30.910148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:32.848225 run osmo-stp_10.42.42.5(pid=18834): stderr: | 20221213184631175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184631175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184631177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184631178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184631179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184631179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184631179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:32.989517 run osmo-stp_10.42.42.5(pid=18834): stdout: | (launched: 2022-12-13_18:46:30.910148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:33.124484 run osmo-stp_10.42.42.5(pid=18834): stderr: | 20221213184631175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184631175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184631177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184631178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184631179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184631179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184631179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:33.285296 run patchelf(pid=18837): Terminating (SIGINT) 18:46:33.470021 run patchelf(pid=18837): Terminated: ok {rc=0} 18:46:33.602942 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18834): Process ended prematurely: osmo-stp_10.42.42.5(pid=18834) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18834)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:46:33.613180 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:46:33.642137 run osmo-hlr_10.42.42.2(pid=18831): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18831)] 18:46:33.694776 run osmo-hlr_10.42.42.2(pid=18831): stdout: | (launched: 2022-12-13_18:46:29.950389) 18:46:33.748560 run osmo-hlr_10.42.42.2(pid=18831): stderr: | 20221213184630127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184630127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184630127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184630127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184630127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184630127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184630139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184630149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184630149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184630149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:33.802296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18824): Terminating (SIGTERM) 18:46:33.844594 run iperf3-srv_10.42.42.10(pid=18825): Terminating (SIGTERM) 18:46:33.887488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18826): Terminating (SIGTERM) 18:46:33.930611 run iperf3-srv_10.42.42.10(pid=18827): Terminating (SIGTERM) 18:46:33.973713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18830): Terminating (SIGTERM) 18:46:34.016789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18833): Terminating (SIGTERM) 18:46:34.059905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18836): Terminating (SIGTERM) 18:46:34.102663 --- ParallelTerminationStrategy: PID 18824 died... 18:46:34.123124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18824): Terminated: ok {rc=0} 18:46:34.170298 --- ParallelTerminationStrategy: PID 18825 died... 18:46:34.190316 run iperf3-srv_10.42.42.10(pid=18825): Terminated {rc=256} 18:46:34.237185 --- ParallelTerminationStrategy: PID 18826 died... 18:46:34.257208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18826): Terminated: ok {rc=0} 18:46:34.304297 --- ParallelTerminationStrategy: PID 18827 died... 18:46:34.324307 run iperf3-srv_10.42.42.10(pid=18827): Terminated {rc=256} 18:46:34.371067 --- ParallelTerminationStrategy: PID 18830 died... 18:46:34.391227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18830): Terminated: ok {rc=0} 18:46:34.437991 --- ParallelTerminationStrategy: PID 18833 died... 18:46:34.457934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18833): Terminated: ok {rc=0} 18:46:34.504449 --- ParallelTerminationStrategy: PID 18836 died... 18:46:34.524459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18836): Terminated: ok {rc=0} 18:46:34.613183 bus /gobi_0: Setting Powered False 18:46:35.711746 bus /gobi_0: Setting Powered False 18:46:36.828251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:46:37.972331 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:37.984339 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:46:38.051166 tst iperf3.py: using LAC 35539 18:46:38.196298 tst iperf3.py: using RAC 94 18:46:38.327415 tst iperf3.py: using CellId 35539 18:46:38.459348 tst iperf3.py: using BVCI 35540 18:46:38.579841 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.591352 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.602608 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.613881 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.625298 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.636840 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.648581 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.659991 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:38.671666 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:38.787433 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:38.992933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:39.300199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18843): Launched 18:46:39.567056 run iperf3-srv_10.42.42.10(pid=18844): Launched 18:46:39.681766 tst iperf3.py:8: start network... 18:46:39.886864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:40.359670 run create_hlr_db(pid=18845): Launched 18:46:40.485204 bus /gobi_6: Setting Powered False 18:46:41.546246 run create_hlr_db(pid=18845): Terminated: ok {rc=0} 18:46:41.993756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18847): Launched 18:46:42.324691 run osmo-hlr_10.42.42.2(pid=18848): Launched 18:46:42.450586 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:43.015546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18850): Launched 18:46:43.346289 run osmo-stp_10.42.42.5(pid=18851): Launched 18:46:43.471771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:44.038100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18853): Launched 18:46:44.163266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:44.441883 run patchelf(pid=18854): Launched 18:46:44.624365 run osmo-stp_10.42.42.5(pid=18851): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18851)] 18:46:44.763384 run osmo-stp_10.42.42.5(pid=18851): stdout: | (launched: 2022-12-13_18:46:43.286175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:44.904100 run osmo-stp_10.42.42.5(pid=18851): stderr: | 20221213184643477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184643477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184643477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184643478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184643478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184643478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184643478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:45.044632 run osmo-stp_10.42.42.5(pid=18851): stdout: | (launched: 2022-12-13_18:46:43.286175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:45.179719 run osmo-stp_10.42.42.5(pid=18851): stderr: | 20221213184643477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184643477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184643477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184643478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184643478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184643478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184643478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:45.340335 run patchelf(pid=18854): Terminating (SIGINT) 18:46:45.523539 run patchelf(pid=18854): Terminated: ok {rc=0} 18:46:45.656290 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18851): Process ended prematurely: osmo-stp_10.42.42.5(pid=18851) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18851)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 18:46:45.666563 tst iperf3.py:8: Test FAILED (7.7 sec) 18:46:45.695219 run osmo-hlr_10.42.42.2(pid=18848): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18848)] 18:46:45.746384 run osmo-hlr_10.42.42.2(pid=18848): stdout: | (launched: 2022-12-13_18:46:42.263935) 18:46:45.799036 run osmo-hlr_10.42.42.2(pid=18848): stderr: | 20221213184642463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184642463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184642463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184642463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184642463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184642463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184642476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184642484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184642485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184642485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:45.864267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18843): Terminating (SIGTERM) 18:46:45.907406 run iperf3-srv_10.42.42.10(pid=18844): Terminating (SIGTERM) 18:46:45.948517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18847): Terminating (SIGTERM) 18:46:45.990891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18850): Terminating (SIGTERM) 18:46:46.034732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18853): Terminating (SIGTERM) 18:46:46.079203 --- ParallelTerminationStrategy: PID 18843 died... 18:46:46.101626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18843): Terminated: ok {rc=0} 18:46:46.150557 --- ParallelTerminationStrategy: PID 18844 died... 18:46:46.170978 run iperf3-srv_10.42.42.10(pid=18844): Terminated {rc=256} 18:46:46.217197 --- ParallelTerminationStrategy: PID 18847 died... 18:46:46.236628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18847): Terminated: ok {rc=0} 18:46:46.282641 --- ParallelTerminationStrategy: PID 18850 died... 18:46:46.303791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18850): Terminated: ok {rc=0} 18:46:46.349856 --- ParallelTerminationStrategy: PID 18853 died... 18:46:46.369625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18853): Terminated: ok {rc=0} 18:46:46.455675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:46:47.604269 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:47.615757 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:46:47.673162 tst iperf3m4.py: using LAC 35540 18:46:47.794308 tst iperf3m4.py: using RAC 95 18:46:47.915557 tst iperf3m4.py: using CellId 35540 18:46:48.037615 tst iperf3m4.py: using BVCI 35541 18:46:48.159989 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.171825 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.183291 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.194794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.206638 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.218280 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.230085 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.241637 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:46:48.253449 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:48.375204 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:48.495645 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:48.615672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:46:48.739616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:48.962511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:49.293360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18856): Launched 18:46:49.579981 run iperf3-srv_10.42.42.10(pid=18857): Launched 18:46:49.703377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:46:49.925308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:50.255370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18858): Launched 18:46:50.544170 run iperf3-srv_10.42.42.10(pid=18859): Launched 18:46:50.667606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:46:50.889380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:51.219101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18860): Launched 18:46:51.507022 run iperf3-srv_10.42.42.10(pid=18861): Launched 18:46:51.631805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:46:51.854114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:52.185176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Launched 18:46:52.473717 run iperf3-srv_10.42.42.10(pid=18863): Launched 18:46:52.597220 tst iperf3m4.py:8: start network... 18:46:52.818234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:53.326946 run create_hlr_db(pid=18864): Launched 18:46:53.454555 bus /gobi_6: Setting Powered False 18:46:54.520070 run create_hlr_db(pid=18864): Terminated: ok {rc=0} 18:46:54.977446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Launched 18:46:55.306338 run osmo-hlr_10.42.42.2(pid=18867): Launched 18:46:55.434201 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:55.998501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Launched 18:46:56.326674 run osmo-stp_10.42.42.5(pid=18870): Launched 18:46:56.451366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:57.015256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Launched 18:46:57.141532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:57.418754 run patchelf(pid=18873): Launched 18:46:57.602283 run osmo-stp_10.42.42.5(pid=18870): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] 18:46:57.740863 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-13_18:46:56.266465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:57.881111 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221213184656454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184656454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184656454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184656454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184656455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184656455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184656455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:58.021264 run osmo-stp_10.42.42.5(pid=18870): stdout: | (launched: 2022-12-13_18:46:56.266465) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:58.155806 run osmo-stp_10.42.42.5(pid=18870): stderr: | 20221213184656454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184656454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184656454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184656454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184656455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184656455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184656455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:58.316106 run patchelf(pid=18873): Terminating (SIGINT) 18:46:58.499371 run patchelf(pid=18873): Terminated: ok {rc=0} 18:46:58.632353 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:46:58.642622 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:46:58.671392 run osmo-hlr_10.42.42.2(pid=18867): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18867)] 18:46:58.722681 run osmo-hlr_10.42.42.2(pid=18867): stdout: | (launched: 2022-12-13_18:46:55.245944) 18:46:58.775305 run osmo-hlr_10.42.42.2(pid=18867): stderr: | 20221213184655440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184655440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184655440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184655440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184655440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184655440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184655462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184655470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184655471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184655471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:58.828052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18856): Terminating (SIGTERM) 18:46:58.870288 run iperf3-srv_10.42.42.10(pid=18857): Terminating (SIGTERM) 18:46:58.912571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18858): Terminating (SIGTERM) 18:46:58.955092 run iperf3-srv_10.42.42.10(pid=18859): Terminating (SIGTERM) 18:46:58.997575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18860): Terminating (SIGTERM) 18:46:59.040143 run iperf3-srv_10.42.42.10(pid=18861): Terminating (SIGTERM) 18:46:59.082439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Terminating (SIGTERM) 18:46:59.125141 run iperf3-srv_10.42.42.10(pid=18863): Terminating (SIGTERM) 18:46:59.167245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminating (SIGTERM) 18:46:59.209624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminating (SIGTERM) 18:46:59.251861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminating (SIGTERM) 18:46:59.294675 --- ParallelTerminationStrategy: PID 18856 died... 18:46:59.315456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18856): Terminated: ok {rc=0} 18:46:59.362468 --- ParallelTerminationStrategy: PID 18857 died... 18:46:59.382383 run iperf3-srv_10.42.42.10(pid=18857): Terminated {rc=256} 18:46:59.428893 --- ParallelTerminationStrategy: PID 18858 died... 18:46:59.449527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18858): Terminated: ok {rc=0} 18:46:59.496165 --- ParallelTerminationStrategy: PID 18859 died... 18:46:59.516124 run iperf3-srv_10.42.42.10(pid=18859): Terminated {rc=256} 18:46:59.562639 --- ParallelTerminationStrategy: PID 18860 died... 18:46:59.582601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18860): Terminated: ok {rc=0} 18:46:59.629291 --- ParallelTerminationStrategy: PID 18861 died... 18:46:59.649300 run iperf3-srv_10.42.42.10(pid=18861): Terminated {rc=256} 18:46:59.695687 --- ParallelTerminationStrategy: PID 18862 died... 18:46:59.715691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18862): Terminated: ok {rc=0} 18:46:59.762339 --- ParallelTerminationStrategy: PID 18863 died... 18:46:59.782386 run iperf3-srv_10.42.42.10(pid=18863): Terminated {rc=256} 18:46:59.829088 --- ParallelTerminationStrategy: PID 18866 died... 18:46:59.849334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18866): Terminated: ok {rc=0} 18:46:59.896098 --- ParallelTerminationStrategy: PID 18869 died... 18:46:59.916206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18869): Terminated: ok {rc=0} 18:46:59.962874 --- ParallelTerminationStrategy: PID 18872 died... 18:46:59.983061 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18872): Terminated: ok {rc=0} 18:47:00.071017 bus /gobi_4: Setting Powered False 18:47:01.167273 bus /gobi_4: Setting Powered False 18:47:02.299403 bus /gobi_1: Setting Powered False 18:47:03.398540 bus /gobi_1: Setting Powered False 18:47:04.514565 bus /gobi_0: Setting Powered False 18:47:05.613592 bus /gobi_0: Setting Powered False 18:47:06.732589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:47:07.837174 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:07.849170 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:07.911816 tst ping.py: using LAC 35541 18:47:08.037666 tst ping.py: using RAC 96 18:47:08.164103 tst ping.py: using CellId 35541 18:47:08.281940 tst ping.py: using BVCI 35542 18:47:08.390993 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.402190 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.413178 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.424257 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.435104 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.445873 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.456738 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.467479 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:08.584597 tst ping.py:19: start network... 18:47:08.802571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:09.303287 run create_hlr_db(pid=18874): Launched 18:47:09.429881 bus /gobi_6: Setting Powered False 18:47:10.490534 run create_hlr_db(pid=18874): Terminated: ok {rc=0} 18:47:10.932190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18876): Launched 18:47:11.254807 run osmo-hlr_10.42.42.2(pid=18877): Launched 18:47:11.380304 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:11.949245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18879): Launched 18:47:12.272179 run osmo-stp_10.42.42.5(pid=18880): Launched 18:47:12.396329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:12.953836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18882): Launched 18:47:13.077131 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:13.349681 run patchelf(pid=18883): Launched 18:47:13.528552 run osmo-stp_10.42.42.5(pid=18880): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18880)] 18:47:13.665093 run osmo-stp_10.42.42.5(pid=18880): stdout: | (launched: 2022-12-13_18:47:12.212845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:13.803294 run osmo-stp_10.42.42.5(pid=18880): stderr: | 20221213184712404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184712405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184712405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184712405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184712406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184712406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184712406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:13.941520 run osmo-stp_10.42.42.5(pid=18880): stdout: | (launched: 2022-12-13_18:47:12.212845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:14.073947 run osmo-stp_10.42.42.5(pid=18880): stderr: | 20221213184712404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184712405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184712405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184712405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184712406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184712406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184712406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:14.230900 run patchelf(pid=18883): Terminating (SIGINT) 18:47:14.411315 run patchelf(pid=18883): Terminated: ok {rc=0} 18:47:14.540831 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18880): Process ended prematurely: osmo-stp_10.42.42.5(pid=18880) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18880)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 18:47:14.550426 tst ping.py:22: Test FAILED (6.7 sec) 18:47:14.578565 run osmo-hlr_10.42.42.2(pid=18877): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18877)] 18:47:14.629828 run osmo-hlr_10.42.42.2(pid=18877): stdout: | (launched: 2022-12-13_18:47:11.195683) 18:47:14.682472 run osmo-hlr_10.42.42.2(pid=18877): stderr: | 20221213184711391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184711391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184711391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184711391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184711391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184711392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184711405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184711413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184711414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184711414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:14.735405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18876): Terminating (SIGTERM) 18:47:14.777613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18879): Terminating (SIGTERM) 18:47:14.820404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18882): Terminating (SIGTERM) 18:47:14.863491 --- ParallelTerminationStrategy: PID 18876 died... 18:47:14.884059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18876): Terminated: ok {rc=0} 18:47:14.930936 --- ParallelTerminationStrategy: PID 18879 died... 18:47:14.950940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18879): Terminated: ok {rc=0} 18:47:14.997370 --- ParallelTerminationStrategy: PID 18882 died... 18:47:15.017400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18882): Terminated: ok {rc=0} 18:47:15.106474 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:47:16.194164 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.207340 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:16.271336 tst ping_idle_ping.py: using LAC 35542 18:47:16.403255 tst ping_idle_ping.py: using RAC 97 18:47:16.572213 tst ping_idle_ping.py: using CellId 35542 18:47:16.704023 tst ping_idle_ping.py: using BVCI 35543 18:47:16.822547 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.834488 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.846113 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.857743 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.869313 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.880507 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.892443 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:16.903910 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:17.018603 tst ping_idle_ping.py:24: start network... 18:47:17.222640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:17.726114 run create_hlr_db(pid=18884): Launched 18:47:17.850586 bus /gobi_6: Setting Powered False 18:47:18.914860 run create_hlr_db(pid=18884): Terminated: ok {rc=0} 18:47:19.347198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18886): Launched 18:47:19.650344 run osmo-hlr_10.42.42.2(pid=18887): Launched 18:47:19.767039 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:20.286496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18889): Launched 18:47:20.587812 run osmo-stp_10.42.42.5(pid=18890): Launched 18:47:20.702268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:21.222612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18892): Launched 18:47:21.338994 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:21.593339 run patchelf(pid=18893): Launched 18:47:21.759930 run osmo-stp_10.42.42.5(pid=18890): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18890)] 18:47:21.887485 run osmo-stp_10.42.42.5(pid=18890): stdout: | (launched: 2022-12-13_18:47:20.532284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:22.016649 run osmo-stp_10.42.42.5(pid=18890): stderr: | 20221213184720703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184720703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184720703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184720703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184720704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184720704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184720704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:22.145613 run osmo-stp_10.42.42.5(pid=18890): stdout: | (launched: 2022-12-13_18:47:20.532284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:22.268820 run osmo-stp_10.42.42.5(pid=18890): stderr: | 20221213184720703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184720703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184720703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184720703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184720704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184720704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184720704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:22.415103 run patchelf(pid=18893): Terminating (SIGINT) 18:47:22.583483 run patchelf(pid=18893): Terminated: ok {rc=0} 18:47:22.704900 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18890): Process ended prematurely: osmo-stp_10.42.42.5(pid=18890) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18890)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:47:22.714049 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:47:22.740661 run osmo-hlr_10.42.42.2(pid=18887): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18887)] 18:47:22.789364 run osmo-hlr_10.42.42.2(pid=18887): stdout: | (launched: 2022-12-13_18:47:19.594773) 18:47:22.839476 run osmo-hlr_10.42.42.2(pid=18887): stderr: | 20221213184719770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184719770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184719770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184719770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184719770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184719770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184719781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184719789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184719790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184719790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:22.889936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18886): Terminating (SIGTERM) 18:47:22.929995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18889): Terminating (SIGTERM) 18:47:22.969928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18892): Terminating (SIGTERM) 18:47:23.010410 --- ParallelTerminationStrategy: PID 18886 died... 18:47:23.029925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18886): Terminated: ok {rc=0} 18:47:23.074229 --- ParallelTerminationStrategy: PID 18889 died... 18:47:23.093158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18889): Terminated: ok {rc=0} 18:47:23.137610 --- ParallelTerminationStrategy: PID 18892 died... 18:47:23.156477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18892): Terminated: ok {rc=0} 18:47:23.240578 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:47:24.522600 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:24.528680 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:47:24.549516 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:47:24.589220 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:47:24.678772 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:47:24.699735 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:47:24.738603 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:47:25.329955 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:47:25.379833 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.390767 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:47:25.447584 tst cs_paging_gprs_active.py: using LAC 35543 18:47:25.569834 tst cs_paging_gprs_active.py: using RAC 98 18:47:25.692638 tst cs_paging_gprs_active.py: using CellId 35543 18:47:25.812940 tst cs_paging_gprs_active.py: using BVCI 35544 18:47:25.923470 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.934459 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.945156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.955753 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.966331 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.977527 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.988402 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:25.999168 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:26.010143 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:26.131732 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:26.249506 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:47:26.457263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:26.764381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Launched 18:47:27.030951 run iperf3-srv_10.42.42.10(pid=18898): Launched 18:47:27.145587 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:47:27.351174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:27.657818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18899): Launched 18:47:27.923762 run iperf3-srv_10.42.42.10(pid=18900): Launched 18:47:28.038251 tst cs_paging_gprs_active.py:38: start network... 18:47:28.243521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:28.717350 run create_hlr_db(pid=18901): Launched 18:47:28.842546 bus /gobi_6: Setting Powered False 18:47:29.903841 run create_hlr_db(pid=18901): Terminated: ok {rc=0} 18:47:30.352148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18903): Launched 18:47:30.683231 run osmo-hlr_10.42.42.2(pid=18904): Launched 18:47:30.811271 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:31.493445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18906): Launched 18:47:31.825680 run osmo-stp_10.42.42.5(pid=18907): Launched 18:47:32.111928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:32.683769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18909): Launched 18:47:32.811914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:33.091059 run patchelf(pid=18910): Launched 18:47:33.276247 run osmo-stp_10.42.42.5(pid=18907): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18907)] 18:47:33.416642 run osmo-stp_10.42.42.5(pid=18907): stdout: | (launched: 2022-12-13_18:47:31.761410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:33.557661 run osmo-stp_10.42.42.5(pid=18907): stderr: | 20221213184731976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184731976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184731977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184731977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184731978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184731978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184731978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:33.698671 run osmo-stp_10.42.42.5(pid=18907): stdout: | (launched: 2022-12-13_18:47:31.761410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:33.833675 run osmo-stp_10.42.42.5(pid=18907): stderr: | 20221213184731976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184731976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184731977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184731977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184731978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184731978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184731978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:33.994092 run patchelf(pid=18910): Terminating (SIGINT) 18:47:34.178556 run patchelf(pid=18910): Terminated: ok {rc=0} 18:47:34.312191 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=18907): Process ended prematurely: osmo-stp_10.42.42.5(pid=18907) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18907)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:47:34.322588 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:47:34.351524 run osmo-hlr_10.42.42.2(pid=18904): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18904)] 18:47:34.403003 run osmo-hlr_10.42.42.2(pid=18904): stdout: | (launched: 2022-12-13_18:47:30.623264) 18:47:34.455908 run osmo-hlr_10.42.42.2(pid=18904): stderr: | 20221213184730820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184730820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184730820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184730820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184730820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184730820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184730834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184730855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184730855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184730856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:34.509231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Terminating (SIGTERM) 18:47:34.551793 run iperf3-srv_10.42.42.10(pid=18898): Terminating (SIGTERM) 18:47:34.594644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18899): Terminating (SIGTERM) 18:47:34.637751 run iperf3-srv_10.42.42.10(pid=18900): Terminating (SIGTERM) 18:47:34.680374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18903): Terminating (SIGTERM) 18:47:34.723499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18906): Terminating (SIGTERM) 18:47:34.766461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18909): Terminating (SIGTERM) 18:47:34.809723 --- ParallelTerminationStrategy: PID 18897 died... 18:47:34.830242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18897): Terminated: ok {rc=0} 18:47:34.877703 --- ParallelTerminationStrategy: PID 18898 died... 18:47:34.898131 run iperf3-srv_10.42.42.10(pid=18898): Terminated {rc=256} 18:47:34.945237 --- ParallelTerminationStrategy: PID 18899 died... 18:47:34.965570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18899): Terminated: ok {rc=0} 18:47:35.012571 --- ParallelTerminationStrategy: PID 18900 died... 18:47:35.032924 run iperf3-srv_10.42.42.10(pid=18900): Terminated {rc=256} 18:47:35.080134 --- ParallelTerminationStrategy: PID 18903 died... 18:47:35.100576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18903): Terminated: ok {rc=0} 18:47:35.147772 --- ParallelTerminationStrategy: PID 18906 died... 18:47:35.168113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18906): Terminated: ok {rc=0} 18:47:35.215204 --- ParallelTerminationStrategy: PID 18909 died... 18:47:35.235507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18909): Terminated: ok {rc=0} 18:47:35.323127 bus /gobi_0: Setting Powered False 18:47:36.420869 bus /gobi_0: Setting Powered False 18:47:37.536761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:47:38.680410 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:38.692095 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:47:38.752670 tst iperf3.py: using LAC 35544 18:47:38.873040 tst iperf3.py: using RAC 99 18:47:38.992424 tst iperf3.py: using CellId 35544 18:47:39.111719 tst iperf3.py: using BVCI 35545 18:47:39.223316 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.234422 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.245159 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.255801 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.266554 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.277211 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.288359 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.299514 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:39.310819 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:39.431954 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:47:39.655877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:39.987517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18911): Launched 18:47:40.276345 run iperf3-srv_10.42.42.10(pid=18912): Launched 18:47:40.400702 tst iperf3.py:8: start network... 18:47:40.623314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:41.135399 run create_hlr_db(pid=18913): Launched 18:47:41.260803 bus /gobi_6: Setting Powered False 18:47:42.326461 run create_hlr_db(pid=18913): Terminated: ok {rc=0} 18:47:42.784116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18915): Launched 18:47:43.114145 run osmo-hlr_10.42.42.2(pid=18916): Launched 18:47:43.241911 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:43.810540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18918): Launched 18:47:44.139706 run osmo-stp_10.42.42.5(pid=18919): Launched 18:47:44.266065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:44.834597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18921): Launched 18:47:44.961678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:45.239847 run patchelf(pid=18922): Launched 18:47:45.423256 run osmo-stp_10.42.42.5(pid=18919): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18919)] 18:47:45.563081 run osmo-stp_10.42.42.5(pid=18919): stdout: | (launched: 2022-12-13_18:47:44.079635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:45.704227 run osmo-stp_10.42.42.5(pid=18919): stderr: | 20221213184744271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184744271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184744271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184744271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184744272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184744272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184744272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:45.845838 run osmo-stp_10.42.42.5(pid=18919): stdout: | (launched: 2022-12-13_18:47:44.079635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:45.984411 run osmo-stp_10.42.42.5(pid=18919): stderr: | 20221213184744271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184744271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184744271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184744271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184744272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184744272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184744272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:46.148096 run patchelf(pid=18922): Terminating (SIGINT) 18:47:46.336074 run patchelf(pid=18922): Terminated: ok {rc=0} 18:47:46.472679 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18919): Process ended prematurely: osmo-stp_10.42.42.5(pid=18919) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18919)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 18:47:46.484078 tst iperf3.py:8: Test FAILED (7.8 sec) 18:47:46.513991 run osmo-hlr_10.42.42.2(pid=18916): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18916)] 18:47:46.569229 run osmo-hlr_10.42.42.2(pid=18916): stdout: | (launched: 2022-12-13_18:47:43.054299) 18:47:46.623928 run osmo-hlr_10.42.42.2(pid=18916): stderr: | 20221213184743250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184743250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184743250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184743250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184743250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184743250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184743262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184743271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184743271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184743271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:46.678142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18911): Terminating (SIGTERM) 18:47:46.722521 run iperf3-srv_10.42.42.10(pid=18912): Terminating (SIGTERM) 18:47:46.767981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18915): Terminating (SIGTERM) 18:47:46.812712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18918): Terminating (SIGTERM) 18:47:46.857084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18921): Terminating (SIGTERM) 18:47:46.901618 --- ParallelTerminationStrategy: PID 18911 died... 18:47:46.923544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18911): Terminated: ok {rc=0} 18:47:46.972494 --- ParallelTerminationStrategy: PID 18912 died... 18:47:46.994051 run iperf3-srv_10.42.42.10(pid=18912): Terminated {rc=256} 18:47:47.042660 --- ParallelTerminationStrategy: PID 18915 died... 18:47:47.064387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18915): Terminated: ok {rc=0} 18:47:47.113079 --- ParallelTerminationStrategy: PID 18918 died... 18:47:47.134552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18918): Terminated: ok {rc=0} 18:47:47.183061 --- ParallelTerminationStrategy: PID 18921 died... 18:47:47.205277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18921): Terminated: ok {rc=0} 18:47:47.293658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:47:48.440475 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:48.452280 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:47:48.510127 tst iperf3m4.py: using LAC 35545 18:47:48.630321 tst iperf3m4.py: using RAC 100 18:47:48.751719 tst iperf3m4.py: using CellId 35545 18:47:48.873201 tst iperf3m4.py: using BVCI 35546 18:47:48.987100 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:48.998633 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.009649 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.020506 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.031549 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.042483 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.053474 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.064278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:47:49.075441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:49.192372 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:49.314619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:49.431833 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:47:49.549951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:47:49.755985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:50.062850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Launched 18:47:50.329844 run iperf3-srv_10.42.42.10(pid=18924): Launched 18:47:50.444736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:47:50.648405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:50.953571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Launched 18:47:51.219183 run iperf3-srv_10.42.42.10(pid=18926): Launched 18:47:51.333886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:47:51.537506 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:51.843164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Launched 18:47:52.110842 run iperf3-srv_10.42.42.10(pid=18928): Launched 18:47:52.225433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:47:52.429178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:52.735465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18929): Launched 18:47:53.001439 run iperf3-srv_10.42.42.10(pid=18930): Launched 18:47:53.118350 tst iperf3m4.py:8: start network... 18:47:53.321888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:53.794286 run create_hlr_db(pid=18931): Launched 18:47:53.920580 bus /gobi_6: Setting Powered False 18:47:54.981708 run create_hlr_db(pid=18931): Terminated: ok {rc=0} 18:47:55.430295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Launched 18:47:55.759293 run osmo-hlr_10.42.42.2(pid=18934): Launched 18:47:55.886645 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:56.462655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Launched 18:47:56.792799 run osmo-stp_10.42.42.5(pid=18937): Launched 18:47:56.918052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:57.485683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Launched 18:47:57.611444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:57.889524 run patchelf(pid=18940): Launched 18:47:58.071804 run osmo-stp_10.42.42.5(pid=18937): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] 18:47:58.211049 run osmo-stp_10.42.42.5(pid=18937): stdout: | (launched: 2022-12-13_18:47:56.732689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:58.351810 run osmo-stp_10.42.42.5(pid=18937): stderr: | 20221213184756922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184756922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184756923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184756923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184756924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184756924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184756924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:58.492421 run osmo-stp_10.42.42.5(pid=18937): stdout: | (launched: 2022-12-13_18:47:56.732689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:58.627057 run osmo-stp_10.42.42.5(pid=18937): stderr: | 20221213184756922 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184756922 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184756923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184756923 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184756924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184756924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184756924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:58.787066 run patchelf(pid=18940): Terminating (SIGINT) 18:47:58.970859 run patchelf(pid=18940): Terminated: ok {rc=0} 18:47:59.103691 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=18937): Process ended prematurely: osmo-stp_10.42.42.5(pid=18937) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:47:59.114059 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:47:59.142868 run osmo-hlr_10.42.42.2(pid=18934): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18934)] 18:47:59.194145 run osmo-hlr_10.42.42.2(pid=18934): stdout: | (launched: 2022-12-13_18:47:55.699324) 18:47:59.245925 run osmo-hlr_10.42.42.2(pid=18934): stderr: | 20221213184755894 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184755894 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184755894 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184755894 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184755894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184755894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184755907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184755916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184755916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184755917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:59.298357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Terminating (SIGTERM) 18:47:59.341142 run iperf3-srv_10.42.42.10(pid=18924): Terminating (SIGTERM) 18:47:59.383684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Terminating (SIGTERM) 18:47:59.426284 run iperf3-srv_10.42.42.10(pid=18926): Terminating (SIGTERM) 18:47:59.468645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Terminating (SIGTERM) 18:47:59.511131 run iperf3-srv_10.42.42.10(pid=18928): Terminating (SIGTERM) 18:47:59.553504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18929): Terminating (SIGTERM) 18:47:59.595929 run iperf3-srv_10.42.42.10(pid=18930): Terminating (SIGTERM) 18:47:59.638261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Terminating (SIGTERM) 18:47:59.680539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Terminating (SIGTERM) 18:47:59.723347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Terminating (SIGTERM) 18:47:59.766228 --- ParallelTerminationStrategy: PID 18923 died... 18:47:59.786996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18923): Terminated: ok {rc=0} 18:47:59.833873 --- ParallelTerminationStrategy: PID 18924 died... 18:47:59.854029 run iperf3-srv_10.42.42.10(pid=18924): Terminated {rc=256} 18:47:59.900690 --- ParallelTerminationStrategy: PID 18925 died... 18:47:59.920853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18925): Terminated: ok {rc=0} 18:47:59.967386 --- ParallelTerminationStrategy: PID 18926 died... 18:47:59.987448 run iperf3-srv_10.42.42.10(pid=18926): Terminated {rc=256} 18:48:00.033775 --- ParallelTerminationStrategy: PID 18927 died... 18:48:00.053809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18927): Terminated: ok {rc=0} 18:48:00.100348 --- ParallelTerminationStrategy: PID 18928 died... 18:48:00.120349 run iperf3-srv_10.42.42.10(pid=18928): Terminated {rc=256} 18:48:00.166911 --- ParallelTerminationStrategy: PID 18929 died... 18:48:00.186996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18929): Terminated: ok {rc=0} 18:48:00.233451 --- ParallelTerminationStrategy: PID 18930 died... 18:48:00.253399 run iperf3-srv_10.42.42.10(pid=18930): Terminated {rc=256} 18:48:00.299863 --- ParallelTerminationStrategy: PID 18933 died... 18:48:00.320413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18933): Terminated: ok {rc=0} 18:48:00.367112 --- ParallelTerminationStrategy: PID 18936 died... 18:48:00.387291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18936): Terminated: ok {rc=0} 18:48:00.433791 --- ParallelTerminationStrategy: PID 18939 died... 18:48:00.453763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18939): Terminated: ok {rc=0} 18:48:00.541704 bus /gobi_4: Setting Powered False 18:48:01.639749 bus /gobi_4: Setting Powered False 18:48:02.756690 bus /gobi_1: Setting Powered False 18:48:03.855174 bus /gobi_1: Setting Powered False 18:48:04.972074 bus /gobi_0: Setting Powered False 18:48:06.071430 bus /gobi_0: Setting Powered False 18:48:07.188073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:48:08.291342 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.303501 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:48:08.363518 tst ping.py: using LAC 35546 18:48:08.490818 tst ping.py: using RAC 101 18:48:08.616422 tst ping.py: using CellId 35546 18:48:08.742211 tst ping.py: using BVCI 35547 18:48:08.858981 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.870621 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.881917 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.893179 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.904645 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.916110 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.927889 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:08.939475 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:48:09.055905 tst ping.py:19: start network... 18:48:09.258766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:09.724665 run create_hlr_db(pid=18941): Launched 18:48:09.848369 bus /gobi_6: Setting Powered False 18:48:10.908848 run create_hlr_db(pid=18941): Terminated: ok {rc=0} 18:48:11.351784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18943): Launched 18:48:11.676366 run osmo-hlr_10.42.42.2(pid=18944): Launched 18:48:11.799509 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:12.360569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18946): Launched 18:48:12.684361 run osmo-stp_10.42.42.5(pid=18947): Launched 18:48:12.807592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:13.365840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18949): Launched 18:48:13.488514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:13.761069 run patchelf(pid=18950): Launched 18:48:13.940834 run osmo-stp_10.42.42.5(pid=18947): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18947)] 18:48:14.077824 run osmo-stp_10.42.42.5(pid=18947): stdout: | (launched: 2022-12-13_18:48:12.624671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:14.216308 run osmo-stp_10.42.42.5(pid=18947): stderr: | 20221213184812815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184812815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184812816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184812816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184812817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184812817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184812817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:14.355418 run osmo-stp_10.42.42.5(pid=18947): stdout: | (launched: 2022-12-13_18:48:12.624671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:14.488503 run osmo-stp_10.42.42.5(pid=18947): stderr: | 20221213184812815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184812815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184812816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184812816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184812817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184812817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184812817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:14.645835 run patchelf(pid=18950): Terminating (SIGINT) 18:48:14.826208 run patchelf(pid=18950): Terminated: ok {rc=0} 18:48:14.956481 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=18947): Process ended prematurely: osmo-stp_10.42.42.5(pid=18947) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18947)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 18:48:14.966190 tst ping.py:22: Test FAILED (6.7 sec) 18:48:14.994456 run osmo-hlr_10.42.42.2(pid=18944): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18944)] 18:48:15.046375 run osmo-hlr_10.42.42.2(pid=18944): stdout: | (launched: 2022-12-13_18:48:11.617361) 18:48:15.099326 run osmo-hlr_10.42.42.2(pid=18944): stderr: | 20221213184811814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184811814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184811814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184811815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184811815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184811815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184811827 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184811835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184811836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184811836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:15.152438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18943): Terminating (SIGTERM) 18:48:15.195045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18946): Terminating (SIGTERM) 18:48:15.237902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18949): Terminating (SIGTERM) 18:48:15.280774 --- ParallelTerminationStrategy: PID 18943 died... 18:48:15.301582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18943): Terminated: ok {rc=0} 18:48:15.349362 --- ParallelTerminationStrategy: PID 18946 died... 18:48:15.369566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18946): Terminated: ok {rc=0} 18:48:15.416701 --- ParallelTerminationStrategy: PID 18949 died... 18:48:15.436894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18949): Terminated: ok {rc=0} 18:48:15.525713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:48:16.611737 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:16.624583 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:48:16.685549 tst ping_idle_ping.py: using LAC 35547 18:48:16.818006 tst ping_idle_ping.py: using RAC 102 18:48:16.939257 tst ping_idle_ping.py: using CellId 35547 18:48:17.069635 tst ping_idle_ping.py: using BVCI 35548 18:48:17.203872 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.215758 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.227339 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.238825 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.250440 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.261926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.274194 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:48:17.285751 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:48:17.407224 tst ping_idle_ping.py:24: start network... 18:48:17.625954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:18.132499 run create_hlr_db(pid=18951): Launched 18:48:18.256173 bus /gobi_6: Setting Powered False 18:48:19.317253 run create_hlr_db(pid=18951): Terminated: ok {rc=0} 18:48:19.750342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Launched 18:48:20.051594 run osmo-hlr_10.42.42.2(pid=18954): Launched 18:48:20.166163 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:20.701469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Launched 18:48:21.001820 run osmo-stp_10.42.42.5(pid=18957): Launched 18:48:21.117912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:21.639473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Launched 18:48:21.754289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:22.009579 run patchelf(pid=18960): Launched 18:48:22.176684 run osmo-stp_10.42.42.5(pid=18957): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] 18:48:22.303928 run osmo-stp_10.42.42.5(pid=18957): stdout: | (launched: 2022-12-13_18:48:20.946538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:22.432462 run osmo-stp_10.42.42.5(pid=18957): stderr: | 20221213184821117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184821118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184821118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184821118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184821119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184821119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184821119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:22.561214 run osmo-stp_10.42.42.5(pid=18957): stdout: | (launched: 2022-12-13_18:48:20.946538) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:22.684261 run osmo-stp_10.42.42.5(pid=18957): stderr: | 20221213184821117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184821118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184821118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184821118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184821119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184821119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184821119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:22.830440 run patchelf(pid=18960): Terminating (SIGINT) 18:48:22.998696 run patchelf(pid=18960): Terminated: ok {rc=0} 18:48:23.120931 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=18957): Process ended prematurely: osmo-stp_10.42.42.5(pid=18957) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:48:23.129936 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:48:23.156558 run osmo-hlr_10.42.42.2(pid=18954): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18954)] 18:48:23.204469 run osmo-hlr_10.42.42.2(pid=18954): stdout: | (launched: 2022-12-13_18:48:19.996289) 18:48:23.254438 run osmo-hlr_10.42.42.2(pid=18954): stderr: | 20221213184820170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184820170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184820171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184820171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184820171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184820171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184820183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184820192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184820192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184820192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:23.304589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Terminating (SIGTERM) 18:48:23.344293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Terminating (SIGTERM) 18:48:23.384015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Terminating (SIGTERM) 18:48:23.423954 --- ParallelTerminationStrategy: PID 18953 died... 18:48:23.443310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18953): Terminated: ok {rc=0} 18:48:23.487248 --- ParallelTerminationStrategy: PID 18956 died... 18:48:23.505964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18956): Terminated: ok {rc=0} 18:48:23.549874 --- ParallelTerminationStrategy: PID 18959 died... 18:48:23.568713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18959): Terminated: ok {rc=0} 18:48:23.651886 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:48:24.935736 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:24.942336 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:48:24.963058 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:48:24.997481 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:48:25.052184 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:48:25.075086 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:48:25.110962 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:48:25.662713 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:48:25.669403 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:25.681300 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:48:25.740266 tst switch_tch_pdch.py: using LAC 35548 18:48:25.868826 tst switch_tch_pdch.py: using RAC 103 18:48:25.994728 tst switch_tch_pdch.py: using CellId 35548 18:48:26.122179 tst switch_tch_pdch.py: using BVCI 35549 18:48:26.238992 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.250836 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.262398 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.274124 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.285933 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.297832 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.310431 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:26.322568 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:48:26.441093 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:48:26.561924 tst switch_tch_pdch.py:51: start network... 18:48:26.763867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:27.229371 run create_hlr_db(pid=18966): Launched 18:48:27.353223 bus /gobi_6: Setting Powered False 18:48:28.413187 run create_hlr_db(pid=18966): Terminated: ok {rc=0} 18:48:28.852924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Launched 18:48:29.174482 run osmo-hlr_10.42.42.2(pid=18969): Launched 18:48:29.298974 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:29.853193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Launched 18:48:30.175798 run osmo-stp_10.42.42.5(pid=18972): Launched 18:48:30.299209 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:30.877682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Launched 18:48:31.013625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:31.299941 run patchelf(pid=18975): Launched 18:48:31.474917 run osmo-stp_10.42.42.5(pid=18972): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] 18:48:31.606883 run osmo-stp_10.42.42.5(pid=18972): stdout: | (launched: 2022-12-13_18:48:30.116754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:31.739432 run osmo-stp_10.42.42.5(pid=18972): stderr: | 20221213184830309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184830309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184830309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184830309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184830310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184830310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184830310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:31.871090 run osmo-stp_10.42.42.5(pid=18972): stdout: | (launched: 2022-12-13_18:48:30.116754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:31.997625 run osmo-stp_10.42.42.5(pid=18972): stderr: | 20221213184830309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184830309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184830309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184830309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184830310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184830310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184830310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:32.149285 run patchelf(pid=18975): Terminating (SIGINT) 18:48:32.321239 run patchelf(pid=18975): Terminated: ok {rc=0} 18:48:32.442705 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18972): Process ended prematurely: osmo-stp_10.42.42.5(pid=18972) [trial-2393↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] [trial-2393↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:48:32.451672 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:48:32.478520 run osmo-hlr_10.42.42.2(pid=18969): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18969)] 18:48:32.526665 run osmo-hlr_10.42.42.2(pid=18969): stdout: | (launched: 2022-12-13_18:48:29.115813) 18:48:32.576716 run osmo-hlr_10.42.42.2(pid=18969): stderr: | 20221213184829315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184829315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184829315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184829315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184829315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184829315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184829327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184829335 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184829335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184829335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:32.626972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Terminating (SIGTERM) 18:48:32.667163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Terminating (SIGTERM) 18:48:32.707370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Terminating (SIGTERM) 18:48:32.747655 --- ParallelTerminationStrategy: PID 18968 died... 18:48:32.767169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18968): Terminated: ok {rc=0} 18:48:32.811606 --- ParallelTerminationStrategy: PID 18971 died... 18:48:32.830480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18971): Terminated: ok {rc=0} 18:48:32.874915 --- ParallelTerminationStrategy: PID 18974 died... 18:48:32.893811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18974): Terminated: ok {rc=0} 18:48:32.979880 bus /gobi_0: Setting Powered False 18:48:34.079887 bus /gobi_0: Setting Powered False 18:48:35.194880 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:48:36.431890 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:36.438141 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:48:36.459142 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:48:36.494141 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:48:36.550006 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:48:36.571492 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:48:36.605942 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:48:37.157299 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:48:37.162538 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.173717 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:48:37.230000 tst switch_tch_pdch.py: using LAC 35549 18:48:37.347904 tst switch_tch_pdch.py: using RAC 104 18:48:37.466690 tst switch_tch_pdch.py: using CellId 35549 18:48:37.586060 tst switch_tch_pdch.py: using BVCI 35550 18:48:37.694752 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.705821 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.716526 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.727250 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.737946 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.749089 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.760152 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:48:37.771087 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:48:37.890500 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:48:38.013873 tst switch_tch_pdch.py:51: start network... 18:48:38.231392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:38.706056 run create_hlr_db(pid=18979): Launched 18:48:38.831472 bus /gobi_6: Setting Powered False 18:48:39.895513 run create_hlr_db(pid=18979): Terminated: ok {rc=0} 18:48:40.302935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18981): Launched 18:48:40.605277 run osmo-hlr_10.42.42.2(pid=18982): Launched 18:48:40.720732 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:41.213181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18984): Launched 18:48:41.516218 run osmo-stp_10.42.42.5(pid=18985): Launched 18:48:41.630143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:42.123402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18987): Launched 18:48:42.239602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:42.493660 run patchelf(pid=18988): Launched 18:48:42.660364 run osmo-stp_10.42.42.5(pid=18985): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18985)] 18:48:42.787773 run osmo-stp_10.42.42.5(pid=18985): stdout: | (launched: 2022-12-13_18:48:41.460523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:42.916358 run osmo-stp_10.42.42.5(pid=18985): stderr: | 20221213184841629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184841629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184841629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184841630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184841630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184841630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184841630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:43.045122 run osmo-stp_10.42.42.5(pid=18985): stdout: | (launched: 2022-12-13_18:48:41.460523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:43.168595 run osmo-stp_10.42.42.5(pid=18985): stderr: | 20221213184841629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184841629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184841629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184841630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184841630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184841630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184841630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:43.314991 run patchelf(pid=18988): Terminating (SIGINT) 18:48:43.483894 run patchelf(pid=18988): Terminated: ok {rc=0} 18:48:43.605057 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=18985): Process ended prematurely: osmo-stp_10.42.42.5(pid=18985) [trial-2393↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18985)] [trial-2393↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:48:43.614012 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 18:48:43.640780 run osmo-hlr_10.42.42.2(pid=18982): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18982)] 18:48:43.689145 run osmo-hlr_10.42.42.2(pid=18982): stdout: | (launched: 2022-12-13_18:48:40.549599) 18:48:43.738952 run osmo-hlr_10.42.42.2(pid=18982): stderr: | 20221213184840722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184840722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184840722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184840722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184840722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184840722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184840734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184840743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184840743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184840743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:43.789260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18981): Terminating (SIGTERM) 18:48:43.829483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18984): Terminating (SIGTERM) 18:48:43.869346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18987): Terminating (SIGTERM) 18:48:43.910139 --- ParallelTerminationStrategy: PID 18981 died... 18:48:43.929766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18981): Terminated: ok {rc=0} 18:48:43.974118 --- ParallelTerminationStrategy: PID 18984 died... 18:48:43.993083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18984): Terminated: ok {rc=0} 18:48:44.037357 --- ParallelTerminationStrategy: PID 18987 died... 18:48:44.056220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18987): Terminated: ok {rc=0} 18:48:44.140161 bus /gobi_0: Setting Powered False 18:48:45.238919 bus /gobi_0: Setting Powered False 18:48:46.353049 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:oc2g --------------------------------------------------------------------- 18:48:47.594326 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:47.598416 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 18:48:47.619601 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 18:48:47.626693 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 18:48:47.679968 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 18:48:47.702820 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 18:48:47.710224 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 18:48:48.247335 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 18:48:48.252662 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 18:48:48.264017 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 18:48:48.298458 tst mo_mt_sms.py: using LAC 35550 18:48:48.426744 tst mo_mt_sms.py: using RAC 105 18:48:48.554350 tst mo_mt_sms.py: using CellId 35550 18:48:48.682579 tst mo_mt_sms.py: using BVCI 35551 18:48:48.801588 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 18:48:48.915671 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 18:48:49.034741 tst mo_mt_sms.py:9: start nitb and bts... 18:48:49.253408 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:48:49.914263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18993): Launched 18:48:50.241194 run osmo-nitb_10.42.42.2(pid=18994): Launched 18:48:50.423289 run osmo-nitb_10.42.42.2(pid=18994): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18994)] 18:48:50.568440 run osmo-nitb_10.42.42.2(pid=18994): stdout: | (launched: 2022-12-13_18:48:50.181792) 18:48:50.715132 run osmo-nitb_10.42.42.2(pid=18994): stderr: | (launched: 2022-12-13_18:48:50.230258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:48:50.861460 run osmo-nitb_10.42.42.2(pid=18994): stdout: | (launched: 2022-12-13_18:48:50.181792) 18:48:51.002733 run osmo-nitb_10.42.42.2(pid=18994): stderr: | (launched: 2022-12-13_18:48:50.230258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=18994): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18994) [trial-2393↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18994)] 18:48:51.366188 tst osmo-nitb_10.42.42.2(pid=18994): stdout: | (launched: 2022-12-13_18:48:50.181792) 18:48:51.490065 tst osmo-nitb_10.42.42.2(pid=18994): stderr: | (launched: 2022-12-13_18:48:50.230258) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:48:51.634249 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=18994): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18994) [trial-2393↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18994)] [trial-2393↪nitb_sms:oc2g↪mo_mt_sms.py:11] 18:48:51.642873 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:48:51.649380 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18993): Terminating (SIGTERM) 18:48:51.858420 --- ParallelTerminationStrategy: PID 18993 died... 18:48:51.879471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=18993): Terminated: ok {rc=0} 18:48:51.965803 bus /sierra_3: Setting Powered False 18:48:53.066594 bus /sierra_3: Setting Powered False 18:48:54.184702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:oc2g --------------------------------------------------------------------- 18:48:55.366329 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:55.371091 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 18:48:55.392412 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 18:48:55.421047 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 18:48:55.475774 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 18:48:55.498506 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 18:48:55.527331 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 18:48:56.070530 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:oc2g mo_mt_sms.py ---------------------------------------------- 18:48:56.075642 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.086823 tst sms:oc2g: Using 1 x bts (candidates: 1) 18:48:56.121681 tst mo_mt_sms.py: using LAC 35551 18:48:56.246131 tst mo_mt_sms.py: using RAC 106 18:48:56.363217 tst mo_mt_sms.py: using CellId 35551 18:48:56.480849 tst mo_mt_sms.py: using BVCI 35552 18:48:56.588912 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.599699 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.610378 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.620684 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.631154 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 18:48:56.641650 tst sms:oc2g: Using 1 x modem (candidates: 2) 18:48:56.757295 tst sms:oc2g: Using 1 x modem (candidates: 2) 18:48:56.872013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:57.338729 run create_hlr_db(pid=18998): Launched 18:48:57.463539 bus /sierra_2: Setting Powered False 18:48:58.523833 run create_hlr_db(pid=18998): Terminated: ok {rc=0} 18:48:58.967792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19000): Launched 18:48:59.293175 run osmo-hlr_10.42.42.2(pid=19001): Launched 18:48:59.417013 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:59.976889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19003): Launched 18:49:00.301495 run osmo-stp_10.42.42.5(pid=19004): Launched 18:49:00.427331 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:01.012640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19006): Launched 18:49:01.361757 run osmo-msc_10.42.42.6(pid=19007): Launched 18:49:01.567288 run osmo-stp_10.42.42.5(pid=19004): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19004)] 18:49:01.802493 run osmo-stp_10.42.42.5(pid=19004): stdout: | (launched: 2022-12-13_18:49:00.241920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:02.120489 run osmo-stp_10.42.42.5(pid=19004): stderr: | 20221213184900432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184900432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184900432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184900433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184900433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184900433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184900433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:02.360912 run osmo-stp_10.42.42.5(pid=19004): stdout: | (launched: 2022-12-13_18:49:00.241920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:02.493540 run osmo-stp_10.42.42.5(pid=19004): stderr: | 20221213184900432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184900432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184900432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184900433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184900433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184900433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184900433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:02.649225 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19004): Process ended prematurely: osmo-stp_10.42.42.5(pid=19004) [trial-2393↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19004)] [trial-2393↪sms:oc2g↪mo_mt_sms.py:16] 18:49:02.658435 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 18:49:02.686025 run osmo-hlr_10.42.42.2(pid=19001): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19001)] 18:49:02.737515 run osmo-hlr_10.42.42.2(pid=19001): stdout: | (launched: 2022-12-13_18:48:59.233274) 18:49:02.790609 run osmo-hlr_10.42.42.2(pid=19001): stderr: | 20221213184859431 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184859431 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184859431 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184859431 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184859431 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184859431 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184859443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184859451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184859452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184859452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:02.864608 run osmo-msc_10.42.42.6(pid=19007): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19007)] 18:49:02.915642 run osmo-msc_10.42.42.6(pid=19007): stdout: | (launched: 2022-12-13_18:49:01.294701) 18:49:02.968213 run osmo-msc_10.42.42.6(pid=19007): stderr: | 20221213184901943 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184901945 DLGLOBAL DEBUG validating counter group 0x7f5cc0ed7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184901946 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184901946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184901947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184901949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184901957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184901959 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184901960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184901962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:03.021238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19000): Terminating (SIGTERM) 18:49:03.063901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19003): Terminating (SIGTERM) 18:49:03.107253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19006): Terminating (SIGTERM) 18:49:03.150453 --- ParallelTerminationStrategy: PID 19000 died... 18:49:03.171238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19000): Terminated: ok {rc=0} 18:49:03.218727 --- ParallelTerminationStrategy: PID 19003 died... 18:49:03.239050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19003): Terminated: ok {rc=0} 18:49:03.286344 --- ParallelTerminationStrategy: PID 19006 died... 18:49:03.306699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19006): Terminated: ok {rc=0} 18:49:03.396363 bus /sierra_3: Setting Powered False 18:49:04.496152 bus /sierra_3: Setting Powered False 18:49:05.614434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:oc2g --------------------------------------------------------------------- 18:49:06.828104 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:06.832078 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 18:49:06.853563 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 18:49:06.860616 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 18:49:06.897806 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 18:49:06.919186 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 18:49:06.926225 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 18:49:07.445159 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 18:49:07.450231 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 18:49:07.460927 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 18:49:07.494733 tst assert_extension.py: using LAC 35552 18:49:07.612747 tst assert_extension.py: using RAC 107 18:49:07.729762 tst assert_extension.py: using CellId 35552 18:49:07.846845 tst assert_extension.py: using BVCI 35553 18:49:07.957631 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 18:49:08.077817 tst assert_extension.py:10: start nitb and bts... 18:49:08.297313 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:49:08.957583 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19012): Launched 18:49:09.283623 run osmo-nitb_10.42.42.2(pid=19013): Launched 18:49:09.464001 run osmo-nitb_10.42.42.2(pid=19013): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19013)] 18:49:09.609994 run osmo-nitb_10.42.42.2(pid=19013): stdout: | (launched: 2022-12-13_18:49:09.224351) 18:49:09.757407 run osmo-nitb_10.42.42.2(pid=19013): stderr: | (launched: 2022-12-13_18:49:09.272607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:49:09.904606 run osmo-nitb_10.42.42.2(pid=19013): stdout: | (launched: 2022-12-13_18:49:09.224351) 18:49:10.046192 run osmo-nitb_10.42.42.2(pid=19013): stderr: | (launched: 2022-12-13_18:49:09.272607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19013): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19013) [trial-2393↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19013)] 18:49:10.406994 tst osmo-nitb_10.42.42.2(pid=19013): stdout: | (launched: 2022-12-13_18:49:09.224351) 18:49:10.538736 tst osmo-nitb_10.42.42.2(pid=19013): stderr: | (launched: 2022-12-13_18:49:09.272607) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:49:10.693674 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19013): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19013) [trial-2393↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19013)] [trial-2393↪nitb_ussd:oc2g↪assert_extension.py:12] 18:49:10.702694 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:49:10.710362 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19012): Terminating (SIGTERM) 18:49:10.922170 --- ParallelTerminationStrategy: PID 19012 died... 18:49:10.944479 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19012): Terminated: ok {rc=0} 18:49:11.034472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:oc2g --------------------------------------------------------------------- 18:49:12.194286 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:12.199318 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 18:49:12.221187 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 18:49:12.250480 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 18:49:12.288271 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 18:49:12.309754 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 18:49:12.336993 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 18:49:12.864600 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:oc2g assert_extension.py ---------------------------------------------- 18:49:12.870779 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:12.882488 tst ussd:oc2g: Using 1 x bts (candidates: 1) 18:49:12.918682 tst assert_extension.py: using LAC 35553 18:49:13.049590 tst assert_extension.py: using RAC 108 18:49:13.180311 tst assert_extension.py: using CellId 35553 18:49:13.307093 tst assert_extension.py: using BVCI 35554 18:49:13.418216 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:13.428926 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:13.439691 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:13.450586 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:13.461296 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 18:49:13.471868 tst ussd:oc2g: Using 1 x modem (candidates: 1) 18:49:13.586377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:14.054139 run create_hlr_db(pid=19017): Launched 18:49:14.179586 bus /sierra_2: Setting Powered False 18:49:15.239873 run create_hlr_db(pid=19017): Terminated: ok {rc=0} 18:49:15.683638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19019): Launched 18:49:16.017648 run osmo-hlr_10.42.42.2(pid=19020): Launched 18:49:16.442966 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:17.077735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19022): Launched 18:49:17.416627 run osmo-stp_10.42.42.5(pid=19023): Launched 18:49:17.542615 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:18.129273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19025): Launched 18:49:18.454827 run osmo-msc_10.42.42.6(pid=19026): Launched 18:49:18.636155 run osmo-stp_10.42.42.5(pid=19023): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19023)] 18:49:18.773562 run osmo-stp_10.42.42.5(pid=19023): stdout: | (launched: 2022-12-13_18:49:17.357196) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:18.911466 run osmo-stp_10.42.42.5(pid=19023): stderr: | 20221213184917548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184917548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184917548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184917549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184917549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184917549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184917549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:19.048544 run osmo-stp_10.42.42.5(pid=19023): stdout: | (launched: 2022-12-13_18:49:17.357196) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:19.178850 run osmo-stp_10.42.42.5(pid=19023): stderr: | 20221213184917548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184917548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184917548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184917549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184917549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184917549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184917549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:19.334575 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19023): Process ended prematurely: osmo-stp_10.42.42.5(pid=19023) [trial-2393↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19023)] [trial-2393↪ussd:oc2g↪assert_extension.py:17] 18:49:19.343835 tst assert_extension.py:17: Test FAILED (6.5 sec) 18:49:19.372090 run osmo-hlr_10.42.42.2(pid=19020): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19020)] 18:49:19.423531 run osmo-hlr_10.42.42.2(pid=19020): stdout: | (launched: 2022-12-13_18:49:15.957269) 18:49:19.477026 run osmo-hlr_10.42.42.2(pid=19020): stderr: | 20221213184916287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184916287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184916288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184916288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184916288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184916288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184916309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184916327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184916327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184916328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:19.550324 run osmo-msc_10.42.42.6(pid=19026): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19026)] 18:49:19.600912 run osmo-msc_10.42.42.6(pid=19026): stdout: | (launched: 2022-12-13_18:49:18.395421) 18:49:19.653750 run osmo-msc_10.42.42.6(pid=19026): stderr: | 20221213184918717 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184918717 DLGLOBAL DEBUG validating counter group 0x7f595732ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184918718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184918718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184918718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184918718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184918720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184918720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184918720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184918720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:19.707059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19019): Terminating (SIGTERM) 18:49:19.749664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19022): Terminating (SIGTERM) 18:49:19.792785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19025): Terminating (SIGTERM) 18:49:19.835643 --- ParallelTerminationStrategy: PID 19019 died... 18:49:19.856267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19019): Terminated: ok {rc=0} 18:49:19.903229 --- ParallelTerminationStrategy: PID 19022 died... 18:49:19.923335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19022): Terminated: ok {rc=0} 18:49:19.970092 --- ParallelTerminationStrategy: PID 19025 died... 18:49:19.990120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19025): Terminated: ok {rc=0} 18:49:20.079170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:49:21.276201 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:21.283139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:49:21.304508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:49:21.334111 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:49:21.390535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:49:21.411705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:49:21.438918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:49:21.989825 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:49:22.043060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.054436 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:49:22.110671 tst mo_mt_call.py: using LAC 35554 18:49:22.231730 tst mo_mt_call.py: using RAC 109 18:49:22.352345 tst mo_mt_call.py: using CellId 35554 18:49:22.471109 tst mo_mt_call.py: using BVCI 35555 18:49:22.583720 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.594927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.605808 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.616600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.627825 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:22.638946 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:49:22.759910 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:49:22.876562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:23.350485 run create_hlr_db(pid=19031): Launched 18:49:23.476435 bus /sierra_2: Setting Powered False 18:49:24.537482 run create_hlr_db(pid=19031): Terminated: ok {rc=0} 18:49:24.987144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19033): Launched 18:49:25.317708 run osmo-hlr_10.42.42.2(pid=19034): Launched 18:49:25.445601 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:26.014831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19036): Launched 18:49:26.345617 run osmo-stp_10.42.42.5(pid=19037): Launched 18:49:26.473988 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:27.069127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19039): Launched 18:49:27.399435 run osmo-msc_10.42.42.6(pid=19040): Launched 18:49:27.584509 run osmo-stp_10.42.42.5(pid=19037): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19037)] 18:49:27.723275 run osmo-stp_10.42.42.5(pid=19037): stdout: | (launched: 2022-12-13_18:49:26.285340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:27.862544 run osmo-stp_10.42.42.5(pid=19037): stderr: | 20221213184926476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184926477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184926477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184926477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184926478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184926478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184926478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:28.000840 run osmo-stp_10.42.42.5(pid=19037): stdout: | (launched: 2022-12-13_18:49:26.285340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:28.133093 run osmo-stp_10.42.42.5(pid=19037): stderr: | 20221213184926476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184926477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184926477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184926477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184926478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184926478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184926478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:28.291862 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19037): Process ended prematurely: osmo-stp_10.42.42.5(pid=19037) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19037)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:49:28.301692 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:49:28.329930 run osmo-hlr_10.42.42.2(pid=19034): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19034)] 18:49:28.381488 run osmo-hlr_10.42.42.2(pid=19034): stdout: | (launched: 2022-12-13_18:49:25.257911) 18:49:28.434550 run osmo-hlr_10.42.42.2(pid=19034): stderr: | 20221213184925454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184925454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184925454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184925454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184925454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184925454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184925466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184925475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184925475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184925475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:28.507421 run osmo-msc_10.42.42.6(pid=19040): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19040)] 18:49:28.557767 run osmo-msc_10.42.42.6(pid=19040): stdout: | (launched: 2022-12-13_18:49:27.338699) 18:49:28.610365 run osmo-msc_10.42.42.6(pid=19040): stderr: | 20221213184927663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184927663 DLGLOBAL DEBUG validating counter group 0x7fc1ceaa1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184927663 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184927663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184927664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184927664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184927666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184927666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184927666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184927666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:28.663467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19033): Terminating (SIGTERM) 18:49:28.705517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19036): Terminating (SIGTERM) 18:49:28.748202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19039): Terminating (SIGTERM) 18:49:28.790709 --- ParallelTerminationStrategy: PID 19033 died... 18:49:28.811203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19033): Terminated: ok {rc=0} 18:49:28.857878 --- ParallelTerminationStrategy: PID 19036 died... 18:49:28.877788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19036): Terminated: ok {rc=0} 18:49:28.924248 --- ParallelTerminationStrategy: PID 19039 died... 18:49:28.944268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19039): Terminated: ok {rc=0} 18:49:29.033236 bus /sierra_3: Setting Powered False 18:49:30.133143 bus /sierra_3: Setting Powered False 18:49:31.250427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:49:32.396204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.408255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:49:32.465398 tst mo_mt_call_osmux.py: using LAC 35555 18:49:32.592833 tst mo_mt_call_osmux.py: using RAC 110 18:49:32.712523 tst mo_mt_call_osmux.py: using CellId 35555 18:49:32.830866 tst mo_mt_call_osmux.py: using BVCI 35556 18:49:32.941531 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.952552 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.963590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.974828 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.985763 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:49:32.996562 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:49:33.113791 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:49:33.234808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:33.748620 run create_hlr_db(pid=19042): Launched 18:49:33.874927 bus /sierra_2: Setting Powered False 18:49:34.939503 run create_hlr_db(pid=19042): Terminated: ok {rc=0} 18:49:35.381142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19044): Launched 18:49:35.688356 run osmo-hlr_10.42.42.2(pid=19045): Launched 18:49:35.805905 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:36.336164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19047): Launched 18:49:36.643844 run osmo-stp_10.42.42.5(pid=19048): Launched 18:49:36.761386 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:37.317408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Launched 18:49:37.625192 run osmo-msc_10.42.42.6(pid=19051): Launched 18:49:37.796399 run osmo-stp_10.42.42.5(pid=19048): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] 18:49:37.926844 run osmo-stp_10.42.42.5(pid=19048): stdout: | (launched: 2022-12-13_18:49:36.587303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:38.055805 run osmo-stp_10.42.42.5(pid=19048): stderr: | 20221213184936756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184936756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184936756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184936757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184936757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184936757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184936757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:38.183268 run osmo-stp_10.42.42.5(pid=19048): stdout: | (launched: 2022-12-13_18:49:36.587303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:38.305799 run osmo-stp_10.42.42.5(pid=19048): stderr: | 20221213184936756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184936756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184936756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184936757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184936757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184936757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184936757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:38.452403 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19048): Process ended prematurely: osmo-stp_10.42.42.5(pid=19048) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:49:38.461526 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:49:38.488383 run osmo-hlr_10.42.42.2(pid=19045): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19045)] 18:49:38.536825 run osmo-hlr_10.42.42.2(pid=19045): stdout: | (launched: 2022-12-13_18:49:35.631840) 18:49:38.586857 run osmo-hlr_10.42.42.2(pid=19045): stderr: | 20221213184935807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184935807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184935807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184935807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184935808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184935808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184935821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184935831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184935831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184935831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:38.656476 run osmo-msc_10.42.42.6(pid=19051): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19051)] 18:49:38.704634 run osmo-msc_10.42.42.6(pid=19051): stdout: | (launched: 2022-12-13_18:49:37.568479) 18:49:38.754303 run osmo-msc_10.42.42.6(pid=19051): stderr: | 20221213184937840 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184937840 DLGLOBAL DEBUG validating counter group 0x7f9e5dc00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184937840 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184937840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184937840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184937840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184937842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184937843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184937843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184937843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:38.804438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19044): Terminating (SIGTERM) 18:49:38.844516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19047): Terminating (SIGTERM) 18:49:38.885196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Terminating (SIGTERM) 18:49:38.926079 --- ParallelTerminationStrategy: PID 19044 died... 18:49:38.945739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19044): Terminated: ok {rc=0} 18:49:38.990310 --- ParallelTerminationStrategy: PID 19047 died... 18:49:39.009324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19047): Terminated: ok {rc=0} 18:49:39.053663 --- ParallelTerminationStrategy: PID 19050 died... 18:49:39.072300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Terminated: ok {rc=0} 18:49:39.159303 bus /sierra_3: Setting Powered False 18:49:40.260441 bus /sierra_3: Setting Powered False 18:49:41.377890 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:49:42.619078 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:42.627746 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:49:42.649375 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:49:42.677966 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:49:42.730933 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:49:42.751536 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:49:42.777916 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:49:43.330585 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:49:43.380050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.391411 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:49:43.445683 tst mo_mt_call.py: using LAC 35556 18:49:43.564228 tst mo_mt_call.py: using RAC 111 18:49:43.682504 tst mo_mt_call.py: using CellId 35556 18:49:43.802339 tst mo_mt_call.py: using BVCI 35557 18:49:43.915735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.926966 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.937962 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.948753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.959645 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:43.970550 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:44.092579 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:44.209797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:44.685768 run create_hlr_db(pid=19056): Launched 18:49:44.810987 bus /sierra_2: Setting Powered False 18:49:45.881984 run create_hlr_db(pid=19056): Terminated: ok {rc=0} 18:49:46.333000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Launched 18:49:46.659272 run osmo-hlr_10.42.42.2(pid=19059): Launched 18:49:46.837103 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:47.609033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Launched 18:49:47.916089 run osmo-stp_10.42.42.5(pid=19062): Launched 18:49:48.033119 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:48.587104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Launched 18:49:48.893808 run osmo-msc_10.42.42.6(pid=19065): Launched 18:49:49.064219 run osmo-stp_10.42.42.5(pid=19062): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] 18:49:49.193714 run osmo-stp_10.42.42.5(pid=19062): stdout: | (launched: 2022-12-13_18:49:47.859683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:49.322912 run osmo-stp_10.42.42.5(pid=19062): stderr: | 20221213184948030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184948030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184948030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184948031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184948031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184948031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184948031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:49.450285 run osmo-stp_10.42.42.5(pid=19062): stdout: | (launched: 2022-12-13_18:49:47.859683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:49.572225 run osmo-stp_10.42.42.5(pid=19062): stderr: | 20221213184948030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184948030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184948030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184948031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184948031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184948031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184948031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:49.718833 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19062): Process ended prematurely: osmo-stp_10.42.42.5(pid=19062) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:49:49.727664 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:49:49.754171 run osmo-hlr_10.42.42.2(pid=19059): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19059)] 18:49:49.802483 run osmo-hlr_10.42.42.2(pid=19059): stdout: | (launched: 2022-12-13_18:49:46.600781) 18:49:49.852289 run osmo-hlr_10.42.42.2(pid=19059): stderr: | 20221213184946999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184946999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184946999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184947000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184947000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184947000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184947025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184947047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184947047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184947047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:49.921966 run osmo-msc_10.42.42.6(pid=19065): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19065)] 18:49:49.970597 run osmo-msc_10.42.42.6(pid=19065): stdout: | (launched: 2022-12-13_18:49:48.837254) 18:49:50.019991 run osmo-msc_10.42.42.6(pid=19065): stderr: | 20221213184949111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184949111 DLGLOBAL DEBUG validating counter group 0x7f0404910c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184949111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184949111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184949112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184949112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184949114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184949114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184949114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184949114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:50.069924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Terminating (SIGTERM) 18:49:50.109772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Terminating (SIGTERM) 18:49:50.150093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Terminating (SIGTERM) 18:49:50.190258 --- ParallelTerminationStrategy: PID 19058 died... 18:49:50.209618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Terminated: ok {rc=0} 18:49:50.253958 --- ParallelTerminationStrategy: PID 19061 died... 18:49:50.272494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Terminated: ok {rc=0} 18:49:50.316784 --- ParallelTerminationStrategy: PID 19064 died... 18:49:50.335578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Terminated: ok {rc=0} 18:49:50.421394 bus /sierra_3: Setting Powered False 18:49:51.518899 bus /sierra_3: Setting Powered False 18:49:52.632303 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:49:53.783307 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:53.795590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:49:53.854211 tst mo_mt_call_osmux.py: using LAC 35557 18:49:53.982718 tst mo_mt_call_osmux.py: using RAC 112 18:49:54.113151 tst mo_mt_call_osmux.py: using CellId 35557 18:49:54.243980 tst mo_mt_call_osmux.py: using BVCI 35558 18:49:54.363742 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:54.375324 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:54.387068 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:54.398532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:54.410329 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:54.422061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:54.541776 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:54.664065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:55.141816 run create_hlr_db(pid=19067): Launched 18:49:55.267564 bus /sierra_2: Setting Powered False 18:49:56.329116 run create_hlr_db(pid=19067): Terminated: ok {rc=0} 18:49:56.757967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19069): Launched 18:49:57.065932 run osmo-hlr_10.42.42.2(pid=19070): Launched 18:49:57.182408 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:57.716177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19072): Launched 18:49:58.024605 run osmo-stp_10.42.42.5(pid=19073): Launched 18:49:58.144066 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:58.716246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19075): Launched 18:49:59.023089 run osmo-msc_10.42.42.6(pid=19076): Launched 18:49:59.196419 run osmo-stp_10.42.42.5(pid=19073): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19073)] 18:49:59.325797 run osmo-stp_10.42.42.5(pid=19073): stdout: | (launched: 2022-12-13_18:49:57.967590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:59.456789 run osmo-stp_10.42.42.5(pid=19073): stderr: | 20221213184958139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184958140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184958140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184958140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184958141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184958141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184958141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:59.584205 run osmo-stp_10.42.42.5(pid=19073): stdout: | (launched: 2022-12-13_18:49:57.967590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:59.706168 run osmo-stp_10.42.42.5(pid=19073): stderr: | 20221213184958139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213184958140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213184958140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213184958140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213184958141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213184958141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213184958141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:59.852207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19073): Process ended prematurely: osmo-stp_10.42.42.5(pid=19073) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19073)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:49:59.861290 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:49:59.887507 run osmo-hlr_10.42.42.2(pid=19070): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19070)] 18:49:59.936017 run osmo-hlr_10.42.42.2(pid=19070): stdout: | (launched: 2022-12-13_18:49:57.008943) 18:49:59.985446 run osmo-hlr_10.42.42.2(pid=19070): stderr: | 20221213184957184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213184957184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213184957184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213184957184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213184957184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213184957185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213184957196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213184957205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213184957205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213184957206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:00.055038 run osmo-msc_10.42.42.6(pid=19076): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19076)] 18:50:00.102631 run osmo-msc_10.42.42.6(pid=19076): stdout: | (launched: 2022-12-13_18:49:58.966615) 18:50:00.151798 run osmo-msc_10.42.42.6(pid=19076): stderr: | 20221213184959237 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213184959237 DLGLOBAL DEBUG validating counter group 0x7fbeb418dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213184959237 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213184959237 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213184959238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213184959238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213184959239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213184959240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213184959240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213184959240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:00.201414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19069): Terminating (SIGTERM) 18:50:00.240866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19072): Terminating (SIGTERM) 18:50:00.280724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19075): Terminating (SIGTERM) 18:50:00.320512 --- ParallelTerminationStrategy: PID 19069 died... 18:50:00.339940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19069): Terminated: ok {rc=0} 18:50:00.383989 --- ParallelTerminationStrategy: PID 19072 died... 18:50:00.402833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19072): Terminated: ok {rc=0} 18:50:00.446659 --- ParallelTerminationStrategy: PID 19075 died... 18:50:00.465294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19075): Terminated: ok {rc=0} 18:50:00.550260 bus /sierra_3: Setting Powered False 18:50:01.649838 bus /sierra_3: Setting Powered False 18:50:02.764524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:50:04.002050 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:04.008739 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:50:04.029335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:50:04.056365 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:50:04.108371 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:50:04.132317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:50:04.158870 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:50:04.709384 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:50:04.763432 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:04.775233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:50:04.833311 tst mo_mt_call.py: using LAC 35558 18:50:04.962684 tst mo_mt_call.py: using RAC 113 18:50:05.092626 tst mo_mt_call.py: using CellId 35558 18:50:05.221393 tst mo_mt_call.py: using BVCI 35559 18:50:05.343598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:05.355276 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:05.366684 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:05.378016 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:05.390046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:05.401779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:50:05.518091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:50:05.641114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:06.118759 run create_hlr_db(pid=19084): Launched 18:50:06.246966 bus /sierra_2: Setting Powered False 18:50:07.308148 run create_hlr_db(pid=19084): Terminated: ok {rc=0} 18:50:07.759436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Launched 18:50:08.091041 run osmo-hlr_10.42.42.2(pid=19087): Launched 18:50:08.218628 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:08.788158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Launched 18:50:09.118071 run osmo-stp_10.42.42.5(pid=19090): Launched 18:50:09.245228 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:09.842242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Launched 18:50:10.174269 run osmo-msc_10.42.42.6(pid=19093): Launched 18:50:10.359426 run osmo-stp_10.42.42.5(pid=19090): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] 18:50:10.499104 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-13_18:50:09.057817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:10.639001 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221213185009250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185009250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185009250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185009251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185009251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185009251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185009251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:10.777654 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-13_18:50:09.057817) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:10.910322 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221213185009250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185009250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185009250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185009251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185009251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185009251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185009251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:11.068670 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:50:11.078523 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:50:11.106729 run osmo-hlr_10.42.42.2(pid=19087): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19087)] 18:50:11.158388 run osmo-hlr_10.42.42.2(pid=19087): stdout: | (launched: 2022-12-13_18:50:08.030972) 18:50:11.210991 run osmo-hlr_10.42.42.2(pid=19087): stderr: | 20221213185008230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185008230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185008230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185008230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185008230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185008230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185008242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185008251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185008251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185008251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:11.283691 run osmo-msc_10.42.42.6(pid=19093): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19093)] 18:50:11.333993 run osmo-msc_10.42.42.6(pid=19093): stdout: | (launched: 2022-12-13_18:50:10.113349) 18:50:11.385896 run osmo-msc_10.42.42.6(pid=19093): stderr: | 20221213185010434 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185010435 DLGLOBAL DEBUG validating counter group 0x7f165c70ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185010435 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185010435 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185010435 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185010435 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185010437 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185010437 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185010437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185010437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:11.439002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminating (SIGTERM) 18:50:11.480733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminating (SIGTERM) 18:50:11.523297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminating (SIGTERM) 18:50:11.565957 --- ParallelTerminationStrategy: PID 19086 died... 18:50:11.586571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminated: ok {rc=0} 18:50:11.633205 --- ParallelTerminationStrategy: PID 19089 died... 18:50:11.653214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminated: ok {rc=0} 18:50:11.699659 --- ParallelTerminationStrategy: PID 19092 died... 18:50:11.719609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminated: ok {rc=0} 18:50:11.807645 bus /sierra_3: Setting Powered False 18:50:12.906611 bus /sierra_3: Setting Powered False 18:50:14.023248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:50:15.173653 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.185994 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:50:15.247496 tst mo_mt_call_osmux.py: using LAC 35559 18:50:15.376198 tst mo_mt_call_osmux.py: using RAC 114 18:50:15.503861 tst mo_mt_call_osmux.py: using CellId 35559 18:50:15.630734 tst mo_mt_call_osmux.py: using BVCI 35560 18:50:15.750742 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.762555 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.774003 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.785450 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.797267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:50:15.809094 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:50:15.958194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:50:16.096399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:16.621659 run create_hlr_db(pid=19095): Launched 18:50:16.782059 bus /sierra_2: Setting Powered False 18:50:17.846683 run create_hlr_db(pid=19095): Terminated: ok {rc=0} 18:50:18.289593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Launched 18:50:18.598223 run osmo-hlr_10.42.42.2(pid=19098): Launched 18:50:18.716394 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:19.259354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Launched 18:50:19.567728 run osmo-stp_10.42.42.5(pid=19101): Launched 18:50:19.685693 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:20.242153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Launched 18:50:20.550425 run osmo-msc_10.42.42.6(pid=19104): Launched 18:50:20.724586 run osmo-stp_10.42.42.5(pid=19101): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] 18:50:20.854643 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-13_18:50:19.511036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:20.984308 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221213185019679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185019679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185019679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185019680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185019680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185019680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185019680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:21.112366 run osmo-stp_10.42.42.5(pid=19101): stdout: | (launched: 2022-12-13_18:50:19.511036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:21.235030 run osmo-stp_10.42.42.5(pid=19101): stderr: | 20221213185019679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185019679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185019679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185019680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185019680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185019680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185019680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:21.382184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:50:21.391184 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:50:21.417556 run osmo-hlr_10.42.42.2(pid=19098): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19098)] 18:50:21.465487 run osmo-hlr_10.42.42.2(pid=19098): stdout: | (launched: 2022-12-13_18:50:18.541549) 18:50:21.514816 run osmo-hlr_10.42.42.2(pid=19098): stderr: | 20221213185018718 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185018718 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185018718 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185018718 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185018718 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185018719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185018731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185018739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185018739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185018739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:21.583828 run osmo-msc_10.42.42.6(pid=19104): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19104)] 18:50:21.631755 run osmo-msc_10.42.42.6(pid=19104): stdout: | (launched: 2022-12-13_18:50:20.493418) 18:50:21.681273 run osmo-msc_10.42.42.6(pid=19104): stderr: | 20221213185020766 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185020766 DLGLOBAL DEBUG validating counter group 0x7f73570ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185020766 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185020766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185020766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185020766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185020768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185020768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185020769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185020769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:21.731068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminating (SIGTERM) 18:50:21.770771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminating (SIGTERM) 18:50:21.810511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminating (SIGTERM) 18:50:21.850495 --- ParallelTerminationStrategy: PID 19097 died... 18:50:21.869853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminated: ok {rc=0} 18:50:21.914082 --- ParallelTerminationStrategy: PID 19100 died... 18:50:21.932821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminated: ok {rc=0} 18:50:21.977569 --- ParallelTerminationStrategy: PID 19103 died... 18:50:21.996562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminated: ok {rc=0} 18:50:22.082959 bus /sierra_3: Setting Powered False 18:50:23.183062 bus /sierra_3: Setting Powered False 18:50:24.296281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:50:25.528169 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:25.536627 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:50:25.558197 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:50:25.586783 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:50:25.639906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:50:25.661577 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:50:25.689999 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:50:26.240109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:50:26.289496 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.300589 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:50:26.357164 tst mo_mt_call.py: using LAC 35560 18:50:26.478632 tst mo_mt_call.py: using RAC 115 18:50:26.599116 tst mo_mt_call.py: using CellId 35560 18:50:26.722108 tst mo_mt_call.py: using BVCI 35561 18:50:26.834926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.846253 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.857182 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.868019 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.879007 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:26.889971 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:50:27.006206 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:50:27.128776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:27.605629 run create_hlr_db(pid=19109): Launched 18:50:27.731720 bus /sierra_2: Setting Powered False 18:50:28.792523 run create_hlr_db(pid=19109): Terminated: ok {rc=0} 18:50:29.242543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Launched 18:50:29.574954 run osmo-hlr_10.42.42.2(pid=19112): Launched 18:50:29.701958 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:30.272924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Launched 18:50:30.603348 run osmo-stp_10.42.42.5(pid=19115): Launched 18:50:30.730817 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:31.367605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Launched 18:50:31.696787 run osmo-msc_10.42.42.6(pid=19118): Launched 18:50:32.050939 run osmo-stp_10.42.42.5(pid=19115): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] 18:50:32.262120 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-13_18:50:30.543093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:32.403043 run osmo-stp_10.42.42.5(pid=19115): stderr: | 20221213185030736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185030736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185030736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185030737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185030737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185030737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185030737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:32.542880 run osmo-stp_10.42.42.5(pid=19115): stdout: | (launched: 2022-12-13_18:50:30.543093) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:32.675188 run osmo-stp_10.42.42.5(pid=19115): stderr: | 20221213185030736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185030736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185030736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185030737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185030737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185030737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185030737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:32.833655 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:50:32.843344 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:50:32.871546 run osmo-hlr_10.42.42.2(pid=19112): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19112)] 18:50:32.923534 run osmo-hlr_10.42.42.2(pid=19112): stdout: | (launched: 2022-12-13_18:50:29.514650) 18:50:32.976625 run osmo-hlr_10.42.42.2(pid=19112): stderr: | 20221213185029713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185029713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185029713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185029713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185029713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185029713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185029727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185029737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185029737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185029737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:33.050245 run osmo-msc_10.42.42.6(pid=19118): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19118)] 18:50:33.100854 run osmo-msc_10.42.42.6(pid=19118): stdout: | (launched: 2022-12-13_18:50:31.638510) 18:50:33.153941 run osmo-msc_10.42.42.6(pid=19118): stderr: | 20221213185032213 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185032213 DLGLOBAL DEBUG validating counter group 0x7fd916e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185032213 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185032213 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185032214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185032214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185032215 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185032216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185032216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185032216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:33.207017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminating (SIGTERM) 18:50:33.249216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminating (SIGTERM) 18:50:33.291949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Terminating (SIGTERM) 18:50:33.334845 --- ParallelTerminationStrategy: PID 19111 died... 18:50:33.355507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19111): Terminated: ok {rc=0} 18:50:33.402551 --- ParallelTerminationStrategy: PID 19114 died... 18:50:33.422663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19114): Terminated: ok {rc=0} 18:50:33.469422 --- ParallelTerminationStrategy: PID 19117 died... 18:50:33.489397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19117): Terminated: ok {rc=0} 18:50:33.578788 bus /sierra_3: Setting Powered False 18:50:34.678682 bus /sierra_3: Setting Powered False 18:50:35.795128 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:50:36.946983 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:36.959323 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:50:37.017736 tst mo_mt_call_osmux.py: using LAC 35561 18:50:37.145138 tst mo_mt_call_osmux.py: using RAC 116 18:50:37.263703 tst mo_mt_call_osmux.py: using CellId 35561 18:50:37.381303 tst mo_mt_call_osmux.py: using BVCI 35562 18:50:37.491970 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:37.503087 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:37.514017 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:37.524933 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:37.535879 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:50:37.546778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:50:37.668630 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:50:37.785261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:38.262764 run create_hlr_db(pid=19121): Launched 18:50:38.390720 bus /sierra_2: Setting Powered False 18:50:39.452424 run create_hlr_db(pid=19121): Terminated: ok {rc=0} 18:50:39.881752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Launched 18:50:40.190752 run osmo-hlr_10.42.42.2(pid=19124): Launched 18:50:40.307627 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:40.854875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Launched 18:50:41.165360 run osmo-stp_10.42.42.5(pid=19127): Launched 18:50:41.283433 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:41.840606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19129): Launched 18:50:42.149230 run osmo-msc_10.42.42.6(pid=19130): Launched 18:50:42.320798 run osmo-stp_10.42.42.5(pid=19127): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] 18:50:42.451543 run osmo-stp_10.42.42.5(pid=19127): stdout: | (launched: 2022-12-13_18:50:41.107950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:42.580350 run osmo-stp_10.42.42.5(pid=19127): stderr: | 20221213185041278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185041278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185041278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185041279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185041279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185041279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185041279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:42.708095 run osmo-stp_10.42.42.5(pid=19127): stdout: | (launched: 2022-12-13_18:50:41.107950) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:42.830627 run osmo-stp_10.42.42.5(pid=19127): stderr: | 20221213185041278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185041278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185041278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185041279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185041279 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185041279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185041279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:42.976878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19127): Process ended prematurely: osmo-stp_10.42.42.5(pid=19127) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:50:42.985892 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:50:43.012347 run osmo-hlr_10.42.42.2(pid=19124): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19124)] 18:50:43.060294 run osmo-hlr_10.42.42.2(pid=19124): stdout: | (launched: 2022-12-13_18:50:40.134017) 18:50:43.110081 run osmo-hlr_10.42.42.2(pid=19124): stderr: | 20221213185040312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185040312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185040312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185040312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185040312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185040312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185040327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185040337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185040337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185040337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:43.179695 run osmo-msc_10.42.42.6(pid=19130): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19130)] 18:50:43.227744 run osmo-msc_10.42.42.6(pid=19130): stdout: | (launched: 2022-12-13_18:50:42.092263) 18:50:43.277454 run osmo-msc_10.42.42.6(pid=19130): stderr: | 20221213185042366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185042366 DLGLOBAL DEBUG validating counter group 0x7f8a20787c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185042366 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185042366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185042366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185042366 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185042368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185042369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185042369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185042369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:43.327370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Terminating (SIGTERM) 18:50:43.367501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Terminating (SIGTERM) 18:50:43.407463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19129): Terminating (SIGTERM) 18:50:43.447894 --- ParallelTerminationStrategy: PID 19123 died... 18:50:43.467236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19123): Terminated: ok {rc=0} 18:50:43.511295 --- ParallelTerminationStrategy: PID 19126 died... 18:50:43.529871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19126): Terminated: ok {rc=0} 18:50:43.573611 --- ParallelTerminationStrategy: PID 19129 died... 18:50:43.592316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19129): Terminated: ok {rc=0} 18:50:43.678454 bus /sierra_3: Setting Powered False 18:50:44.778055 bus /sierra_3: Setting Powered False 18:50:45.912737 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:50:47.206330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:47.215757 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:50:47.238181 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:50:47.270519 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:50:47.326788 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:50:47.347593 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:50:47.374307 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:50:47.928591 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:50:47.982085 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:47.993876 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:50:48.051421 tst mo_mt_call.py: using LAC 35562 18:50:48.180467 tst mo_mt_call.py: using RAC 117 18:50:48.311527 tst mo_mt_call.py: using CellId 35562 18:50:48.434269 tst mo_mt_call.py: using BVCI 35563 18:50:48.548101 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:48.559569 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:48.570676 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:48.581853 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:48.592694 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:48.603646 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:48.723471 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:48.840489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:49.317105 run create_hlr_db(pid=19135): Launched 18:50:49.443587 bus /sierra_2: Setting Powered False 18:50:50.504390 run create_hlr_db(pid=19135): Terminated: ok {rc=0} 18:50:50.955688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Launched 18:50:51.288335 run osmo-hlr_10.42.42.2(pid=19138): Launched 18:50:51.415406 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:51.989151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19144): Launched 18:50:52.321584 run osmo-stp_10.42.42.5(pid=19145): Launched 18:50:52.447900 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:53.044207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19147): Launched 18:50:53.375671 run osmo-msc_10.42.42.6(pid=19148): Launched 18:50:53.560707 run osmo-stp_10.42.42.5(pid=19145): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19145)] 18:50:53.700595 run osmo-stp_10.42.42.5(pid=19145): stdout: | (launched: 2022-12-13_18:50:52.260850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:53.840336 run osmo-stp_10.42.42.5(pid=19145): stderr: | 20221213185052453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185052453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185052453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185052454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185052454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185052454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185052454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:53.978819 run osmo-stp_10.42.42.5(pid=19145): stdout: | (launched: 2022-12-13_18:50:52.260850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:54.111629 run osmo-stp_10.42.42.5(pid=19145): stderr: | 20221213185052453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185052453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185052453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185052454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185052454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185052454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185052454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:54.270322 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19145): Process ended prematurely: osmo-stp_10.42.42.5(pid=19145) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19145)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:50:54.280091 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:50:54.308019 run osmo-hlr_10.42.42.2(pid=19138): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19138)] 18:50:54.359204 run osmo-hlr_10.42.42.2(pid=19138): stdout: | (launched: 2022-12-13_18:50:51.227663) 18:50:54.412166 run osmo-hlr_10.42.42.2(pid=19138): stderr: | 20221213185051427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185051427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185051427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185051427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185051427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185051427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185051472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185051482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185051482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185051482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:54.485420 run osmo-msc_10.42.42.6(pid=19148): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19148)] 18:50:54.536064 run osmo-msc_10.42.42.6(pid=19148): stdout: | (launched: 2022-12-13_18:50:53.314995) 18:50:54.588850 run osmo-msc_10.42.42.6(pid=19148): stderr: | 20221213185053638 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185053638 DLGLOBAL DEBUG validating counter group 0x7ff0c6c90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185053638 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185053638 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185053638 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185053638 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185053640 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185053640 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185053641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185053641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:54.641479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminating (SIGTERM) 18:50:54.683404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19144): Terminating (SIGTERM) 18:50:54.725985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19147): Terminating (SIGTERM) 18:50:54.768313 --- ParallelTerminationStrategy: PID 19137 died... 18:50:54.788649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19137): Terminated: ok {rc=0} 18:50:54.835786 --- ParallelTerminationStrategy: PID 19144 died... 18:50:54.855956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19144): Terminated: ok {rc=0} 18:50:54.902882 --- ParallelTerminationStrategy: PID 19147 died... 18:50:54.922849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19147): Terminated: ok {rc=0} 18:50:55.011855 bus /sierra_3: Setting Powered False 18:50:56.111269 bus /sierra_3: Setting Powered False 18:50:57.230050 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:50:58.377062 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.388735 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:50:58.449355 tst mo_mt_call_osmux.py: using LAC 35563 18:50:58.569844 tst mo_mt_call_osmux.py: using RAC 118 18:50:58.690869 tst mo_mt_call_osmux.py: using CellId 35563 18:50:58.810919 tst mo_mt_call_osmux.py: using BVCI 35564 18:50:58.923540 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.934791 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.946201 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.957212 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.968122 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:58.979171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:59.100014 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:59.221409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:59.734849 run create_hlr_db(pid=19150): Launched 18:50:59.863291 bus /sierra_2: Setting Powered False 18:51:00.941917 run create_hlr_db(pid=19150): Terminated: ok {rc=0} 18:51:01.438137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Launched 18:51:01.785953 run osmo-hlr_10.42.42.2(pid=19153): Launched 18:51:01.968266 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:02.630344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Launched 18:51:02.940429 run osmo-stp_10.42.42.5(pid=19156): Launched 18:51:03.057818 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:03.612297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Launched 18:51:03.920408 run osmo-msc_10.42.42.6(pid=19159): Launched 18:51:04.092227 run osmo-stp_10.42.42.5(pid=19156): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] 18:51:04.226971 run osmo-stp_10.42.42.5(pid=19156): stdout: | (launched: 2022-12-13_18:51:02.883022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:04.356596 run osmo-stp_10.42.42.5(pid=19156): stderr: | 20221213185103052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185103053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185103053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185103053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185103054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185103054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185103054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:04.483890 run osmo-stp_10.42.42.5(pid=19156): stdout: | (launched: 2022-12-13_18:51:02.883022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:04.606834 run osmo-stp_10.42.42.5(pid=19156): stderr: | 20221213185103052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185103053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185103053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185103053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185103054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185103054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185103054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:04.752694 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19156): Process ended prematurely: osmo-stp_10.42.42.5(pid=19156) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:51:04.761573 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:51:04.788270 run osmo-hlr_10.42.42.2(pid=19153): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19153)] 18:51:04.836672 run osmo-hlr_10.42.42.2(pid=19153): stdout: | (launched: 2022-12-13_18:51:01.724642) 18:51:04.887251 run osmo-hlr_10.42.42.2(pid=19153): stderr: | 20221213185102089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185102089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185102089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185102089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185102089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185102089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185102106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185102124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185102124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185102124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:04.957293 run osmo-msc_10.42.42.6(pid=19159): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19159)] 18:51:05.005430 run osmo-msc_10.42.42.6(pid=19159): stdout: | (launched: 2022-12-13_18:51:03.863675) 18:51:05.055358 run osmo-msc_10.42.42.6(pid=19159): stderr: | 20221213185104140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185104140 DLGLOBAL DEBUG validating counter group 0x7f1ecdd28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185104140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185104140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185104140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185104140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185104142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185104143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185104143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185104143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:05.105650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Terminating (SIGTERM) 18:51:05.145764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Terminating (SIGTERM) 18:51:05.185740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Terminating (SIGTERM) 18:51:05.226320 --- ParallelTerminationStrategy: PID 19152 died... 18:51:05.245528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19152): Terminated: ok {rc=0} 18:51:05.290211 --- ParallelTerminationStrategy: PID 19155 died... 18:51:05.309170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19155): Terminated: ok {rc=0} 18:51:05.353703 --- ParallelTerminationStrategy: PID 19158 died... 18:51:05.372576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19158): Terminated: ok {rc=0} 18:51:05.458348 bus /sierra_3: Setting Powered False 18:51:06.559834 bus /sierra_3: Setting Powered False 18:51:07.674129 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:51:08.918284 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:51:08.925279 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:51:08.946625 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:51:08.975034 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:51:09.029768 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:51:09.052203 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:51:09.080135 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:51:09.627362 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:51:09.676708 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:09.688157 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:51:09.743387 tst mo_mt_call.py: using LAC 35564 18:51:09.867079 tst mo_mt_call.py: using RAC 119 18:51:09.987017 tst mo_mt_call.py: using CellId 35564 18:51:10.105967 tst mo_mt_call.py: using BVCI 35565 18:51:10.216817 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:10.228074 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:10.239037 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:10.249984 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:10.260846 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:10.271837 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:51:10.393531 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:51:10.517461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:11.031198 run create_hlr_db(pid=19164): Launched 18:51:11.157466 bus /sierra_2: Setting Powered False 18:51:12.222647 run create_hlr_db(pid=19164): Terminated: ok {rc=0} 18:51:12.661968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19166): Launched 18:51:12.968750 run osmo-hlr_10.42.42.2(pid=19167): Launched 18:51:13.086233 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:13.628386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19169): Launched 18:51:13.935145 run osmo-stp_10.42.42.5(pid=19170): Launched 18:51:14.052471 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:14.609084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19172): Launched 18:51:14.917120 run osmo-msc_10.42.42.6(pid=19173): Launched 18:51:15.088744 run osmo-stp_10.42.42.5(pid=19170): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19170)] 18:51:15.219916 run osmo-stp_10.42.42.5(pid=19170): stdout: | (launched: 2022-12-13_18:51:13.878632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:15.349896 run osmo-stp_10.42.42.5(pid=19170): stderr: | 20221213185114049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185114049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185114049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185114050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185114050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185114050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185114050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:15.477846 run osmo-stp_10.42.42.5(pid=19170): stdout: | (launched: 2022-12-13_18:51:13.878632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:15.600638 run osmo-stp_10.42.42.5(pid=19170): stderr: | 20221213185114049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185114049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185114049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185114050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185114050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185114050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185114050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:15.747215 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19170): Process ended prematurely: osmo-stp_10.42.42.5(pid=19170) [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19170)] [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:51:15.756305 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:51:15.782722 run osmo-hlr_10.42.42.2(pid=19167): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19167)] 18:51:15.830635 run osmo-hlr_10.42.42.2(pid=19167): stdout: | (launched: 2022-12-13_18:51:12.912462) 18:51:15.900724 run osmo-hlr_10.42.42.2(pid=19167): stderr: | 20221213185113089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185113089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185113089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185113089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185113089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185113089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185113101 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185113110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185113110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185113110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:15.988012 run osmo-msc_10.42.42.6(pid=19173): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19173)] 18:51:16.037480 run osmo-msc_10.42.42.6(pid=19173): stdout: | (launched: 2022-12-13_18:51:14.860282) 18:51:16.087748 run osmo-msc_10.42.42.6(pid=19173): stderr: | 20221213185115134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185115134 DLGLOBAL DEBUG validating counter group 0x7fbdacc84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185115134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185115134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185115134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185115135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185115136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185115137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185115137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185115137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:16.138520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19166): Terminating (SIGTERM) 18:51:16.179257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19169): Terminating (SIGTERM) 18:51:16.220316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19172): Terminating (SIGTERM) 18:51:16.262832 --- ParallelTerminationStrategy: PID 19166 died... 18:51:16.282532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19166): Terminated: ok {rc=0} 18:51:16.327658 --- ParallelTerminationStrategy: PID 19169 died... 18:51:16.347161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19169): Terminated: ok {rc=0} 18:51:16.392270 --- ParallelTerminationStrategy: PID 19172 died... 18:51:16.411748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19172): Terminated: ok {rc=0} 18:51:16.497034 bus /sierra_3: Setting Powered False 18:51:17.596007 bus /sierra_3: Setting Powered False 18:51:18.715179 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:51:19.867829 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:19.880182 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:51:19.940113 tst mo_mt_call_osmux.py: using LAC 35565 18:51:20.063728 tst mo_mt_call_osmux.py: using RAC 120 18:51:20.195533 tst mo_mt_call_osmux.py: using CellId 35565 18:51:20.328046 tst mo_mt_call_osmux.py: using BVCI 35566 18:51:20.442177 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:20.453804 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:20.464915 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:20.476070 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:20.487399 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:51:20.498972 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:51:20.618880 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:51:20.736161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:21.252935 run create_hlr_db(pid=19175): Launched 18:51:21.379498 bus /sierra_2: Setting Powered False 18:51:22.445639 run create_hlr_db(pid=19175): Terminated: ok {rc=0} 18:51:22.886953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Launched 18:51:23.195882 run osmo-hlr_10.42.42.2(pid=19178): Launched 18:51:23.313581 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:23.861295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Launched 18:51:24.168662 run osmo-stp_10.42.42.5(pid=19181): Launched 18:51:24.286038 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:24.842082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19183): Launched 18:51:25.150716 run osmo-msc_10.42.42.6(pid=19184): Launched 18:51:25.322630 run osmo-stp_10.42.42.5(pid=19181): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] 18:51:25.452436 run osmo-stp_10.42.42.5(pid=19181): stdout: | (launched: 2022-12-13_18:51:24.111799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:25.582012 run osmo-stp_10.42.42.5(pid=19181): stderr: | 20221213185124281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185124281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185124282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185124282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185124283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185124283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185124283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:25.709852 run osmo-stp_10.42.42.5(pid=19181): stdout: | (launched: 2022-12-13_18:51:24.111799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:25.832429 run osmo-stp_10.42.42.5(pid=19181): stderr: | 20221213185124281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185124281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185124282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185124282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185124283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185124283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185124283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:25.979033 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19181): Process ended prematurely: osmo-stp_10.42.42.5(pid=19181) [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:51:25.988067 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:51:26.014572 run osmo-hlr_10.42.42.2(pid=19178): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19178)] 18:51:26.062352 run osmo-hlr_10.42.42.2(pid=19178): stdout: | (launched: 2022-12-13_18:51:23.139256) 18:51:26.112006 run osmo-hlr_10.42.42.2(pid=19178): stderr: | 20221213185123315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185123315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185123315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185123315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185123315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185123315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185123328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185123336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185123336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185123336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:26.181110 run osmo-msc_10.42.42.6(pid=19184): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19184)] 18:51:26.228864 run osmo-msc_10.42.42.6(pid=19184): stdout: | (launched: 2022-12-13_18:51:25.094007) 18:51:26.278327 run osmo-msc_10.42.42.6(pid=19184): stderr: | 20221213185125367 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185125367 DLGLOBAL DEBUG validating counter group 0x7f24b32e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185125367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185125368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185125368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185125368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185125370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185125370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185125370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185125370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:26.327844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Terminating (SIGTERM) 18:51:26.367547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Terminating (SIGTERM) 18:51:26.407208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19183): Terminating (SIGTERM) 18:51:26.447316 --- ParallelTerminationStrategy: PID 19177 died... 18:51:26.466784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19177): Terminated: ok {rc=0} 18:51:26.510897 --- ParallelTerminationStrategy: PID 19180 died... 18:51:26.529794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19180): Terminated: ok {rc=0} 18:51:26.573522 --- ParallelTerminationStrategy: PID 19183 died... 18:51:26.592296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19183): Terminated: ok {rc=0} 18:51:26.677668 bus /sierra_3: Setting Powered False 18:51:27.777136 bus /sierra_3: Setting Powered False 18:51:28.892128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:51:30.130181 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:51:30.136377 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:51:30.157984 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:51:30.186797 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:51:30.240495 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:51:30.262428 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:51:30.290363 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:51:30.845495 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:51:30.912179 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:30.925416 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:51:30.991661 tst mo_mt_call.py: using LAC 35566 18:51:31.114979 tst mo_mt_call.py: using RAC 121 18:51:31.271439 tst mo_mt_call.py: using CellId 35566 18:51:31.398986 tst mo_mt_call.py: using BVCI 35567 18:51:31.553076 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:31.567281 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:31.581577 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:31.595779 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:31.610089 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:31.624516 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:51:31.766310 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:51:31.889039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:32.424715 run create_hlr_db(pid=19189): Launched 18:51:32.553393 bus /sierra_2: Setting Powered False 18:51:33.618405 run create_hlr_db(pid=19189): Terminated: ok {rc=0} 18:51:34.059316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Launched 18:51:34.369326 run osmo-hlr_10.42.42.2(pid=19192): Launched 18:51:34.485924 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:35.029479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Launched 18:51:35.337523 run osmo-stp_10.42.42.5(pid=19195): Launched 18:51:35.454292 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:36.008157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19197): Launched 18:51:36.317063 run osmo-msc_10.42.42.6(pid=19198): Launched 18:51:36.488862 run osmo-stp_10.42.42.5(pid=19195): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] 18:51:36.619316 run osmo-stp_10.42.42.5(pid=19195): stdout: | (launched: 2022-12-13_18:51:35.280585) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:36.749176 run osmo-stp_10.42.42.5(pid=19195): stderr: | 20221213185135450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185135450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185135451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185135451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185135452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185135452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185135452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:36.878403 run osmo-stp_10.42.42.5(pid=19195): stdout: | (launched: 2022-12-13_18:51:35.280585) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:37.001849 run osmo-stp_10.42.42.5(pid=19195): stderr: | 20221213185135450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185135450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185135451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185135451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185135452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185135452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185135452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:37.149437 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19195): Process ended prematurely: osmo-stp_10.42.42.5(pid=19195) [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:51:37.158515 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:51:37.185462 run osmo-hlr_10.42.42.2(pid=19192): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19192)] 18:51:37.234283 run osmo-hlr_10.42.42.2(pid=19192): stdout: | (launched: 2022-12-13_18:51:34.312182) 18:51:37.284734 run osmo-hlr_10.42.42.2(pid=19192): stderr: | 20221213185134487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185134487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185134487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185134488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185134488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185134488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185134500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185134510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185134511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185134511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:37.355098 run osmo-msc_10.42.42.6(pid=19198): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19198)] 18:51:37.403426 run osmo-msc_10.42.42.6(pid=19198): stdout: | (launched: 2022-12-13_18:51:36.260154) 18:51:37.453226 run osmo-msc_10.42.42.6(pid=19198): stderr: | 20221213185136535 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185136535 DLGLOBAL DEBUG validating counter group 0x7fbf6ae28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185136535 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185136535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185136535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185136535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185136537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185136538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185136538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185136538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:37.503088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Terminating (SIGTERM) 18:51:37.543137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Terminating (SIGTERM) 18:51:37.583035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19197): Terminating (SIGTERM) 18:51:37.623538 --- ParallelTerminationStrategy: PID 19191 died... 18:51:37.643740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19191): Terminated: ok {rc=0} 18:51:37.688427 --- ParallelTerminationStrategy: PID 19194 died... 18:51:37.707609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19194): Terminated: ok {rc=0} 18:51:37.752051 --- ParallelTerminationStrategy: PID 19197 died... 18:51:37.771016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19197): Terminated: ok {rc=0} 18:51:37.858210 bus /sierra_3: Setting Powered False 18:51:38.957947 bus /sierra_3: Setting Powered False 18:51:40.071317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:51:41.223266 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.235529 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:51:41.296327 tst mo_mt_call_osmux.py: using LAC 35567 18:51:41.426436 tst mo_mt_call_osmux.py: using RAC 122 18:51:41.558660 tst mo_mt_call_osmux.py: using CellId 35567 18:51:41.689099 tst mo_mt_call_osmux.py: using BVCI 35568 18:51:41.810016 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.821607 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.832712 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.843936 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.855447 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:51:41.867157 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:51:41.985471 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:51:42.104577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:42.618801 run create_hlr_db(pid=19200): Launched 18:51:42.746251 bus /sierra_2: Setting Powered False 18:51:43.811681 run create_hlr_db(pid=19200): Terminated: ok {rc=0} 18:51:44.252716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19202): Launched 18:51:44.561056 run osmo-hlr_10.42.42.2(pid=19203): Launched 18:51:44.678667 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:45.212242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19205): Launched 18:51:45.519036 run osmo-stp_10.42.42.5(pid=19206): Launched 18:51:45.635975 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:46.210658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19208): Launched 18:51:46.541935 run osmo-msc_10.42.42.6(pid=19209): Launched 18:51:46.943587 run osmo-stp_10.42.42.5(pid=19206): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19206)] 18:51:47.168075 run osmo-stp_10.42.42.5(pid=19206): stdout: | (launched: 2022-12-13_18:51:45.462418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:47.298935 run osmo-stp_10.42.42.5(pid=19206): stderr: | 20221213185145634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185145634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185145634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185145634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185145635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185145635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185145635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:47.428156 run osmo-stp_10.42.42.5(pid=19206): stdout: | (launched: 2022-12-13_18:51:45.462418) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:47.551368 run osmo-stp_10.42.42.5(pid=19206): stderr: | 20221213185145634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185145634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185145634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185145634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185145635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185145635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185145635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:47.698982 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19206): Process ended prematurely: osmo-stp_10.42.42.5(pid=19206) [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19206)] [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:51:47.707924 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:51:47.734762 run osmo-hlr_10.42.42.2(pid=19203): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19203)] 18:51:47.783586 run osmo-hlr_10.42.42.2(pid=19203): stdout: | (launched: 2022-12-13_18:51:44.504279) 18:51:47.833832 run osmo-hlr_10.42.42.2(pid=19203): stderr: | 20221213185144680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185144680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185144680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185144680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185144680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185144680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185144692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185144700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185144701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185144701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:47.904291 run osmo-msc_10.42.42.6(pid=19209): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19209)] 18:51:47.952757 run osmo-msc_10.42.42.6(pid=19209): stdout: | (launched: 2022-12-13_18:51:46.480087) 18:51:48.002701 run osmo-msc_10.42.42.6(pid=19209): stderr: | 20221213185146860 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185146861 DLGLOBAL DEBUG validating counter group 0x7f0f97a48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185146861 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185146861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185146861 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185146861 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185146863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185146863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185146863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185146863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:48.053144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19202): Terminating (SIGTERM) 18:51:48.093486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19205): Terminating (SIGTERM) 18:51:48.133847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19208): Terminating (SIGTERM) 18:51:48.174291 --- ParallelTerminationStrategy: PID 19202 died... 18:51:48.193692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19202): Terminated: ok {rc=0} 18:51:48.238172 --- ParallelTerminationStrategy: PID 19205 died... 18:51:48.257136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19205): Terminated: ok {rc=0} 18:51:48.301568 --- ParallelTerminationStrategy: PID 19208 died... 18:51:48.320484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19208): Terminated: ok {rc=0} 18:51:48.407456 bus /sierra_3: Setting Powered False 18:51:49.507267 bus /sierra_3: Setting Powered False 18:51:50.623631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:oc2g --------------------------------------------------------------------- 18:51:51.857769 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:51:51.862270 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 18:51:51.882939 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 18:51:51.909614 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 18:51:51.994500 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 18:51:52.015206 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 18:51:52.041554 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 18:51:52.624500 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 18:51:52.629422 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:52.640083 tst emergency:oc2g: Using 1 x bts (candidates: 1) 18:51:52.675290 tst emergency_mo_mt_call.py: using LAC 35568 18:51:52.796745 tst emergency_mo_mt_call.py: using RAC 123 18:51:52.913661 tst emergency_mo_mt_call.py: using CellId 35568 18:51:53.030407 tst emergency_mo_mt_call.py: using BVCI 35569 18:51:53.141141 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:53.151825 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:53.162370 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:53.172730 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:53.183240 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:51:53.193712 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:51:53.312018 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:51:53.429319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:53.898981 run create_hlr_db(pid=19215): Launched 18:51:54.022625 bus /sierra_2: Setting Powered False 18:51:55.083984 run create_hlr_db(pid=19215): Terminated: ok {rc=0} 18:51:55.507708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19217): Launched 18:51:55.811079 run osmo-hlr_10.42.42.2(pid=19218): Launched 18:51:55.925747 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:56.460181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19220): Launched 18:51:56.762396 run osmo-stp_10.42.42.5(pid=19221): Launched 18:51:56.886892 tst emergency_mo_mt_call.py: using MSISDN 8282 18:51:57.042014 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:57.585563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19223): Launched 18:51:57.888017 run osmo-msc_10.42.42.6(pid=19224): Launched 18:51:58.056870 run osmo-stp_10.42.42.5(pid=19221): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19221)] 18:51:58.183975 run osmo-stp_10.42.42.5(pid=19221): stdout: | (launched: 2022-12-13_18:51:56.706590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:58.311062 run osmo-stp_10.42.42.5(pid=19221): stderr: | 20221213185156875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185156875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185156875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185156876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185156876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185156876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185156876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:58.436922 run osmo-stp_10.42.42.5(pid=19221): stdout: | (launched: 2022-12-13_18:51:56.706590) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:58.558070 run osmo-stp_10.42.42.5(pid=19221): stderr: | 20221213185156875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185156875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185156875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185156876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185156876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185156876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185156876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:58.702517 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=19221): Process ended prematurely: osmo-stp_10.42.42.5(pid=19221) [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19221)] [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py:19] 18:51:58.710931 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 18:51:58.737366 run osmo-hlr_10.42.42.2(pid=19218): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19218)] 18:51:58.786522 run osmo-hlr_10.42.42.2(pid=19218): stdout: | (launched: 2022-12-13_18:51:55.755322) 18:51:58.836896 run osmo-hlr_10.42.42.2(pid=19218): stderr: | 20221213185155931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185155931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185155931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185155931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185155931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185155931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185155944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185155954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185155955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185155955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:58.906725 run osmo-msc_10.42.42.6(pid=19224): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19224)] 18:51:58.955562 run osmo-msc_10.42.42.6(pid=19224): stdout: | (launched: 2022-12-13_18:51:57.832330) 18:51:59.005588 run osmo-msc_10.42.42.6(pid=19224): stderr: | 20221213185158106 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185158106 DLGLOBAL DEBUG validating counter group 0x7fe542415c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185158106 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185158106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185158106 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185158106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185158108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185158109 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185158109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185158109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:59.055868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19217): Terminating (SIGTERM) 18:51:59.096326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19220): Terminating (SIGTERM) 18:51:59.136529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19223): Terminating (SIGTERM) 18:51:59.177132 --- ParallelTerminationStrategy: PID 19217 died... 18:51:59.196488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19217): Terminated: ok {rc=0} 18:51:59.241243 --- ParallelTerminationStrategy: PID 19220 died... 18:51:59.260428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19220): Terminated: ok {rc=0} 18:51:59.305190 --- ParallelTerminationStrategy: PID 19223 died... 18:51:59.324372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19223): Terminated: ok {rc=0} 18:51:59.412316 bus /sierra_3: Setting Powered False 18:52:00.513262 bus /sierra_3: Setting Powered False 18:52:01.644355 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 18:52:02.743000 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:02.754669 tst emergency:oc2g: Using 1 x bts (candidates: 1) 18:52:02.792201 tst emergency_preemptive_call.py: using LAC 35569 18:52:02.912055 tst emergency_preemptive_call.py: using RAC 124 18:52:03.041342 tst emergency_preemptive_call.py: using CellId 35569 18:52:03.168716 tst emergency_preemptive_call.py: using BVCI 35570 18:52:03.287402 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:03.298841 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:03.310162 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:03.321435 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:03.333110 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 18:52:03.344608 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:52:03.465361 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:52:03.586365 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:52:03.707071 tst emergency:oc2g: Using 1 x modem (candidates: 4) 18:52:03.824730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:04.333906 run create_hlr_db(pid=19226): Launched 18:52:04.460742 bus /sierra_2: Setting Powered False 18:52:05.525357 run create_hlr_db(pid=19226): Terminated: ok {rc=0} 18:52:05.981614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19228): Launched 18:52:06.308856 run osmo-hlr_10.42.42.2(pid=19229): Launched 18:52:06.434356 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:06.998451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19231): Launched 18:52:07.326984 run osmo-stp_10.42.42.5(pid=19232): Launched 18:52:07.463347 tst emergency_preemptive_call.py: using MSISDN 8283 18:52:07.633576 run osmo-msc_10.42.42.6: Starting osmo-msc 18:52:08.219040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19234): Launched 18:52:08.547251 run osmo-msc_10.42.42.6(pid=19235): Launched 18:52:08.730693 run osmo-stp_10.42.42.5(pid=19232): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19232)] 18:52:08.868160 run osmo-stp_10.42.42.5(pid=19232): stdout: | (launched: 2022-12-13_18:52:07.266881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:09.006692 run osmo-stp_10.42.42.5(pid=19232): stderr: | 20221213185207458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185207458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185207459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185207459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185207460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185207460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185207460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:09.143746 run osmo-stp_10.42.42.5(pid=19232): stdout: | (launched: 2022-12-13_18:52:07.266881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:09.274355 run osmo-stp_10.42.42.5(pid=19232): stderr: | 20221213185207458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185207458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185207459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185207459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185207460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185207460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185207460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:09.430690 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=19232): Process ended prematurely: osmo-stp_10.42.42.5(pid=19232) [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19232)] [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py:32] 18:52:09.439770 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 18:52:09.468421 run osmo-hlr_10.42.42.2(pid=19229): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19229)] 18:52:09.520012 run osmo-hlr_10.42.42.2(pid=19229): stdout: | (launched: 2022-12-13_18:52:06.248924) 18:52:09.572852 run osmo-hlr_10.42.42.2(pid=19229): stderr: | 20221213185206448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185206448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185206448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185206448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185206448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185206448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185206460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185206468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185206469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185206469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:09.646286 run osmo-msc_10.42.42.6(pid=19235): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19235)] 18:52:09.696624 run osmo-msc_10.42.42.6(pid=19235): stdout: | (launched: 2022-12-13_18:52:08.487251) 18:52:09.749556 run osmo-msc_10.42.42.6(pid=19235): stderr: | 20221213185208808 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185208809 DLGLOBAL DEBUG validating counter group 0x7f4e01e65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185208809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185208809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185208809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185208809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185208811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185208812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185208812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185208812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:52:09.802404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19228): Terminating (SIGTERM) 18:52:09.844817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19231): Terminating (SIGTERM) 18:52:09.887331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19234): Terminating (SIGTERM) 18:52:09.930122 --- ParallelTerminationStrategy: PID 19228 died... 18:52:09.950702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19228): Terminated: ok {rc=0} 18:52:09.997802 --- ParallelTerminationStrategy: PID 19231 died... 18:52:10.018043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19231): Terminated: ok {rc=0} 18:52:10.065112 --- ParallelTerminationStrategy: PID 19234 died... 18:52:10.085331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19234): Terminated: ok {rc=0} 18:52:10.174909 bus /sierra_9: Setting Powered False 18:52:11.274120 bus /sierra_9: Setting Powered False 18:52:12.392508 bus /sierra_8: Setting Powered False 18:52:13.492240 bus /sierra_8: Setting Powered False 18:52:14.609143 bus /sierra_3: Setting Powered False 18:52:15.707084 bus /sierra_3: Setting Powered False 18:52:16.832241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:oc2g --------------------------------------------------------------------- 18:52:18.111191 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:52:18.115505 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 18:52:18.136152 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 18:52:18.175174 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 18:52:18.261258 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 18:52:18.281895 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 18:52:18.320314 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 18:52:18.910120 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 18:52:18.960692 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:18.971599 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:52:19.005792 tst cs_paging_gprs_active.py: using LAC 35570 18:52:19.127718 tst cs_paging_gprs_active.py: using RAC 125 18:52:19.247481 tst cs_paging_gprs_active.py: using CellId 35570 18:52:19.367182 tst cs_paging_gprs_active.py: using BVCI 35571 18:52:19.480779 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.491433 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.501837 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.512129 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.522509 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.532911 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.543326 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.554526 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:19.565190 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:19.687125 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:19.805062 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:52:20.012003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:20.321422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Launched 18:52:20.590038 run iperf3-srv_10.42.42.10(pid=19241): Launched 18:52:20.707654 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:52:20.914802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:21.224773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Launched 18:52:21.493374 run iperf3-srv_10.42.42.10(pid=19243): Launched 18:52:21.609295 tst cs_paging_gprs_active.py:38: start network... 18:52:21.817368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:22.295244 run create_hlr_db(pid=19244): Launched 18:52:22.420787 bus /sierra_2: Setting Powered False 18:52:23.482549 run create_hlr_db(pid=19244): Terminated: ok {rc=0} 18:52:23.933666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Launched 18:52:24.263924 run osmo-hlr_10.42.42.2(pid=19247): Launched 18:52:24.391612 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:24.962419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Launched 18:52:25.294570 run osmo-stp_10.42.42.5(pid=19250): Launched 18:52:25.422513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:25.992258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19252): Launched 18:52:26.120463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:26.399791 run patchelf(pid=19253): Launched 18:52:26.585496 run osmo-stp_10.42.42.5(pid=19250): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] 18:52:26.725738 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-13_18:52:25.234148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:26.867489 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221213185225425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185225425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185225425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185225426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185225426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185225426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185225426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:27.009307 run osmo-stp_10.42.42.5(pid=19250): stdout: | (launched: 2022-12-13_18:52:25.234148) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:27.144931 run osmo-stp_10.42.42.5(pid=19250): stderr: | 20221213185225425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185225425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185225425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185225426 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185225426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185225426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185225426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:27.306425 run patchelf(pid=19253): Terminating (SIGINT) 18:52:27.492441 run patchelf(pid=19253): Terminated: ok {rc=0} 18:52:27.626767 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2393↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] [trial-2393↪gprs:oc2g↪cs_paging_gprs_active.py:38] 18:52:27.636720 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:52:27.665746 run osmo-hlr_10.42.42.2(pid=19247): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19247)] 18:52:27.716701 run osmo-hlr_10.42.42.2(pid=19247): stdout: | (launched: 2022-12-13_18:52:24.203699) 18:52:27.768844 run osmo-hlr_10.42.42.2(pid=19247): stderr: | 20221213185224401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185224401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185224401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185224401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185224401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185224401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185224414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185224422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185224422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185224422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:27.821558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Terminating (SIGTERM) 18:52:27.863367 run iperf3-srv_10.42.42.10(pid=19241): Terminating (SIGTERM) 18:52:27.905987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Terminating (SIGTERM) 18:52:27.948257 run iperf3-srv_10.42.42.10(pid=19243): Terminating (SIGTERM) 18:52:27.990493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminating (SIGTERM) 18:52:28.032691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminating (SIGTERM) 18:52:28.075228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19252): Terminating (SIGTERM) 18:52:28.117912 --- ParallelTerminationStrategy: PID 19240 died... 18:52:28.138661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19240): Terminated: ok {rc=0} 18:52:28.185980 --- ParallelTerminationStrategy: PID 19241 died... 18:52:28.206150 run iperf3-srv_10.42.42.10(pid=19241): Terminated {rc=256} 18:52:28.252840 --- ParallelTerminationStrategy: PID 19242 died... 18:52:28.273457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19242): Terminated: ok {rc=0} 18:52:28.320166 --- ParallelTerminationStrategy: PID 19243 died... 18:52:28.340340 run iperf3-srv_10.42.42.10(pid=19243): Terminated {rc=256} 18:52:28.387026 --- ParallelTerminationStrategy: PID 19246 died... 18:52:28.407269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19246): Terminated: ok {rc=0} 18:52:28.454145 --- ParallelTerminationStrategy: PID 19249 died... 18:52:28.474806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19249): Terminated: ok {rc=0} 18:52:28.521924 --- ParallelTerminationStrategy: PID 19252 died... 18:52:28.542157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19252): Terminated: ok {rc=0} 18:52:28.631041 bus /gobi_0: Setting Powered False 18:52:29.730581 bus /gobi_0: Setting Powered False 18:52:30.853407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g iperf3.py ---------------------------------------------- 18:52:32.020111 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.032142 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:52:32.068191 tst iperf3.py: using LAC 35571 18:52:32.202489 tst iperf3.py: using RAC 126 18:52:32.330720 tst iperf3.py: using CellId 35571 18:52:32.452504 tst iperf3.py: using BVCI 35572 18:52:32.573873 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.584898 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.596015 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.607089 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.618346 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.629663 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.640753 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.652008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:32.663315 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:32.786425 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:32.995306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:33.306127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19254): Launched 18:52:33.577184 run iperf3-srv_10.42.42.10(pid=19255): Launched 18:52:33.694895 tst iperf3.py:8: start network... 18:52:33.901430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:34.379237 run create_hlr_db(pid=19256): Launched 18:52:34.506645 bus /gobi_6: Setting Powered False 18:52:35.567780 run create_hlr_db(pid=19256): Terminated: ok {rc=0} 18:52:36.018788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19258): Launched 18:52:36.353150 run osmo-hlr_10.42.42.2(pid=19259): Launched 18:52:36.480373 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:37.050808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19261): Launched 18:52:37.383849 run osmo-stp_10.42.42.5(pid=19262): Launched 18:52:37.510688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:38.084512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19264): Launched 18:52:38.211592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:38.491958 run patchelf(pid=19265): Launched 18:52:38.677663 run osmo-stp_10.42.42.5(pid=19262): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19262)] 18:52:38.817811 run osmo-stp_10.42.42.5(pid=19262): stdout: | (launched: 2022-12-13_18:52:37.323454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:38.959427 run osmo-stp_10.42.42.5(pid=19262): stderr: | 20221213185237515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185237515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185237516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185237516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185237516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185237517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185237517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:39.100748 run osmo-stp_10.42.42.5(pid=19262): stdout: | (launched: 2022-12-13_18:52:37.323454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:39.236833 run osmo-stp_10.42.42.5(pid=19262): stderr: | 20221213185237515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185237515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185237516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185237516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185237516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185237517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185237517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:39.398351 run patchelf(pid=19265): Terminating (SIGINT) 18:52:39.583919 run patchelf(pid=19265): Terminated: ok {rc=0} 18:52:39.717513 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19262): Process ended prematurely: osmo-stp_10.42.42.5(pid=19262) [trial-2393↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19262)] [trial-2393↪gprs:oc2g↪iperf3.py:8] 18:52:39.727820 tst iperf3.py:8: Test FAILED (7.7 sec) 18:52:39.756626 run osmo-hlr_10.42.42.2(pid=19259): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19259)] 18:52:39.807784 run osmo-hlr_10.42.42.2(pid=19259): stdout: | (launched: 2022-12-13_18:52:36.292197) 18:52:39.860576 run osmo-hlr_10.42.42.2(pid=19259): stderr: | 20221213185236490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185236490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185236490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185236491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185236491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185236491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185236503 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185236512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185236512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185236512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:39.913843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19254): Terminating (SIGTERM) 18:52:39.956380 run iperf3-srv_10.42.42.10(pid=19255): Terminating (SIGTERM) 18:52:39.999057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19258): Terminating (SIGTERM) 18:52:40.041738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19261): Terminating (SIGTERM) 18:52:40.084436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19264): Terminating (SIGTERM) 18:52:40.127436 --- ParallelTerminationStrategy: PID 19254 died... 18:52:40.148380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19254): Terminated: ok {rc=0} 18:52:40.195517 --- ParallelTerminationStrategy: PID 19255 died... 18:52:40.215666 run iperf3-srv_10.42.42.10(pid=19255): Terminated {rc=256} 18:52:40.262602 --- ParallelTerminationStrategy: PID 19258 died... 18:52:40.282922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19258): Terminated: ok {rc=0} 18:52:40.330007 --- ParallelTerminationStrategy: PID 19261 died... 18:52:40.350301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19261): Terminated: ok {rc=0} 18:52:40.397291 --- ParallelTerminationStrategy: PID 19264 died... 18:52:40.417604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19264): Terminated: ok {rc=0} 18:52:40.507076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g iperf3m4.py ---------------------------------------------- 18:52:41.659642 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:41.671652 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:52:41.706622 tst iperf3m4.py: using LAC 35572 18:52:41.836323 tst iperf3m4.py: using RAC 127 18:52:41.963637 tst iperf3m4.py: using CellId 35572 18:52:42.091028 tst iperf3m4.py: using BVCI 35573 18:52:42.211051 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.222103 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.233034 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.243976 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.255074 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.266188 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.277543 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.288653 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:52:42.299997 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:42.420736 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:42.543282 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:42.661623 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:52:42.776642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:42.983343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:43.294309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19266): Launched 18:52:43.566179 run iperf3-srv_10.42.42.10(pid=19267): Launched 18:52:43.683937 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:52:43.889649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:44.198782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19268): Launched 18:52:44.468557 run iperf3-srv_10.42.42.10(pid=19269): Launched 18:52:44.583697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:52:44.788825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:45.097832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19270): Launched 18:52:45.365606 run iperf3-srv_10.42.42.10(pid=19271): Launched 18:52:45.480314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:52:45.684750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:46.008755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19272): Launched 18:52:46.346120 run iperf3-srv_10.42.42.10(pid=19273): Launched 18:52:46.480318 tst iperf3m4.py:8: start network... 18:52:46.693742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:47.183587 run create_hlr_db(pid=19274): Launched 18:52:47.336598 bus /gobi_6: Setting Powered False 18:52:48.402319 run create_hlr_db(pid=19274): Terminated: ok {rc=0} 18:52:48.843655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Launched 18:52:49.153278 run osmo-hlr_10.42.42.2(pid=19277): Launched 18:52:49.270108 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:49.815530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Launched 18:52:50.123562 run osmo-stp_10.42.42.5(pid=19280): Launched 18:52:50.241568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:50.772785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19282): Launched 18:52:50.891036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:51.151469 run patchelf(pid=19283): Launched 18:52:51.322008 run osmo-stp_10.42.42.5(pid=19280): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] 18:52:51.452885 run osmo-stp_10.42.42.5(pid=19280): stdout: | (launched: 2022-12-13_18:52:50.066316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:51.584316 run osmo-stp_10.42.42.5(pid=19280): stderr: | 20221213185250237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185250237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185250237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185250237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185250238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185250238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185250238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:51.716257 run osmo-stp_10.42.42.5(pid=19280): stdout: | (launched: 2022-12-13_18:52:50.066316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:51.842251 run osmo-stp_10.42.42.5(pid=19280): stderr: | 20221213185250237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185250237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185250237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185250237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185250238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185250238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185250238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:52.012356 run patchelf(pid=19283): Terminating (SIGINT) 18:52:52.184355 run patchelf(pid=19283): Terminated: ok {rc=0} 18:52:52.308322 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19280): Process ended prematurely: osmo-stp_10.42.42.5(pid=19280) [trial-2393↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] [trial-2393↪gprs:oc2g↪iperf3m4.py:8] 18:52:52.317839 tst iperf3m4.py:8: Test FAILED (10.7 sec) 18:52:52.345361 run osmo-hlr_10.42.42.2(pid=19277): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19277)] 18:52:52.393535 run osmo-hlr_10.42.42.2(pid=19277): stdout: | (launched: 2022-12-13_18:52:49.096117) 18:52:52.443343 run osmo-hlr_10.42.42.2(pid=19277): stderr: | 20221213185249272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185249272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185249272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185249272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185249272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185249272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185249285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185249295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185249295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185249295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:52.493663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19266): Terminating (SIGTERM) 18:52:52.533695 run iperf3-srv_10.42.42.10(pid=19267): Terminating (SIGTERM) 18:52:52.573328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19268): Terminating (SIGTERM) 18:52:52.613137 run iperf3-srv_10.42.42.10(pid=19269): Terminating (SIGTERM) 18:52:52.652636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19270): Terminating (SIGTERM) 18:52:52.692423 run iperf3-srv_10.42.42.10(pid=19271): Terminating (SIGTERM) 18:52:52.732071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19272): Terminating (SIGTERM) 18:52:52.771654 run iperf3-srv_10.42.42.10(pid=19273): Terminating (SIGTERM) 18:52:52.811137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Terminating (SIGTERM) 18:52:52.850790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Terminating (SIGTERM) 18:52:52.890495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19282): Terminating (SIGTERM) 18:52:52.930293 --- ParallelTerminationStrategy: PID 19266 died... 18:52:52.949606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19266): Terminated: ok {rc=0} 18:52:52.994255 --- ParallelTerminationStrategy: PID 19267 died... 18:52:53.013110 run iperf3-srv_10.42.42.10(pid=19267): Terminated {rc=256} 18:52:53.057074 --- ParallelTerminationStrategy: PID 19268 died... 18:52:53.075947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19268): Terminated: ok {rc=0} 18:52:53.120107 --- ParallelTerminationStrategy: PID 19269 died... 18:52:53.138805 run iperf3-srv_10.42.42.10(pid=19269): Terminated {rc=256} 18:52:53.182743 --- ParallelTerminationStrategy: PID 19270 died... 18:52:53.201604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19270): Terminated: ok {rc=0} 18:52:53.245787 --- ParallelTerminationStrategy: PID 19271 died... 18:52:53.264548 run iperf3-srv_10.42.42.10(pid=19271): Terminated {rc=256} 18:52:53.308593 --- ParallelTerminationStrategy: PID 19272 died... 18:52:53.327969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19272): Terminated: ok {rc=0} 18:52:53.372262 --- ParallelTerminationStrategy: PID 19273 died... 18:52:53.391578 run iperf3-srv_10.42.42.10(pid=19273): Terminated {rc=256} 18:52:53.436263 --- ParallelTerminationStrategy: PID 19276 died... 18:52:53.455149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19276): Terminated: ok {rc=0} 18:52:53.499467 --- ParallelTerminationStrategy: PID 19279 died... 18:52:53.518424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19279): Terminated: ok {rc=0} 18:52:53.562782 --- ParallelTerminationStrategy: PID 19282 died... 18:52:53.581767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19282): Terminated: ok {rc=0} 18:52:53.668092 bus /gobi_4: Setting Powered False 18:52:54.768984 bus /gobi_4: Setting Powered False 18:52:55.885649 bus /gobi_1: Setting Powered False 18:52:56.986999 bus /gobi_1: Setting Powered False 18:52:58.103914 bus /gobi_0: Setting Powered False 18:52:59.201600 bus /gobi_0: Setting Powered False 18:53:00.318723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g ping.py ---------------------------------------------- 18:53:01.426799 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:01.442248 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:53:01.487539 tst ping.py: using LAC 35573 18:53:01.608932 tst ping.py: using RAC 128 18:53:01.755023 tst ping.py: using CellId 35573 18:53:01.890403 tst ping.py: using BVCI 35574 18:53:02.003735 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.015051 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.026345 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.037385 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.048178 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.059126 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.070207 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:02.081241 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:53:02.198056 tst ping.py:19: start network... 18:53:02.422629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:02.927806 run create_hlr_db(pid=19284): Launched 18:53:03.052377 bus /gobi_6: Setting Powered False 18:53:04.117179 run create_hlr_db(pid=19284): Terminated: ok {rc=0} 18:53:04.570331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Launched 18:53:04.897115 run osmo-hlr_10.42.42.2(pid=19287): Launched 18:53:05.022963 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:05.588741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Launched 18:53:05.915287 run osmo-stp_10.42.42.5(pid=19290): Launched 18:53:06.042072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:06.605627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19292): Launched 18:53:06.730124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:07.005904 run patchelf(pid=19293): Launched 18:53:07.187713 run osmo-stp_10.42.42.5(pid=19290): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] 18:53:07.326448 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-13_18:53:05.855366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:07.466072 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221213185306047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185306047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185306048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185306048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185306049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185306049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185306049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:07.606746 run osmo-stp_10.42.42.5(pid=19290): stdout: | (launched: 2022-12-13_18:53:05.855366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:07.740841 run osmo-stp_10.42.42.5(pid=19290): stderr: | 20221213185306047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185306047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185306048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185306048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185306049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185306049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185306049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:07.899549 run patchelf(pid=19293): Terminating (SIGINT) 18:53:08.081591 run patchelf(pid=19293): Terminated: ok {rc=0} 18:53:08.212898 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2393↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] [trial-2393↪gprs:oc2g↪ping.py:22] 18:53:08.222602 tst ping.py:22: Test FAILED (6.8 sec) 18:53:08.251150 run osmo-hlr_10.42.42.2(pid=19287): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19287)] 18:53:08.303225 run osmo-hlr_10.42.42.2(pid=19287): stdout: | (launched: 2022-12-13_18:53:04.837461) 18:53:08.356243 run osmo-hlr_10.42.42.2(pid=19287): stderr: | 20221213185305034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185305034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185305034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185305034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185305034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185305034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185305047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185305055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185305056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185305056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:08.409517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminating (SIGTERM) 18:53:08.452149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminating (SIGTERM) 18:53:08.495371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19292): Terminating (SIGTERM) 18:53:08.538293 --- ParallelTerminationStrategy: PID 19286 died... 18:53:08.559297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19286): Terminated: ok {rc=0} 18:53:08.606843 --- ParallelTerminationStrategy: PID 19289 died... 18:53:08.627320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19289): Terminated: ok {rc=0} 18:53:08.674514 --- ParallelTerminationStrategy: PID 19292 died... 18:53:08.694920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19292): Terminated: ok {rc=0} 18:53:08.784436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 18:53:09.872565 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:09.884378 tst gprs:oc2g: Using 1 x bts (candidates: 1) 18:53:09.921683 tst ping_idle_ping.py: using LAC 35574 18:53:10.052330 tst ping_idle_ping.py: using RAC 129 18:53:10.179391 tst ping_idle_ping.py: using CellId 35574 18:53:10.306684 tst ping_idle_ping.py: using BVCI 35575 18:53:10.426959 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.438251 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.449268 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.460178 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.471388 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.483027 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.494465 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 18:53:10.505864 tst gprs:oc2g: Using 1 x modem (candidates: 4) 18:53:10.622301 tst ping_idle_ping.py:24: start network... 18:53:10.825510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:11.298254 run create_hlr_db(pid=19294): Launched 18:53:11.427904 bus /gobi_6: Setting Powered False 18:53:12.492514 run create_hlr_db(pid=19294): Terminated: ok {rc=0} 18:53:12.946333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Launched 18:53:13.275093 run osmo-hlr_10.42.42.2(pid=19297): Launched 18:53:13.401293 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:13.966790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Launched 18:53:14.295251 run osmo-stp_10.42.42.5(pid=19300): Launched 18:53:14.420483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:14.985439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19302): Launched 18:53:15.110019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:15.385282 run patchelf(pid=19303): Launched 18:53:15.567743 run osmo-stp_10.42.42.5(pid=19300): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] 18:53:15.705919 run osmo-stp_10.42.42.5(pid=19300): stdout: | (launched: 2022-12-13_18:53:14.235277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:15.857629 run osmo-stp_10.42.42.5(pid=19300): stderr: | 20221213185314426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185314426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185314427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185314427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185314428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185314428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185314428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:16.004617 run osmo-stp_10.42.42.5(pid=19300): stdout: | (launched: 2022-12-13_18:53:14.235277) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:16.140787 run osmo-stp_10.42.42.5(pid=19300): stderr: | 20221213185314426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185314426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185314427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185314427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185314428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185314428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185314428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:16.303463 run patchelf(pid=19303): Terminating (SIGINT) 18:53:16.490789 run patchelf(pid=19303): Terminated: ok {rc=0} 18:53:16.626454 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19300): Process ended prematurely: osmo-stp_10.42.42.5(pid=19300) [trial-2393↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] [trial-2393↪gprs:oc2g↪ping_idle_ping.py:27] 18:53:16.637283 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 18:53:16.666861 run osmo-hlr_10.42.42.2(pid=19297): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19297)] 18:53:16.721557 run osmo-hlr_10.42.42.2(pid=19297): stdout: | (launched: 2022-12-13_18:53:13.215018) 18:53:16.776092 run osmo-hlr_10.42.42.2(pid=19297): stderr: | 20221213185313414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185313414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185313414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185313414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185313414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185313414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185313427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185313436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185313436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185313436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:16.831379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Terminating (SIGTERM) 18:53:16.875221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Terminating (SIGTERM) 18:53:16.921043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19302): Terminating (SIGTERM) 18:53:16.965727 --- ParallelTerminationStrategy: PID 19296 died... 18:53:16.987528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19296): Terminated: ok {rc=0} 18:53:17.036252 --- ParallelTerminationStrategy: PID 19299 died... 18:53:17.058008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19299): Terminated: ok {rc=0} 18:53:17.106742 --- ParallelTerminationStrategy: PID 19302 died... 18:53:17.128408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19302): Terminated: ok {rc=0} 18:53:17.220504 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 18:53:18.519813 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:53:18.526340 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:53:18.547586 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:53:18.586279 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:53:18.672749 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:53:18.693482 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:53:18.731733 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:53:19.325089 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:53:19.373741 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.384572 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:53:19.421527 tst cs_paging_gprs_active.py: using LAC 35575 18:53:19.550991 tst cs_paging_gprs_active.py: using RAC 130 18:53:19.677287 tst cs_paging_gprs_active.py: using CellId 35575 18:53:19.805731 tst cs_paging_gprs_active.py: using BVCI 35576 18:53:19.923403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.934869 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.946613 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.957882 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.969124 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.980427 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:19.992080 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:20.003600 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:20.015265 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:20.133959 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:20.251361 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:53:20.456229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:20.760901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19307): Launched 18:53:21.024579 run iperf3-srv_10.42.42.10(pid=19308): Launched 18:53:21.138036 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:53:21.340524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:21.645188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Launched 18:53:21.909256 run iperf3-srv_10.42.42.10(pid=19310): Launched 18:53:22.022663 tst cs_paging_gprs_active.py:38: start network... 18:53:22.225866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:22.697572 run create_hlr_db(pid=19311): Launched 18:53:22.825810 bus /gobi_6: Setting Powered False 18:53:23.890467 run create_hlr_db(pid=19311): Terminated: ok {rc=0} 18:53:24.343857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19313): Launched 18:53:24.670091 run osmo-hlr_10.42.42.2(pid=19314): Launched 18:53:24.795299 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:25.357773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19316): Launched 18:53:25.684700 run osmo-stp_10.42.42.5(pid=19317): Launched 18:53:25.809756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:26.372164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19319): Launched 18:53:26.497462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:26.773381 run patchelf(pid=19320): Launched 18:53:26.954032 run osmo-stp_10.42.42.5(pid=19317): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19317)] 18:53:27.092078 run osmo-stp_10.42.42.5(pid=19317): stdout: | (launched: 2022-12-13_18:53:25.624936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:27.231693 run osmo-stp_10.42.42.5(pid=19317): stderr: | 20221213185325815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185325816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185325816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185325816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185325817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185325817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185325817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:27.371750 run osmo-stp_10.42.42.5(pid=19317): stdout: | (launched: 2022-12-13_18:53:25.624936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:27.505849 run osmo-stp_10.42.42.5(pid=19317): stderr: | 20221213185325815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185325816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185325816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185325816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185325817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185325817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185325817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:27.664514 run patchelf(pid=19320): Terminating (SIGINT) 18:53:27.847115 run patchelf(pid=19320): Terminated: ok {rc=0} 18:53:27.978681 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19317): Process ended prematurely: osmo-stp_10.42.42.5(pid=19317) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19317)] [trial-2393↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:53:27.988932 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:53:28.017602 run osmo-hlr_10.42.42.2(pid=19314): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19314)] 18:53:28.068879 run osmo-hlr_10.42.42.2(pid=19314): stdout: | (launched: 2022-12-13_18:53:24.610533) 18:53:28.121921 run osmo-hlr_10.42.42.2(pid=19314): stderr: | 20221213185324808 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185324808 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185324808 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185324808 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185324808 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185324808 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185324823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185324833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185324833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185324833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:28.175409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19307): Terminating (SIGTERM) 18:53:28.217835 run iperf3-srv_10.42.42.10(pid=19308): Terminating (SIGTERM) 18:53:28.260291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Terminating (SIGTERM) 18:53:28.302929 run iperf3-srv_10.42.42.10(pid=19310): Terminating (SIGTERM) 18:53:28.345528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19313): Terminating (SIGTERM) 18:53:28.388378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19316): Terminating (SIGTERM) 18:53:28.430933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19319): Terminating (SIGTERM) 18:53:28.473730 --- ParallelTerminationStrategy: PID 19307 died... 18:53:28.494574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19307): Terminated: ok {rc=0} 18:53:28.541899 --- ParallelTerminationStrategy: PID 19308 died... 18:53:28.561979 run iperf3-srv_10.42.42.10(pid=19308): Terminated {rc=256} 18:53:28.608746 --- ParallelTerminationStrategy: PID 19309 died... 18:53:28.628662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19309): Terminated: ok {rc=0} 18:53:28.675440 --- ParallelTerminationStrategy: PID 19310 died... 18:53:28.695362 run iperf3-srv_10.42.42.10(pid=19310): Terminated {rc=256} 18:53:28.742213 --- ParallelTerminationStrategy: PID 19313 died... 18:53:28.762236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19313): Terminated: ok {rc=0} 18:53:28.808916 --- ParallelTerminationStrategy: PID 19316 died... 18:53:28.829536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19316): Terminated: ok {rc=0} 18:53:28.876185 --- ParallelTerminationStrategy: PID 19319 died... 18:53:28.896482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19319): Terminated: ok {rc=0} 18:53:28.986225 bus /gobi_0: Setting Powered False 18:53:30.085944 bus /gobi_0: Setting Powered False 18:53:31.203531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:53:32.356351 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.368753 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:53:32.407033 tst iperf3.py: using LAC 35576 18:53:32.534901 tst iperf3.py: using RAC 131 18:53:32.661708 tst iperf3.py: using CellId 35576 18:53:32.790613 tst iperf3.py: using BVCI 35577 18:53:32.908927 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.920284 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.931493 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.942724 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.954285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.965809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.977563 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:32.988997 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:33.000812 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:33.119451 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:33.322646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:33.627557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19321): Launched 18:53:33.914281 run iperf3-srv_10.42.42.10(pid=19322): Launched 18:53:34.036789 tst iperf3.py:8: start network... 18:53:34.255806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:34.759462 run create_hlr_db(pid=19323): Launched 18:53:34.883520 bus /gobi_6: Setting Powered False 18:53:35.947408 run create_hlr_db(pid=19323): Terminated: ok {rc=0} 18:53:36.398092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Launched 18:53:36.722329 run osmo-hlr_10.42.42.2(pid=19326): Launched 18:53:36.846243 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:37.406660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Launched 18:53:37.734673 run osmo-stp_10.42.42.5(pid=19329): Launched 18:53:37.862571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:38.422263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19331): Launched 18:53:38.547019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:38.821141 run patchelf(pid=19332): Launched 18:53:39.001321 run osmo-stp_10.42.42.5(pid=19329): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] 18:53:39.138967 run osmo-stp_10.42.42.5(pid=19329): stdout: | (launched: 2022-12-13_18:53:37.674690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:39.278029 run osmo-stp_10.42.42.5(pid=19329): stderr: | 20221213185337865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185337865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185337865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185337866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185337866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185337866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185337866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:39.417629 run osmo-stp_10.42.42.5(pid=19329): stdout: | (launched: 2022-12-13_18:53:37.674690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:39.551694 run osmo-stp_10.42.42.5(pid=19329): stderr: | 20221213185337865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185337865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185337865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185337866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185337866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185337866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185337866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:39.710232 run patchelf(pid=19332): Terminating (SIGINT) 18:53:39.891966 run patchelf(pid=19332): Terminated: ok {rc=0} 18:53:40.023187 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19329): Process ended prematurely: osmo-stp_10.42.42.5(pid=19329) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 18:53:40.033671 tst iperf3.py:8: Test FAILED (7.7 sec) 18:53:40.062149 run osmo-hlr_10.42.42.2(pid=19326): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19326)] 18:53:40.112836 run osmo-hlr_10.42.42.2(pid=19326): stdout: | (launched: 2022-12-13_18:53:36.663277) 18:53:40.164766 run osmo-hlr_10.42.42.2(pid=19326): stderr: | 20221213185336859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185336859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185336859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185336859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185336859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185336859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185336871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185336880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185336880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185336880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:40.217511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19321): Terminating (SIGTERM) 18:53:40.259760 run iperf3-srv_10.42.42.10(pid=19322): Terminating (SIGTERM) 18:53:40.302387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminating (SIGTERM) 18:53:40.344998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminating (SIGTERM) 18:53:40.387251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19331): Terminating (SIGTERM) 18:53:40.429837 --- ParallelTerminationStrategy: PID 19321 died... 18:53:40.450376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19321): Terminated: ok {rc=0} 18:53:40.497971 --- ParallelTerminationStrategy: PID 19322 died... 18:53:40.518110 run iperf3-srv_10.42.42.10(pid=19322): Terminated {rc=256} 18:53:40.565624 --- ParallelTerminationStrategy: PID 19325 died... 18:53:40.585532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19325): Terminated: ok {rc=0} 18:53:40.632116 --- ParallelTerminationStrategy: PID 19328 died... 18:53:40.652310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19328): Terminated: ok {rc=0} 18:53:40.699332 --- ParallelTerminationStrategy: PID 19331 died... 18:53:40.719422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19331): Terminated: ok {rc=0} 18:53:40.810459 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:53:41.962708 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:41.974945 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:53:42.013113 tst iperf3m4.py: using LAC 35577 18:53:42.140111 tst iperf3m4.py: using RAC 132 18:53:42.266529 tst iperf3m4.py: using CellId 35577 18:53:42.392610 tst iperf3m4.py: using BVCI 35578 18:53:42.511329 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.522821 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.534061 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.545466 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.557451 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.569339 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.581580 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.593536 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:42.605664 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:42.731785 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:42.850114 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:42.970819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:43.089712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:43.309569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:43.637894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19334): Launched 18:53:43.922282 run iperf3-srv_10.42.42.10(pid=19335): Launched 18:53:44.046006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:53:44.265200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:44.593018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Launched 18:53:44.876060 run iperf3-srv_10.42.42.10(pid=19337): Launched 18:53:44.999543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:53:45.218561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:45.546050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Launched 18:53:45.827990 run iperf3-srv_10.42.42.10(pid=19339): Launched 18:53:45.988079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:53:46.211183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:46.544217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Launched 18:53:46.843012 run iperf3-srv_10.42.42.10(pid=19341): Launched 18:53:46.981043 tst iperf3m4.py:8: start network... 18:53:47.211853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:47.728828 run create_hlr_db(pid=19353): Launched 18:53:47.891986 bus /gobi_6: Setting Powered False 18:53:48.954116 run create_hlr_db(pid=19353): Terminated: ok {rc=0} 18:53:49.391047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19355): Launched 18:53:49.717538 run osmo-hlr_10.42.42.2(pid=19356): Launched 18:53:49.956378 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:50.669085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Launched 18:53:51.008580 run osmo-stp_10.42.42.5(pid=19361): Launched 18:53:51.244876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:51.931010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19363): Launched 18:53:52.063139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:52.328686 run patchelf(pid=19364): Launched 18:53:52.514611 run osmo-stp_10.42.42.5(pid=19361): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19361)] 18:53:52.648024 run osmo-stp_10.42.42.5(pid=19361): stdout: | (launched: 2022-12-13_18:53:50.948895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:52.782126 run osmo-stp_10.42.42.5(pid=19361): stderr: | 20221213185351273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185351273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185351274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185351274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185351275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185351275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185351275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:52.915663 run osmo-stp_10.42.42.5(pid=19361): stdout: | (launched: 2022-12-13_18:53:50.948895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:53.044685 run osmo-stp_10.42.42.5(pid=19361): stderr: | 20221213185351273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185351273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185351274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185351274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185351275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185351275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185351275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:53.200077 run patchelf(pid=19364): Terminating (SIGINT) 18:53:53.375853 run patchelf(pid=19364): Terminated: ok {rc=0} 18:53:53.502630 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19361): Process ended prematurely: osmo-stp_10.42.42.5(pid=19361) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19361)] [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 18:53:53.513430 tst iperf3m4.py:8: Test FAILED (11.6 sec) 18:53:53.543630 run osmo-hlr_10.42.42.2(pid=19356): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19356)] 18:53:53.594232 run osmo-hlr_10.42.42.2(pid=19356): stdout: | (launched: 2022-12-13_18:53:49.660007) 18:53:53.646015 run osmo-hlr_10.42.42.2(pid=19356): stderr: | 20221213185350001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185350001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185350001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185350001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185350001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185350001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185350013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185350021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185350021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185350021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:53.707321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19334): Terminating (SIGTERM) 18:53:53.759629 run iperf3-srv_10.42.42.10(pid=19335): Terminating (SIGTERM) 18:53:53.808674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Terminating (SIGTERM) 18:53:53.856797 run iperf3-srv_10.42.42.10(pid=19337): Terminating (SIGTERM) 18:53:53.909073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminating (SIGTERM) 18:53:53.955000 run iperf3-srv_10.42.42.10(pid=19339): Terminating (SIGTERM) 18:53:54.007652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminating (SIGTERM) 18:53:54.049158 run iperf3-srv_10.42.42.10(pid=19341): Terminating (SIGTERM) 18:53:54.090066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19355): Terminating (SIGTERM) 18:53:54.132287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminating (SIGTERM) 18:53:54.180089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19363): Terminating (SIGTERM) 18:53:54.231415 --- ParallelTerminationStrategy: PID 19334 died... 18:53:54.255055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19334): Terminated: ok {rc=0} 18:53:54.302150 --- ParallelTerminationStrategy: PID 19335 died... 18:53:54.322819 run iperf3-srv_10.42.42.10(pid=19335): Terminated {rc=256} 18:53:54.369606 --- ParallelTerminationStrategy: PID 19336 died... 18:53:54.389184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19336): Terminated: ok {rc=0} 18:53:54.443087 --- ParallelTerminationStrategy: PID 19337 died... 18:53:54.467295 run iperf3-srv_10.42.42.10(pid=19337): Terminated {rc=256} 18:53:54.520814 --- ParallelTerminationStrategy: PID 19338 died... 18:53:54.547167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19338): Terminated: ok {rc=0} 18:53:54.594842 --- ParallelTerminationStrategy: PID 19339 died... 18:53:54.618607 run iperf3-srv_10.42.42.10(pid=19339): Terminated {rc=256} 18:53:54.674879 --- ParallelTerminationStrategy: PID 19340 died... 18:53:54.701551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19340): Terminated: ok {rc=0} 18:53:54.754499 --- ParallelTerminationStrategy: PID 19341 died... 18:53:54.781063 run iperf3-srv_10.42.42.10(pid=19341): Terminated {rc=256} 18:53:54.837993 --- ParallelTerminationStrategy: PID 19355 died... 18:53:54.870182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19355): Terminated: ok {rc=0} 18:53:54.930336 --- ParallelTerminationStrategy: PID 19359 died... 18:53:54.953529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19359): Terminated: ok {rc=0} 18:53:55.015976 --- ParallelTerminationStrategy: PID 19363 died... 18:53:55.039711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19363): Terminated: ok {rc=0} 18:53:55.154876 bus /gobi_4: Setting Powered False 18:53:56.261036 bus /gobi_4: Setting Powered False 18:53:57.384921 bus /gobi_1: Setting Powered False 18:53:58.486515 bus /gobi_1: Setting Powered False 18:53:59.603563 bus /gobi_0: Setting Powered False 18:54:00.702750 bus /gobi_0: Setting Powered False 18:54:01.830506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 18:54:02.950286 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:02.963391 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:54:03.002623 tst ping.py: using LAC 35578 18:54:03.125421 tst ping.py: using RAC 133 18:54:03.246300 tst ping.py: using CellId 35578 18:54:03.367155 tst ping.py: using BVCI 35579 18:54:03.477549 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.489681 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.501838 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.513663 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.525828 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.538865 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.551203 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:03.563341 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:54:03.683077 tst ping.py:19: start network... 18:54:03.888599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:04.369845 run create_hlr_db(pid=19625): Launched 18:54:04.530742 bus /gobi_6: Setting Powered False 18:54:05.592382 run create_hlr_db(pid=19625): Terminated: ok {rc=0} 18:54:06.028933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Launched 18:54:06.352300 run osmo-hlr_10.42.42.2(pid=19628): Launched 18:54:06.589214 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:07.298014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Launched 18:54:07.623807 run osmo-stp_10.42.42.5(pid=19631): Launched 18:54:07.866740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:08.543109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Launched 18:54:08.674715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:08.936994 run patchelf(pid=19634): Launched 18:54:09.121560 run osmo-stp_10.42.42.5(pid=19631): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] 18:54:09.253687 run osmo-stp_10.42.42.5(pid=19631): stdout: | (launched: 2022-12-13_18:54:07.566008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:09.388728 run osmo-stp_10.42.42.5(pid=19631): stderr: | 20221213185407885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185407886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185407886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185407886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185407893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185407893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185407894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:09.522485 run osmo-stp_10.42.42.5(pid=19631): stdout: | (launched: 2022-12-13_18:54:07.566008) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:09.650909 run osmo-stp_10.42.42.5(pid=19631): stderr: | 20221213185407885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185407886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185407886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185407886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185407893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185407893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185407894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:09.803157 run patchelf(pid=19634): Terminating (SIGINT) 18:54:09.978136 run patchelf(pid=19634): Terminated: ok {rc=0} 18:54:10.109805 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19631): Process ended prematurely: osmo-stp_10.42.42.5(pid=19631) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 18:54:10.118994 tst ping.py:22: Test FAILED (7.2 sec) 18:54:10.146319 run osmo-hlr_10.42.42.2(pid=19628): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19628)] 18:54:10.195823 run osmo-hlr_10.42.42.2(pid=19628): stdout: | (launched: 2022-12-13_18:54:06.293493) 18:54:10.246654 run osmo-hlr_10.42.42.2(pid=19628): stderr: | 20221213185406631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185406631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185406631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185406631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185406631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185406631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185406646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185406663 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185406663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185406663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:10.297526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Terminating (SIGTERM) 18:54:10.338359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Terminating (SIGTERM) 18:54:10.378955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Terminating (SIGTERM) 18:54:10.419822 --- ParallelTerminationStrategy: PID 19627 died... 18:54:10.439093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19627): Terminated: ok {rc=0} 18:54:10.484157 --- ParallelTerminationStrategy: PID 19630 died... 18:54:10.503158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19630): Terminated: ok {rc=0} 18:54:10.548216 --- ParallelTerminationStrategy: PID 19633 died... 18:54:10.567223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19633): Terminated: ok {rc=0} 18:54:10.654514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:54:11.745065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:11.757763 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:54:11.797590 tst ping_idle_ping.py: using LAC 35579 18:54:11.924708 tst ping_idle_ping.py: using RAC 134 18:54:12.043770 tst ping_idle_ping.py: using CellId 35579 18:54:12.162258 tst ping_idle_ping.py: using BVCI 35580 18:54:12.272874 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.283938 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.294679 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.305631 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.316650 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.327891 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.339725 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:54:12.350996 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:54:12.471272 tst ping_idle_ping.py:24: start network... 18:54:12.687704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:13.187994 run create_hlr_db(pid=19635): Launched 18:54:13.310709 bus /gobi_6: Setting Powered False 18:54:14.373920 run create_hlr_db(pid=19635): Terminated: ok {rc=0} 18:54:14.823136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Launched 18:54:15.146731 run osmo-hlr_10.42.42.2(pid=19638): Launched 18:54:15.271176 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:15.837106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Launched 18:54:16.188604 run osmo-stp_10.42.42.5(pid=19641): Launched 18:54:16.396410 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:17.085405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Launched 18:54:17.219714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:17.496742 run patchelf(pid=19644): Launched 18:54:17.676656 run osmo-stp_10.42.42.5(pid=19641): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] 18:54:17.813888 run osmo-stp_10.42.42.5(pid=19641): stdout: | (launched: 2022-12-13_18:54:16.124613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:17.951950 run osmo-stp_10.42.42.5(pid=19641): stderr: | 20221213185416470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185416470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185416471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185416473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185416474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185416474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185416474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:18.090727 run osmo-stp_10.42.42.5(pid=19641): stdout: | (launched: 2022-12-13_18:54:16.124613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:18.223582 run osmo-stp_10.42.42.5(pid=19641): stderr: | 20221213185416470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185416470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185416471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185416473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185416474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185416474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185416474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:18.380475 run patchelf(pid=19644): Terminating (SIGINT) 18:54:18.561089 run patchelf(pid=19644): Terminated: ok {rc=0} 18:54:18.691196 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19641): Process ended prematurely: osmo-stp_10.42.42.5(pid=19641) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 18:54:18.700790 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:54:18.729165 run osmo-hlr_10.42.42.2(pid=19638): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19638)] 18:54:18.780924 run osmo-hlr_10.42.42.2(pid=19638): stdout: | (launched: 2022-12-13_18:54:15.087836) 18:54:18.833741 run osmo-hlr_10.42.42.2(pid=19638): stderr: | 20221213185415281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185415282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185415282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185415282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185415282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185415282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185415295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185415305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185415305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185415305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:18.886978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Terminating (SIGTERM) 18:54:18.929535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Terminating (SIGTERM) 18:54:18.972394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Terminating (SIGTERM) 18:54:19.015464 --- ParallelTerminationStrategy: PID 19637 died... 18:54:19.036295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19637): Terminated: ok {rc=0} 18:54:19.083498 --- ParallelTerminationStrategy: PID 19640 died... 18:54:19.103817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19640): Terminated: ok {rc=0} 18:54:19.151247 --- ParallelTerminationStrategy: PID 19643 died... 18:54:19.171571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19643): Terminated: ok {rc=0} 18:54:19.260270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:54:20.552080 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:54:20.558161 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:54:20.578773 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:54:20.617850 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:54:20.706523 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:54:20.727584 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:54:20.765618 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:54:21.356068 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:54:21.405478 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.416364 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:54:21.473218 tst cs_paging_gprs_active.py: using LAC 35580 18:54:21.593813 tst cs_paging_gprs_active.py: using RAC 135 18:54:21.712592 tst cs_paging_gprs_active.py: using CellId 35580 18:54:21.831528 tst cs_paging_gprs_active.py: using BVCI 35581 18:54:21.941827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.952727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.963440 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.974098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.984552 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:21.995997 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:22.007300 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:22.018097 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:22.029056 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:22.151789 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:22.268325 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:54:22.476371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:22.784559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19648): Launched 18:54:23.051924 run iperf3-srv_10.42.42.10(pid=19649): Launched 18:54:23.167059 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:54:23.373538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:23.681646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19650): Launched 18:54:23.948012 run iperf3-srv_10.42.42.10(pid=19651): Launched 18:54:24.063193 tst cs_paging_gprs_active.py:38: start network... 18:54:24.270281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:24.745132 run create_hlr_db(pid=19652): Launched 18:54:24.870532 bus /gobi_6: Setting Powered False 18:54:25.931539 run create_hlr_db(pid=19652): Terminated: ok {rc=0} 18:54:26.379532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Launched 18:54:26.707238 run osmo-hlr_10.42.42.2(pid=19655): Launched 18:54:26.834349 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:27.400168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Launched 18:54:27.727389 run osmo-stp_10.42.42.5(pid=19658): Launched 18:54:27.853858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:28.418834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19660): Launched 18:54:28.543751 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:28.820471 run patchelf(pid=19661): Launched 18:54:29.002495 run osmo-stp_10.42.42.5(pid=19658): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] 18:54:29.140744 run osmo-stp_10.42.42.5(pid=19658): stdout: | (launched: 2022-12-13_18:54:27.667969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:29.280697 run osmo-stp_10.42.42.5(pid=19658): stderr: | 20221213185427855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185427855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185427855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185427856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185427856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185427856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185427856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:29.420897 run osmo-stp_10.42.42.5(pid=19658): stdout: | (launched: 2022-12-13_18:54:27.667969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:29.555390 run osmo-stp_10.42.42.5(pid=19658): stderr: | 20221213185427855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185427855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185427855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185427856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185427856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185427856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185427856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:29.714428 run patchelf(pid=19661): Terminating (SIGINT) 18:54:29.897716 run patchelf(pid=19661): Terminated: ok {rc=0} 18:54:30.030250 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19658): Process ended prematurely: osmo-stp_10.42.42.5(pid=19658) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:54:30.040401 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:54:30.069009 run osmo-hlr_10.42.42.2(pid=19655): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19655)] 18:54:30.119892 run osmo-hlr_10.42.42.2(pid=19655): stdout: | (launched: 2022-12-13_18:54:26.647679) 18:54:30.172463 run osmo-hlr_10.42.42.2(pid=19655): stderr: | 20221213185426843 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185426843 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185426843 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185426843 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185426843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185426843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185426855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185426863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185426864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185426864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:30.225742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19648): Terminating (SIGTERM) 18:54:30.267651 run iperf3-srv_10.42.42.10(pid=19649): Terminating (SIGTERM) 18:54:30.310140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19650): Terminating (SIGTERM) 18:54:30.352048 run iperf3-srv_10.42.42.10(pid=19651): Terminating (SIGTERM) 18:54:30.394115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Terminating (SIGTERM) 18:54:30.436502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Terminating (SIGTERM) 18:54:30.478662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19660): Terminating (SIGTERM) 18:54:30.521409 --- ParallelTerminationStrategy: PID 19648 died... 18:54:30.541711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19648): Terminated: ok {rc=0} 18:54:30.588144 --- ParallelTerminationStrategy: PID 19649 died... 18:54:30.607781 run iperf3-srv_10.42.42.10(pid=19649): Terminated {rc=256} 18:54:30.653652 --- ParallelTerminationStrategy: PID 19650 died... 18:54:30.673386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19650): Terminated: ok {rc=0} 18:54:30.719287 --- ParallelTerminationStrategy: PID 19651 died... 18:54:30.739305 run iperf3-srv_10.42.42.10(pid=19651): Terminated {rc=256} 18:54:30.785283 --- ParallelTerminationStrategy: PID 19654 died... 18:54:30.805193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19654): Terminated: ok {rc=0} 18:54:30.852068 --- ParallelTerminationStrategy: PID 19657 died... 18:54:30.872635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19657): Terminated: ok {rc=0} 18:54:30.933477 --- ParallelTerminationStrategy: PID 19660 died... 18:54:30.953466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19660): Terminated: ok {rc=0} 18:54:31.044279 bus /gobi_0: Setting Powered False 18:54:32.142504 bus /gobi_0: Setting Powered False 18:54:33.261189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:54:34.407701 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:34.419356 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:54:34.482366 tst iperf3.py: using LAC 35581 18:54:34.600838 tst iperf3.py: using RAC 136 18:54:34.718618 tst iperf3.py: using CellId 35581 18:54:34.838328 tst iperf3.py: using BVCI 35582 18:54:34.950268 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:34.961206 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:34.971752 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:34.982352 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:34.992879 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:35.003559 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:35.014544 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:35.025211 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:35.036416 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:35.150887 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:35.355295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:35.660790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19662): Launched 18:54:35.926401 run iperf3-srv_10.42.42.10(pid=19663): Launched 18:54:36.042790 tst iperf3.py:8: start network... 18:54:36.247388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:36.719157 run create_hlr_db(pid=19664): Launched 18:54:36.843639 bus /gobi_6: Setting Powered False 18:54:37.903658 run create_hlr_db(pid=19664): Terminated: ok {rc=0} 18:54:38.349523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19666): Launched 18:54:38.678281 run osmo-hlr_10.42.42.2(pid=19667): Launched 18:54:38.803097 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:39.371352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19669): Launched 18:54:39.698661 run osmo-stp_10.42.42.5(pid=19670): Launched 18:54:39.824833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:40.385183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19672): Launched 18:54:40.509873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:40.786389 run patchelf(pid=19673): Launched 18:54:40.968541 run osmo-stp_10.42.42.5(pid=19670): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19670)] 18:54:41.106991 run osmo-stp_10.42.42.5(pid=19670): stdout: | (launched: 2022-12-13_18:54:39.639259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:41.247175 run osmo-stp_10.42.42.5(pid=19670): stderr: | 20221213185439829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185439829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185439829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185439829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185439830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185439830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185439830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:41.387695 run osmo-stp_10.42.42.5(pid=19670): stdout: | (launched: 2022-12-13_18:54:39.639259) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:41.522360 run osmo-stp_10.42.42.5(pid=19670): stderr: | 20221213185439829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185439829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185439829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185439829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185439830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185439830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185439830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:41.681818 run patchelf(pid=19673): Terminating (SIGINT) 18:54:41.864546 run patchelf(pid=19673): Terminated: ok {rc=0} 18:54:41.996631 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19670): Process ended prematurely: osmo-stp_10.42.42.5(pid=19670) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19670)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 18:54:42.007113 tst iperf3.py:8: Test FAILED (7.6 sec) 18:54:42.035807 run osmo-hlr_10.42.42.2(pid=19667): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19667)] 18:54:42.087386 run osmo-hlr_10.42.42.2(pid=19667): stdout: | (launched: 2022-12-13_18:54:38.618409) 18:54:42.140678 run osmo-hlr_10.42.42.2(pid=19667): stderr: | 20221213185438813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185438813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185438813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185438813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185438813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185438814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185438825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185438834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185438834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185438834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:42.193876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19662): Terminating (SIGTERM) 18:54:42.236218 run iperf3-srv_10.42.42.10(pid=19663): Terminating (SIGTERM) 18:54:42.278837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19666): Terminating (SIGTERM) 18:54:42.321687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19669): Terminating (SIGTERM) 18:54:42.364190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19672): Terminating (SIGTERM) 18:54:42.406910 --- ParallelTerminationStrategy: PID 19662 died... 18:54:42.427425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19662): Terminated: ok {rc=0} 18:54:42.474355 --- ParallelTerminationStrategy: PID 19663 died... 18:54:42.494421 run iperf3-srv_10.42.42.10(pid=19663): Terminated {rc=256} 18:54:42.541578 --- ParallelTerminationStrategy: PID 19666 died... 18:54:42.561644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19666): Terminated: ok {rc=0} 18:54:42.608406 --- ParallelTerminationStrategy: PID 19669 died... 18:54:42.628288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19669): Terminated: ok {rc=0} 18:54:42.675013 --- ParallelTerminationStrategy: PID 19672 died... 18:54:42.695051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19672): Terminated: ok {rc=0} 18:54:42.783639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:54:43.934510 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:43.946655 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:54:44.005174 tst iperf3m4.py: using LAC 35582 18:54:44.132079 tst iperf3m4.py: using RAC 137 18:54:44.269264 tst iperf3m4.py: using CellId 35582 18:54:44.406541 tst iperf3m4.py: using BVCI 35583 18:54:44.527179 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.538792 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.549972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.561086 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.572608 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.584073 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.595880 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.607297 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:44.618911 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:44.736469 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:44.858954 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:44.975488 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:45.095254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:45.317180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:45.646610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19674): Launched 18:54:45.953818 run iperf3-srv_10.42.42.10(pid=19675): Launched 18:54:46.074584 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:54:46.286682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:46.611747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19676): Launched 18:54:46.893772 run iperf3-srv_10.42.42.10(pid=19677): Launched 18:54:47.029252 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:54:47.255720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:47.587042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19678): Launched 18:54:47.873295 run iperf3-srv_10.42.42.10(pid=19679): Launched 18:54:47.997808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:54:48.218879 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:48.549316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Launched 18:54:48.835112 run iperf3-srv_10.42.42.10(pid=19681): Launched 18:54:48.959778 tst iperf3m4.py:8: start network... 18:54:49.180887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:49.690190 run create_hlr_db(pid=19682): Launched 18:54:49.816825 bus /gobi_6: Setting Powered False 18:54:50.881457 run create_hlr_db(pid=19682): Terminated: ok {rc=0} 18:54:51.338956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Launched 18:54:51.667800 run osmo-hlr_10.42.42.2(pid=19685): Launched 18:54:51.793717 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:52.359901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Launched 18:54:52.689131 run osmo-stp_10.42.42.5(pid=19688): Launched 18:54:52.816093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:53.382119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19690): Launched 18:54:53.507390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:53.785514 run patchelf(pid=19691): Launched 18:54:53.967373 run osmo-stp_10.42.42.5(pid=19688): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] 18:54:54.106385 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-13_18:54:52.628757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:54.246609 run osmo-stp_10.42.42.5(pid=19688): stderr: | 20221213185452818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185452819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185452819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185452819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185452820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185452820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185452820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:54.387091 run osmo-stp_10.42.42.5(pid=19688): stdout: | (launched: 2022-12-13_18:54:52.628757) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:54.521376 run osmo-stp_10.42.42.5(pid=19688): stderr: | 20221213185452818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185452819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185452819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185452819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185452820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185452820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185452820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:54.681238 run patchelf(pid=19691): Terminating (SIGINT) 18:54:54.864523 run patchelf(pid=19691): Terminated: ok {rc=0} 18:54:54.996579 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:54:55.007001 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:54:55.035985 run osmo-hlr_10.42.42.2(pid=19685): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19685)] 18:54:55.088085 run osmo-hlr_10.42.42.2(pid=19685): stdout: | (launched: 2022-12-13_18:54:51.607607) 18:54:55.141105 run osmo-hlr_10.42.42.2(pid=19685): stderr: | 20221213185451805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185451805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185451805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185451805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185451805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185451805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185451819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185451829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185451829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185451830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:55.194251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19674): Terminating (SIGTERM) 18:54:55.236710 run iperf3-srv_10.42.42.10(pid=19675): Terminating (SIGTERM) 18:54:55.279881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19676): Terminating (SIGTERM) 18:54:55.322697 run iperf3-srv_10.42.42.10(pid=19677): Terminating (SIGTERM) 18:54:55.365622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19678): Terminating (SIGTERM) 18:54:55.408509 run iperf3-srv_10.42.42.10(pid=19679): Terminating (SIGTERM) 18:54:55.451139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Terminating (SIGTERM) 18:54:55.493823 run iperf3-srv_10.42.42.10(pid=19681): Terminating (SIGTERM) 18:54:55.536611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminating (SIGTERM) 18:54:55.579970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminating (SIGTERM) 18:54:55.622491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19690): Terminating (SIGTERM) 18:54:55.665394 --- ParallelTerminationStrategy: PID 19674 died... 18:54:55.686062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19674): Terminated: ok {rc=0} 18:54:55.733164 --- ParallelTerminationStrategy: PID 19675 died... 18:54:55.753192 run iperf3-srv_10.42.42.10(pid=19675): Terminated {rc=256} 18:54:55.800045 --- ParallelTerminationStrategy: PID 19676 died... 18:54:55.820223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19676): Terminated: ok {rc=0} 18:54:55.867305 --- ParallelTerminationStrategy: PID 19677 died... 18:54:55.887432 run iperf3-srv_10.42.42.10(pid=19677): Terminated {rc=256} 18:54:55.934187 --- ParallelTerminationStrategy: PID 19678 died... 18:54:55.954181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19678): Terminated: ok {rc=0} 18:54:56.001099 --- ParallelTerminationStrategy: PID 19679 died... 18:54:56.021130 run iperf3-srv_10.42.42.10(pid=19679): Terminated {rc=256} 18:54:56.067473 --- ParallelTerminationStrategy: PID 19680 died... 18:54:56.087475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19680): Terminated: ok {rc=0} 18:54:56.134157 --- ParallelTerminationStrategy: PID 19681 died... 18:54:56.154306 run iperf3-srv_10.42.42.10(pid=19681): Terminated {rc=256} 18:54:56.201204 --- ParallelTerminationStrategy: PID 19684 died... 18:54:56.221355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19684): Terminated: ok {rc=0} 18:54:56.268444 --- ParallelTerminationStrategy: PID 19687 died... 18:54:56.288766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19687): Terminated: ok {rc=0} 18:54:56.335951 --- ParallelTerminationStrategy: PID 19690 died... 18:54:56.356072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19690): Terminated: ok {rc=0} 18:54:56.445988 bus /gobi_4: Setting Powered False 18:54:57.546896 bus /gobi_4: Setting Powered False 18:54:58.663788 bus /gobi_1: Setting Powered False 18:54:59.763331 bus /gobi_1: Setting Powered False 18:55:00.904535 bus /gobi_0: Setting Powered False 18:55:02.012651 bus /gobi_0: Setting Powered False 18:55:03.131442 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:55:04.235973 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.248061 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:55:04.306999 tst ping.py: using LAC 35583 18:55:04.434140 tst ping.py: using RAC 138 18:55:04.563736 tst ping.py: using CellId 35583 18:55:04.689473 tst ping.py: using BVCI 35584 18:55:04.802135 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.813094 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.823675 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.834394 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.845025 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.857122 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.868642 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:04.880018 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:55:04.999125 tst ping.py:19: start network... 18:55:05.216673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:05.717850 run create_hlr_db(pid=19695): Launched 18:55:05.841556 bus /gobi_6: Setting Powered False 18:55:06.905373 run create_hlr_db(pid=19695): Terminated: ok {rc=0} 18:55:07.335518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19697): Launched 18:55:07.636414 run osmo-hlr_10.42.42.2(pid=19698): Launched 18:55:07.751094 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:08.286454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19700): Launched 18:55:08.588640 run osmo-stp_10.42.42.5(pid=19701): Launched 18:55:08.702333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:09.220918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19703): Launched 18:55:09.335606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:09.589694 run patchelf(pid=19704): Launched 18:55:09.755906 run osmo-stp_10.42.42.5(pid=19701): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19701)] 18:55:09.883015 run osmo-stp_10.42.42.5(pid=19701): stdout: | (launched: 2022-12-13_18:55:08.533603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:10.011752 run osmo-stp_10.42.42.5(pid=19701): stderr: | 20221213185508699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185508699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185508699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185508700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185508700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185508700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185508700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:10.140144 run osmo-stp_10.42.42.5(pid=19701): stdout: | (launched: 2022-12-13_18:55:08.533603) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:10.263089 run osmo-stp_10.42.42.5(pid=19701): stderr: | 20221213185508699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185508699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185508699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185508700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185508700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185508700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185508700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:10.408680 run patchelf(pid=19704): Terminating (SIGINT) 18:55:10.577957 run patchelf(pid=19704): Terminated: ok {rc=0} 18:55:10.699291 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19701): Process ended prematurely: osmo-stp_10.42.42.5(pid=19701) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19701)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 18:55:10.708358 tst ping.py:22: Test FAILED (6.5 sec) 18:55:10.735218 run osmo-hlr_10.42.42.2(pid=19698): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19698)] 18:55:10.784325 run osmo-hlr_10.42.42.2(pid=19698): stdout: | (launched: 2022-12-13_18:55:07.580931) 18:55:10.834588 run osmo-hlr_10.42.42.2(pid=19698): stderr: | 20221213185507756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185507756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185507757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185507757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185507757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185507757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185507770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185507779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185507779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185507779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:10.885326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19697): Terminating (SIGTERM) 18:55:10.925695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19700): Terminating (SIGTERM) 18:55:10.966147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19703): Terminating (SIGTERM) 18:55:11.006540 --- ParallelTerminationStrategy: PID 19697 died... 18:55:11.026261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19697): Terminated: ok {rc=0} 18:55:11.071092 --- ParallelTerminationStrategy: PID 19700 died... 18:55:11.090109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19700): Terminated: ok {rc=0} 18:55:11.134543 --- ParallelTerminationStrategy: PID 19703 died... 18:55:11.153565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19703): Terminated: ok {rc=0} 18:55:11.238177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:55:12.323805 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.335560 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:55:12.399793 tst ping_idle_ping.py: using LAC 35584 18:55:12.526057 tst ping_idle_ping.py: using RAC 139 18:55:12.652002 tst ping_idle_ping.py: using CellId 35584 18:55:12.777146 tst ping_idle_ping.py: using BVCI 35585 18:55:12.896184 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.907996 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.919406 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.930683 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.942174 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.953744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.965639 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:55:12.977210 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:55:13.093499 tst ping_idle_ping.py:24: start network... 18:55:13.295536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:13.765824 run create_hlr_db(pid=19705): Launched 18:55:13.889053 bus /gobi_6: Setting Powered False 18:55:14.949024 run create_hlr_db(pid=19705): Terminated: ok {rc=0} 18:55:15.390958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19707): Launched 18:55:15.714801 run osmo-hlr_10.42.42.2(pid=19708): Launched 18:55:15.852754 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:16.516629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19710): Launched 18:55:16.841847 run osmo-stp_10.42.42.5(pid=19711): Launched 18:55:17.085055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:17.753092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19713): Launched 18:55:17.877121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:18.149067 run patchelf(pid=19714): Launched 18:55:18.327296 run osmo-stp_10.42.42.5(pid=19711): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19711)] 18:55:18.463452 run osmo-stp_10.42.42.5(pid=19711): stdout: | (launched: 2022-12-13_18:55:16.785250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:18.602252 run osmo-stp_10.42.42.5(pid=19711): stderr: | 20221213185517112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185517112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185517112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185517121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185517122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185517122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185517122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:18.739785 run osmo-stp_10.42.42.5(pid=19711): stdout: | (launched: 2022-12-13_18:55:16.785250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:18.872016 run osmo-stp_10.42.42.5(pid=19711): stderr: | 20221213185517112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185517112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185517112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185517121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185517122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185517122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185517122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:19.028475 run patchelf(pid=19714): Terminating (SIGINT) 18:55:19.208326 run patchelf(pid=19714): Terminated: ok {rc=0} 18:55:19.338171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19711): Process ended prematurely: osmo-stp_10.42.42.5(pid=19711) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19711)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:55:19.347693 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 18:55:19.375669 run osmo-hlr_10.42.42.2(pid=19708): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19708)] 18:55:19.426725 run osmo-hlr_10.42.42.2(pid=19708): stdout: | (launched: 2022-12-13_18:55:15.655615) 18:55:19.479254 run osmo-hlr_10.42.42.2(pid=19708): stderr: | 20221213185515877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185515877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185515877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185515877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185515877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185515877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185515890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185515912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185515913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185515913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:19.531852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19707): Terminating (SIGTERM) 18:55:19.574286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19710): Terminating (SIGTERM) 18:55:19.617082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19713): Terminating (SIGTERM) 18:55:19.660165 --- ParallelTerminationStrategy: PID 19707 died... 18:55:19.681068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19707): Terminated: ok {rc=0} 18:55:19.728103 --- ParallelTerminationStrategy: PID 19710 died... 18:55:19.748394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19710): Terminated: ok {rc=0} 18:55:19.795263 --- ParallelTerminationStrategy: PID 19713 died... 18:55:19.815404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19713): Terminated: ok {rc=0} 18:55:19.904627 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:55:21.202580 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:21.209201 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:55:21.230379 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:55:21.270828 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:55:21.361692 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:55:21.383634 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:55:21.423555 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:55:22.018055 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:55:22.071097 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.082668 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:55:22.141088 tst cs_paging_gprs_active.py: using LAC 35585 18:55:22.270733 tst cs_paging_gprs_active.py: using RAC 140 18:55:22.401669 tst cs_paging_gprs_active.py: using CellId 35585 18:55:22.528708 tst cs_paging_gprs_active.py: using BVCI 35586 18:55:22.647864 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.659318 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.670667 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.682060 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.693629 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.705179 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.716822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.728348 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:22.740140 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:22.856617 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:22.976377 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:55:23.199654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:23.530138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19718): Launched 18:55:23.817326 run iperf3-srv_10.42.42.10(pid=19719): Launched 18:55:23.940506 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:55:24.163002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:24.492480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19720): Launched 18:55:24.778721 run iperf3-srv_10.42.42.10(pid=19721): Launched 18:55:24.901500 tst cs_paging_gprs_active.py:38: start network... 18:55:25.123672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:25.633538 run create_hlr_db(pid=19722): Launched 18:55:25.760198 bus /gobi_6: Setting Powered False 18:55:26.824666 run create_hlr_db(pid=19722): Terminated: ok {rc=0} 18:55:27.262047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Launched 18:55:27.570550 run osmo-hlr_10.42.42.2(pid=19725): Launched 18:55:27.687597 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:28.213191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Launched 18:55:28.519088 run osmo-stp_10.42.42.5(pid=19728): Launched 18:55:28.638819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:29.166998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19730): Launched 18:55:29.283498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:29.541266 run patchelf(pid=19731): Launched 18:55:29.711726 run osmo-stp_10.42.42.5(pid=19728): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] 18:55:29.841078 run osmo-stp_10.42.42.5(pid=19728): stdout: | (launched: 2022-12-13_18:55:28.462857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:29.971799 run osmo-stp_10.42.42.5(pid=19728): stderr: | 20221213185528632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185528632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185528632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185528632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185528633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185528633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185528633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:30.103272 run osmo-stp_10.42.42.5(pid=19728): stdout: | (launched: 2022-12-13_18:55:28.462857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:30.228259 run osmo-stp_10.42.42.5(pid=19728): stderr: | 20221213185528632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185528632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185528632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185528632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185528633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185528633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185528633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:30.376347 run patchelf(pid=19731): Terminating (SIGINT) 18:55:30.547580 run patchelf(pid=19731): Terminated: ok {rc=0} 18:55:30.671285 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=19728): Process ended prematurely: osmo-stp_10.42.42.5(pid=19728) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:55:30.680848 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:55:30.707788 run osmo-hlr_10.42.42.2(pid=19725): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19725)] 18:55:30.755718 run osmo-hlr_10.42.42.2(pid=19725): stdout: | (launched: 2022-12-13_18:55:27.513629) 18:55:30.804929 run osmo-hlr_10.42.42.2(pid=19725): stderr: | 20221213185527686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185527686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185527686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185527686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185527686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185527686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185527698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185527708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185527709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185527709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:30.859504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19718): Terminating (SIGTERM) 18:55:30.900833 run iperf3-srv_10.42.42.10(pid=19719): Terminating (SIGTERM) 18:55:30.952798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19720): Terminating (SIGTERM) 18:55:30.994495 run iperf3-srv_10.42.42.10(pid=19721): Terminating (SIGTERM) 18:55:31.048675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Terminating (SIGTERM) 18:55:31.096209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Terminating (SIGTERM) 18:55:31.142955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19730): Terminating (SIGTERM) 18:55:31.190504 --- ParallelTerminationStrategy: PID 19718 died... 18:55:31.212541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19718): Terminated: ok {rc=0} 18:55:31.262237 --- ParallelTerminationStrategy: PID 19719 died... 18:55:31.283973 run iperf3-srv_10.42.42.10(pid=19719): Terminated {rc=256} 18:55:31.332884 --- ParallelTerminationStrategy: PID 19720 died... 18:55:31.355640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19720): Terminated: ok {rc=0} 18:55:31.404202 --- ParallelTerminationStrategy: PID 19721 died... 18:55:31.426308 run iperf3-srv_10.42.42.10(pid=19721): Terminated {rc=256} 18:55:31.474648 --- ParallelTerminationStrategy: PID 19724 died... 18:55:31.496245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19724): Terminated: ok {rc=0} 18:55:31.546530 --- ParallelTerminationStrategy: PID 19727 died... 18:55:31.568382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19727): Terminated: ok {rc=0} 18:55:31.617199 --- ParallelTerminationStrategy: PID 19730 died... 18:55:31.638940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19730): Terminated: ok {rc=0} 18:55:31.737142 bus /gobi_0: Setting Powered False 18:55:32.850873 bus /gobi_0: Setting Powered False 18:55:33.966302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:55:35.116313 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.128492 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:55:35.190833 tst iperf3.py: using LAC 35586 18:55:35.318564 tst iperf3.py: using RAC 141 18:55:35.446711 tst iperf3.py: using CellId 35586 18:55:35.576394 tst iperf3.py: using BVCI 35587 18:55:35.694334 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.706403 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.717707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.729023 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.740525 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.752179 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.763989 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.775541 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:35.787333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:35.905181 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:55:36.111467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:36.418148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19732): Launched 18:55:36.686281 run iperf3-srv_10.42.42.10(pid=19733): Launched 18:55:36.802669 tst iperf3.py:8: start network... 18:55:37.006442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:37.480198 run create_hlr_db(pid=19735): Launched 18:55:37.605435 bus /gobi_6: Setting Powered False 18:55:38.666459 run create_hlr_db(pid=19735): Terminated: ok {rc=0} 18:55:39.092525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Launched 18:55:39.397899 run osmo-hlr_10.42.42.2(pid=19743): Launched 18:55:39.513115 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:40.064343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Launched 18:55:40.391533 run osmo-stp_10.42.42.5(pid=19746): Launched 18:55:40.515557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:41.080103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Launched 18:55:41.205106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:41.481686 run patchelf(pid=19749): Launched 18:55:41.664543 run osmo-stp_10.42.42.5(pid=19746): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] 18:55:41.802578 run osmo-stp_10.42.42.5(pid=19746): stdout: | (launched: 2022-12-13_18:55:40.331891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:41.941989 run osmo-stp_10.42.42.5(pid=19746): stderr: | 20221213185540522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185540522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185540523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185540523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185540523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185540524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185540524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:42.081744 run osmo-stp_10.42.42.5(pid=19746): stdout: | (launched: 2022-12-13_18:55:40.331891) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:42.215689 run osmo-stp_10.42.42.5(pid=19746): stderr: | 20221213185540522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185540522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185540523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185540523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185540523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185540524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185540524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:42.374558 run patchelf(pid=19749): Terminating (SIGINT) 18:55:42.557617 run patchelf(pid=19749): Terminated: ok {rc=0} 18:55:42.689870 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19746): Process ended prematurely: osmo-stp_10.42.42.5(pid=19746) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 18:55:42.700253 tst iperf3.py:8: Test FAILED (7.6 sec) 18:55:42.728752 run osmo-hlr_10.42.42.2(pid=19743): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19743)] 18:55:42.779755 run osmo-hlr_10.42.42.2(pid=19743): stdout: | (launched: 2022-12-13_18:55:39.341528) 18:55:42.832309 run osmo-hlr_10.42.42.2(pid=19743): stderr: | 20221213185539517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185539517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185539517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185539517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185539518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185539518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185539530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185539538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185539539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185539539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:42.885151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19732): Terminating (SIGTERM) 18:55:42.927249 run iperf3-srv_10.42.42.10(pid=19733): Terminating (SIGTERM) 18:55:42.969673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Terminating (SIGTERM) 18:55:43.011899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Terminating (SIGTERM) 18:55:43.054176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Terminating (SIGTERM) 18:55:43.096470 --- ParallelTerminationStrategy: PID 19732 died... 18:55:43.116924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19732): Terminated: ok {rc=0} 18:55:43.163901 --- ParallelTerminationStrategy: PID 19733 died... 18:55:43.183900 run iperf3-srv_10.42.42.10(pid=19733): Terminated {rc=256} 18:55:43.229938 --- ParallelTerminationStrategy: PID 19742 died... 18:55:43.249783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19742): Terminated: ok {rc=0} 18:55:43.295877 --- ParallelTerminationStrategy: PID 19745 died... 18:55:43.315865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19745): Terminated: ok {rc=0} 18:55:43.362077 --- ParallelTerminationStrategy: PID 19748 died... 18:55:43.382058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19748): Terminated: ok {rc=0} 18:55:43.470806 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:55:44.623940 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:44.636141 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:55:44.699329 tst iperf3m4.py: using LAC 35587 18:55:44.826491 tst iperf3m4.py: using RAC 142 18:55:44.952315 tst iperf3m4.py: using CellId 35587 18:55:45.078388 tst iperf3m4.py: using BVCI 35588 18:55:45.196610 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.208868 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.220256 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.231651 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.243053 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.254902 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.266800 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.278418 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:55:45.290325 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:45.407309 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:45.531858 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:45.653584 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:55:45.770715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:55:45.991929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:46.305246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19750): Launched 18:55:46.611894 run iperf3-srv_10.42.42.10(pid=19751): Launched 18:55:46.742962 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:55:46.962689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:47.335820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19752): Launched 18:55:47.622252 run iperf3-srv_10.42.42.10(pid=19753): Launched 18:55:47.746339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:55:47.966927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:48.294828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Launched 18:55:48.581446 run iperf3-srv_10.42.42.10(pid=19755): Launched 18:55:48.703602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:55:48.924090 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:55:49.242808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Launched 18:55:49.507673 run iperf3-srv_10.42.42.10(pid=19758): Launched 18:55:49.622403 tst iperf3m4.py:8: start network... 18:55:49.826050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:50.298579 run create_hlr_db(pid=19759): Launched 18:55:50.423003 bus /gobi_6: Setting Powered False 18:55:51.484144 run create_hlr_db(pid=19759): Terminated: ok {rc=0} 18:55:51.933566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19764): Launched 18:55:52.261224 run osmo-hlr_10.42.42.2(pid=19765): Launched 18:55:52.387500 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:52.951628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19767): Launched 18:55:53.280408 run osmo-stp_10.42.42.5(pid=19768): Launched 18:55:53.405222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:53.969100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19770): Launched 18:55:54.094286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:54.370953 run patchelf(pid=19771): Launched 18:55:54.554355 run osmo-stp_10.42.42.5(pid=19768): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19768)] 18:55:54.693559 run osmo-stp_10.42.42.5(pid=19768): stdout: | (launched: 2022-12-13_18:55:53.220503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:54.833928 run osmo-stp_10.42.42.5(pid=19768): stderr: | 20221213185553411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185553411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185553411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185553411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185553412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185553412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185553412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:54.974879 run osmo-stp_10.42.42.5(pid=19768): stdout: | (launched: 2022-12-13_18:55:53.220503) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:55.109117 run osmo-stp_10.42.42.5(pid=19768): stderr: | 20221213185553411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185553411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185553411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185553411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185553412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185553412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185553412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:55.268113 run patchelf(pid=19771): Terminating (SIGINT) 18:55:55.450990 run patchelf(pid=19771): Terminated: ok {rc=0} 18:55:55.583441 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19768): Process ended prematurely: osmo-stp_10.42.42.5(pid=19768) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19768)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:55:55.593789 tst iperf3m4.py:8: Test FAILED (11.0 sec) 18:55:55.622796 run osmo-hlr_10.42.42.2(pid=19765): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19765)] 18:55:55.674387 run osmo-hlr_10.42.42.2(pid=19765): stdout: | (launched: 2022-12-13_18:55:52.201641) 18:55:55.727375 run osmo-hlr_10.42.42.2(pid=19765): stderr: | 20221213185552399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185552399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185552399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185552399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185552399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185552399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185552411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185552419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185552420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185552420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:55.780805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19750): Terminating (SIGTERM) 18:55:55.823023 run iperf3-srv_10.42.42.10(pid=19751): Terminating (SIGTERM) 18:55:55.865494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19752): Terminating (SIGTERM) 18:55:55.907891 run iperf3-srv_10.42.42.10(pid=19753): Terminating (SIGTERM) 18:55:55.950362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Terminating (SIGTERM) 18:55:55.993035 run iperf3-srv_10.42.42.10(pid=19755): Terminating (SIGTERM) 18:55:56.035227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Terminating (SIGTERM) 18:55:56.077695 run iperf3-srv_10.42.42.10(pid=19758): Terminating (SIGTERM) 18:55:56.120003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19764): Terminating (SIGTERM) 18:55:56.162521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19767): Terminating (SIGTERM) 18:55:56.204783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19770): Terminating (SIGTERM) 18:55:56.247273 --- ParallelTerminationStrategy: PID 19750 died... 18:55:56.267798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19750): Terminated: ok {rc=0} 18:55:56.315135 --- ParallelTerminationStrategy: PID 19751 died... 18:55:56.335112 run iperf3-srv_10.42.42.10(pid=19751): Terminated {rc=256} 18:55:56.381587 --- ParallelTerminationStrategy: PID 19752 died... 18:55:56.401667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19752): Terminated: ok {rc=0} 18:55:56.448460 --- ParallelTerminationStrategy: PID 19753 died... 18:55:56.468324 run iperf3-srv_10.42.42.10(pid=19753): Terminated {rc=256} 18:55:56.514623 --- ParallelTerminationStrategy: PID 19754 died... 18:55:56.534533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19754): Terminated: ok {rc=0} 18:55:56.581379 --- ParallelTerminationStrategy: PID 19755 died... 18:55:56.601190 run iperf3-srv_10.42.42.10(pid=19755): Terminated {rc=256} 18:55:56.647499 --- ParallelTerminationStrategy: PID 19757 died... 18:55:56.667378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=19757): Terminated: ok {rc=0} 18:55:56.713640 --- ParallelTerminationStrategy: PID 19758 died... 18:55:56.733450 run iperf3-srv_10.42.42.10(pid=19758): Terminated {rc=256} 18:55:56.779622 --- ParallelTerminationStrategy: PID 19764 died... 18:55:56.799576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19764): Terminated: ok {rc=0} 18:55:56.846230 --- ParallelTerminationStrategy: PID 19767 died... 18:55:56.866224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19767): Terminated: ok {rc=0} 18:55:56.912764 --- ParallelTerminationStrategy: PID 19770 died... 18:55:56.932742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19770): Terminated: ok {rc=0} 18:55:57.022313 bus /gobi_4: Setting Powered False 18:55:58.121167 bus /gobi_4: Setting Powered False 18:55:59.239460 bus /gobi_1: Setting Powered False 18:56:00.337187 bus /gobi_1: Setting Powered False 18:56:01.477426 bus /gobi_0: Setting Powered False 18:56:02.592672 bus /gobi_0: Setting Powered False 18:56:03.710509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:56:04.814927 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:04.826950 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:56:04.887117 tst ping.py: using LAC 35588 18:56:05.014127 tst ping.py: using RAC 143 18:56:05.141081 tst ping.py: using CellId 35588 18:56:05.266248 tst ping.py: using BVCI 35589 18:56:05.382903 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.394456 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.405720 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.416901 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.428443 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.439915 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.451658 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:05.463201 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:56:05.583191 tst ping.py:19: start network... 18:56:05.799859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:06.298627 run create_hlr_db(pid=19772): Launched 18:56:06.420554 bus /gobi_6: Setting Powered False 18:56:07.483982 run create_hlr_db(pid=19772): Terminated: ok {rc=0} 18:56:07.914952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Launched 18:56:08.216721 run osmo-hlr_10.42.42.2(pid=19777): Launched 18:56:08.331437 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:08.851493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Launched 18:56:09.153618 run osmo-stp_10.42.42.5(pid=19780): Launched 18:56:09.267614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:56:09.784853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19782): Launched 18:56:09.899836 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:56:10.154008 run patchelf(pid=19783): Launched 18:56:10.321795 run osmo-stp_10.42.42.5(pid=19780): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] 18:56:10.448494 run osmo-stp_10.42.42.5(pid=19780): stdout: | (launched: 2022-12-13_18:56:09.098216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:10.576929 run osmo-stp_10.42.42.5(pid=19780): stderr: | 20221213185609265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185609265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185609265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185609266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185609266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185609266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185609266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:10.705508 run osmo-stp_10.42.42.5(pid=19780): stdout: | (launched: 2022-12-13_18:56:09.098216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:10.828411 run osmo-stp_10.42.42.5(pid=19780): stderr: | 20221213185609265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185609265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185609265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185609266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185609266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185609266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185609266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:10.974373 run patchelf(pid=19783): Terminating (SIGINT) 18:56:11.142423 run patchelf(pid=19783): Terminated: ok {rc=0} 18:56:11.263300 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=19780): Process ended prematurely: osmo-stp_10.42.42.5(pid=19780) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 18:56:11.272458 tst ping.py:22: Test FAILED (6.5 sec) 18:56:11.299385 run osmo-hlr_10.42.42.2(pid=19777): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19777)] 18:56:11.348379 run osmo-hlr_10.42.42.2(pid=19777): stdout: | (launched: 2022-12-13_18:56:08.161215) 18:56:11.398495 run osmo-hlr_10.42.42.2(pid=19777): stderr: | 20221213185608334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185608334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185608334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185608335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185608335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185608335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185608346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185608356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185608357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185608357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:11.448730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Terminating (SIGTERM) 18:56:11.489106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Terminating (SIGTERM) 18:56:11.529447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19782): Terminating (SIGTERM) 18:56:11.569955 --- ParallelTerminationStrategy: PID 19776 died... 18:56:11.589103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19776): Terminated: ok {rc=0} 18:56:11.633806 --- ParallelTerminationStrategy: PID 19779 died... 18:56:11.652626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19779): Terminated: ok {rc=0} 18:56:11.697299 --- ParallelTerminationStrategy: PID 19782 died... 18:56:11.716277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19782): Terminated: ok {rc=0} 18:56:11.801132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:56:12.888815 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:12.901637 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:56:12.962132 tst ping_idle_ping.py: using LAC 35589 18:56:13.092015 tst ping_idle_ping.py: using RAC 144 18:56:13.216593 tst ping_idle_ping.py: using CellId 35589 18:56:13.340333 tst ping_idle_ping.py: using BVCI 35590 18:56:13.457419 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.468731 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.479983 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.491186 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.502746 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.514215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.526294 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:56:13.537762 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:56:13.658008 tst ping_idle_ping.py:24: start network... 18:56:13.874873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:14.382023 run create_hlr_db(pid=19784): Launched 18:56:14.505623 bus /gobi_6: Setting Powered False 18:56:15.570085 run create_hlr_db(pid=19784): Terminated: ok {rc=0} 18:56:16.037368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Launched 18:56:16.447995 run osmo-hlr_10.42.42.2(pid=19787): Launched 18:56:16.684905 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:17.395784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Launched 18:56:17.698996 run osmo-stp_10.42.42.5(pid=19790): Launched 18:56:17.813610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:56:18.331787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19792): Launched 18:56:18.447109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:56:18.702359 run patchelf(pid=19793): Launched 18:56:18.869426 run osmo-stp_10.42.42.5(pid=19790): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] 18:56:18.997388 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-13_18:56:17.642969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:19.126964 run osmo-stp_10.42.42.5(pid=19790): stderr: | 20221213185617812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185617812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185617812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185617813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185617813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185617813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185617813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:19.256189 run osmo-stp_10.42.42.5(pid=19790): stdout: | (launched: 2022-12-13_18:56:17.642969) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:19.379750 run osmo-stp_10.42.42.5(pid=19790): stderr: | 20221213185617812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185617812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185617812 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185617813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185617813 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185617813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185617813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:19.526617 run patchelf(pid=19793): Terminating (SIGINT) 18:56:19.695058 run patchelf(pid=19793): Terminated: ok {rc=0} 18:56:19.816348 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:56:19.825380 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:56:19.851789 run osmo-hlr_10.42.42.2(pid=19787): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19787)] 18:56:19.899573 run osmo-hlr_10.42.42.2(pid=19787): stdout: | (launched: 2022-12-13_18:56:16.387725) 18:56:19.948883 run osmo-hlr_10.42.42.2(pid=19787): stderr: | 20221213185616731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185616731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185616731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185616731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185616731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185616731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185616751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185616765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185616766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185616766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:19.999125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminating (SIGTERM) 18:56:20.038937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminating (SIGTERM) 18:56:20.078625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19792): Terminating (SIGTERM) 18:56:20.118852 --- ParallelTerminationStrategy: PID 19786 died... 18:56:20.138096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19786): Terminated: ok {rc=0} 18:56:20.182041 --- ParallelTerminationStrategy: PID 19789 died... 18:56:20.200620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19789): Terminated: ok {rc=0} 18:56:20.244701 --- ParallelTerminationStrategy: PID 19792 died... 18:56:20.263624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19792): Terminated: ok {rc=0} 18:56:20.350249 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:56:21.636708 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:21.643322 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:56:21.663813 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:56:21.698242 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:56:21.751361 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:56:21.773705 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:56:21.809954 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:56:22.362650 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:56:22.367651 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.378870 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:56:22.434406 tst switch_tch_pdch.py: using LAC 35590 18:56:22.551186 tst switch_tch_pdch.py: using RAC 145 18:56:22.667820 tst switch_tch_pdch.py: using CellId 35590 18:56:22.785479 tst switch_tch_pdch.py: using BVCI 35591 18:56:22.893197 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.904397 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.915391 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.926432 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.937294 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.948290 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.959373 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:56:22.970311 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:56:23.090830 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:56:23.212566 tst switch_tch_pdch.py:51: start network... 18:56:23.428364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:23.926441 run create_hlr_db(pid=19797): Launched 18:56:24.051291 bus /gobi_6: Setting Powered False 18:56:25.114780 run create_hlr_db(pid=19797): Terminated: ok {rc=0} 18:56:25.545180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Launched 18:56:25.844565 run osmo-hlr_10.42.42.2(pid=19800): Launched 18:56:25.958133 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:26.473314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Launched 18:56:26.773312 run osmo-stp_10.42.42.5(pid=19803): Launched 18:56:26.887287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:56:27.405102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19805): Launched 18:56:27.519875 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:56:27.773644 run patchelf(pid=19806): Launched 18:56:27.939322 run osmo-stp_10.42.42.5(pid=19803): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] 18:56:28.065828 run osmo-stp_10.42.42.5(pid=19803): stdout: | (launched: 2022-12-13_18:56:26.717643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:28.193515 run osmo-stp_10.42.42.5(pid=19803): stderr: | 20221213185626885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185626886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185626886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185626886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185626887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185626887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185626887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:28.320920 run osmo-stp_10.42.42.5(pid=19803): stdout: | (launched: 2022-12-13_18:56:26.717643) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:28.443364 run osmo-stp_10.42.42.5(pid=19803): stderr: | 20221213185626885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185626886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185626886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185626886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185626887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185626887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185626887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:28.588939 run patchelf(pid=19806): Terminating (SIGINT) 18:56:28.757480 run patchelf(pid=19806): Terminated: ok {rc=0} 18:56:28.877670 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19803): Process ended prematurely: osmo-stp_10.42.42.5(pid=19803) [trial-2393↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] [trial-2393↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:56:28.886482 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 18:56:28.913044 run osmo-hlr_10.42.42.2(pid=19800): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19800)] 18:56:28.961153 run osmo-hlr_10.42.42.2(pid=19800): stdout: | (launched: 2022-12-13_18:56:25.789666) 18:56:29.010672 run osmo-hlr_10.42.42.2(pid=19800): stderr: | 20221213185625964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185625964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185625964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185625964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185625964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185625964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185625979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185625990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185625990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185625990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:29.060399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Terminating (SIGTERM) 18:56:29.100375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Terminating (SIGTERM) 18:56:29.140107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19805): Terminating (SIGTERM) 18:56:29.179724 --- ParallelTerminationStrategy: PID 19799 died... 18:56:29.198916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19799): Terminated: ok {rc=0} 18:56:29.242679 --- ParallelTerminationStrategy: PID 19802 died... 18:56:29.261070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19802): Terminated: ok {rc=0} 18:56:29.304519 --- ParallelTerminationStrategy: PID 19805 died... 18:56:29.322909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19805): Terminated: ok {rc=0} 18:56:29.409123 bus /gobi_0: Setting Powered False 18:56:30.507218 bus /gobi_0: Setting Powered False 18:56:31.625358 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:56:32.871213 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:32.876859 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:56:32.897420 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:56:32.932346 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:56:32.984737 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:56:33.005727 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:56:33.040203 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:56:33.598743 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:56:33.604325 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:33.615822 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:56:33.674302 tst switch_tch_pdch.py: using LAC 35591 18:56:33.798828 tst switch_tch_pdch.py: using RAC 146 18:56:33.926081 tst switch_tch_pdch.py: using CellId 35591 18:56:34.052274 tst switch_tch_pdch.py: using BVCI 35592 18:56:34.170295 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.181833 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.192900 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.204080 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.215451 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.226858 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.238537 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:56:34.250028 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:56:34.366153 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:56:34.482269 tst switch_tch_pdch.py:51: start network... 18:56:34.683031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:35.122679 run create_hlr_db(pid=19810): Launched 18:56:35.247638 bus /gobi_6: Setting Powered False 18:56:36.307899 run create_hlr_db(pid=19810): Terminated: ok {rc=0} 18:56:36.701100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Launched 18:56:36.998446 run osmo-hlr_10.42.42.2(pid=19813): Launched 18:56:37.112920 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:37.614950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Launched 18:56:37.913238 run osmo-stp_10.42.42.5(pid=19816): Launched 18:56:38.025775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:56:38.513625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19818): Launched 18:56:38.627003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:56:38.878287 run patchelf(pid=19819): Launched 18:56:39.045786 run osmo-stp_10.42.42.5(pid=19816): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] 18:56:39.171642 run osmo-stp_10.42.42.5(pid=19816): stdout: | (launched: 2022-12-13_18:56:37.858102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:39.299378 run osmo-stp_10.42.42.5(pid=19816): stderr: | 20221213185638027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185638028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185638028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185638028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185638029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185638029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185638029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:39.426303 run osmo-stp_10.42.42.5(pid=19816): stdout: | (launched: 2022-12-13_18:56:37.858102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:39.547998 run osmo-stp_10.42.42.5(pid=19816): stderr: | 20221213185638027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185638028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185638028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185638028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185638029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185638029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185638029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:39.692428 run patchelf(pid=19819): Terminating (SIGINT) 18:56:39.858711 run patchelf(pid=19819): Terminated: ok {rc=0} 18:56:39.978467 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=19816): Process ended prematurely: osmo-stp_10.42.42.5(pid=19816) [trial-2393↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] [trial-2393↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:56:39.987361 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 18:56:40.013819 run osmo-hlr_10.42.42.2(pid=19813): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19813)] 18:56:40.061337 run osmo-hlr_10.42.42.2(pid=19813): stdout: | (launched: 2022-12-13_18:56:36.943651) 18:56:40.110681 run osmo-hlr_10.42.42.2(pid=19813): stderr: | 20221213185637114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185637114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185637114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185637114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185637114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185637114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185637129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185637139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185637139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185637140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:40.160283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Terminating (SIGTERM) 18:56:40.200254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Terminating (SIGTERM) 18:56:40.239801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19818): Terminating (SIGTERM) 18:56:40.279494 --- ParallelTerminationStrategy: PID 19812 died... 18:56:40.298635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19812): Terminated: ok {rc=0} 18:56:40.342286 --- ParallelTerminationStrategy: PID 19815 died... 18:56:40.360619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19815): Terminated: ok {rc=0} 18:56:40.404524 --- ParallelTerminationStrategy: PID 19818 died... 18:56:40.423178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=19818): Terminated: ok {rc=0} 18:56:40.508292 bus /gobi_0: Setting Powered False 18:56:41.610792 bus /gobi_0: Setting Powered False 18:56:42.727650 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:trx-b200 --------------------------------------------------------------------- 18:56:43.963210 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:43.967639 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 18:56:44.002221 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 18:56:44.010983 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 18:56:44.064655 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 18:56:44.099084 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 18:56:44.106452 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 18:56:44.644032 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 18:56:44.650026 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 18:56:44.661365 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 18:56:44.713154 tst mo_mt_sms.py: using LAC 35592 18:56:44.843620 tst mo_mt_sms.py: using RAC 147 18:56:44.961875 tst mo_mt_sms.py: using CellId 35592 18:56:45.077072 tst mo_mt_sms.py: using BVCI 35593 18:56:45.184630 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 18:56:45.302864 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 18:56:45.420683 tst mo_mt_sms.py:9: start nitb and bts... 18:56:45.639214 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:56:46.297394 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19823): Launched 18:56:46.621030 run osmo-nitb_10.42.42.2(pid=19824): Launched 18:56:46.816820 run osmo-nitb_10.42.42.2(pid=19824): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19824)] 18:56:46.965831 run osmo-nitb_10.42.42.2(pid=19824): stdout: | (launched: 2022-12-13_18:56:46.563968) 18:56:47.116255 run osmo-nitb_10.42.42.2(pid=19824): stderr: | (launched: 2022-12-13_18:56:46.609878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:56:47.265511 run osmo-nitb_10.42.42.2(pid=19824): stdout: | (launched: 2022-12-13_18:56:46.563968) 18:56:47.406809 run osmo-nitb_10.42.42.2(pid=19824): stderr: | (launched: 2022-12-13_18:56:46.609878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19824): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19824) [trial-2393↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19824)] 18:56:47.758794 tst osmo-nitb_10.42.42.2(pid=19824): stdout: | (launched: 2022-12-13_18:56:46.563968) 18:56:47.889790 tst osmo-nitb_10.42.42.2(pid=19824): stderr: | (launched: 2022-12-13_18:56:46.609878) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:56:48.043356 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=19824): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19824) [trial-2393↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19824)] [trial-2393↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 18:56:48.052705 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:56:48.060144 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19823): Terminating (SIGTERM) 18:56:48.271515 --- ParallelTerminationStrategy: PID 19823 died... 18:56:48.293265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19823): Terminated: ok {rc=0} 18:56:48.383259 bus /sierra_3: Setting Powered False 18:56:49.481508 bus /sierra_3: Setting Powered False 18:56:50.599946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:trx-b200 --------------------------------------------------------------------- 18:56:51.803516 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:51.808042 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 18:56:51.842384 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:56:51.871372 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 18:56:51.925761 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 18:56:51.959914 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:56:51.987620 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 18:56:52.534685 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 18:56:52.540086 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:52.551332 tst sms:trx-b200: Using 1 x bts (candidates: 1) 18:56:52.604033 tst mo_mt_sms.py: using LAC 35593 18:56:52.727789 tst mo_mt_sms.py: using RAC 148 18:56:52.853352 tst mo_mt_sms.py: using CellId 35593 18:56:52.990963 tst mo_mt_sms.py: using BVCI 35594 18:56:53.109133 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:53.120468 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:53.131598 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:53.142730 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:53.154402 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 18:56:53.165923 tst sms:trx-b200: Using 1 x modem (candidates: 2) 18:56:53.280039 tst sms:trx-b200: Using 1 x modem (candidates: 2) 18:56:53.399064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:53.899355 run create_hlr_db(pid=19828): Launched 18:56:54.023575 bus /sierra_2: Setting Powered False 18:56:55.086889 run create_hlr_db(pid=19828): Terminated: ok {rc=0} 18:56:55.518117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19830): Launched 18:56:55.818905 run osmo-hlr_10.42.42.2(pid=19831): Launched 18:56:55.933244 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:56.450215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19833): Launched 18:56:56.748810 run osmo-stp_10.42.42.5(pid=19834): Launched 18:56:56.862315 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:57.404916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19836): Launched 18:56:57.704029 run osmo-msc_10.42.42.6(pid=19837): Launched 18:56:57.870412 run osmo-stp_10.42.42.5(pid=19834): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19834)] 18:56:57.996374 run osmo-stp_10.42.42.5(pid=19834): stdout: | (launched: 2022-12-13_18:56:56.693739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:58.122862 run osmo-stp_10.42.42.5(pid=19834): stderr: | 20221213185656863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185656863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185656863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185656864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185656864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185656864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185656864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:58.247002 run osmo-stp_10.42.42.5(pid=19834): stdout: | (launched: 2022-12-13_18:56:56.693739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:58.366238 run osmo-stp_10.42.42.5(pid=19834): stderr: | 20221213185656863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185656863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185656863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185656864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185656864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185656864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185656864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:58.508105 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=19834): Process ended prematurely: osmo-stp_10.42.42.5(pid=19834) [trial-2393↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19834)] [trial-2393↪sms:trx-b200↪mo_mt_sms.py:16] 18:56:58.516343 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 18:56:58.542282 run osmo-hlr_10.42.42.2(pid=19831): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19831)] 18:56:58.591443 run osmo-hlr_10.42.42.2(pid=19831): stdout: | (launched: 2022-12-13_18:56:55.763441) 18:56:58.641387 run osmo-hlr_10.42.42.2(pid=19831): stderr: | 20221213185655933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185655933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185655934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185655934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185655934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185655934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185655946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185655955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185655956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185655956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:58.710986 run osmo-msc_10.42.42.6(pid=19837): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19837)] 18:56:58.759194 run osmo-msc_10.42.42.6(pid=19837): stdout: | (launched: 2022-12-13_18:56:57.649148) 18:56:58.809714 run osmo-msc_10.42.42.6(pid=19837): stderr: | 20221213185657918 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185657919 DLGLOBAL DEBUG validating counter group 0x7f55ab495c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185657919 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185657919 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185657919 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185657919 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185657921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185657921 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185657921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185657922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:58.859682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19830): Terminating (SIGTERM) 18:56:58.899657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19833): Terminating (SIGTERM) 18:56:58.939811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19836): Terminating (SIGTERM) 18:56:58.979981 --- ParallelTerminationStrategy: PID 19830 died... 18:56:58.999319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19830): Terminated: ok {rc=0} 18:56:59.043547 --- ParallelTerminationStrategy: PID 19833 died... 18:56:59.062467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19833): Terminated: ok {rc=0} 18:56:59.106642 --- ParallelTerminationStrategy: PID 19836 died... 18:56:59.125429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19836): Terminated: ok {rc=0} 18:56:59.211968 bus /sierra_3: Setting Powered False 18:57:00.311377 bus /sierra_3: Setting Powered False 18:57:01.425790 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-b200 --------------------------------------------------------------------- 18:57:02.661824 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:02.665459 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 18:57:02.698263 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 18:57:02.705276 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 18:57:02.739299 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 18:57:02.772554 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 18:57:02.779288 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:57:03.304006 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:57:03.309691 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 18:57:03.320558 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 18:57:03.368028 tst assert_extension.py: using LAC 35594 18:57:03.484200 tst assert_extension.py: using RAC 149 18:57:03.599203 tst assert_extension.py: using CellId 35594 18:57:03.714240 tst assert_extension.py: using BVCI 35595 18:57:03.822927 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 18:57:03.940400 tst assert_extension.py:10: start nitb and bts... 18:57:04.157590 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:57:04.814366 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19842): Launched 18:57:05.135099 run osmo-nitb_10.42.42.2(pid=19843): Launched 18:57:05.314128 run osmo-nitb_10.42.42.2(pid=19843): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19843)] 18:57:05.458068 run osmo-nitb_10.42.42.2(pid=19843): stdout: | (launched: 2022-12-13_18:57:05.076494) 18:57:05.603746 run osmo-nitb_10.42.42.2(pid=19843): stderr: | (launched: 2022-12-13_18:57:05.124329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:57:05.748637 run osmo-nitb_10.42.42.2(pid=19843): stdout: | (launched: 2022-12-13_18:57:05.076494) 18:57:05.888129 run osmo-nitb_10.42.42.2(pid=19843): stderr: | (launched: 2022-12-13_18:57:05.124329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=19843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19843) [trial-2393↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19843)] 18:57:06.258097 tst osmo-nitb_10.42.42.2(pid=19843): stdout: | (launched: 2022-12-13_18:57:05.076494) 18:57:06.388443 tst osmo-nitb_10.42.42.2(pid=19843): stderr: | (launched: 2022-12-13_18:57:05.124329) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:57:06.541682 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=19843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19843) [trial-2393↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19843)] [trial-2393↪nitb_ussd:trx-b200↪assert_extension.py:12] 18:57:06.550760 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:57:06.557785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19842): Terminating (SIGTERM) 18:57:06.769603 --- ParallelTerminationStrategy: PID 19842 died... 18:57:06.791891 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=19842): Terminated: ok {rc=0} 18:57:06.880891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:trx-b200 --------------------------------------------------------------------- 18:57:08.057829 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:08.061804 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 18:57:08.094629 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:57:08.121497 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 18:57:08.156703 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 18:57:08.190220 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:57:08.216838 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:57:08.745405 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:57:08.750517 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:08.761320 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 18:57:08.809977 tst assert_extension.py: using LAC 35595 18:57:08.928574 tst assert_extension.py: using RAC 150 18:57:09.047190 tst assert_extension.py: using CellId 35595 18:57:09.165926 tst assert_extension.py: using BVCI 35596 18:57:09.275080 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:09.285738 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:09.296219 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:09.306699 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:09.317153 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:57:09.328042 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 18:57:09.447026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:09.946229 run create_hlr_db(pid=19847): Launched 18:57:10.070561 bus /sierra_2: Setting Powered False 18:57:11.134287 run create_hlr_db(pid=19847): Terminated: ok {rc=0} 18:57:11.563830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Launched 18:57:11.862928 run osmo-hlr_10.42.42.2(pid=19850): Launched 18:57:11.978181 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:12.507973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Launched 18:57:12.808269 run osmo-stp_10.42.42.5(pid=19853): Launched 18:57:12.922021 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:13.460751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Launched 18:57:13.759843 run osmo-msc_10.42.42.6(pid=19856): Launched 18:57:13.926560 run osmo-stp_10.42.42.5(pid=19853): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] 18:57:14.052525 run osmo-stp_10.42.42.5(pid=19853): stdout: | (launched: 2022-12-13_18:57:12.752933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:14.178811 run osmo-stp_10.42.42.5(pid=19853): stderr: | 20221213185712920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185712920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185712920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185712921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185712921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185712922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185712922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:14.303421 run osmo-stp_10.42.42.5(pid=19853): stdout: | (launched: 2022-12-13_18:57:12.752933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:14.422992 run osmo-stp_10.42.42.5(pid=19853): stderr: | 20221213185712920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185712920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185712920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185712921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185712921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185712922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185712922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:14.566225 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=19853): Process ended prematurely: osmo-stp_10.42.42.5(pid=19853) [trial-2393↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] [trial-2393↪ussd:trx-b200↪assert_extension.py:17] 18:57:14.574587 tst assert_extension.py:17: Test FAILED (5.8 sec) 18:57:14.600591 run osmo-hlr_10.42.42.2(pid=19850): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19850)] 18:57:14.649200 run osmo-hlr_10.42.42.2(pid=19850): stdout: | (launched: 2022-12-13_18:57:11.807765) 18:57:14.699324 run osmo-hlr_10.42.42.2(pid=19850): stderr: | 20221213185711980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185711980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185711980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185711980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185711980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185711980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185711992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185712000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185712000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185712001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:14.768853 run osmo-msc_10.42.42.6(pid=19856): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19856)] 18:57:14.816826 run osmo-msc_10.42.42.6(pid=19856): stdout: | (launched: 2022-12-13_18:57:13.704816) 18:57:14.866443 run osmo-msc_10.42.42.6(pid=19856): stderr: | 20221213185713975 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185713975 DLGLOBAL DEBUG validating counter group 0x7f3fdd438c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185713975 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185713975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185713975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185713975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185713977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185713978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185713978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185713978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:14.916338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Terminating (SIGTERM) 18:57:14.956375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Terminating (SIGTERM) 18:57:14.996171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Terminating (SIGTERM) 18:57:15.036207 --- ParallelTerminationStrategy: PID 19849 died... 18:57:15.055773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19849): Terminated: ok {rc=0} 18:57:15.100098 --- ParallelTerminationStrategy: PID 19852 died... 18:57:15.119010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19852): Terminated: ok {rc=0} 18:57:15.163224 --- ParallelTerminationStrategy: PID 19855 died... 18:57:15.182101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19855): Terminated: ok {rc=0} 18:57:15.268164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:57:16.524253 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:16.532237 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:57:16.569846 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:57:16.599642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:57:16.656929 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:57:16.725671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:57:16.762355 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:57:17.277762 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:57:17.331566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.343288 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:57:17.414932 tst mo_mt_call.py: using LAC 35596 18:57:17.544035 tst mo_mt_call.py: using RAC 151 18:57:17.673920 tst mo_mt_call.py: using CellId 35596 18:57:17.796335 tst mo_mt_call.py: using BVCI 35597 18:57:17.909107 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.920266 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.931333 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.942442 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.954212 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:17.965866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:57:18.085929 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:57:18.203342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:18.678123 run create_hlr_db(pid=19861): Launched 18:57:18.802106 bus /sierra_2: Setting Powered False 18:57:19.863525 run create_hlr_db(pid=19861): Terminated: ok {rc=0} 18:57:20.310494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Launched 18:57:20.620044 run osmo-hlr_10.42.42.2(pid=19864): Launched 18:57:20.734912 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:21.260482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Launched 18:57:21.565248 run osmo-stp_10.42.42.5(pid=19867): Launched 18:57:21.680326 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:22.229684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Launched 18:57:22.533575 run osmo-msc_10.42.42.6(pid=19870): Launched 18:57:22.704066 run osmo-stp_10.42.42.5(pid=19867): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] 18:57:22.832214 run osmo-stp_10.42.42.5(pid=19867): stdout: | (launched: 2022-12-13_18:57:21.508583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:22.960513 run osmo-stp_10.42.42.5(pid=19867): stderr: | 20221213185721679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185721679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185721679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185721680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185721680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185721681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185721681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:23.086703 run osmo-stp_10.42.42.5(pid=19867): stdout: | (launched: 2022-12-13_18:57:21.508583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:23.207789 run osmo-stp_10.42.42.5(pid=19867): stderr: | 20221213185721679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185721679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185721679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185721680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185721680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185721681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185721681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:23.352640 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19867): Process ended prematurely: osmo-stp_10.42.42.5(pid=19867) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:57:23.361510 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:57:23.387712 run osmo-hlr_10.42.42.2(pid=19864): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19864)] 18:57:23.435992 run osmo-hlr_10.42.42.2(pid=19864): stdout: | (launched: 2022-12-13_18:57:20.564241) 18:57:23.485819 run osmo-hlr_10.42.42.2(pid=19864): stderr: | 20221213185720737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185720737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185720737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185720737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185720737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185720737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185720750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185720760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185720760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185720760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:23.555815 run osmo-msc_10.42.42.6(pid=19870): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19870)] 18:57:23.604149 run osmo-msc_10.42.42.6(pid=19870): stdout: | (launched: 2022-12-13_18:57:22.477407) 18:57:23.653893 run osmo-msc_10.42.42.6(pid=19870): stderr: | 20221213185722747 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185722747 DLGLOBAL DEBUG validating counter group 0x7fd884dfec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185722747 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185722747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185722747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185722747 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185722749 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185722749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185722750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185722750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:23.704057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Terminating (SIGTERM) 18:57:23.743855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Terminating (SIGTERM) 18:57:23.784213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Terminating (SIGTERM) 18:57:23.824331 --- ParallelTerminationStrategy: PID 19863 died... 18:57:23.843521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19863): Terminated: ok {rc=0} 18:57:23.887619 --- ParallelTerminationStrategy: PID 19866 died... 18:57:23.906243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19866): Terminated: ok {rc=0} 18:57:23.950197 --- ParallelTerminationStrategy: PID 19869 died... 18:57:23.968849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19869): Terminated: ok {rc=0} 18:57:24.056067 bus /sierra_3: Setting Powered False 18:57:25.156680 bus /sierra_3: Setting Powered False 18:57:26.273533 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:57:27.420697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:27.432534 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:57:27.502607 tst mo_mt_call_osmux.py: using LAC 35597 18:57:27.624432 tst mo_mt_call_osmux.py: using RAC 152 18:57:27.743715 tst mo_mt_call_osmux.py: using CellId 35597 18:57:27.865095 tst mo_mt_call_osmux.py: using BVCI 35598 18:57:27.976463 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:27.987612 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:27.998454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:28.009367 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:28.020285 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:57:28.031178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:57:28.150973 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:57:28.268024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:28.738265 run create_hlr_db(pid=19872): Launched 18:57:28.864351 bus /sierra_2: Setting Powered False 18:57:29.925216 run create_hlr_db(pid=19872): Terminated: ok {rc=0} 18:57:30.371034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Launched 18:57:30.700565 run osmo-hlr_10.42.42.2(pid=19875): Launched 18:57:30.825051 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:31.530155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Launched 18:57:31.844591 run osmo-stp_10.42.42.5(pid=19878): Launched 18:57:32.217824 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:32.813530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Launched 18:57:33.140586 run osmo-msc_10.42.42.6(pid=19881): Launched 18:57:33.321809 run osmo-stp_10.42.42.5(pid=19878): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] 18:57:33.459483 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-13_18:57:31.788100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:33.597690 run osmo-stp_10.42.42.5(pid=19878): stderr: | 20221213185731995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185731995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185731995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185731997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185731998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185731998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185731998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:33.734683 run osmo-stp_10.42.42.5(pid=19878): stdout: | (launched: 2022-12-13_18:57:31.788100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:33.865213 run osmo-stp_10.42.42.5(pid=19878): stderr: | 20221213185731995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185731995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185731995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185731997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185731998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185731998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185731998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:34.021417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:57:34.031055 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:57:34.058750 run osmo-hlr_10.42.42.2(pid=19875): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19875)] 18:57:34.110686 run osmo-hlr_10.42.42.2(pid=19875): stdout: | (launched: 2022-12-13_18:57:30.639786) 18:57:34.163748 run osmo-hlr_10.42.42.2(pid=19875): stderr: | 20221213185730855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185730855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185730855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185730855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185730855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185730855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185730887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185730904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185730905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185730905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:34.236619 run osmo-msc_10.42.42.6(pid=19881): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19881)] 18:57:34.287085 run osmo-msc_10.42.42.6(pid=19881): stdout: | (launched: 2022-12-13_18:57:33.080917) 18:57:34.339744 run osmo-msc_10.42.42.6(pid=19881): stderr: | 20221213185733402 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185733402 DLGLOBAL DEBUG validating counter group 0x7f5aba616c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185733402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185733402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185733402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185733402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185733404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185733405 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185733405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185733405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:34.391984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminating (SIGTERM) 18:57:34.434418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminating (SIGTERM) 18:57:34.477215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Terminating (SIGTERM) 18:57:34.519747 --- ParallelTerminationStrategy: PID 19874 died... 18:57:34.540301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19874): Terminated: ok {rc=0} 18:57:34.587192 --- ParallelTerminationStrategy: PID 19877 died... 18:57:34.607500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19877): Terminated: ok {rc=0} 18:57:34.654402 --- ParallelTerminationStrategy: PID 19880 died... 18:57:34.674477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19880): Terminated: ok {rc=0} 18:57:34.763663 bus /sierra_3: Setting Powered False 18:57:35.862324 bus /sierra_3: Setting Powered False 18:57:36.978812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:57:38.234791 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:38.241866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:57:38.276344 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:57:38.305015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:57:38.359863 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:57:38.393337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:57:38.419915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:57:38.972683 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:57:39.025777 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.037585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:57:39.109303 tst mo_mt_call.py: using LAC 35598 18:57:39.236463 tst mo_mt_call.py: using RAC 153 18:57:39.357088 tst mo_mt_call.py: using CellId 35598 18:57:39.477817 tst mo_mt_call.py: using BVCI 35599 18:57:39.588212 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.599583 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.610855 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.622112 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.633697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:39.644793 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:57:39.763963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:57:39.881166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:40.354772 run create_hlr_db(pid=19886): Launched 18:57:40.480900 bus /sierra_2: Setting Powered False 18:57:41.541656 run create_hlr_db(pid=19886): Terminated: ok {rc=0} 18:57:41.967729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Launched 18:57:42.273907 run osmo-hlr_10.42.42.2(pid=19889): Launched 18:57:42.388704 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:42.915758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Launched 18:57:43.220590 run osmo-stp_10.42.42.5(pid=19892): Launched 18:57:43.335550 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:43.887012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Launched 18:57:44.191503 run osmo-msc_10.42.42.6(pid=19895): Launched 18:57:44.361572 run osmo-stp_10.42.42.5(pid=19892): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] 18:57:44.490229 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-13_18:57:43.164167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:44.618837 run osmo-stp_10.42.42.5(pid=19892): stderr: | 20221213185743333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185743333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185743333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185743334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185743334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185743334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185743335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:44.745632 run osmo-stp_10.42.42.5(pid=19892): stdout: | (launched: 2022-12-13_18:57:43.164167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:44.867536 run osmo-stp_10.42.42.5(pid=19892): stderr: | 20221213185743333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185743333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185743333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185743334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185743334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185743334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185743335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:45.012559 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:57:45.021715 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:57:45.048206 run osmo-hlr_10.42.42.2(pid=19889): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19889)] 18:57:45.096516 run osmo-hlr_10.42.42.2(pid=19889): stdout: | (launched: 2022-12-13_18:57:42.217320) 18:57:45.146197 run osmo-hlr_10.42.42.2(pid=19889): stderr: | 20221213185742391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185742391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185742391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185742391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185742391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185742391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185742403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185742414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185742414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185742415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:45.215339 run osmo-msc_10.42.42.6(pid=19895): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19895)] 18:57:45.263301 run osmo-msc_10.42.42.6(pid=19895): stdout: | (launched: 2022-12-13_18:57:44.135189) 18:57:45.312771 run osmo-msc_10.42.42.6(pid=19895): stderr: | 20221213185744408 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185744408 DLGLOBAL DEBUG validating counter group 0x7f34d641ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185744408 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185744408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185744408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185744409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185744410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185744411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185744411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185744411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:45.362708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminating (SIGTERM) 18:57:45.402834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminating (SIGTERM) 18:57:45.443029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Terminating (SIGTERM) 18:57:45.483309 --- ParallelTerminationStrategy: PID 19888 died... 18:57:45.502805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19888): Terminated: ok {rc=0} 18:57:45.547588 --- ParallelTerminationStrategy: PID 19891 died... 18:57:45.566541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19891): Terminated: ok {rc=0} 18:57:45.610871 --- ParallelTerminationStrategy: PID 19894 died... 18:57:45.629713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19894): Terminated: ok {rc=0} 18:57:45.716826 bus /sierra_3: Setting Powered False 18:57:46.818239 bus /sierra_3: Setting Powered False 18:57:47.939238 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:57:49.087454 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.099398 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:57:49.169808 tst mo_mt_call_osmux.py: using LAC 35599 18:57:49.290443 tst mo_mt_call_osmux.py: using RAC 154 18:57:49.418813 tst mo_mt_call_osmux.py: using CellId 35599 18:57:49.546098 tst mo_mt_call_osmux.py: using BVCI 35600 18:57:49.665200 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.677059 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.688631 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.700309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.712286 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:57:49.723991 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:57:49.844486 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:57:49.961729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:57:50.435655 run create_hlr_db(pid=19897): Launched 18:57:50.560088 bus /sierra_2: Setting Powered False 18:57:51.620369 run create_hlr_db(pid=19897): Terminated: ok {rc=0} 18:57:52.069864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Launched 18:57:52.398216 run osmo-hlr_10.42.42.2(pid=19900): Launched 18:57:52.523491 run osmo-stp_10.42.42.5: Starting osmo-stp 18:57:53.090304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Launched 18:57:53.417798 run osmo-stp_10.42.42.5(pid=19903): Launched 18:57:53.543666 run osmo-msc_10.42.42.6: Starting osmo-msc 18:57:54.141753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Launched 18:57:54.452790 run osmo-msc_10.42.42.6(pid=19906): Launched 18:57:54.623404 run osmo-stp_10.42.42.5(pid=19903): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] 18:57:54.753282 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-13_18:57:53.358204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:54.882741 run osmo-stp_10.42.42.5(pid=19903): stderr: | 20221213185753548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185753548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185753549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185753549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185753550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185753550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185753550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:55.010301 run osmo-stp_10.42.42.5(pid=19903): stdout: | (launched: 2022-12-13_18:57:53.358204) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:57:55.132339 run osmo-stp_10.42.42.5(pid=19903): stderr: | 20221213185753548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185753548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185753549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185753549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185753550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185753550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185753550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:57:55.278428 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:57:55.287400 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:57:55.314040 run osmo-hlr_10.42.42.2(pid=19900): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19900)] 18:57:55.362681 run osmo-hlr_10.42.42.2(pid=19900): stdout: | (launched: 2022-12-13_18:57:52.338469) 18:57:55.412807 run osmo-hlr_10.42.42.2(pid=19900): stderr: | 20221213185752532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185752532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185752532 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185752532 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185752532 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185752532 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185752545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185752555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185752556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185752556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:57:55.483049 run osmo-msc_10.42.42.6(pid=19906): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19906)] 18:57:55.531271 run osmo-msc_10.42.42.6(pid=19906): stdout: | (launched: 2022-12-13_18:57:54.396590) 18:57:55.581185 run osmo-msc_10.42.42.6(pid=19906): stderr: | 20221213185754666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185754667 DLGLOBAL DEBUG validating counter group 0x7f9f61b73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185754667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185754667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185754667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185754667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185754669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185754669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185754670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185754670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:57:55.631447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminating (SIGTERM) 18:57:55.671972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminating (SIGTERM) 18:57:55.712163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Terminating (SIGTERM) 18:57:55.752643 --- ParallelTerminationStrategy: PID 19899 died... 18:57:55.772445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19899): Terminated: ok {rc=0} 18:57:55.817835 --- ParallelTerminationStrategy: PID 19902 died... 18:57:55.836751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19902): Terminated: ok {rc=0} 18:57:55.881300 --- ParallelTerminationStrategy: PID 19905 died... 18:57:55.900065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19905): Terminated: ok {rc=0} 18:57:55.987146 bus /sierra_3: Setting Powered False 18:57:57.088255 bus /sierra_3: Setting Powered False 18:57:58.205348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:57:59.461310 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:57:59.468551 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:57:59.503833 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:57:59.531698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:57:59.586620 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:57:59.621339 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:57:59.649149 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:58:00.200290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:58:00.253919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.265919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:58:00.338027 tst mo_mt_call.py: using LAC 35600 18:58:00.467496 tst mo_mt_call.py: using RAC 155 18:58:00.595260 tst mo_mt_call.py: using CellId 35600 18:58:00.724700 tst mo_mt_call.py: using BVCI 35601 18:58:00.854095 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.869831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.888165 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.909808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.931849 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:00.943870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:58:01.066224 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:58:01.218510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:01.721191 run create_hlr_db(pid=19911): Launched 18:58:01.884550 bus /sierra_2: Setting Powered False 18:58:02.945634 run create_hlr_db(pid=19911): Terminated: ok {rc=0} 18:58:03.391825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Launched 18:58:03.719552 run osmo-hlr_10.42.42.2(pid=19914): Launched 18:58:03.843781 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:04.409521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Launched 18:58:04.735598 run osmo-stp_10.42.42.5(pid=19917): Launched 18:58:04.859637 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:05.450046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Launched 18:58:05.778922 run osmo-msc_10.42.42.6(pid=19920): Launched 18:58:05.960897 run osmo-stp_10.42.42.5(pid=19917): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] 18:58:06.100340 run osmo-stp_10.42.42.5(pid=19917): stdout: | (launched: 2022-12-13_18:58:04.676149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:06.238848 run osmo-stp_10.42.42.5(pid=19917): stderr: | 20221213185804865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185804865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185804865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185804866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185804866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185804866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185804866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:06.375646 run osmo-stp_10.42.42.5(pid=19917): stdout: | (launched: 2022-12-13_18:58:04.676149) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:06.507296 run osmo-stp_10.42.42.5(pid=19917): stderr: | 20221213185804865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185804865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185804865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185804866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185804866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185804866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185804866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:06.664845 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19917): Process ended prematurely: osmo-stp_10.42.42.5(pid=19917) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:58:06.674907 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:58:06.702845 run osmo-hlr_10.42.42.2(pid=19914): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19914)] 18:58:06.754397 run osmo-hlr_10.42.42.2(pid=19914): stdout: | (launched: 2022-12-13_18:58:03.659699) 18:58:06.807397 run osmo-hlr_10.42.42.2(pid=19914): stderr: | 20221213185803858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185803858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185803858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185803858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185803858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185803858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185803869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185803878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185803878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185803878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:06.880022 run osmo-msc_10.42.42.6(pid=19920): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19920)] 18:58:06.930054 run osmo-msc_10.42.42.6(pid=19920): stdout: | (launched: 2022-12-13_18:58:05.718707) 18:58:06.982211 run osmo-msc_10.42.42.6(pid=19920): stderr: | 20221213185806040 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185806041 DLGLOBAL DEBUG validating counter group 0x7fb45cc73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185806041 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185806041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185806041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185806041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185806043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185806043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185806043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185806043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:07.034911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Terminating (SIGTERM) 18:58:07.076705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Terminating (SIGTERM) 18:58:07.118824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Terminating (SIGTERM) 18:58:07.161575 --- ParallelTerminationStrategy: PID 19913 died... 18:58:07.182272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19913): Terminated: ok {rc=0} 18:58:07.229198 --- ParallelTerminationStrategy: PID 19916 died... 18:58:07.249402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19916): Terminated: ok {rc=0} 18:58:07.295949 --- ParallelTerminationStrategy: PID 19919 died... 18:58:07.316280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19919): Terminated: ok {rc=0} 18:58:07.405947 bus /sierra_3: Setting Powered False 18:58:08.505221 bus /sierra_3: Setting Powered False 18:58:09.622053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:58:10.772306 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:10.784772 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:58:10.863853 tst mo_mt_call_osmux.py: using LAC 35601 18:58:10.986813 tst mo_mt_call_osmux.py: using RAC 156 18:58:11.105547 tst mo_mt_call_osmux.py: using CellId 35601 18:58:11.234810 tst mo_mt_call_osmux.py: using BVCI 35602 18:58:11.354203 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:11.366148 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:11.377842 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:11.389504 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:11.401733 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:58:11.413867 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:58:11.530217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:58:11.647406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:12.122001 run create_hlr_db(pid=19922): Launched 18:58:12.247110 bus /sierra_2: Setting Powered False 18:58:13.307533 run create_hlr_db(pid=19922): Terminated: ok {rc=0} 18:58:13.754870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Launched 18:58:14.083037 run osmo-hlr_10.42.42.2(pid=19925): Launched 18:58:14.207602 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:14.734268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Launched 18:58:15.038915 run osmo-stp_10.42.42.5(pid=19928): Launched 18:58:15.156603 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:15.706825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Launched 18:58:16.024751 run osmo-msc_10.42.42.6(pid=19931): Launched 18:58:16.342681 run osmo-stp_10.42.42.5(pid=19928): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] 18:58:16.559792 run osmo-stp_10.42.42.5(pid=19928): stdout: | (launched: 2022-12-13_18:58:14.982893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:16.822904 run osmo-stp_10.42.42.5(pid=19928): stderr: | 20221213185815150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185815151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185815152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185815152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185815153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185815153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185815153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:16.979280 run osmo-stp_10.42.42.5(pid=19928): stdout: | (launched: 2022-12-13_18:58:14.982893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:17.139630 run osmo-stp_10.42.42.5(pid=19928): stderr: | 20221213185815150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185815151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185815152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185815152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185815153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185815153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185815153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:17.303225 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19928): Process ended prematurely: osmo-stp_10.42.42.5(pid=19928) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:58:17.313303 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:58:17.342413 run osmo-hlr_10.42.42.2(pid=19925): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19925)] 18:58:17.397905 run osmo-hlr_10.42.42.2(pid=19925): stdout: | (launched: 2022-12-13_18:58:14.023138) 18:58:17.452661 run osmo-hlr_10.42.42.2(pid=19925): stderr: | 20221213185814219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185814219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185814219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185814219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185814219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185814219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185814231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185814240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185814240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185814240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:17.528095 run osmo-msc_10.42.42.6(pid=19931): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19931)] 18:58:17.579471 run osmo-msc_10.42.42.6(pid=19931): stdout: | (launched: 2022-12-13_18:58:15.967338) 18:58:17.634144 run osmo-msc_10.42.42.6(pid=19931): stderr: | 20221213185816545 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185816546 DLGLOBAL DEBUG validating counter group 0x7f54af199c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185816546 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185816546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185816546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185816546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185816548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185816548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185816548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185816548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:17.688497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Terminating (SIGTERM) 18:58:17.731292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Terminating (SIGTERM) 18:58:17.774725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Terminating (SIGTERM) 18:58:17.818422 --- ParallelTerminationStrategy: PID 19924 died... 18:58:17.839640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19924): Terminated: ok {rc=0} 18:58:17.887742 --- ParallelTerminationStrategy: PID 19927 died... 18:58:17.908711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19927): Terminated: ok {rc=0} 18:58:17.956653 --- ParallelTerminationStrategy: PID 19930 died... 18:58:17.977689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19930): Terminated: ok {rc=0} 18:58:18.069270 bus /sierra_3: Setting Powered False 18:58:19.165982 bus /sierra_3: Setting Powered False 18:58:20.283638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:58:21.539517 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:58:21.546904 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:58:21.582394 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:58:21.610472 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:58:21.666390 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:58:21.699564 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:58:21.726446 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:58:22.276000 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:58:22.325244 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.336473 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:58:22.405124 tst mo_mt_call.py: using LAC 35602 18:58:22.524365 tst mo_mt_call.py: using RAC 157 18:58:22.645478 tst mo_mt_call.py: using CellId 35602 18:58:22.764331 tst mo_mt_call.py: using BVCI 35603 18:58:22.875769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.886949 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.897872 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.908757 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.919989 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:22.931115 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:58:23.051324 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:58:23.168885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:23.642076 run create_hlr_db(pid=19936): Launched 18:58:23.766126 bus /sierra_2: Setting Powered False 18:58:24.831122 run create_hlr_db(pid=19936): Terminated: ok {rc=0} 18:58:25.286179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Launched 18:58:25.614109 run osmo-hlr_10.42.42.2(pid=19939): Launched 18:58:25.739682 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:26.302901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Launched 18:58:26.631639 run osmo-stp_10.42.42.5(pid=19942): Launched 18:58:26.758267 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:27.352751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19944): Launched 18:58:27.681412 run osmo-msc_10.42.42.6(pid=19945): Launched 18:58:27.863482 run osmo-stp_10.42.42.5(pid=19942): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] 18:58:28.001896 run osmo-stp_10.42.42.5(pid=19942): stdout: | (launched: 2022-12-13_18:58:26.571656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:28.140653 run osmo-stp_10.42.42.5(pid=19942): stderr: | 20221213185826762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185826762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185826762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185826763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185826763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185826763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185826763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:28.277477 run osmo-stp_10.42.42.5(pid=19942): stdout: | (launched: 2022-12-13_18:58:26.571656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:28.408737 run osmo-stp_10.42.42.5(pid=19942): stderr: | 20221213185826762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185826762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185826762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185826763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185826763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185826763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185826763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:28.565114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19942): Process ended prematurely: osmo-stp_10.42.42.5(pid=19942) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:58:28.575069 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:58:28.602878 run osmo-hlr_10.42.42.2(pid=19939): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19939)] 18:58:28.654686 run osmo-hlr_10.42.42.2(pid=19939): stdout: | (launched: 2022-12-13_18:58:25.554447) 18:58:28.707407 run osmo-hlr_10.42.42.2(pid=19939): stderr: | 20221213185825750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185825750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185825750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185825750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185825750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185825750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185825763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185825772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185825772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185825772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:28.780055 run osmo-msc_10.42.42.6(pid=19945): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19945)] 18:58:28.830668 run osmo-msc_10.42.42.6(pid=19945): stdout: | (launched: 2022-12-13_18:58:27.620684) 18:58:28.883576 run osmo-msc_10.42.42.6(pid=19945): stderr: | 20221213185827941 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185827942 DLGLOBAL DEBUG validating counter group 0x7ff679308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185827942 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185827942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185827942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185827942 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185827944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185827944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185827944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185827944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:28.936450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Terminating (SIGTERM) 18:58:28.978364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Terminating (SIGTERM) 18:58:29.020892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19944): Terminating (SIGTERM) 18:58:29.063625 --- ParallelTerminationStrategy: PID 19938 died... 18:58:29.084540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19938): Terminated: ok {rc=0} 18:58:29.131509 --- ParallelTerminationStrategy: PID 19941 died... 18:58:29.151634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19941): Terminated: ok {rc=0} 18:58:29.198675 --- ParallelTerminationStrategy: PID 19944 died... 18:58:29.218789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19944): Terminated: ok {rc=0} 18:58:29.308172 bus /sierra_3: Setting Powered False 18:58:30.405271 bus /sierra_3: Setting Powered False 18:58:31.521239 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:58:32.674189 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:32.686704 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:58:32.758941 tst mo_mt_call_osmux.py: using LAC 35603 18:58:32.888136 tst mo_mt_call_osmux.py: using RAC 158 18:58:33.015222 tst mo_mt_call_osmux.py: using CellId 35603 18:58:33.149369 tst mo_mt_call_osmux.py: using BVCI 35604 18:58:33.262507 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:33.274017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:33.285213 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:33.296177 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:33.307980 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:58:33.319745 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:58:33.436006 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:58:33.557120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:34.064661 run create_hlr_db(pid=19947): Launched 18:58:34.189793 bus /sierra_2: Setting Powered False 18:58:35.254139 run create_hlr_db(pid=19947): Terminated: ok {rc=0} 18:58:35.693073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Launched 18:58:35.999394 run osmo-hlr_10.42.42.2(pid=19950): Launched 18:58:36.115998 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:36.652199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Launched 18:58:36.957433 run osmo-stp_10.42.42.5(pid=19953): Launched 18:58:37.074290 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:37.624510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Launched 18:58:37.929645 run osmo-msc_10.42.42.6(pid=19956): Launched 18:58:38.099956 run osmo-stp_10.42.42.5(pid=19953): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] 18:58:38.229229 run osmo-stp_10.42.42.5(pid=19953): stdout: | (launched: 2022-12-13_18:58:36.901633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:38.358550 run osmo-stp_10.42.42.5(pid=19953): stderr: | 20221213185837070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185837070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185837070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185837070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185837071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185837071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185837071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:38.485116 run osmo-stp_10.42.42.5(pid=19953): stdout: | (launched: 2022-12-13_18:58:36.901633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:38.606362 run osmo-stp_10.42.42.5(pid=19953): stderr: | 20221213185837070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185837070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185837070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185837070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185837071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185837071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185837071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:38.751808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19953): Process ended prematurely: osmo-stp_10.42.42.5(pid=19953) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:58:38.760745 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:58:38.787115 run osmo-hlr_10.42.42.2(pid=19950): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19950)] 18:58:38.835046 run osmo-hlr_10.42.42.2(pid=19950): stdout: | (launched: 2022-12-13_18:58:35.943247) 18:58:38.884462 run osmo-hlr_10.42.42.2(pid=19950): stderr: | 20221213185836115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185836115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185836115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185836115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185836115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185836115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185836127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185836137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185836138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185836138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:38.953522 run osmo-msc_10.42.42.6(pid=19956): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19956)] 18:58:39.001383 run osmo-msc_10.42.42.6(pid=19956): stdout: | (launched: 2022-12-13_18:58:37.873812) 18:58:39.050689 run osmo-msc_10.42.42.6(pid=19956): stderr: | 20221213185838144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185838145 DLGLOBAL DEBUG validating counter group 0x7f7d90699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185838145 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185838145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185838145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185838145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185838147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185838147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185838147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185838148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:39.100332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminating (SIGTERM) 18:58:39.140193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Terminating (SIGTERM) 18:58:39.180012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Terminating (SIGTERM) 18:58:39.220013 --- ParallelTerminationStrategy: PID 19949 died... 18:58:39.239322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminated: ok {rc=0} 18:58:39.283466 --- ParallelTerminationStrategy: PID 19952 died... 18:58:39.302096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19952): Terminated: ok {rc=0} 18:58:39.345964 --- ParallelTerminationStrategy: PID 19955 died... 18:58:39.364559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19955): Terminated: ok {rc=0} 18:58:39.450679 bus /sierra_3: Setting Powered False 18:58:40.550515 bus /sierra_3: Setting Powered False 18:58:41.667655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:58:42.924444 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:58:42.931671 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:58:42.967028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:58:42.995659 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:58:43.049569 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:58:43.084663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:58:43.112901 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:58:43.664523 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:58:43.714055 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:43.725500 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:58:43.794855 tst mo_mt_call.py: using LAC 35604 18:58:43.913721 tst mo_mt_call.py: using RAC 159 18:58:44.033229 tst mo_mt_call.py: using CellId 35604 18:58:44.152577 tst mo_mt_call.py: using BVCI 35605 18:58:44.263697 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:44.274870 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:44.285843 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:44.296725 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:44.308095 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:44.319016 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:58:44.437973 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:58:44.555654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:45.028567 run create_hlr_db(pid=19961): Launched 18:58:45.152730 bus /sierra_2: Setting Powered False 18:58:46.218267 run create_hlr_db(pid=19961): Terminated: ok {rc=0} 18:58:46.685839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19963): Launched 18:58:47.032564 run osmo-hlr_10.42.42.2(pid=19964): Launched 18:58:47.198082 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:47.721287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19966): Launched 18:58:48.026688 run osmo-stp_10.42.42.5(pid=19967): Launched 18:58:48.144031 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:48.693531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19969): Launched 18:58:48.996845 run osmo-msc_10.42.42.6(pid=19970): Launched 18:58:49.167199 run osmo-stp_10.42.42.5(pid=19967): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19967)] 18:58:49.295372 run osmo-stp_10.42.42.5(pid=19967): stdout: | (launched: 2022-12-13_18:58:47.970347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:49.423167 run osmo-stp_10.42.42.5(pid=19967): stderr: | 20221213185848139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185848139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185848140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185848140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185848140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185848141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185848141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:49.549660 run osmo-stp_10.42.42.5(pid=19967): stdout: | (launched: 2022-12-13_18:58:47.970347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:49.671280 run osmo-stp_10.42.42.5(pid=19967): stderr: | 20221213185848139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185848139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185848140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185848140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185848140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185848141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185848141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:49.816437 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19967): Process ended prematurely: osmo-stp_10.42.42.5(pid=19967) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19967)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:58:49.825518 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:58:49.851926 run osmo-hlr_10.42.42.2(pid=19964): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19964)] 18:58:49.900031 run osmo-hlr_10.42.42.2(pid=19964): stdout: | (launched: 2022-12-13_18:58:46.972337) 18:58:49.949403 run osmo-hlr_10.42.42.2(pid=19964): stderr: | 20221213185847172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185847172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185847172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185847172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185847172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185847172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185847185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185847193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185847193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185847193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:58:50.018207 run osmo-msc_10.42.42.6(pid=19970): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19970)] 18:58:50.065872 run osmo-msc_10.42.42.6(pid=19970): stdout: | (launched: 2022-12-13_18:58:48.940662) 18:58:50.114889 run osmo-msc_10.42.42.6(pid=19970): stderr: | 20221213185849210 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185849210 DLGLOBAL DEBUG validating counter group 0x7fead1cdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185849210 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185849210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185849210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185849210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185849212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185849212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185849213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185849213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:58:50.164460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19963): Terminating (SIGTERM) 18:58:50.203931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19966): Terminating (SIGTERM) 18:58:50.244075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19969): Terminating (SIGTERM) 18:58:50.283919 --- ParallelTerminationStrategy: PID 19963 died... 18:58:50.303488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19963): Terminated: ok {rc=0} 18:58:50.347391 --- ParallelTerminationStrategy: PID 19966 died... 18:58:50.366059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19966): Terminated: ok {rc=0} 18:58:50.409999 --- ParallelTerminationStrategy: PID 19969 died... 18:58:50.428659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19969): Terminated: ok {rc=0} 18:58:50.512342 bus /sierra_3: Setting Powered False 18:58:51.609377 bus /sierra_3: Setting Powered False 18:58:52.727316 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:58:53.877852 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:53.890258 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:58:53.966013 tst mo_mt_call_osmux.py: using LAC 35605 18:58:54.086258 tst mo_mt_call_osmux.py: using RAC 160 18:58:54.213754 tst mo_mt_call_osmux.py: using CellId 35605 18:58:54.342152 tst mo_mt_call_osmux.py: using BVCI 35606 18:58:54.462527 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:54.474422 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:54.486064 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:54.498035 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:54.510165 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:58:54.522172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:58:54.643447 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:58:54.762227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:58:55.235896 run create_hlr_db(pid=19972): Launched 18:58:55.360931 bus /sierra_2: Setting Powered False 18:58:56.422080 run create_hlr_db(pid=19972): Terminated: ok {rc=0} 18:58:56.868015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Launched 18:58:57.197252 run osmo-hlr_10.42.42.2(pid=19975): Launched 18:58:57.322842 run osmo-stp_10.42.42.5: Starting osmo-stp 18:58:57.892416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Launched 18:58:58.221150 run osmo-stp_10.42.42.5(pid=19978): Launched 18:58:58.346290 run osmo-msc_10.42.42.6: Starting osmo-msc 18:58:58.938020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19980): Launched 18:58:59.268761 run osmo-msc_10.42.42.6(pid=19981): Launched 18:58:59.452081 run osmo-stp_10.42.42.5(pid=19978): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] 18:58:59.591083 run osmo-stp_10.42.42.5(pid=19978): stdout: | (launched: 2022-12-13_18:58:58.161060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:58:59.731271 run osmo-stp_10.42.42.5(pid=19978): stderr: | 20221213185858353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185858353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185858353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185858353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185858354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185858354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185858354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:58:59.868649 run osmo-stp_10.42.42.5(pid=19978): stdout: | (launched: 2022-12-13_18:58:58.161060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:00.000063 run osmo-stp_10.42.42.5(pid=19978): stderr: | 20221213185858353 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185858353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185858353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185858353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185858354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185858354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185858354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:00.157549 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19978): Process ended prematurely: osmo-stp_10.42.42.5(pid=19978) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:59:00.167497 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:59:00.195603 run osmo-hlr_10.42.42.2(pid=19975): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19975)] 18:59:00.248127 run osmo-hlr_10.42.42.2(pid=19975): stdout: | (launched: 2022-12-13_18:58:57.136892) 18:59:00.301167 run osmo-hlr_10.42.42.2(pid=19975): stderr: | 20221213185857333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185857333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185857333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185857333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185857333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185857333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185857345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185857354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185857355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185857355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:00.375106 run osmo-msc_10.42.42.6(pid=19981): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19981)] 18:59:00.426636 run osmo-msc_10.42.42.6(pid=19981): stdout: | (launched: 2022-12-13_18:58:59.208485) 18:59:00.479388 run osmo-msc_10.42.42.6(pid=19981): stderr: | 20221213185859528 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185859528 DLGLOBAL DEBUG validating counter group 0x7fc49105cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185859529 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185859529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185859529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185859529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185859531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185859531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185859531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185859531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:00.531984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Terminating (SIGTERM) 18:59:00.573967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Terminating (SIGTERM) 18:59:00.616301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19980): Terminating (SIGTERM) 18:59:00.659181 --- ParallelTerminationStrategy: PID 19974 died... 18:59:00.679785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19974): Terminated: ok {rc=0} 18:59:00.727049 --- ParallelTerminationStrategy: PID 19977 died... 18:59:00.746940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19977): Terminated: ok {rc=0} 18:59:00.793444 --- ParallelTerminationStrategy: PID 19980 died... 18:59:00.813435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19980): Terminated: ok {rc=0} 18:59:00.904785 bus /sierra_3: Setting Powered False 18:59:02.014665 bus /sierra_3: Setting Powered False 18:59:03.133433 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:59:04.390832 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:04.398930 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:59:04.432288 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:59:04.459011 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:59:04.510048 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:59:04.543245 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:59:04.569967 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:59:05.126948 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:59:05.175700 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.187024 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:59:05.257312 tst mo_mt_call.py: using LAC 35606 18:59:05.377521 tst mo_mt_call.py: using RAC 161 18:59:05.499259 tst mo_mt_call.py: using CellId 35606 18:59:05.621185 tst mo_mt_call.py: using BVCI 35607 18:59:05.731277 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.742597 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.753686 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.764633 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.775699 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:05.786741 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:59:05.900226 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:59:06.018256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:06.491638 run create_hlr_db(pid=19986): Launched 18:59:06.614924 bus /sierra_2: Setting Powered False 18:59:07.675586 run create_hlr_db(pid=19986): Terminated: ok {rc=0} 18:59:08.099953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19988): Launched 18:59:08.405958 run osmo-hlr_10.42.42.2(pid=19989): Launched 18:59:08.520922 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:09.045264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19991): Launched 18:59:09.349659 run osmo-stp_10.42.42.5(pid=19992): Launched 18:59:09.464920 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:10.014511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19994): Launched 18:59:10.319610 run osmo-msc_10.42.42.6(pid=19995): Launched 18:59:10.490727 run osmo-stp_10.42.42.5(pid=19992): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19992)] 18:59:10.619450 run osmo-stp_10.42.42.5(pid=19992): stdout: | (launched: 2022-12-13_18:59:09.293517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:10.747330 run osmo-stp_10.42.42.5(pid=19992): stderr: | 20221213185909462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185909462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185909462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185909462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185909463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185909463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185909463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:10.874029 run osmo-stp_10.42.42.5(pid=19992): stdout: | (launched: 2022-12-13_18:59:09.293517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:10.995440 run osmo-stp_10.42.42.5(pid=19992): stderr: | 20221213185909462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185909462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185909462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185909462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185909463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185909463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185909463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:11.140574 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=19992): Process ended prematurely: osmo-stp_10.42.42.5(pid=19992) [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19992)] [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:59:11.149372 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:59:11.175515 run osmo-hlr_10.42.42.2(pid=19989): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19989)] 18:59:11.223311 run osmo-hlr_10.42.42.2(pid=19989): stdout: | (launched: 2022-12-13_18:59:08.349218) 18:59:11.272593 run osmo-hlr_10.42.42.2(pid=19989): stderr: | 20221213185908522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185908522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185908522 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185908522 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185908522 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185908523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185908535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185908544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185908545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185908545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:11.341339 run osmo-msc_10.42.42.6(pid=19995): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19995)] 18:59:11.388774 run osmo-msc_10.42.42.6(pid=19995): stdout: | (launched: 2022-12-13_18:59:10.263540) 18:59:11.437861 run osmo-msc_10.42.42.6(pid=19995): stderr: | 20221213185910536 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185910536 DLGLOBAL DEBUG validating counter group 0x7f6f76035c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185910536 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185910536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185910536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185910537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185910538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185910539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185910539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185910539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:11.487282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19988): Terminating (SIGTERM) 18:59:11.526937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19991): Terminating (SIGTERM) 18:59:11.566370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19994): Terminating (SIGTERM) 18:59:11.606151 --- ParallelTerminationStrategy: PID 19988 died... 18:59:11.625353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19988): Terminated: ok {rc=0} 18:59:11.669182 --- ParallelTerminationStrategy: PID 19991 died... 18:59:11.687779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19991): Terminated: ok {rc=0} 18:59:11.731508 --- ParallelTerminationStrategy: PID 19994 died... 18:59:11.750112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19994): Terminated: ok {rc=0} 18:59:11.835733 bus /sierra_3: Setting Powered False 18:59:12.935316 bus /sierra_3: Setting Powered False 18:59:14.050197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:59:15.196143 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.208092 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:59:15.278613 tst mo_mt_call_osmux.py: using LAC 35607 18:59:15.398231 tst mo_mt_call_osmux.py: using RAC 162 18:59:15.517513 tst mo_mt_call_osmux.py: using CellId 35607 18:59:15.637121 tst mo_mt_call_osmux.py: using BVCI 35608 18:59:15.748777 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.760116 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.771091 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.782142 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.793245 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:59:15.804264 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:59:15.956592 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:59:16.089435 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:16.572010 run create_hlr_db(pid=19998): Launched 18:59:16.732089 bus /sierra_2: Setting Powered False 18:59:17.793620 run create_hlr_db(pid=19998): Terminated: ok {rc=0} 18:59:18.220206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Launched 18:59:18.527587 run osmo-hlr_10.42.42.2(pid=20001): Launched 18:59:18.642848 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:19.186717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Launched 18:59:19.491687 run osmo-stp_10.42.42.5(pid=20004): Launched 18:59:19.607770 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:20.159938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Launched 18:59:20.493301 run osmo-msc_10.42.42.6(pid=20007): Launched 18:59:20.678624 run osmo-stp_10.42.42.5(pid=20004): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] 18:59:20.817751 run osmo-stp_10.42.42.5(pid=20004): stdout: | (launched: 2022-12-13_18:59:19.435352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:20.957253 run osmo-stp_10.42.42.5(pid=20004): stderr: | 20221213185919605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185919605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185919605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185919606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185919606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185919606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185919606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:21.095117 run osmo-stp_10.42.42.5(pid=20004): stdout: | (launched: 2022-12-13_18:59:19.435352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:21.226615 run osmo-stp_10.42.42.5(pid=20004): stderr: | 20221213185919605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185919605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185919605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185919606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185919606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185919606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185919606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:21.383931 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20004): Process ended prematurely: osmo-stp_10.42.42.5(pid=20004) [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:59:21.393807 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:59:21.421864 run osmo-hlr_10.42.42.2(pid=20001): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20001)] 18:59:21.473349 run osmo-hlr_10.42.42.2(pid=20001): stdout: | (launched: 2022-12-13_18:59:18.471383) 18:59:21.526321 run osmo-hlr_10.42.42.2(pid=20001): stderr: | 20221213185918647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185918647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185918647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185918647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185918647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185918647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185918660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185918671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185918671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185918671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:21.600204 run osmo-msc_10.42.42.6(pid=20007): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20007)] 18:59:21.650737 run osmo-msc_10.42.42.6(pid=20007): stdout: | (launched: 2022-12-13_18:59:20.433349) 18:59:21.703613 run osmo-msc_10.42.42.6(pid=20007): stderr: | 20221213185920754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185920755 DLGLOBAL DEBUG validating counter group 0x7f306e0eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185920755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185920755 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185920755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185920755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185920757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185920757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185920757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185920758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:21.756664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Terminating (SIGTERM) 18:59:21.798848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Terminating (SIGTERM) 18:59:21.841526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Terminating (SIGTERM) 18:59:21.884368 --- ParallelTerminationStrategy: PID 20000 died... 18:59:21.905223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20000): Terminated: ok {rc=0} 18:59:21.952109 --- ParallelTerminationStrategy: PID 20003 died... 18:59:21.972166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20003): Terminated: ok {rc=0} 18:59:22.019152 --- ParallelTerminationStrategy: PID 20006 died... 18:59:22.039174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20006): Terminated: ok {rc=0} 18:59:22.128266 bus /sierra_3: Setting Powered False 18:59:23.227862 bus /sierra_3: Setting Powered False 18:59:24.347738 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:59:25.600000 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:25.606118 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:59:25.639705 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:59:25.666855 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:59:25.718124 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:59:25.751130 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:59:25.777759 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:59:26.328212 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:59:26.377512 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:26.388483 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:59:26.458618 tst mo_mt_call.py: using LAC 35608 18:59:26.583946 tst mo_mt_call.py: using RAC 163 18:59:26.704257 tst mo_mt_call.py: using CellId 35608 18:59:26.823357 tst mo_mt_call.py: using BVCI 35609 18:59:26.943238 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:26.954743 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:26.966091 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:26.977558 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:26.989753 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:27.001614 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:59:27.119545 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:59:27.241027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:27.752869 run create_hlr_db(pid=20013): Launched 18:59:27.877609 bus /sierra_2: Setting Powered False 18:59:28.942161 run create_hlr_db(pid=20013): Terminated: ok {rc=0} 18:59:29.380471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20015): Launched 18:59:29.687601 run osmo-hlr_10.42.42.2(pid=20016): Launched 18:59:29.804377 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:30.344901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20018): Launched 18:59:30.652770 run osmo-stp_10.42.42.5(pid=20019): Launched 18:59:30.769031 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:31.349752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20021): Launched 18:59:31.695078 run osmo-msc_10.42.42.6(pid=20022): Launched 18:59:32.096390 run osmo-stp_10.42.42.5(pid=20019): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20019)] 18:59:32.284526 run osmo-stp_10.42.42.5(pid=20019): stdout: | (launched: 2022-12-13_18:59:30.596403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:32.413889 run osmo-stp_10.42.42.5(pid=20019): stderr: | 20221213185930767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185930768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185930768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185930768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185930769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185930769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185930769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:32.541767 run osmo-stp_10.42.42.5(pid=20019): stdout: | (launched: 2022-12-13_18:59:30.596403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:32.665250 run osmo-stp_10.42.42.5(pid=20019): stderr: | 20221213185930767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185930768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185930768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185930768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185930769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185930769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185930769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:32.811452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20019): Process ended prematurely: osmo-stp_10.42.42.5(pid=20019) [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20019)] [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:59:32.820451 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:59:32.847040 run osmo-hlr_10.42.42.2(pid=20016): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20016)] 18:59:32.895088 run osmo-hlr_10.42.42.2(pid=20016): stdout: | (launched: 2022-12-13_18:59:29.631255) 18:59:32.944791 run osmo-hlr_10.42.42.2(pid=20016): stderr: | 20221213185929805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185929805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185929805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185929805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185929805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185929805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185929817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185929826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185929826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185929826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:33.014425 run osmo-msc_10.42.42.6(pid=20022): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20022)] 18:59:33.062962 run osmo-msc_10.42.42.6(pid=20022): stdout: | (launched: 2022-12-13_18:59:31.628101) 18:59:33.112590 run osmo-msc_10.42.42.6(pid=20022): stderr: | 20221213185931955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185931955 DLGLOBAL DEBUG validating counter group 0x7f47f85e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185931955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185931956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185931956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185931956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185931970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185931970 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185931971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185931971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:33.162564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20015): Terminating (SIGTERM) 18:59:33.202752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20018): Terminating (SIGTERM) 18:59:33.243077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20021): Terminating (SIGTERM) 18:59:33.283311 --- ParallelTerminationStrategy: PID 20015 died... 18:59:33.302593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20015): Terminated: ok {rc=0} 18:59:33.347085 --- ParallelTerminationStrategy: PID 20018 died... 18:59:33.365839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20018): Terminated: ok {rc=0} 18:59:33.409866 --- ParallelTerminationStrategy: PID 20021 died... 18:59:33.428667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20021): Terminated: ok {rc=0} 18:59:33.513954 bus /sierra_3: Setting Powered False 18:59:34.610467 bus /sierra_3: Setting Powered False 18:59:35.722831 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:59:36.873705 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:36.885909 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:59:36.960220 tst mo_mt_call_osmux.py: using LAC 35609 18:59:37.090330 tst mo_mt_call_osmux.py: using RAC 164 18:59:37.218114 tst mo_mt_call_osmux.py: using CellId 35609 18:59:37.349679 tst mo_mt_call_osmux.py: using BVCI 35610 18:59:37.470962 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:37.482638 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:37.494069 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:37.505454 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:37.517129 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:59:37.528826 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:59:37.644917 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:59:37.767293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:38.277156 run create_hlr_db(pid=20024): Launched 18:59:38.404028 bus /sierra_2: Setting Powered False 18:59:39.468720 run create_hlr_db(pid=20024): Terminated: ok {rc=0} 18:59:39.926102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Launched 18:59:40.256877 run osmo-hlr_10.42.42.2(pid=20027): Launched 18:59:40.383941 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:40.949178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Launched 18:59:41.278331 run osmo-stp_10.42.42.5(pid=20030): Launched 18:59:41.405779 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:42.000388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Launched 18:59:42.329921 run osmo-msc_10.42.42.6(pid=20033): Launched 18:59:42.514315 run osmo-stp_10.42.42.5(pid=20030): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] 18:59:42.653095 run osmo-stp_10.42.42.5(pid=20030): stdout: | (launched: 2022-12-13_18:59:41.218181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:42.793344 run osmo-stp_10.42.42.5(pid=20030): stderr: | 20221213185941409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185941409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185941409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185941409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185941410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185941410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185941410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:42.930517 run osmo-stp_10.42.42.5(pid=20030): stdout: | (launched: 2022-12-13_18:59:41.218181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:43.062624 run osmo-stp_10.42.42.5(pid=20030): stderr: | 20221213185941409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185941409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185941409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185941409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185941410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185941410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185941410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:43.220093 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20030): Process ended prematurely: osmo-stp_10.42.42.5(pid=20030) [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:59:43.229747 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:59:43.257583 run osmo-hlr_10.42.42.2(pid=20027): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20027)] 18:59:43.309166 run osmo-hlr_10.42.42.2(pid=20027): stdout: | (launched: 2022-12-13_18:59:40.196605) 18:59:43.362000 run osmo-hlr_10.42.42.2(pid=20027): stderr: | 20221213185940393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185940393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185940393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185940393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185940393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185940393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185940406 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185940414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185940415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185940415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:43.435054 run osmo-msc_10.42.42.6(pid=20033): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20033)] 18:59:43.485877 run osmo-msc_10.42.42.6(pid=20033): stdout: | (launched: 2022-12-13_18:59:42.269418) 18:59:43.538548 run osmo-msc_10.42.42.6(pid=20033): stderr: | 20221213185942592 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185942592 DLGLOBAL DEBUG validating counter group 0x7f49e287ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185942592 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185942592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185942592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185942593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185942594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185942595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185942595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185942595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:43.591419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Terminating (SIGTERM) 18:59:43.633444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Terminating (SIGTERM) 18:59:43.676168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Terminating (SIGTERM) 18:59:43.718918 --- ParallelTerminationStrategy: PID 20026 died... 18:59:43.739517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20026): Terminated: ok {rc=0} 18:59:43.786231 --- ParallelTerminationStrategy: PID 20029 died... 18:59:43.806190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20029): Terminated: ok {rc=0} 18:59:43.852653 --- ParallelTerminationStrategy: PID 20032 died... 18:59:43.872639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20032): Terminated: ok {rc=0} 18:59:43.961727 bus /sierra_3: Setting Powered False 18:59:45.061023 bus /sierra_3: Setting Powered False 18:59:46.179295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 18:59:47.441982 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:47.447813 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 18:59:47.481102 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 18:59:47.508185 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 18:59:47.559495 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 18:59:47.592403 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 18:59:47.618782 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 18:59:48.169611 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 18:59:48.218484 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.229588 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:59:48.280481 tst mo_mt_call.py: using LAC 35610 18:59:48.401064 tst mo_mt_call.py: using RAC 165 18:59:48.529605 tst mo_mt_call.py: using CellId 35610 18:59:48.650571 tst mo_mt_call.py: using BVCI 35611 18:59:48.763450 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.774643 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.785535 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.796311 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.807089 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:48.818036 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:59:48.937500 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:59:49.054284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:49.527913 run create_hlr_db(pid=20038): Launched 18:59:49.651997 bus /sierra_2: Setting Powered False 18:59:50.713776 run create_hlr_db(pid=20038): Terminated: ok {rc=0} 18:59:51.161911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Launched 18:59:51.491852 run osmo-hlr_10.42.42.2(pid=20041): Launched 18:59:51.617560 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:52.182809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Launched 18:59:52.512275 run osmo-stp_10.42.42.5(pid=20044): Launched 18:59:52.637991 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:53.231578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Launched 18:59:53.560741 run osmo-msc_10.42.42.6(pid=20047): Launched 18:59:53.745139 run osmo-stp_10.42.42.5(pid=20044): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] 18:59:53.883923 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-13_18:59:52.451857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:54.023449 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221213185952643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185952643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185952643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185952643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185952644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185952644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185952644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:54.160888 run osmo-stp_10.42.42.5(pid=20044): stdout: | (launched: 2022-12-13_18:59:52.451857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:54.292259 run osmo-stp_10.42.42.5(pid=20044): stderr: | 20221213185952643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213185952643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213185952643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213185952643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213185952644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213185952644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213185952644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:54.449275 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 18:59:54.458879 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:59:54.486650 run osmo-hlr_10.42.42.2(pid=20041): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20041)] 18:59:54.538231 run osmo-hlr_10.42.42.2(pid=20041): stdout: | (launched: 2022-12-13_18:59:51.432136) 18:59:54.591790 run osmo-hlr_10.42.42.2(pid=20041): stderr: | 20221213185951630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213185951630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213185951630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213185951630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213185951630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213185951630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213185951643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213185951654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213185951654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213185951654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:54.664774 run osmo-msc_10.42.42.6(pid=20047): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20047)] 18:59:54.715315 run osmo-msc_10.42.42.6(pid=20047): stdout: | (launched: 2022-12-13_18:59:53.500204) 18:59:54.767816 run osmo-msc_10.42.42.6(pid=20047): stderr: | 20221213185953823 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213185953823 DLGLOBAL DEBUG validating counter group 0x7fda040a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213185953823 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213185953823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213185953823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213185953823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213185953825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213185953825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213185953826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213185953826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:54.820643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminating (SIGTERM) 18:59:54.862571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminating (SIGTERM) 18:59:54.905333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Terminating (SIGTERM) 18:59:54.947785 --- ParallelTerminationStrategy: PID 20040 died... 18:59:54.968136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20040): Terminated: ok {rc=0} 18:59:55.014871 --- ParallelTerminationStrategy: PID 20043 died... 18:59:55.034825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20043): Terminated: ok {rc=0} 18:59:55.081835 --- ParallelTerminationStrategy: PID 20046 died... 18:59:55.101796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20046): Terminated: ok {rc=0} 18:59:55.190354 bus /sierra_3: Setting Powered False 18:59:56.288323 bus /sierra_3: Setting Powered False 18:59:57.405335 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 18:59:58.552841 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:58.564662 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:59:58.616404 tst mo_mt_call_osmux.py: using LAC 35611 18:59:58.738579 tst mo_mt_call_osmux.py: using RAC 166 18:59:58.858680 tst mo_mt_call_osmux.py: using CellId 35611 18:59:58.980647 tst mo_mt_call_osmux.py: using BVCI 35612 18:59:59.092911 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:59.104094 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:59.115059 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:59.125971 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:59.136940 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:59:59.148075 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:59:59.263234 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:59:59.383829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:59.895607 run create_hlr_db(pid=20049): Launched 19:00:00.021439 bus /sierra_2: Setting Powered False 19:00:01.092463 run create_hlr_db(pid=20049): Terminated: ok {rc=0} 19:00:01.581591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Launched 19:00:01.909706 run osmo-hlr_10.42.42.2(pid=20055): Launched 19:00:02.151825 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:02.773771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Launched 19:00:03.102049 run osmo-stp_10.42.42.5(pid=20058): Launched 19:00:03.227619 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:03.821566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20060): Launched 19:00:04.149684 run osmo-msc_10.42.42.6(pid=20061): Launched 19:00:04.334720 run osmo-stp_10.42.42.5(pid=20058): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] 19:00:04.473173 run osmo-stp_10.42.42.5(pid=20058): stdout: | (launched: 2022-12-13_19:00:03.041758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:04.611606 run osmo-stp_10.42.42.5(pid=20058): stderr: | 20221213190003232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190003232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190003232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190003233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190003233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190003233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190003233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:04.749086 run osmo-stp_10.42.42.5(pid=20058): stdout: | (launched: 2022-12-13_19:00:03.041758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:04.880225 run osmo-stp_10.42.42.5(pid=20058): stderr: | 20221213190003232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190003232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190003232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190003233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190003233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190003233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190003233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:05.037211 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20058): Process ended prematurely: osmo-stp_10.42.42.5(pid=20058) [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 19:00:05.046860 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:00:05.074551 run osmo-hlr_10.42.42.2(pid=20055): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20055)] 19:00:05.126277 run osmo-hlr_10.42.42.2(pid=20055): stdout: | (launched: 2022-12-13_19:00:01.852222) 19:00:05.178662 run osmo-hlr_10.42.42.2(pid=20055): stderr: | 20221213190002179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190002179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190002179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190002179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190002179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190002179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190002199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190002211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190002211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190002211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:05.251377 run osmo-msc_10.42.42.6(pid=20061): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20061)] 19:00:05.301651 run osmo-msc_10.42.42.6(pid=20061): stdout: | (launched: 2022-12-13_19:00:04.089736) 19:00:05.354171 run osmo-msc_10.42.42.6(pid=20061): stderr: | 20221213190004412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190004412 DLGLOBAL DEBUG validating counter group 0x7f0f902f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190004412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190004412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190004412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190004413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190004414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190004415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190004415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190004415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:05.406422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Terminating (SIGTERM) 19:00:05.448383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Terminating (SIGTERM) 19:00:05.491001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20060): Terminating (SIGTERM) 19:00:05.533262 --- ParallelTerminationStrategy: PID 20054 died... 19:00:05.553571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20054): Terminated: ok {rc=0} 19:00:05.600307 --- ParallelTerminationStrategy: PID 20057 died... 19:00:05.620357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20057): Terminated: ok {rc=0} 19:00:05.666652 --- ParallelTerminationStrategy: PID 20060 died... 19:00:05.686732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20060): Terminated: ok {rc=0} 19:00:05.775655 bus /sierra_3: Setting Powered False 19:00:06.875297 bus /sierra_3: Setting Powered False 19:00:07.992601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:00:09.240914 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:09.246987 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:00:09.280282 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:00:09.307257 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:00:09.358933 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:00:09.394973 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:00:09.423168 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:00:09.972681 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:00:10.021451 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.032743 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:00:10.084668 tst mo_mt_call.py: using LAC 35612 19:00:10.204110 tst mo_mt_call.py: using RAC 167 19:00:10.322056 tst mo_mt_call.py: using CellId 35612 19:00:10.439551 tst mo_mt_call.py: using BVCI 35613 19:00:10.550131 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.561576 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.572778 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.584046 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.595274 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:10.606483 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:00:10.726197 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:00:10.844524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:11.318504 run create_hlr_db(pid=20067): Launched 19:00:11.446054 bus /sierra_2: Setting Powered False 19:00:12.506956 run create_hlr_db(pid=20067): Terminated: ok {rc=0} 19:00:12.934236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Launched 19:00:13.239528 run osmo-hlr_10.42.42.2(pid=20070): Launched 19:00:13.354868 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:13.880547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Launched 19:00:14.188223 run osmo-stp_10.42.42.5(pid=20073): Launched 19:00:14.305314 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:14.857502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Launched 19:00:15.164789 run osmo-msc_10.42.42.6(pid=20076): Launched 19:00:15.334923 run osmo-stp_10.42.42.5(pid=20073): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] 19:00:15.465192 run osmo-stp_10.42.42.5(pid=20073): stdout: | (launched: 2022-12-13_19:00:14.131650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:15.593995 run osmo-stp_10.42.42.5(pid=20073): stderr: | 20221213190014300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190014300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190014300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190014300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190014301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190014301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190014301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:15.720735 run osmo-stp_10.42.42.5(pid=20073): stdout: | (launched: 2022-12-13_19:00:14.131650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:15.844003 run osmo-stp_10.42.42.5(pid=20073): stderr: | 20221213190014300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190014300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190014300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190014300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190014301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190014301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190014301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:15.992853 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20073): Process ended prematurely: osmo-stp_10.42.42.5(pid=20073) [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:00:16.002375 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:00:16.029990 run osmo-hlr_10.42.42.2(pid=20070): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20070)] 19:00:16.094463 run osmo-hlr_10.42.42.2(pid=20070): stdout: | (launched: 2022-12-13_19:00:13.183389) 19:00:16.149731 run osmo-hlr_10.42.42.2(pid=20070): stderr: | 20221213190013357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190013357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190013357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190013358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190013358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190013358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190013370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190013381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190013381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190013381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:16.226582 run osmo-msc_10.42.42.6(pid=20076): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20076)] 19:00:16.279911 run osmo-msc_10.42.42.6(pid=20076): stdout: | (launched: 2022-12-13_19:00:15.107681) 19:00:16.334638 run osmo-msc_10.42.42.6(pid=20076): stderr: | 20221213190015379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190015379 DLGLOBAL DEBUG validating counter group 0x7fdbd013dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190015379 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190015379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190015379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190015380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190015381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190015382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190015382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190015382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:16.391858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Terminating (SIGTERM) 19:00:16.436028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Terminating (SIGTERM) 19:00:16.482654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Terminating (SIGTERM) 19:00:16.530460 --- ParallelTerminationStrategy: PID 20069 died... 19:00:16.552752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20069): Terminated: ok {rc=0} 19:00:16.604748 --- ParallelTerminationStrategy: PID 20072 died... 19:00:16.627167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20072): Terminated: ok {rc=0} 19:00:16.678762 --- ParallelTerminationStrategy: PID 20075 died... 19:00:16.700057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20075): Terminated: ok {rc=0} 19:00:16.791965 bus /sierra_3: Setting Powered False 19:00:17.888354 bus /sierra_3: Setting Powered False 19:00:19.001901 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:00:20.151808 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.164856 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:00:20.225578 tst mo_mt_call_osmux.py: using LAC 35613 19:00:20.354902 tst mo_mt_call_osmux.py: using RAC 168 19:00:20.481356 tst mo_mt_call_osmux.py: using CellId 35613 19:00:20.608409 tst mo_mt_call_osmux.py: using BVCI 35614 19:00:20.727676 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.739673 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.751549 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.763234 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.775795 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:00:20.788003 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:00:20.906510 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:00:21.030884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:21.541282 run create_hlr_db(pid=20078): Launched 19:00:21.666747 bus /sierra_2: Setting Powered False 19:00:22.732070 run create_hlr_db(pid=20078): Terminated: ok {rc=0} 19:00:23.188474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Launched 19:00:23.517422 run osmo-hlr_10.42.42.2(pid=20081): Launched 19:00:23.643447 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:24.210289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Launched 19:00:24.540066 run osmo-stp_10.42.42.5(pid=20084): Launched 19:00:24.664794 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:25.257688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20086): Launched 19:00:25.585178 run osmo-msc_10.42.42.6(pid=20087): Launched 19:00:25.769938 run osmo-stp_10.42.42.5(pid=20084): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] 19:00:25.907874 run osmo-stp_10.42.42.5(pid=20084): stdout: | (launched: 2022-12-13_19:00:24.480144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:26.046631 run osmo-stp_10.42.42.5(pid=20084): stderr: | 20221213190024671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190024671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190024672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190024672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190024672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190024673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190024673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:26.183712 run osmo-stp_10.42.42.5(pid=20084): stdout: | (launched: 2022-12-13_19:00:24.480144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:26.315392 run osmo-stp_10.42.42.5(pid=20084): stderr: | 20221213190024671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190024671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190024672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190024672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190024672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190024673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190024673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:26.472526 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20084): Process ended prematurely: osmo-stp_10.42.42.5(pid=20084) [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:00:26.482380 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:00:26.510459 run osmo-hlr_10.42.42.2(pid=20081): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20081)] 19:00:26.561805 run osmo-hlr_10.42.42.2(pid=20081): stdout: | (launched: 2022-12-13_19:00:23.457720) 19:00:26.614364 run osmo-hlr_10.42.42.2(pid=20081): stderr: | 20221213190023655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190023655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190023655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190023655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190023655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190023655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190023667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190023676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190023677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190023677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:26.687768 run osmo-msc_10.42.42.6(pid=20087): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20087)] 19:00:26.738188 run osmo-msc_10.42.42.6(pid=20087): stdout: | (launched: 2022-12-13_19:00:25.525742) 19:00:26.790893 run osmo-msc_10.42.42.6(pid=20087): stderr: | 20221213190025846 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190025846 DLGLOBAL DEBUG validating counter group 0x7f54e2901c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190025846 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190025846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190025846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190025846 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190025848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190025848 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190025849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190025849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:26.843818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Terminating (SIGTERM) 19:00:26.885651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Terminating (SIGTERM) 19:00:26.927900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20086): Terminating (SIGTERM) 19:00:26.970242 --- ParallelTerminationStrategy: PID 20080 died... 19:00:26.991013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20080): Terminated: ok {rc=0} 19:00:27.037880 --- ParallelTerminationStrategy: PID 20083 died... 19:00:27.057773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20083): Terminated: ok {rc=0} 19:00:27.104325 --- ParallelTerminationStrategy: PID 20086 died... 19:00:27.124427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20086): Terminated: ok {rc=0} 19:00:27.212499 bus /sierra_3: Setting Powered False 19:00:28.310518 bus /sierra_3: Setting Powered False 19:00:29.423142 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:trx-b200 --------------------------------------------------------------------- 19:00:30.674370 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:30.678632 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 19:00:30.711563 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 19:00:30.738236 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 19:00:30.822338 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 19:00:30.876436 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 19:00:30.909472 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 19:00:31.507320 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 19:00:31.515437 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:31.528485 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 19:00:31.600160 tst emergency_mo_mt_call.py: using LAC 35614 19:00:31.754266 tst emergency_mo_mt_call.py: using RAC 169 19:00:31.886943 tst emergency_mo_mt_call.py: using CellId 35614 19:00:32.004339 tst emergency_mo_mt_call.py: using BVCI 35615 19:00:32.153726 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:32.168698 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:32.182613 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:32.195994 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:32.210565 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:32.224190 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:32.346201 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:32.463642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:32.928003 run create_hlr_db(pid=20093): Launched 19:00:33.051891 bus /sierra_2: Setting Powered False 19:00:34.112279 run create_hlr_db(pid=20093): Terminated: ok {rc=0} 19:00:34.531542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20095): Launched 19:00:34.831539 run osmo-hlr_10.42.42.2(pid=20096): Launched 19:00:34.945684 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:35.480054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20098): Launched 19:00:35.781382 run osmo-stp_10.42.42.5(pid=20099): Launched 19:00:35.906106 tst emergency_mo_mt_call.py: using MSISDN 8284 19:00:36.059651 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:36.603156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20101): Launched 19:00:36.903689 run osmo-msc_10.42.42.6(pid=20102): Launched 19:00:37.071900 run osmo-stp_10.42.42.5(pid=20099): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20099)] 19:00:37.198812 run osmo-stp_10.42.42.5(pid=20099): stdout: | (launched: 2022-12-13_19:00:35.725872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:37.324893 run osmo-stp_10.42.42.5(pid=20099): stderr: | 20221213190035893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190035893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190035894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190035894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190035895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190035895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190035895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:37.449374 run osmo-stp_10.42.42.5(pid=20099): stdout: | (launched: 2022-12-13_19:00:35.725872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:37.568638 run osmo-stp_10.42.42.5(pid=20099): stderr: | 20221213190035893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190035893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190035894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190035894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190035895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190035895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190035895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:37.711220 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20099): Process ended prematurely: osmo-stp_10.42.42.5(pid=20099) [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20099)] [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 19:00:37.719715 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 19:00:37.745595 run osmo-hlr_10.42.42.2(pid=20096): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20096)] 19:00:37.793454 run osmo-hlr_10.42.42.2(pid=20096): stdout: | (launched: 2022-12-13_19:00:34.776372) 19:00:37.842902 run osmo-hlr_10.42.42.2(pid=20096): stderr: | 20221213190034949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190034949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190034949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190034949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190034949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190034949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190034961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190034973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190034973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190034973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:37.911933 run osmo-msc_10.42.42.6(pid=20102): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20102)] 19:00:37.959523 run osmo-msc_10.42.42.6(pid=20102): stdout: | (launched: 2022-12-13_19:00:36.848515) 19:00:38.008581 run osmo-msc_10.42.42.6(pid=20102): stderr: | 20221213190037116 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190037116 DLGLOBAL DEBUG validating counter group 0x7f3c52bc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190037117 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190037117 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190037117 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190037117 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190037119 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190037119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190037119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190037119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:38.058059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20095): Terminating (SIGTERM) 19:00:38.097714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20098): Terminating (SIGTERM) 19:00:38.137339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20101): Terminating (SIGTERM) 19:00:38.177647 --- ParallelTerminationStrategy: PID 20095 died... 19:00:38.197002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20095): Terminated: ok {rc=0} 19:00:38.240894 --- ParallelTerminationStrategy: PID 20098 died... 19:00:38.259684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20098): Terminated: ok {rc=0} 19:00:38.303588 --- ParallelTerminationStrategy: PID 20101 died... 19:00:38.322381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20101): Terminated: ok {rc=0} 19:00:38.408135 bus /sierra_3: Setting Powered False 19:00:39.508640 bus /sierra_3: Setting Powered False 19:00:40.625604 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 19:00:41.714074 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:41.725998 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 19:00:41.779069 tst emergency_preemptive_call.py: using LAC 35615 19:00:41.905362 tst emergency_preemptive_call.py: using RAC 170 19:00:42.033091 tst emergency_preemptive_call.py: using CellId 35615 19:00:42.151527 tst emergency_preemptive_call.py: using BVCI 35616 19:00:42.261655 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:42.272628 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:42.283355 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:42.294079 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:42.304651 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 19:00:42.315221 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:42.434260 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:42.551398 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:42.665379 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 19:00:42.779374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:43.247004 run create_hlr_db(pid=20104): Launched 19:00:43.370857 bus /sierra_2: Setting Powered False 19:00:44.431338 run create_hlr_db(pid=20104): Terminated: ok {rc=0} 19:00:44.851868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20106): Launched 19:00:45.153451 run osmo-hlr_10.42.42.2(pid=20107): Launched 19:00:45.269456 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:45.785397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20109): Launched 19:00:46.122535 run osmo-stp_10.42.42.5(pid=20110): Launched 19:00:46.397193 tst emergency_preemptive_call.py: using MSISDN 8285 19:00:46.551295 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:47.102426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20112): Launched 19:00:47.408834 run osmo-msc_10.42.42.6(pid=20113): Launched 19:00:47.576641 run osmo-stp_10.42.42.5(pid=20110): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20110)] 19:00:47.703425 run osmo-stp_10.42.42.5(pid=20110): stdout: | (launched: 2022-12-13_19:00:46.066586) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:47.829992 run osmo-stp_10.42.42.5(pid=20110): stderr: | 20221213190046309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190046309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190046310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190046310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190046310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190046311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190046311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:47.955088 run osmo-stp_10.42.42.5(pid=20110): stdout: | (launched: 2022-12-13_19:00:46.066586) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:48.074901 run osmo-stp_10.42.42.5(pid=20110): stderr: | 20221213190046309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190046309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190046310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190046310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190046310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190046311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190046311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:48.218710 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20110): Process ended prematurely: osmo-stp_10.42.42.5(pid=20110) [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20110)] [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py:32] 19:00:48.227220 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:00:48.253218 run osmo-hlr_10.42.42.2(pid=20107): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20107)] 19:00:48.301522 run osmo-hlr_10.42.42.2(pid=20107): stdout: | (launched: 2022-12-13_19:00:45.097178) 19:00:48.351467 run osmo-hlr_10.42.42.2(pid=20107): stderr: | 20221213190045271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190045271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190045271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190045271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190045271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190045272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190045284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190045295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190045295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190045295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:48.421186 run osmo-msc_10.42.42.6(pid=20113): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20113)] 19:00:48.469340 run osmo-msc_10.42.42.6(pid=20113): stdout: | (launched: 2022-12-13_19:00:47.353520) 19:00:48.518947 run osmo-msc_10.42.42.6(pid=20113): stderr: | 20221213190047624 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190047624 DLGLOBAL DEBUG validating counter group 0x7fe6de50fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190047624 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190047624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190047625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190047625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190047627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190047627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190047627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190047628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:48.569548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20106): Terminating (SIGTERM) 19:00:48.609541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20109): Terminating (SIGTERM) 19:00:48.649510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20112): Terminating (SIGTERM) 19:00:48.689944 --- ParallelTerminationStrategy: PID 20106 died... 19:00:48.709442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20106): Terminated: ok {rc=0} 19:00:48.754046 --- ParallelTerminationStrategy: PID 20109 died... 19:00:48.772750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20109): Terminated: ok {rc=0} 19:00:48.817270 --- ParallelTerminationStrategy: PID 20112 died... 19:00:48.836148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20112): Terminated: ok {rc=0} 19:00:48.922800 bus /sierra_9: Setting Powered False 19:00:50.023464 bus /sierra_9: Setting Powered False 19:00:51.139685 bus /sierra_8: Setting Powered False 19:00:52.240941 bus /sierra_8: Setting Powered False 19:00:53.360939 bus /sierra_3: Setting Powered False 19:00:54.456821 bus /sierra_3: Setting Powered False 19:00:55.570348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-b200 --------------------------------------------------------------------- 19:00:56.858116 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:56.862793 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 19:00:56.896736 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 19:00:56.936840 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 19:00:57.024473 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 19:00:57.058766 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 19:00:57.098364 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 19:00:57.692124 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 19:00:57.745749 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:57.756866 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:00:57.805784 tst cs_paging_gprs_active.py: using LAC 35616 19:00:57.933300 tst cs_paging_gprs_active.py: using RAC 171 19:00:58.059282 tst cs_paging_gprs_active.py: using CellId 35616 19:00:58.186685 tst cs_paging_gprs_active.py: using BVCI 35617 19:00:58.304228 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.315478 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.326471 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.337395 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.348453 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.359590 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.370902 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.382190 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:00:58.393535 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:00:58.508582 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:00:58.630132 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:00:58.836819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:00:59.142065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Launched 19:00:59.406374 run iperf3-srv_10.42.42.10(pid=20120): Launched 19:00:59.520111 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:00:59.723710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:00.027477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20121): Launched 19:01:00.292081 run iperf3-srv_10.42.42.10(pid=20122): Launched 19:01:00.405875 tst cs_paging_gprs_active.py:38: start network... 19:01:00.609279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:01.084899 run create_hlr_db(pid=20123): Launched 19:01:01.245344 bus /sierra_2: Setting Powered False 19:01:02.306545 run create_hlr_db(pid=20123): Terminated: ok {rc=0} 19:01:02.740235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20125): Launched 19:01:03.044073 run osmo-hlr_10.42.42.2(pid=20126): Launched 19:01:03.159063 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:03.692187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20128): Launched 19:01:03.994498 run osmo-stp_10.42.42.5(pid=20129): Launched 19:01:04.109458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:04.630371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20131): Launched 19:01:04.746361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:05.002525 run patchelf(pid=20132): Launched 19:01:05.171003 run osmo-stp_10.42.42.5(pid=20129): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20129)] 19:01:05.301861 run osmo-stp_10.42.42.5(pid=20129): stdout: | (launched: 2022-12-13_19:01:03.938864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:05.432354 run osmo-stp_10.42.42.5(pid=20129): stderr: | 20221213190104106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190104106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190104106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190104106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190104107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190104107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190104107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:05.562760 run osmo-stp_10.42.42.5(pid=20129): stdout: | (launched: 2022-12-13_19:01:03.938864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:05.687321 run osmo-stp_10.42.42.5(pid=20129): stderr: | 20221213190104106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190104106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190104106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190104106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190104107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190104107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190104107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:05.834961 run patchelf(pid=20132): Terminating (SIGINT) 19:01:06.004700 run patchelf(pid=20132): Terminated: ok {rc=0} 19:01:06.126755 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20129): Process ended prematurely: osmo-stp_10.42.42.5(pid=20129) [trial-2393↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20129)] [trial-2393↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 19:01:06.136078 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 19:01:06.163403 run osmo-hlr_10.42.42.2(pid=20126): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20126)] 19:01:06.210999 run osmo-hlr_10.42.42.2(pid=20126): stdout: | (launched: 2022-12-13_19:01:02.988152) 19:01:06.259884 run osmo-hlr_10.42.42.2(pid=20126): stderr: | 20221213190103162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190103162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190103162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190103162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190103162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190103162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190103175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190103183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190103184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190103184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:06.309243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Terminating (SIGTERM) 19:01:06.348898 run iperf3-srv_10.42.42.10(pid=20120): Terminating (SIGTERM) 19:01:06.388508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20121): Terminating (SIGTERM) 19:01:06.428092 run iperf3-srv_10.42.42.10(pid=20122): Terminating (SIGTERM) 19:01:06.467531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20125): Terminating (SIGTERM) 19:01:06.507273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20128): Terminating (SIGTERM) 19:01:06.546829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20131): Terminating (SIGTERM) 19:01:06.587045 --- ParallelTerminationStrategy: PID 20119 died... 19:01:06.606254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20119): Terminated: ok {rc=0} 19:01:06.650276 --- ParallelTerminationStrategy: PID 20120 died... 19:01:06.668730 run iperf3-srv_10.42.42.10(pid=20120): Terminated {rc=256} 19:01:06.712129 --- ParallelTerminationStrategy: PID 20121 died... 19:01:06.730485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20121): Terminated: ok {rc=0} 19:01:06.773910 --- ParallelTerminationStrategy: PID 20122 died... 19:01:06.792330 run iperf3-srv_10.42.42.10(pid=20122): Terminated {rc=256} 19:01:06.835895 --- ParallelTerminationStrategy: PID 20125 died... 19:01:06.854419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20125): Terminated: ok {rc=0} 19:01:06.897677 --- ParallelTerminationStrategy: PID 20128 died... 19:01:06.916047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20128): Terminated: ok {rc=0} 19:01:06.959555 --- ParallelTerminationStrategy: PID 20131 died... 19:01:06.978176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20131): Terminated: ok {rc=0} 19:01:07.063028 bus /gobi_0: Setting Powered False 19:01:08.162404 bus /gobi_0: Setting Powered False 19:01:09.276355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200 iperf3.py ---------------------------------------------- 19:01:10.420815 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:10.431902 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:01:10.486992 tst iperf3.py: using LAC 35617 19:01:10.604333 tst iperf3.py: using RAC 172 19:01:10.721780 tst iperf3.py: using CellId 35617 19:01:10.848657 tst iperf3.py: using BVCI 35618 19:01:10.966558 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:10.977940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:10.988892 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:10.999970 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:11.010767 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:11.022139 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:11.033520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:11.044529 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:11.055845 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:11.171969 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:01:11.375335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:11.678194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Launched 19:01:11.941793 run iperf3-srv_10.42.42.10(pid=20134): Launched 19:01:12.054857 tst iperf3.py:8: start network... 19:01:12.257496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:12.724706 run create_hlr_db(pid=20135): Launched 19:01:12.848183 bus /gobi_6: Setting Powered False 19:01:13.908020 run create_hlr_db(pid=20135): Terminated: ok {rc=0} 19:01:14.327466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20137): Launched 19:01:14.629223 run osmo-hlr_10.42.42.2(pid=20138): Launched 19:01:14.744015 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:15.263139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20140): Launched 19:01:15.566962 run osmo-stp_10.42.42.5(pid=20141): Launched 19:01:15.681070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:16.213267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20143): Launched 19:01:16.342153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:16.605445 run patchelf(pid=20144): Launched 19:01:16.790534 run osmo-stp_10.42.42.5(pid=20141): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20141)] 19:01:16.921065 run osmo-stp_10.42.42.5(pid=20141): stdout: | (launched: 2022-12-13_19:01:15.510152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:17.052275 run osmo-stp_10.42.42.5(pid=20141): stderr: | 20221213190115678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190115679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190115679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190115679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190115680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190115680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190115680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:17.184504 run osmo-stp_10.42.42.5(pid=20141): stdout: | (launched: 2022-12-13_19:01:15.510152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:17.309687 run osmo-stp_10.42.42.5(pid=20141): stderr: | 20221213190115678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190115679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190115679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190115679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190115680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190115680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190115680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:17.456825 run patchelf(pid=20144): Terminating (SIGINT) 19:01:17.626459 run patchelf(pid=20144): Terminated: ok {rc=0} 19:01:17.748603 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20141): Process ended prematurely: osmo-stp_10.42.42.5(pid=20141) [trial-2393↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20141)] [trial-2393↪gprs:trx-b200↪iperf3.py:8] 19:01:17.758119 tst iperf3.py:8: Test FAILED (7.4 sec) 19:01:17.784800 run osmo-hlr_10.42.42.2(pid=20138): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20138)] 19:01:17.832295 run osmo-hlr_10.42.42.2(pid=20138): stdout: | (launched: 2022-12-13_19:01:14.573691) 19:01:17.881285 run osmo-hlr_10.42.42.2(pid=20138): stderr: | 20221213190114748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190114748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190114748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190114748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190114748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190114748 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190114760 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190114771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190114772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190114772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:17.930297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Terminating (SIGTERM) 19:01:17.970055 run iperf3-srv_10.42.42.10(pid=20134): Terminating (SIGTERM) 19:01:18.009479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20137): Terminating (SIGTERM) 19:01:18.049049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20140): Terminating (SIGTERM) 19:01:18.088320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20143): Terminating (SIGTERM) 19:01:18.128039 --- ParallelTerminationStrategy: PID 20133 died... 19:01:18.147043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20133): Terminated: ok {rc=0} 19:01:18.190804 --- ParallelTerminationStrategy: PID 20134 died... 19:01:18.209168 run iperf3-srv_10.42.42.10(pid=20134): Terminated {rc=256} 19:01:18.252326 --- ParallelTerminationStrategy: PID 20137 died... 19:01:18.270639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20137): Terminated: ok {rc=0} 19:01:18.313881 --- ParallelTerminationStrategy: PID 20140 died... 19:01:18.332270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20140): Terminated: ok {rc=0} 19:01:18.375595 --- ParallelTerminationStrategy: PID 20143 died... 19:01:18.394017 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20143): Terminated: ok {rc=0} 19:01:18.476470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 19:01:19.624762 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:19.636630 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:01:19.688104 tst iperf3m4.py: using LAC 35618 19:01:19.818056 tst iperf3m4.py: using RAC 173 19:01:19.944821 tst iperf3m4.py: using CellId 35618 19:01:20.071337 tst iperf3m4.py: using BVCI 35619 19:01:20.189446 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.200608 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.211721 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.222863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.234718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.246400 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.258263 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.270643 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:20.282707 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:20.401909 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:20.524088 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:20.642587 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:20.758264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:01:20.962143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:21.266402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20145): Launched 19:01:21.532302 run iperf3-srv_10.42.42.10(pid=20146): Launched 19:01:21.646285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:01:21.849650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:22.154362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20147): Launched 19:01:22.417654 run iperf3-srv_10.42.42.10(pid=20148): Launched 19:01:22.530774 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:01:22.732937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:23.036466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20149): Launched 19:01:23.300455 run iperf3-srv_10.42.42.10(pid=20150): Launched 19:01:23.413572 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:01:23.615970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:23.919937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Launched 19:01:24.183533 run iperf3-srv_10.42.42.10(pid=20152): Launched 19:01:24.296280 tst iperf3m4.py:8: start network... 19:01:24.498289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:24.967430 run create_hlr_db(pid=20153): Launched 19:01:25.092655 bus /gobi_6: Setting Powered False 19:01:26.155963 run create_hlr_db(pid=20153): Terminated: ok {rc=0} 19:01:26.586713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20155): Launched 19:01:26.887625 run osmo-hlr_10.42.42.2(pid=20156): Launched 19:01:27.002467 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:27.528690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20158): Launched 19:01:27.830758 run osmo-stp_10.42.42.5(pid=20159): Launched 19:01:27.945221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:28.463491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20161): Launched 19:01:28.578469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:28.833945 run patchelf(pid=20162): Launched 19:01:29.002712 run osmo-stp_10.42.42.5(pid=20159): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20159)] 19:01:29.132304 run osmo-stp_10.42.42.5(pid=20159): stdout: | (launched: 2022-12-13_19:01:27.775562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:29.263239 run osmo-stp_10.42.42.5(pid=20159): stderr: | 20221213190127944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190127944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190127945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190127945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190127946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190127946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190127946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:29.394164 run osmo-stp_10.42.42.5(pid=20159): stdout: | (launched: 2022-12-13_19:01:27.775562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:29.520243 run osmo-stp_10.42.42.5(pid=20159): stderr: | 20221213190127944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190127944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190127945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190127945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190127946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190127946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190127946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:29.669282 run patchelf(pid=20162): Terminating (SIGINT) 19:01:29.839895 run patchelf(pid=20162): Terminated: ok {rc=0} 19:01:29.963511 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20159): Process ended prematurely: osmo-stp_10.42.42.5(pid=20159) [trial-2393↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20159)] [trial-2393↪gprs:trx-b200↪iperf3m4.py:8] 19:01:29.973094 tst iperf3m4.py:8: Test FAILED (10.4 sec) 19:01:30.000239 run osmo-hlr_10.42.42.2(pid=20156): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20156)] 19:01:30.048053 run osmo-hlr_10.42.42.2(pid=20156): stdout: | (launched: 2022-12-13_19:01:26.832503) 19:01:30.097432 run osmo-hlr_10.42.42.2(pid=20156): stderr: | 20221213190127005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190127005 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190127005 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190127005 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190127005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190127005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190127018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190127026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190127027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190127027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:30.146954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20145): Terminating (SIGTERM) 19:01:30.186708 run iperf3-srv_10.42.42.10(pid=20146): Terminating (SIGTERM) 19:01:30.226379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20147): Terminating (SIGTERM) 19:01:30.266044 run iperf3-srv_10.42.42.10(pid=20148): Terminating (SIGTERM) 19:01:30.305736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20149): Terminating (SIGTERM) 19:01:30.345418 run iperf3-srv_10.42.42.10(pid=20150): Terminating (SIGTERM) 19:01:30.384909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Terminating (SIGTERM) 19:01:30.424612 run iperf3-srv_10.42.42.10(pid=20152): Terminating (SIGTERM) 19:01:30.463936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20155): Terminating (SIGTERM) 19:01:30.503674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20158): Terminating (SIGTERM) 19:01:30.543302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20161): Terminating (SIGTERM) 19:01:30.583193 --- ParallelTerminationStrategy: PID 20145 died... 19:01:30.602619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20145): Terminated: ok {rc=0} 19:01:30.646654 --- ParallelTerminationStrategy: PID 20146 died... 19:01:30.665385 run iperf3-srv_10.42.42.10(pid=20146): Terminated {rc=256} 19:01:30.709255 --- ParallelTerminationStrategy: PID 20147 died... 19:01:30.727919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20147): Terminated: ok {rc=0} 19:01:30.771672 --- ParallelTerminationStrategy: PID 20148 died... 19:01:30.790516 run iperf3-srv_10.42.42.10(pid=20148): Terminated {rc=256} 19:01:30.834747 --- ParallelTerminationStrategy: PID 20149 died... 19:01:30.854334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20149): Terminated: ok {rc=0} 19:01:30.903803 --- ParallelTerminationStrategy: PID 20150 died... 19:01:30.923849 run iperf3-srv_10.42.42.10(pid=20150): Terminated {rc=256} 19:01:30.968311 --- ParallelTerminationStrategy: PID 20151 died... 19:01:30.987592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20151): Terminated: ok {rc=0} 19:01:31.032441 --- ParallelTerminationStrategy: PID 20152 died... 19:01:31.051902 run iperf3-srv_10.42.42.10(pid=20152): Terminated {rc=256} 19:01:31.096665 --- ParallelTerminationStrategy: PID 20155 died... 19:01:31.116237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20155): Terminated: ok {rc=0} 19:01:31.161227 --- ParallelTerminationStrategy: PID 20158 died... 19:01:31.180748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20158): Terminated: ok {rc=0} 19:01:31.225699 --- ParallelTerminationStrategy: PID 20161 died... 19:01:31.244874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20161): Terminated: ok {rc=0} 19:01:31.329589 bus /gobi_4: Setting Powered False 19:01:32.424799 bus /gobi_4: Setting Powered False 19:01:33.540216 bus /gobi_1: Setting Powered False 19:01:34.639680 bus /gobi_1: Setting Powered False 19:01:35.753330 bus /gobi_0: Setting Powered False 19:01:36.852054 bus /gobi_0: Setting Powered False 19:01:37.968125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200 ping.py ---------------------------------------------- 19:01:39.073777 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.085646 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:01:39.135904 tst ping.py: using LAC 35619 19:01:39.261942 tst ping.py: using RAC 174 19:01:39.386345 tst ping.py: using CellId 35619 19:01:39.510259 tst ping.py: using BVCI 35620 19:01:39.626094 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.637307 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.648454 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.659459 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.670908 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.682356 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.693810 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:39.705140 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:39.822562 tst ping.py:19: start network... 19:01:40.022223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:40.482495 run create_hlr_db(pid=20163): Launched 19:01:40.604697 bus /gobi_6: Setting Powered False 19:01:41.663982 run create_hlr_db(pid=20163): Terminated: ok {rc=0} 19:01:42.099037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Launched 19:01:42.418608 run osmo-hlr_10.42.42.2(pid=20166): Launched 19:01:42.540400 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:43.094590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Launched 19:01:43.417373 run osmo-stp_10.42.42.5(pid=20169): Launched 19:01:43.540241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:44.095106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20171): Launched 19:01:44.219657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:44.492622 run patchelf(pid=20172): Launched 19:01:44.673472 run osmo-stp_10.42.42.5(pid=20169): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] 19:01:44.811308 run osmo-stp_10.42.42.5(pid=20169): stdout: | (launched: 2022-12-13_19:01:43.358102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:44.949887 run osmo-stp_10.42.42.5(pid=20169): stderr: | 20221213190143546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190143546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190143546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190143547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190143547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190143547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190143547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:45.089066 run osmo-stp_10.42.42.5(pid=20169): stdout: | (launched: 2022-12-13_19:01:43.358102) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:45.222208 run osmo-stp_10.42.42.5(pid=20169): stderr: | 20221213190143546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190143546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190143546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190143547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190143547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190143547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190143547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:45.379876 run patchelf(pid=20172): Terminating (SIGINT) 19:01:45.560495 run patchelf(pid=20172): Terminated: ok {rc=0} 19:01:45.690790 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20169): Process ended prematurely: osmo-stp_10.42.42.5(pid=20169) [trial-2393↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] [trial-2393↪gprs:trx-b200↪ping.py:22] 19:01:45.700319 tst ping.py:22: Test FAILED (6.6 sec) 19:01:45.728528 run osmo-hlr_10.42.42.2(pid=20166): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20166)] 19:01:45.779965 run osmo-hlr_10.42.42.2(pid=20166): stdout: | (launched: 2022-12-13_19:01:42.360282) 19:01:45.843539 run osmo-hlr_10.42.42.2(pid=20166): stderr: | 20221213190142552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190142552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190142552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190142552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190142552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190142552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190142565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190142574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190142574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190142574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:45.915964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Terminating (SIGTERM) 19:01:45.963997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Terminating (SIGTERM) 19:01:46.009830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20171): Terminating (SIGTERM) 19:01:46.057531 --- ParallelTerminationStrategy: PID 20165 died... 19:01:46.078947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20165): Terminated: ok {rc=0} 19:01:46.127441 --- ParallelTerminationStrategy: PID 20168 died... 19:01:46.148908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20168): Terminated: ok {rc=0} 19:01:46.198954 --- ParallelTerminationStrategy: PID 20171 died... 19:01:46.220303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20171): Terminated: ok {rc=0} 19:01:46.311630 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 19:01:47.400376 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.412393 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 19:01:47.467831 tst ping_idle_ping.py: using LAC 35620 19:01:47.586914 tst ping_idle_ping.py: using RAC 175 19:01:47.706924 tst ping_idle_ping.py: using CellId 35620 19:01:47.823999 tst ping_idle_ping.py: using BVCI 35621 19:01:47.933120 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.943999 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.954906 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.965540 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.976131 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.986666 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:47.997566 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 19:01:48.008393 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 19:01:48.128372 tst ping_idle_ping.py:24: start network... 19:01:48.345614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:48.848358 run create_hlr_db(pid=20173): Launched 19:01:48.973816 bus /gobi_6: Setting Powered False 19:01:50.037907 run create_hlr_db(pid=20173): Terminated: ok {rc=0} 19:01:50.468186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Launched 19:01:50.768704 run osmo-hlr_10.42.42.2(pid=20176): Launched 19:01:50.882814 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:51.400692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20178): Launched 19:01:51.701705 run osmo-stp_10.42.42.5(pid=20179): Launched 19:01:51.816440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:01:52.334758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20181): Launched 19:01:52.449263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:01:52.702488 run patchelf(pid=20182): Launched 19:01:52.870859 run osmo-stp_10.42.42.5(pid=20179): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20179)] 19:01:52.998122 run osmo-stp_10.42.42.5(pid=20179): stdout: | (launched: 2022-12-13_19:01:51.645675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:53.127001 run osmo-stp_10.42.42.5(pid=20179): stderr: | 20221213190151814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190151814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190151814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190151815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190151815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190151815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190151815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:53.255314 run osmo-stp_10.42.42.5(pid=20179): stdout: | (launched: 2022-12-13_19:01:51.645675) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:53.378315 run osmo-stp_10.42.42.5(pid=20179): stderr: | 20221213190151814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190151814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190151814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190151815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190151815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190151815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190151815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:53.523691 run patchelf(pid=20182): Terminating (SIGINT) 19:01:53.691894 run patchelf(pid=20182): Terminated: ok {rc=0} 19:01:53.812830 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20179): Process ended prematurely: osmo-stp_10.42.42.5(pid=20179) [trial-2393↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20179)] [trial-2393↪gprs:trx-b200↪ping_idle_ping.py:27] 19:01:53.821875 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:01:53.848534 run osmo-hlr_10.42.42.2(pid=20176): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20176)] 19:01:53.896375 run osmo-hlr_10.42.42.2(pid=20176): stdout: | (launched: 2022-12-13_19:01:50.713537) 19:01:53.946001 run osmo-hlr_10.42.42.2(pid=20176): stderr: | 20221213190150885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190150885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190150885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190150885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190150885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190150885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190150902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190150912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190150912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190150912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:53.995787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Terminating (SIGTERM) 19:01:54.035671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20178): Terminating (SIGTERM) 19:01:54.075402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20181): Terminating (SIGTERM) 19:01:54.115904 --- ParallelTerminationStrategy: PID 20175 died... 19:01:54.135448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20175): Terminated: ok {rc=0} 19:01:54.179594 --- ParallelTerminationStrategy: PID 20178 died... 19:01:54.198389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20178): Terminated: ok {rc=0} 19:01:54.242167 --- ParallelTerminationStrategy: PID 20181 died... 19:01:54.261090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20181): Terminated: ok {rc=0} 19:01:54.347300 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 19:01:55.657742 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:55.663472 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:01:55.696839 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:01:55.735238 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:01:55.821561 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:01:55.854373 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:01:55.892333 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:01:56.487389 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:01:56.536254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:56.547225 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:01:56.597423 tst cs_paging_gprs_active.py: using LAC 35621 19:01:56.720880 tst cs_paging_gprs_active.py: using RAC 176 19:01:56.849452 tst cs_paging_gprs_active.py: using CellId 35621 19:01:56.969351 tst cs_paging_gprs_active.py: using BVCI 35622 19:01:57.081006 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.091906 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.102631 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.113328 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.124393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.135639 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.146953 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.158148 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:01:57.169497 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:01:57.290088 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:01:57.408562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:01:57.615431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:57.923529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20186): Launched 19:01:58.190241 run iperf3-srv_10.42.42.10(pid=20187): Launched 19:01:58.305244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:01:58.510990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:01:58.818515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20188): Launched 19:01:59.086181 run iperf3-srv_10.42.42.10(pid=20189): Launched 19:01:59.202921 tst cs_paging_gprs_active.py:38: start network... 19:01:59.408086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:59.882975 run create_hlr_db(pid=20190): Launched 19:02:00.008583 bus /gobi_6: Setting Powered False 19:02:01.095259 run create_hlr_db(pid=20190): Terminated: ok {rc=0} 19:02:01.626261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Launched 19:02:01.976727 run osmo-hlr_10.42.42.2(pid=20193): Launched 19:02:02.222744 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:02.774323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Launched 19:02:03.079344 run osmo-stp_10.42.42.5(pid=20196): Launched 19:02:03.195535 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:03.719968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20198): Launched 19:02:03.837654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:04.094901 run patchelf(pid=20199): Launched 19:02:04.264278 run osmo-stp_10.42.42.5(pid=20196): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] 19:02:04.393402 run osmo-stp_10.42.42.5(pid=20196): stdout: | (launched: 2022-12-13_19:02:03.023037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:04.523991 run osmo-stp_10.42.42.5(pid=20196): stderr: | 20221213190203191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190203191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190203191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190203192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190203192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190203192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190203192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:04.654430 run osmo-stp_10.42.42.5(pid=20196): stdout: | (launched: 2022-12-13_19:02:03.023037) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:04.779144 run osmo-stp_10.42.42.5(pid=20196): stderr: | 20221213190203191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190203191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190203191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190203192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190203192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190203192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190203192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:04.927097 run patchelf(pid=20199): Terminating (SIGINT) 19:02:05.098475 run patchelf(pid=20199): Terminated: ok {rc=0} 19:02:05.221797 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20196): Process ended prematurely: osmo-stp_10.42.42.5(pid=20196) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:02:05.231236 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:02:05.258270 run osmo-hlr_10.42.42.2(pid=20193): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20193)] 19:02:05.306042 run osmo-hlr_10.42.42.2(pid=20193): stdout: | (launched: 2022-12-13_19:02:01.912291) 19:02:05.355603 run osmo-hlr_10.42.42.2(pid=20193): stderr: | 20221213190202125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190202125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190202125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190202125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190202125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190202126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190202142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190202165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190202165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190202166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:05.405416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20186): Terminating (SIGTERM) 19:02:05.445511 run iperf3-srv_10.42.42.10(pid=20187): Terminating (SIGTERM) 19:02:05.485123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20188): Terminating (SIGTERM) 19:02:05.524673 run iperf3-srv_10.42.42.10(pid=20189): Terminating (SIGTERM) 19:02:05.564131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Terminating (SIGTERM) 19:02:05.603758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Terminating (SIGTERM) 19:02:05.643473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20198): Terminating (SIGTERM) 19:02:05.683231 --- ParallelTerminationStrategy: PID 20186 died... 19:02:05.702330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20186): Terminated: ok {rc=0} 19:02:05.745796 --- ParallelTerminationStrategy: PID 20187 died... 19:02:05.764091 run iperf3-srv_10.42.42.10(pid=20187): Terminated {rc=256} 19:02:05.808099 --- ParallelTerminationStrategy: PID 20188 died... 19:02:05.826637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20188): Terminated: ok {rc=0} 19:02:05.870299 --- ParallelTerminationStrategy: PID 20189 died... 19:02:05.888666 run iperf3-srv_10.42.42.10(pid=20189): Terminated {rc=256} 19:02:05.932048 --- ParallelTerminationStrategy: PID 20192 died... 19:02:05.950481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20192): Terminated: ok {rc=0} 19:02:05.994046 --- ParallelTerminationStrategy: PID 20195 died... 19:02:06.012383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20195): Terminated: ok {rc=0} 19:02:06.056108 --- ParallelTerminationStrategy: PID 20198 died... 19:02:06.074635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20198): Terminated: ok {rc=0} 19:02:06.159999 bus /gobi_0: Setting Powered False 19:02:07.260496 bus /gobi_0: Setting Powered False 19:02:08.376766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:02:09.520263 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:09.531734 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:02:09.585610 tst iperf3.py: using LAC 35622 19:02:09.714750 tst iperf3.py: using RAC 177 19:02:09.844246 tst iperf3.py: using CellId 35622 19:02:09.977446 tst iperf3.py: using BVCI 35623 19:02:10.089385 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.100361 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.111051 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.121841 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.132501 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.143117 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.154438 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.165017 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:10.175856 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:10.290795 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:02:10.495754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:10.803093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Launched 19:02:11.069729 run iperf3-srv_10.42.42.10(pid=20201): Launched 19:02:11.184308 tst iperf3.py:8: start network... 19:02:11.388610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:11.862163 run create_hlr_db(pid=20202): Launched 19:02:11.987427 bus /gobi_6: Setting Powered False 19:02:13.047899 run create_hlr_db(pid=20202): Terminated: ok {rc=0} 19:02:13.493702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Launched 19:02:13.821790 run osmo-hlr_10.42.42.2(pid=20205): Launched 19:02:13.946536 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:14.511705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Launched 19:02:14.839553 run osmo-stp_10.42.42.5(pid=20208): Launched 19:02:14.964230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:15.527369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Launched 19:02:15.654168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:15.951888 run patchelf(pid=20211): Launched 19:02:16.159884 run osmo-stp_10.42.42.5(pid=20208): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] 19:02:16.294369 run osmo-stp_10.42.42.5(pid=20208): stdout: | (launched: 2022-12-13_19:02:14.779472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:16.430966 run osmo-stp_10.42.42.5(pid=20208): stderr: | 20221213190214968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190214968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190214969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190214969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190214971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190214971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190214971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:16.564384 run osmo-stp_10.42.42.5(pid=20208): stdout: | (launched: 2022-12-13_19:02:14.779472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:16.693745 run osmo-stp_10.42.42.5(pid=20208): stderr: | 20221213190214968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190214968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190214969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190214969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190214971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190214971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190214971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:16.847284 run patchelf(pid=20211): Terminating (SIGINT) 19:02:17.026116 run patchelf(pid=20211): Terminated: ok {rc=0} 19:02:17.152640 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20208): Process ended prematurely: osmo-stp_10.42.42.5(pid=20208) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 19:02:17.162841 tst iperf3.py:8: Test FAILED (7.7 sec) 19:02:17.191678 run osmo-hlr_10.42.42.2(pid=20205): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20205)] 19:02:17.239598 run osmo-hlr_10.42.42.2(pid=20205): stdout: | (launched: 2022-12-13_19:02:13.762185) 19:02:17.289331 run osmo-hlr_10.42.42.2(pid=20205): stderr: | 20221213190213956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190213956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190213956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190213957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190213957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190213957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190213969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190213979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190213979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190213979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:17.339824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Terminating (SIGTERM) 19:02:17.379728 run iperf3-srv_10.42.42.10(pid=20201): Terminating (SIGTERM) 19:02:17.419309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Terminating (SIGTERM) 19:02:17.459093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Terminating (SIGTERM) 19:02:17.498681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Terminating (SIGTERM) 19:02:17.538333 --- ParallelTerminationStrategy: PID 20200 died... 19:02:17.557511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20200): Terminated: ok {rc=0} 19:02:17.601461 --- ParallelTerminationStrategy: PID 20201 died... 19:02:17.619888 run iperf3-srv_10.42.42.10(pid=20201): Terminated {rc=256} 19:02:17.663591 --- ParallelTerminationStrategy: PID 20204 died... 19:02:17.682329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20204): Terminated: ok {rc=0} 19:02:17.726299 --- ParallelTerminationStrategy: PID 20207 died... 19:02:17.744900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20207): Terminated: ok {rc=0} 19:02:17.788727 --- ParallelTerminationStrategy: PID 20210 died... 19:02:17.807539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20210): Terminated: ok {rc=0} 19:02:17.893482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:02:19.041297 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.052721 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:02:19.103288 tst iperf3m4.py: using LAC 35623 19:02:19.234184 tst iperf3m4.py: using RAC 178 19:02:19.363498 tst iperf3m4.py: using CellId 35623 19:02:19.492942 tst iperf3m4.py: using BVCI 35624 19:02:19.612238 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.623887 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.635195 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.646393 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.657888 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.669445 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.681150 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.692518 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:19.704185 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:19.826027 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:19.944931 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:20.065489 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:20.183167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:02:20.388582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:20.695681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20212): Launched 19:02:20.962300 run iperf3-srv_10.42.42.10(pid=20213): Launched 19:02:21.087104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:02:21.309222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:21.639433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Launched 19:02:21.926020 run iperf3-srv_10.42.42.10(pid=20215): Launched 19:02:22.049491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:02:22.271048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:22.600389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Launched 19:02:22.886096 run iperf3-srv_10.42.42.10(pid=20217): Launched 19:02:23.010532 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:02:23.231339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:23.559906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20218): Launched 19:02:23.845541 run iperf3-srv_10.42.42.10(pid=20219): Launched 19:02:23.968450 tst iperf3m4.py:8: start network... 19:02:24.188999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:24.696921 run create_hlr_db(pid=20220): Launched 19:02:24.821762 bus /gobi_6: Setting Powered False 19:02:25.886286 run create_hlr_db(pid=20220): Terminated: ok {rc=0} 19:02:26.343971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Launched 19:02:26.672051 run osmo-hlr_10.42.42.2(pid=20223): Launched 19:02:26.797696 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:27.364130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Launched 19:02:27.691611 run osmo-stp_10.42.42.5(pid=20226): Launched 19:02:27.817070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:28.382298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20228): Launched 19:02:28.507800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:28.785929 run patchelf(pid=20229): Launched 19:02:28.967224 run osmo-stp_10.42.42.5(pid=20226): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] 19:02:29.106228 run osmo-stp_10.42.42.5(pid=20226): stdout: | (launched: 2022-12-13_19:02:27.631521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:29.246755 run osmo-stp_10.42.42.5(pid=20226): stderr: | 20221213190227822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190227822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190227822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190227823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190227823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190227823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190227823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:29.387386 run osmo-stp_10.42.42.5(pid=20226): stdout: | (launched: 2022-12-13_19:02:27.631521) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:29.521794 run osmo-stp_10.42.42.5(pid=20226): stderr: | 20221213190227822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190227822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190227822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190227823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190227823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190227823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190227823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:29.681131 run patchelf(pid=20229): Terminating (SIGINT) 19:02:29.864353 run patchelf(pid=20229): Terminated: ok {rc=0} 19:02:29.997119 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20226): Process ended prematurely: osmo-stp_10.42.42.5(pid=20226) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 19:02:30.007588 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:02:30.036578 run osmo-hlr_10.42.42.2(pid=20223): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20223)] 19:02:30.088051 run osmo-hlr_10.42.42.2(pid=20223): stdout: | (launched: 2022-12-13_19:02:26.612232) 19:02:30.140531 run osmo-hlr_10.42.42.2(pid=20223): stderr: | 20221213190226807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190226807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190226807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190226807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190226807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190226807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190226819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190226828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190226828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190226828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:30.193408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20212): Terminating (SIGTERM) 19:02:30.235856 run iperf3-srv_10.42.42.10(pid=20213): Terminating (SIGTERM) 19:02:30.278679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Terminating (SIGTERM) 19:02:30.321705 run iperf3-srv_10.42.42.10(pid=20215): Terminating (SIGTERM) 19:02:30.364363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Terminating (SIGTERM) 19:02:30.407755 run iperf3-srv_10.42.42.10(pid=20217): Terminating (SIGTERM) 19:02:30.450507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20218): Terminating (SIGTERM) 19:02:30.493257 run iperf3-srv_10.42.42.10(pid=20219): Terminating (SIGTERM) 19:02:30.535782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Terminating (SIGTERM) 19:02:30.578549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Terminating (SIGTERM) 19:02:30.621159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20228): Terminating (SIGTERM) 19:02:30.663947 --- ParallelTerminationStrategy: PID 20212 died... 19:02:30.684600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20212): Terminated: ok {rc=0} 19:02:30.731881 --- ParallelTerminationStrategy: PID 20213 died... 19:02:30.752105 run iperf3-srv_10.42.42.10(pid=20213): Terminated {rc=256} 19:02:30.799307 --- ParallelTerminationStrategy: PID 20214 died... 19:02:30.819584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20214): Terminated: ok {rc=0} 19:02:30.867423 --- ParallelTerminationStrategy: PID 20215 died... 19:02:30.886908 run iperf3-srv_10.42.42.10(pid=20215): Terminated {rc=256} 19:02:30.933137 --- ParallelTerminationStrategy: PID 20216 died... 19:02:30.952921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20216): Terminated: ok {rc=0} 19:02:30.999931 --- ParallelTerminationStrategy: PID 20217 died... 19:02:31.019818 run iperf3-srv_10.42.42.10(pid=20217): Terminated {rc=256} 19:02:31.065328 --- ParallelTerminationStrategy: PID 20218 died... 19:02:31.085139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20218): Terminated: ok {rc=0} 19:02:31.130664 --- ParallelTerminationStrategy: PID 20219 died... 19:02:31.150312 run iperf3-srv_10.42.42.10(pid=20219): Terminated {rc=256} 19:02:31.196490 --- ParallelTerminationStrategy: PID 20222 died... 19:02:31.216203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20222): Terminated: ok {rc=0} 19:02:31.261701 --- ParallelTerminationStrategy: PID 20225 died... 19:02:31.281772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20225): Terminated: ok {rc=0} 19:02:31.327324 --- ParallelTerminationStrategy: PID 20228 died... 19:02:31.346990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20228): Terminated: ok {rc=0} 19:02:31.435052 bus /gobi_4: Setting Powered False 19:02:32.531243 bus /gobi_4: Setting Powered False 19:02:33.644009 bus /gobi_1: Setting Powered False 19:02:34.742286 bus /gobi_1: Setting Powered False 19:02:35.855153 bus /gobi_0: Setting Powered False 19:02:36.953386 bus /gobi_0: Setting Powered False 19:02:38.070453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 19:02:39.173796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.185866 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:02:39.238256 tst ping.py: using LAC 35624 19:02:39.365362 tst ping.py: using RAC 179 19:02:39.491222 tst ping.py: using CellId 35624 19:02:39.616303 tst ping.py: using BVCI 35625 19:02:39.733256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.744550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.755759 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.767450 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.778995 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.790468 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.802160 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:39.813753 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:39.929838 tst ping.py:19: start network... 19:02:40.145973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:40.644392 run create_hlr_db(pid=20230): Launched 19:02:40.767755 bus /gobi_6: Setting Powered False 19:02:41.831461 run create_hlr_db(pid=20230): Terminated: ok {rc=0} 19:02:42.280819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Launched 19:02:42.602733 run osmo-hlr_10.42.42.2(pid=20233): Launched 19:02:42.725633 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:43.286966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Launched 19:02:43.608899 run osmo-stp_10.42.42.5(pid=20236): Launched 19:02:43.732128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:44.288748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Launched 19:02:44.411588 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:44.683241 run patchelf(pid=20239): Launched 19:02:44.863401 run osmo-stp_10.42.42.5(pid=20236): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] 19:02:44.999922 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-13_19:02:43.549829) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:45.138107 run osmo-stp_10.42.42.5(pid=20236): stderr: | 20221213190243738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190243738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190243738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190243738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190243739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190243739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190243739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:45.275861 run osmo-stp_10.42.42.5(pid=20236): stdout: | (launched: 2022-12-13_19:02:43.549829) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:45.408300 run osmo-stp_10.42.42.5(pid=20236): stderr: | 20221213190243738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190243738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190243738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190243738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190243739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190243739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190243739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:45.565312 run patchelf(pid=20239): Terminating (SIGINT) 19:02:45.744908 run patchelf(pid=20239): Terminated: ok {rc=0} 19:02:45.902252 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 19:02:45.914547 tst ping.py:22: Test FAILED (6.7 sec) 19:02:45.945411 run osmo-hlr_10.42.42.2(pid=20233): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20233)] 19:02:45.997922 run osmo-hlr_10.42.42.2(pid=20233): stdout: | (launched: 2022-12-13_19:02:42.543767) 19:02:46.051826 run osmo-hlr_10.42.42.2(pid=20233): stderr: | 20221213190242736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190242736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190242736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190242736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190242736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190242736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190242748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190242756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190242757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190242757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:46.105890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminating (SIGTERM) 19:02:46.148812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminating (SIGTERM) 19:02:46.192850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminating (SIGTERM) 19:02:46.238352 --- ParallelTerminationStrategy: PID 20232 died... 19:02:46.259582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20232): Terminated: ok {rc=0} 19:02:46.307873 --- ParallelTerminationStrategy: PID 20235 died... 19:02:46.329028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20235): Terminated: ok {rc=0} 19:02:46.377090 --- ParallelTerminationStrategy: PID 20238 died... 19:02:46.397850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20238): Terminated: ok {rc=0} 19:02:46.488192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:02:47.578817 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:47.591001 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:02:47.643800 tst ping_idle_ping.py: using LAC 35625 19:02:47.763777 tst ping_idle_ping.py: using RAC 180 19:02:47.883895 tst ping_idle_ping.py: using CellId 35625 19:02:48.003776 tst ping_idle_ping.py: using BVCI 35626 19:02:48.115317 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.126797 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.137630 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.148404 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.159655 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.170822 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.182272 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:02:48.193590 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:02:48.314550 tst ping_idle_ping.py:24: start network... 19:02:48.532455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:49.035316 run create_hlr_db(pid=20240): Launched 19:02:49.159182 bus /gobi_6: Setting Powered False 19:02:50.223408 run create_hlr_db(pid=20240): Terminated: ok {rc=0} 19:02:50.654214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20242): Launched 19:02:50.957180 run osmo-hlr_10.42.42.2(pid=20243): Launched 19:02:51.072013 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:51.591640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20245): Launched 19:02:51.893664 run osmo-stp_10.42.42.5(pid=20246): Launched 19:02:52.008191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:02:52.529520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20248): Launched 19:02:52.644489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:02:52.900850 run patchelf(pid=20249): Launched 19:02:53.067766 run osmo-stp_10.42.42.5(pid=20246): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20246)] 19:02:53.195370 run osmo-stp_10.42.42.5(pid=20246): stdout: | (launched: 2022-12-13_19:02:51.838268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:53.324032 run osmo-stp_10.42.42.5(pid=20246): stderr: | 20221213190252006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190252006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190252006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190252006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190252007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190252007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190252007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:53.453412 run osmo-stp_10.42.42.5(pid=20246): stdout: | (launched: 2022-12-13_19:02:51.838268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:53.577110 run osmo-stp_10.42.42.5(pid=20246): stderr: | 20221213190252006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190252006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190252006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190252006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190252007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190252007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190252007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:53.723530 run patchelf(pid=20249): Terminating (SIGINT) 19:02:53.892187 run patchelf(pid=20249): Terminated: ok {rc=0} 19:02:54.013644 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20246): Process ended prematurely: osmo-stp_10.42.42.5(pid=20246) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20246)] [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 19:02:54.022424 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:02:54.049096 run osmo-hlr_10.42.42.2(pid=20243): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20243)] 19:02:54.097577 run osmo-hlr_10.42.42.2(pid=20243): stdout: | (launched: 2022-12-13_19:02:50.901867) 19:02:54.147278 run osmo-hlr_10.42.42.2(pid=20243): stderr: | 20221213190251075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190251075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190251075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190251075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190251075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190251075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190251087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190251096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190251096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190251097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:54.198015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20242): Terminating (SIGTERM) 19:02:54.238012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20245): Terminating (SIGTERM) 19:02:54.278648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20248): Terminating (SIGTERM) 19:02:54.319324 --- ParallelTerminationStrategy: PID 20242 died... 19:02:54.338700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20242): Terminated: ok {rc=0} 19:02:54.383401 --- ParallelTerminationStrategy: PID 20245 died... 19:02:54.402357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20245): Terminated: ok {rc=0} 19:02:54.446720 --- ParallelTerminationStrategy: PID 20248 died... 19:02:54.465548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20248): Terminated: ok {rc=0} 19:02:54.551983 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:02:55.870041 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:55.876615 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:02:55.910595 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:02:55.951705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:02:56.041742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:02:56.075837 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:02:56.115630 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:02:56.712872 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:02:56.766150 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:56.777927 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:02:56.850421 tst cs_paging_gprs_active.py: using LAC 35626 19:02:56.979715 tst cs_paging_gprs_active.py: using RAC 181 19:02:57.100164 tst cs_paging_gprs_active.py: using CellId 35626 19:02:57.221407 tst cs_paging_gprs_active.py: using BVCI 35627 19:02:57.332156 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.343058 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.353807 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.364430 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.375048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.385870 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.397165 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.407767 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:02:57.418623 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:02:57.538391 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:02:57.659966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:02:57.868519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:58.177712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20256): Launched 19:02:58.444087 run iperf3-srv_10.42.42.10(pid=20257): Launched 19:02:58.557866 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:02:58.762704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:02:59.069464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20258): Launched 19:02:59.335352 run iperf3-srv_10.42.42.10(pid=20259): Launched 19:02:59.449707 tst cs_paging_gprs_active.py:38: start network... 19:02:59.655134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:00.128674 run create_hlr_db(pid=20260): Launched 19:03:00.253082 bus /gobi_6: Setting Powered False 19:03:01.317585 run create_hlr_db(pid=20260): Terminated: ok {rc=0} 19:03:01.787258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Launched 19:03:02.133193 run osmo-hlr_10.42.42.2(pid=20264): Launched 19:03:02.295298 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:02.818626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Launched 19:03:03.124228 run osmo-stp_10.42.42.5(pid=20267): Launched 19:03:03.239670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:03.765116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20269): Launched 19:03:03.881826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:04.140349 run patchelf(pid=20270): Launched 19:03:04.310875 run osmo-stp_10.42.42.5(pid=20267): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] 19:03:04.440131 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-13_19:03:03.068363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:04.570688 run osmo-stp_10.42.42.5(pid=20267): stderr: | 20221213190303238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190303238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190303238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190303239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190303239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190303239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190303240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:04.701409 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-13_19:03:03.068363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:04.826468 run osmo-stp_10.42.42.5(pid=20267): stderr: | 20221213190303238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190303238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190303238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190303239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190303239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190303239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190303240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:04.974670 run patchelf(pid=20270): Terminating (SIGINT) 19:03:05.145288 run patchelf(pid=20270): Terminated: ok {rc=0} 19:03:05.268340 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:03:05.277884 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:03:05.304801 run osmo-hlr_10.42.42.2(pid=20264): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20264)] 19:03:05.352822 run osmo-hlr_10.42.42.2(pid=20264): stdout: | (launched: 2022-12-13_19:03:02.072314) 19:03:05.402279 run osmo-hlr_10.42.42.2(pid=20264): stderr: | 20221213190302262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190302262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190302262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190302262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190302262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190302262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190302274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190302283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190302283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190302283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:05.452202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20256): Terminating (SIGTERM) 19:03:05.492242 run iperf3-srv_10.42.42.10(pid=20257): Terminating (SIGTERM) 19:03:05.532190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20258): Terminating (SIGTERM) 19:03:05.571982 run iperf3-srv_10.42.42.10(pid=20259): Terminating (SIGTERM) 19:03:05.611715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminating (SIGTERM) 19:03:05.651482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminating (SIGTERM) 19:03:05.691302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20269): Terminating (SIGTERM) 19:03:05.731214 --- ParallelTerminationStrategy: PID 20256 died... 19:03:05.750359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20256): Terminated: ok {rc=0} 19:03:05.794456 --- ParallelTerminationStrategy: PID 20257 died... 19:03:05.813166 run iperf3-srv_10.42.42.10(pid=20257): Terminated {rc=256} 19:03:05.857030 --- ParallelTerminationStrategy: PID 20258 died... 19:03:05.875867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20258): Terminated: ok {rc=0} 19:03:05.919572 --- ParallelTerminationStrategy: PID 20259 died... 19:03:05.938153 run iperf3-srv_10.42.42.10(pid=20259): Terminated {rc=256} 19:03:05.981979 --- ParallelTerminationStrategy: PID 20263 died... 19:03:06.000550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminated: ok {rc=0} 19:03:06.044322 --- ParallelTerminationStrategy: PID 20266 died... 19:03:06.062930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminated: ok {rc=0} 19:03:06.106628 --- ParallelTerminationStrategy: PID 20269 died... 19:03:06.125269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20269): Terminated: ok {rc=0} 19:03:06.210971 bus /gobi_0: Setting Powered False 19:03:07.312665 bus /gobi_0: Setting Powered False 19:03:08.426102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:03:09.576593 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:09.588931 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:03:09.664925 tst iperf3.py: using LAC 35627 19:03:09.792434 tst iperf3.py: using RAC 182 19:03:09.919708 tst iperf3.py: using CellId 35627 19:03:10.047192 tst iperf3.py: using BVCI 35628 19:03:10.167092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.178607 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.189866 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.201161 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.212713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.224273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.235969 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.247368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:10.259154 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:10.379104 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:03:10.600492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:10.929424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Launched 19:03:11.213227 run iperf3-srv_10.42.42.10(pid=20272): Launched 19:03:11.337341 tst iperf3.py:8: start network... 19:03:11.558316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:12.064449 run create_hlr_db(pid=20273): Launched 19:03:12.188513 bus /gobi_6: Setting Powered False 19:03:13.252834 run create_hlr_db(pid=20273): Terminated: ok {rc=0} 19:03:13.687617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20275): Launched 19:03:13.992189 run osmo-hlr_10.42.42.2(pid=20276): Launched 19:03:14.107658 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:14.639324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20278): Launched 19:03:14.944851 run osmo-stp_10.42.42.5(pid=20279): Launched 19:03:15.061152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:15.587682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20281): Launched 19:03:15.704674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:16.001307 run patchelf(pid=20282): Launched 19:03:16.196767 run osmo-stp_10.42.42.5(pid=20279): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20279)] 19:03:16.339629 run osmo-stp_10.42.42.5(pid=20279): stdout: | (launched: 2022-12-13_19:03:14.888894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:16.485182 run osmo-stp_10.42.42.5(pid=20279): stderr: | 20221213190315058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190315058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190315058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190315059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190315059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190315059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190315060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:16.630875 run osmo-stp_10.42.42.5(pid=20279): stdout: | (launched: 2022-12-13_19:03:14.888894) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:16.770846 run osmo-stp_10.42.42.5(pid=20279): stderr: | 20221213190315058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190315058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190315058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190315059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190315059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190315059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190315060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:16.937648 run patchelf(pid=20282): Terminating (SIGINT) 19:03:17.127252 run patchelf(pid=20282): Terminated: ok {rc=0} 19:03:17.261351 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20279): Process ended prematurely: osmo-stp_10.42.42.5(pid=20279) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20279)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 19:03:17.271673 tst iperf3.py:8: Test FAILED (7.7 sec) 19:03:17.300503 run osmo-hlr_10.42.42.2(pid=20276): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20276)] 19:03:17.352504 run osmo-hlr_10.42.42.2(pid=20276): stdout: | (launched: 2022-12-13_19:03:13.936024) 19:03:17.405534 run osmo-hlr_10.42.42.2(pid=20276): stderr: | 20221213190314111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190314111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190314111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190314111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190314112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190314112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190314123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190314132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190314132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190314132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:17.459208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Terminating (SIGTERM) 19:03:17.501877 run iperf3-srv_10.42.42.10(pid=20272): Terminating (SIGTERM) 19:03:17.544722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20275): Terminating (SIGTERM) 19:03:17.587586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20278): Terminating (SIGTERM) 19:03:17.630473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20281): Terminating (SIGTERM) 19:03:17.673597 --- ParallelTerminationStrategy: PID 20271 died... 19:03:17.694396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20271): Terminated: ok {rc=0} 19:03:17.741610 --- ParallelTerminationStrategy: PID 20272 died... 19:03:17.761652 run iperf3-srv_10.42.42.10(pid=20272): Terminated {rc=256} 19:03:17.808746 --- ParallelTerminationStrategy: PID 20275 died... 19:03:17.828835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20275): Terminated: ok {rc=0} 19:03:17.875597 --- ParallelTerminationStrategy: PID 20278 died... 19:03:17.895599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20278): Terminated: ok {rc=0} 19:03:17.942335 --- ParallelTerminationStrategy: PID 20281 died... 19:03:17.962281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20281): Terminated: ok {rc=0} 19:03:18.051709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:03:19.203048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.215359 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:03:19.287911 tst iperf3m4.py: using LAC 35628 19:03:19.414721 tst iperf3m4.py: using RAC 183 19:03:19.542141 tst iperf3m4.py: using CellId 35628 19:03:19.669786 tst iperf3m4.py: using BVCI 35629 19:03:19.788522 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.800078 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.811365 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.822630 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.834113 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.845848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.857610 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.869137 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:19.880877 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:19.998431 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:20.120572 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:20.242426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:20.362274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:03:20.568053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:20.875683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20283): Launched 19:03:21.142498 run iperf3-srv_10.42.42.10(pid=20284): Launched 19:03:21.259020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:03:21.463326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:21.769191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20285): Launched 19:03:22.035820 run iperf3-srv_10.42.42.10(pid=20286): Launched 19:03:22.150544 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:03:22.354776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:22.661767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20287): Launched 19:03:22.930036 run iperf3-srv_10.42.42.10(pid=20288): Launched 19:03:23.045794 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:03:23.249029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:23.554838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20289): Launched 19:03:23.821674 run iperf3-srv_10.42.42.10(pid=20290): Launched 19:03:23.935878 tst iperf3m4.py:8: start network... 19:03:24.139286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:24.612269 run create_hlr_db(pid=20291): Launched 19:03:24.737416 bus /gobi_6: Setting Powered False 19:03:25.798684 run create_hlr_db(pid=20291): Terminated: ok {rc=0} 19:03:26.245708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20293): Launched 19:03:26.574554 run osmo-hlr_10.42.42.2(pid=20294): Launched 19:03:26.701568 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:27.271779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20296): Launched 19:03:27.601575 run osmo-stp_10.42.42.5(pid=20297): Launched 19:03:27.727354 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:28.292050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20299): Launched 19:03:28.417675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:28.695057 run patchelf(pid=20300): Launched 19:03:28.879046 run osmo-stp_10.42.42.5(pid=20297): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20297)] 19:03:29.017732 run osmo-stp_10.42.42.5(pid=20297): stdout: | (launched: 2022-12-13_19:03:27.541659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:29.157908 run osmo-stp_10.42.42.5(pid=20297): stderr: | 20221213190327731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190327731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190327731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190327732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190327732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190327732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190327732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:29.298403 run osmo-stp_10.42.42.5(pid=20297): stdout: | (launched: 2022-12-13_19:03:27.541659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:29.433070 run osmo-stp_10.42.42.5(pid=20297): stderr: | 20221213190327731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190327731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190327731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190327732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190327732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190327732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190327732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:29.592639 run patchelf(pid=20300): Terminating (SIGINT) 19:03:29.776234 run patchelf(pid=20300): Terminated: ok {rc=0} 19:03:29.909259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20297): Process ended prematurely: osmo-stp_10.42.42.5(pid=20297) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20297)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:03:29.919472 tst iperf3m4.py:8: Test FAILED (10.8 sec) 19:03:29.948483 run osmo-hlr_10.42.42.2(pid=20294): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20294)] 19:03:29.999872 run osmo-hlr_10.42.42.2(pid=20294): stdout: | (launched: 2022-12-13_19:03:26.514653) 19:03:30.052049 run osmo-hlr_10.42.42.2(pid=20294): stderr: | 20221213190326709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190326709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190326709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190326710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190326710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190326710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190326726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190326736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190326736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190326736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:30.104692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20283): Terminating (SIGTERM) 19:03:30.146803 run iperf3-srv_10.42.42.10(pid=20284): Terminating (SIGTERM) 19:03:30.188857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20285): Terminating (SIGTERM) 19:03:30.231233 run iperf3-srv_10.42.42.10(pid=20286): Terminating (SIGTERM) 19:03:30.273442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20287): Terminating (SIGTERM) 19:03:30.315933 run iperf3-srv_10.42.42.10(pid=20288): Terminating (SIGTERM) 19:03:30.358222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20289): Terminating (SIGTERM) 19:03:30.400454 run iperf3-srv_10.42.42.10(pid=20290): Terminating (SIGTERM) 19:03:30.443201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20293): Terminating (SIGTERM) 19:03:30.485859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20296): Terminating (SIGTERM) 19:03:30.528059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20299): Terminating (SIGTERM) 19:03:30.570586 --- ParallelTerminationStrategy: PID 20283 died... 19:03:30.591109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20283): Terminated: ok {rc=0} 19:03:30.638245 --- ParallelTerminationStrategy: PID 20284 died... 19:03:30.658369 run iperf3-srv_10.42.42.10(pid=20284): Terminated {rc=256} 19:03:30.705139 --- ParallelTerminationStrategy: PID 20285 died... 19:03:30.725183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20285): Terminated: ok {rc=0} 19:03:30.772070 --- ParallelTerminationStrategy: PID 20286 died... 19:03:30.792399 run iperf3-srv_10.42.42.10(pid=20286): Terminated {rc=256} 19:03:30.839615 --- ParallelTerminationStrategy: PID 20287 died... 19:03:30.865574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20287): Terminated: ok {rc=0} 19:03:30.926658 --- ParallelTerminationStrategy: PID 20288 died... 19:03:30.947227 run iperf3-srv_10.42.42.10(pid=20288): Terminated {rc=256} 19:03:30.995691 --- ParallelTerminationStrategy: PID 20289 died... 19:03:31.016450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20289): Terminated: ok {rc=0} 19:03:31.064109 --- ParallelTerminationStrategy: PID 20290 died... 19:03:31.084534 run iperf3-srv_10.42.42.10(pid=20290): Terminated {rc=256} 19:03:31.131264 --- ParallelTerminationStrategy: PID 20293 died... 19:03:31.151616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20293): Terminated: ok {rc=0} 19:03:31.199232 --- ParallelTerminationStrategy: PID 20296 died... 19:03:31.219417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20296): Terminated: ok {rc=0} 19:03:31.265657 --- ParallelTerminationStrategy: PID 20299 died... 19:03:31.286387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20299): Terminated: ok {rc=0} 19:03:31.374544 bus /gobi_4: Setting Powered False 19:03:32.472131 bus /gobi_4: Setting Powered False 19:03:33.589221 bus /gobi_1: Setting Powered False 19:03:34.691093 bus /gobi_1: Setting Powered False 19:03:35.807000 bus /gobi_0: Setting Powered False 19:03:36.905463 bus /gobi_0: Setting Powered False 19:03:38.023162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:03:39.126397 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.138612 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:03:39.217502 tst ping.py: using LAC 35629 19:03:39.338808 tst ping.py: using RAC 184 19:03:39.457115 tst ping.py: using CellId 35629 19:03:39.576364 tst ping.py: using BVCI 35630 19:03:39.686666 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.697763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.708446 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.719252 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.729888 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.740529 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.751685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:39.762399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:39.880491 tst ping.py:19: start network... 19:03:40.098356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:40.597991 run create_hlr_db(pid=20301): Launched 19:03:40.722765 bus /gobi_6: Setting Powered False 19:03:41.786405 run create_hlr_db(pid=20301): Terminated: ok {rc=0} 19:03:42.217808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20303): Launched 19:03:42.518515 run osmo-hlr_10.42.42.2(pid=20304): Launched 19:03:42.636162 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:43.170972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20306): Launched 19:03:43.471280 run osmo-stp_10.42.42.5(pid=20307): Launched 19:03:43.586619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:44.104474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20309): Launched 19:03:44.219551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:44.473746 run patchelf(pid=20310): Launched 19:03:44.640781 run osmo-stp_10.42.42.5(pid=20307): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20307)] 19:03:44.768683 run osmo-stp_10.42.42.5(pid=20307): stdout: | (launched: 2022-12-13_19:03:43.415763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:44.897481 run osmo-stp_10.42.42.5(pid=20307): stderr: | 20221213190343583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190343584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190343584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190343584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190343585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190343585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190343585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:45.026129 run osmo-stp_10.42.42.5(pid=20307): stdout: | (launched: 2022-12-13_19:03:43.415763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:45.148745 run osmo-stp_10.42.42.5(pid=20307): stderr: | 20221213190343583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190343584 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190343584 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190343584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190343585 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190343585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190343585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:45.294658 run patchelf(pid=20310): Terminating (SIGINT) 19:03:45.462761 run patchelf(pid=20310): Terminated: ok {rc=0} 19:03:45.583961 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20307): Process ended prematurely: osmo-stp_10.42.42.5(pid=20307) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20307)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 19:03:45.592786 tst ping.py:22: Test FAILED (6.5 sec) 19:03:45.619794 run osmo-hlr_10.42.42.2(pid=20304): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20304)] 19:03:45.668082 run osmo-hlr_10.42.42.2(pid=20304): stdout: | (launched: 2022-12-13_19:03:42.463310) 19:03:45.718128 run osmo-hlr_10.42.42.2(pid=20304): stderr: | 20221213190342638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190342638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190342638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190342638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190342638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190342638 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190342651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190342662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190342662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190342662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:45.768498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20303): Terminating (SIGTERM) 19:03:45.808799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20306): Terminating (SIGTERM) 19:03:45.850730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20309): Terminating (SIGTERM) 19:03:45.907651 --- ParallelTerminationStrategy: PID 20303 died... 19:03:45.927475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20303): Terminated: ok {rc=0} 19:03:45.972853 --- ParallelTerminationStrategy: PID 20306 died... 19:03:45.996572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20306): Terminated: ok {rc=0} 19:03:46.052441 --- ParallelTerminationStrategy: PID 20309 died... 19:03:46.077245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20309): Terminated: ok {rc=0} 19:03:46.181054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:03:47.277361 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.289512 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:03:47.360558 tst ping_idle_ping.py: using LAC 35630 19:03:47.480389 tst ping_idle_ping.py: using RAC 185 19:03:47.601786 tst ping_idle_ping.py: using CellId 35630 19:03:47.721709 tst ping_idle_ping.py: using BVCI 35631 19:03:47.832778 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.843884 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.854690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.865600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.876396 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.887231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.898176 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:03:47.909013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:03:48.023716 tst ping_idle_ping.py:24: start network... 19:03:48.227079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:48.703258 run create_hlr_db(pid=20311): Launched 19:03:48.825642 bus /gobi_6: Setting Powered False 19:03:49.886410 run create_hlr_db(pid=20311): Terminated: ok {rc=0} 19:03:50.327335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Launched 19:03:50.652294 run osmo-hlr_10.42.42.2(pid=20314): Launched 19:03:50.775606 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:51.331366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Launched 19:03:51.654070 run osmo-stp_10.42.42.5(pid=20317): Launched 19:03:51.778633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:03:52.335004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20319): Launched 19:03:52.459618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:03:52.732935 run patchelf(pid=20320): Launched 19:03:52.912279 run osmo-stp_10.42.42.5(pid=20317): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] 19:03:53.049324 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-13_19:03:51.595398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:53.187529 run osmo-stp_10.42.42.5(pid=20317): stderr: | 20221213190351784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190351784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190351784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190351784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190351785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190351785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190351785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:53.325832 run osmo-stp_10.42.42.5(pid=20317): stdout: | (launched: 2022-12-13_19:03:51.595398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:53.458759 run osmo-stp_10.42.42.5(pid=20317): stderr: | 20221213190351784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190351784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190351784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190351784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190351785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190351785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190351785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:53.615779 run patchelf(pid=20320): Terminating (SIGINT) 19:03:53.796270 run patchelf(pid=20320): Terminated: ok {rc=0} 19:03:53.927293 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:03:53.936895 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:03:53.965130 run osmo-hlr_10.42.42.2(pid=20314): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20314)] 19:03:54.016254 run osmo-hlr_10.42.42.2(pid=20314): stdout: | (launched: 2022-12-13_19:03:50.593253) 19:03:54.068926 run osmo-hlr_10.42.42.2(pid=20314): stderr: | 20221213190350788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190350788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190350788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190350788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190350788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190350788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190350804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190350814 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190350814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190350814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:54.121962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminating (SIGTERM) 19:03:54.164048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminating (SIGTERM) 19:03:54.206551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20319): Terminating (SIGTERM) 19:03:54.249049 --- ParallelTerminationStrategy: PID 20313 died... 19:03:54.269480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20313): Terminated: ok {rc=0} 19:03:54.316208 --- ParallelTerminationStrategy: PID 20316 died... 19:03:54.336160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20316): Terminated: ok {rc=0} 19:03:54.382685 --- ParallelTerminationStrategy: PID 20319 died... 19:03:54.402595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20319): Terminated: ok {rc=0} 19:03:54.491388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:03:55.801030 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:55.808270 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:03:55.842976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:03:55.883584 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:03:55.974782 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:03:56.009561 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:03:56.049697 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:03:56.645480 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:03:56.698977 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:56.710494 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:03:56.782671 tst cs_paging_gprs_active.py: using LAC 35631 19:03:56.912436 tst cs_paging_gprs_active.py: using RAC 186 19:03:57.040342 tst cs_paging_gprs_active.py: using CellId 35631 19:03:57.176100 tst cs_paging_gprs_active.py: using BVCI 35632 19:03:57.295575 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.306982 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.318340 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.329649 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.341126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.352562 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.364263 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.375878 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:03:57.387576 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:03:57.506266 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:03:57.622785 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:03:57.830002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:58.137982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20324): Launched 19:03:58.403860 run iperf3-srv_10.42.42.10(pid=20325): Launched 19:03:58.518134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:03:58.724154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:03:59.031712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20326): Launched 19:03:59.319535 run iperf3-srv_10.42.42.10(pid=20327): Launched 19:03:59.443247 tst cs_paging_gprs_active.py:38: start network... 19:03:59.666434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:00.177736 run create_hlr_db(pid=20328): Launched 19:04:00.309746 bus /gobi_6: Setting Powered False 19:04:01.374091 run create_hlr_db(pid=20328): Terminated: ok {rc=0} 19:04:01.840490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20330): Launched 19:04:02.185303 run osmo-hlr_10.42.42.2(pid=20331): Launched 19:04:02.311664 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:02.878896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20333): Launched 19:04:03.209075 run osmo-stp_10.42.42.5(pid=20334): Launched 19:04:03.335340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:03.901781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20336): Launched 19:04:04.028177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:04.305307 run patchelf(pid=20337): Launched 19:04:04.487795 run osmo-stp_10.42.42.5(pid=20334): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20334)] 19:04:04.626757 run osmo-stp_10.42.42.5(pid=20334): stdout: | (launched: 2022-12-13_19:04:03.149530) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:04.767768 run osmo-stp_10.42.42.5(pid=20334): stderr: | 20221213190403337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190403337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190403337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190403338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190403338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190403338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190403338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:04.908692 run osmo-stp_10.42.42.5(pid=20334): stdout: | (launched: 2022-12-13_19:04:03.149530) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:05.043225 run osmo-stp_10.42.42.5(pid=20334): stderr: | 20221213190403337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190403337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190403337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190403338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190403338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190403338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190403338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:05.202626 run patchelf(pid=20337): Terminating (SIGINT) 19:04:05.386533 run patchelf(pid=20337): Terminated: ok {rc=0} 19:04:05.519199 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20334): Process ended prematurely: osmo-stp_10.42.42.5(pid=20334) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20334)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:04:05.529594 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:04:05.558357 run osmo-hlr_10.42.42.2(pid=20331): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20331)] 19:04:05.609873 run osmo-hlr_10.42.42.2(pid=20331): stdout: | (launched: 2022-12-13_19:04:02.124804) 19:04:05.662481 run osmo-hlr_10.42.42.2(pid=20331): stderr: | 20221213190402318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190402318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190402318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190402318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190402318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190402318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190402331 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190402341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190402341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190402341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:05.715339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20324): Terminating (SIGTERM) 19:04:05.757576 run iperf3-srv_10.42.42.10(pid=20325): Terminating (SIGTERM) 19:04:05.799916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20326): Terminating (SIGTERM) 19:04:05.842727 run iperf3-srv_10.42.42.10(pid=20327): Terminating (SIGTERM) 19:04:05.885164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20330): Terminating (SIGTERM) 19:04:05.927470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20333): Terminating (SIGTERM) 19:04:05.970067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20336): Terminating (SIGTERM) 19:04:06.012626 --- ParallelTerminationStrategy: PID 20324 died... 19:04:06.033234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20324): Terminated: ok {rc=0} 19:04:06.080047 --- ParallelTerminationStrategy: PID 20325 died... 19:04:06.099841 run iperf3-srv_10.42.42.10(pid=20325): Terminated {rc=256} 19:04:06.146371 --- ParallelTerminationStrategy: PID 20326 died... 19:04:06.166302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20326): Terminated: ok {rc=0} 19:04:06.212555 --- ParallelTerminationStrategy: PID 20327 died... 19:04:06.232453 run iperf3-srv_10.42.42.10(pid=20327): Terminated {rc=256} 19:04:06.278942 --- ParallelTerminationStrategy: PID 20330 died... 19:04:06.298826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20330): Terminated: ok {rc=0} 19:04:06.345287 --- ParallelTerminationStrategy: PID 20333 died... 19:04:06.365150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20333): Terminated: ok {rc=0} 19:04:06.411566 --- ParallelTerminationStrategy: PID 20336 died... 19:04:06.431510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20336): Terminated: ok {rc=0} 19:04:06.519649 bus /gobi_0: Setting Powered False 19:04:07.620679 bus /gobi_0: Setting Powered False 19:04:08.737227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:04:09.888825 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:09.901178 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:04:09.977780 tst iperf3.py: using LAC 35632 19:04:10.101227 tst iperf3.py: using RAC 187 19:04:10.221743 tst iperf3.py: using CellId 35632 19:04:10.343511 tst iperf3.py: using BVCI 35633 19:04:10.454897 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.465941 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.476608 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.487361 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.498565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.510011 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.521430 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.532796 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:10.544283 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:10.666883 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:04:10.890887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:11.210516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Launched 19:04:11.478226 run iperf3-srv_10.42.42.10(pid=20339): Launched 19:04:11.592700 tst iperf3.py:8: start network... 19:04:11.797469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:12.271758 run create_hlr_db(pid=20340): Launched 19:04:12.396278 bus /gobi_6: Setting Powered False 19:04:13.456165 run create_hlr_db(pid=20340): Terminated: ok {rc=0} 19:04:13.902325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Launched 19:04:14.231486 run osmo-hlr_10.42.42.2(pid=20343): Launched 19:04:14.356079 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:14.924296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Launched 19:04:15.254188 run osmo-stp_10.42.42.5(pid=20346): Launched 19:04:15.379467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:15.961159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Launched 19:04:16.089984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:16.360740 run patchelf(pid=20349): Launched 19:04:16.552925 run osmo-stp_10.42.42.5(pid=20346): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] 19:04:16.688731 run osmo-stp_10.42.42.5(pid=20346): stdout: | (launched: 2022-12-13_19:04:15.193724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:16.826071 run osmo-stp_10.42.42.5(pid=20346): stderr: | 20221213190415383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190415384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190415384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190415384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190415385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190415385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190415385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:16.962457 run osmo-stp_10.42.42.5(pid=20346): stdout: | (launched: 2022-12-13_19:04:15.193724) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:17.092717 run osmo-stp_10.42.42.5(pid=20346): stderr: | 20221213190415383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190415384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190415384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190415384 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190415385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190415385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190415385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:17.244936 run patchelf(pid=20349): Terminating (SIGINT) 19:04:17.417441 run patchelf(pid=20349): Terminated: ok {rc=0} 19:04:17.542236 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20346): Process ended prematurely: osmo-stp_10.42.42.5(pid=20346) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 19:04:17.551898 tst iperf3.py:8: Test FAILED (7.7 sec) 19:04:17.579424 run osmo-hlr_10.42.42.2(pid=20343): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20343)] 19:04:17.628202 run osmo-hlr_10.42.42.2(pid=20343): stdout: | (launched: 2022-12-13_19:04:14.171897) 19:04:17.678492 run osmo-hlr_10.42.42.2(pid=20343): stderr: | 20221213190414367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190414367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190414367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190414367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190414367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190414367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190414379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190414389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190414389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190414389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:17.729481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminating (SIGTERM) 19:04:17.769950 run iperf3-srv_10.42.42.10(pid=20339): Terminating (SIGTERM) 19:04:17.810301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Terminating (SIGTERM) 19:04:17.850837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Terminating (SIGTERM) 19:04:17.891322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Terminating (SIGTERM) 19:04:17.931933 --- ParallelTerminationStrategy: PID 20338 died... 19:04:17.951352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminated: ok {rc=0} 19:04:17.996097 --- ParallelTerminationStrategy: PID 20339 died... 19:04:18.014827 run iperf3-srv_10.42.42.10(pid=20339): Terminated {rc=256} 19:04:18.059223 --- ParallelTerminationStrategy: PID 20342 died... 19:04:18.078088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Terminated: ok {rc=0} 19:04:18.122659 --- ParallelTerminationStrategy: PID 20345 died... 19:04:18.141543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Terminated: ok {rc=0} 19:04:18.186098 --- ParallelTerminationStrategy: PID 20348 died... 19:04:18.205024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Terminated: ok {rc=0} 19:04:18.292206 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:04:19.441011 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:19.453063 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:04:19.526776 tst iperf3m4.py: using LAC 35633 19:04:19.656219 tst iperf3m4.py: using RAC 188 19:04:19.785084 tst iperf3m4.py: using CellId 35633 19:04:19.912900 tst iperf3m4.py: using BVCI 35634 19:04:20.032317 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.044045 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.055541 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.066986 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.079072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.091146 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.103415 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.115468 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:20.127765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:20.245544 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:20.370034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:20.487500 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:20.603860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:04:20.810009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:21.118687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Launched 19:04:21.385651 run iperf3-srv_10.42.42.10(pid=20351): Launched 19:04:21.499585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:04:21.704083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:22.009801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Launched 19:04:22.275146 run iperf3-srv_10.42.42.10(pid=20353): Launched 19:04:22.389554 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:04:22.592854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:22.899519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20354): Launched 19:04:23.165368 run iperf3-srv_10.42.42.10(pid=20355): Launched 19:04:23.281724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:04:23.485610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:23.791333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20356): Launched 19:04:24.056839 run iperf3-srv_10.42.42.10(pid=20357): Launched 19:04:24.171310 tst iperf3m4.py:8: start network... 19:04:24.375267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:24.848634 run create_hlr_db(pid=20358): Launched 19:04:24.975399 bus /gobi_6: Setting Powered False 19:04:26.036111 run create_hlr_db(pid=20358): Terminated: ok {rc=0} 19:04:26.483332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20360): Launched 19:04:26.811250 run osmo-hlr_10.42.42.2(pid=20361): Launched 19:04:26.936314 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:27.499754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20363): Launched 19:04:27.828250 run osmo-stp_10.42.42.5(pid=20364): Launched 19:04:27.952797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:28.518780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20366): Launched 19:04:28.644189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:28.921764 run patchelf(pid=20367): Launched 19:04:29.103435 run osmo-stp_10.42.42.5(pid=20364): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20364)] 19:04:29.242455 run osmo-stp_10.42.42.5(pid=20364): stdout: | (launched: 2022-12-13_19:04:27.768570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:29.382330 run osmo-stp_10.42.42.5(pid=20364): stderr: | 20221213190427957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190427957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190427957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190427958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190427958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190427958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190427958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:29.522004 run osmo-stp_10.42.42.5(pid=20364): stdout: | (launched: 2022-12-13_19:04:27.768570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:29.656162 run osmo-stp_10.42.42.5(pid=20364): stderr: | 20221213190427957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190427957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190427957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190427958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190427958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190427958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190427958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:29.815531 run patchelf(pid=20367): Terminating (SIGINT) 19:04:29.998995 run patchelf(pid=20367): Terminated: ok {rc=0} 19:04:30.131308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20364): Process ended prematurely: osmo-stp_10.42.42.5(pid=20364) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20364)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:04:30.141567 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:04:30.170377 run osmo-hlr_10.42.42.2(pid=20361): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20361)] 19:04:30.222309 run osmo-hlr_10.42.42.2(pid=20361): stdout: | (launched: 2022-12-13_19:04:26.751826) 19:04:30.274806 run osmo-hlr_10.42.42.2(pid=20361): stderr: | 20221213190426947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190426947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190426947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190426947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190426948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190426948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190426961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190426969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190426969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190426969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:30.327822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Terminating (SIGTERM) 19:04:30.369829 run iperf3-srv_10.42.42.10(pid=20351): Terminating (SIGTERM) 19:04:30.412576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminating (SIGTERM) 19:04:30.455249 run iperf3-srv_10.42.42.10(pid=20353): Terminating (SIGTERM) 19:04:30.497726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20354): Terminating (SIGTERM) 19:04:30.540347 run iperf3-srv_10.42.42.10(pid=20355): Terminating (SIGTERM) 19:04:30.583046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20356): Terminating (SIGTERM) 19:04:30.625666 run iperf3-srv_10.42.42.10(pid=20357): Terminating (SIGTERM) 19:04:30.668032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20360): Terminating (SIGTERM) 19:04:30.710809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20363): Terminating (SIGTERM) 19:04:30.753298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20366): Terminating (SIGTERM) 19:04:30.796141 --- ParallelTerminationStrategy: PID 20350 died... 19:04:30.816793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20350): Terminated: ok {rc=0} 19:04:30.874102 --- ParallelTerminationStrategy: PID 20351 died... 19:04:30.903307 run iperf3-srv_10.42.42.10(pid=20351): Terminated {rc=256} 19:04:30.956485 --- ParallelTerminationStrategy: PID 20352 died... 19:04:30.977331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20352): Terminated: ok {rc=0} 19:04:31.025108 --- ParallelTerminationStrategy: PID 20353 died... 19:04:31.056580 run iperf3-srv_10.42.42.10(pid=20353): Terminated {rc=256} 19:04:31.102493 --- ParallelTerminationStrategy: PID 20354 died... 19:04:31.122812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20354): Terminated: ok {rc=0} 19:04:31.168666 --- ParallelTerminationStrategy: PID 20355 died... 19:04:31.191107 run iperf3-srv_10.42.42.10(pid=20355): Terminated {rc=256} 19:04:31.252797 --- ParallelTerminationStrategy: PID 20356 died... 19:04:31.279084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20356): Terminated: ok {rc=0} 19:04:31.328748 --- ParallelTerminationStrategy: PID 20357 died... 19:04:31.349179 run iperf3-srv_10.42.42.10(pid=20357): Terminated {rc=256} 19:04:31.396303 --- ParallelTerminationStrategy: PID 20360 died... 19:04:31.416573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20360): Terminated: ok {rc=0} 19:04:31.462604 --- ParallelTerminationStrategy: PID 20363 died... 19:04:31.483141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20363): Terminated: ok {rc=0} 19:04:31.529520 --- ParallelTerminationStrategy: PID 20366 died... 19:04:31.549678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20366): Terminated: ok {rc=0} 19:04:31.640332 bus /gobi_4: Setting Powered False 19:04:32.742100 bus /gobi_4: Setting Powered False 19:04:33.856933 bus /gobi_1: Setting Powered False 19:04:34.956433 bus /gobi_1: Setting Powered False 19:04:36.072297 bus /gobi_0: Setting Powered False 19:04:37.170835 bus /gobi_0: Setting Powered False 19:04:38.288638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:04:39.394135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:39.406495 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:04:39.480141 tst ping.py: using LAC 35634 19:04:39.607330 tst ping.py: using RAC 189 19:04:39.732365 tst ping.py: using CellId 35634 19:04:39.858257 tst ping.py: using BVCI 35635 19:04:39.976560 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:39.988169 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:39.999418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:40.010793 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:40.022440 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:40.034049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:40.045880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:40.057491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:40.176634 tst ping.py:19: start network... 19:04:40.393721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:40.894193 run create_hlr_db(pid=20368): Launched 19:04:41.018207 bus /gobi_6: Setting Powered False 19:04:42.081349 run create_hlr_db(pid=20368): Terminated: ok {rc=0} 19:04:42.511393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20370): Launched 19:04:42.812091 run osmo-hlr_10.42.42.2(pid=20371): Launched 19:04:42.925652 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:43.466016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20373): Launched 19:04:43.765834 run osmo-stp_10.42.42.5(pid=20374): Launched 19:04:43.878871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:44.395157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20376): Launched 19:04:44.510447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:44.763792 run patchelf(pid=20377): Launched 19:04:44.929987 run osmo-stp_10.42.42.5(pid=20374): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20374)] 19:04:45.057689 run osmo-stp_10.42.42.5(pid=20374): stdout: | (launched: 2022-12-13_19:04:43.710575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:45.186277 run osmo-stp_10.42.42.5(pid=20374): stderr: | 20221213190443878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190443878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190443879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190443879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190443880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190443880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190443880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:45.314696 run osmo-stp_10.42.42.5(pid=20374): stdout: | (launched: 2022-12-13_19:04:43.710575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:45.438040 run osmo-stp_10.42.42.5(pid=20374): stderr: | 20221213190443878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190443878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190443879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190443879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190443880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190443880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190443880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:45.583386 run patchelf(pid=20377): Terminating (SIGINT) 19:04:45.751313 run patchelf(pid=20377): Terminated: ok {rc=0} 19:04:45.886607 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20374): Process ended prematurely: osmo-stp_10.42.42.5(pid=20374) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20374)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 19:04:45.900112 tst ping.py:22: Test FAILED (6.5 sec) 19:04:45.940028 run osmo-hlr_10.42.42.2(pid=20371): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20371)] 19:04:45.988545 run osmo-hlr_10.42.42.2(pid=20371): stdout: | (launched: 2022-12-13_19:04:42.757031) 19:04:46.042998 run osmo-hlr_10.42.42.2(pid=20371): stderr: | 20221213190442931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190442931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190442931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190442931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190442931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190442931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190442944 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190442954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190442954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190442954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:46.106114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20370): Terminating (SIGTERM) 19:04:46.155739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20373): Terminating (SIGTERM) 19:04:46.205483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20376): Terminating (SIGTERM) 19:04:46.253184 --- ParallelTerminationStrategy: PID 20370 died... 19:04:46.275659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20370): Terminated: ok {rc=0} 19:04:46.326052 --- ParallelTerminationStrategy: PID 20373 died... 19:04:46.348007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20373): Terminated: ok {rc=0} 19:04:46.398835 --- ParallelTerminationStrategy: PID 20376 died... 19:04:46.419509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20376): Terminated: ok {rc=0} 19:04:46.559857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:04:47.746570 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:47.759222 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:04:47.833972 tst ping_idle_ping.py: using LAC 35635 19:04:47.964924 tst ping_idle_ping.py: using RAC 190 19:04:48.090052 tst ping_idle_ping.py: using CellId 35635 19:04:48.214882 tst ping_idle_ping.py: using BVCI 35636 19:04:48.332540 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.344129 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.355328 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.366721 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.378730 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.390871 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.403089 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:04:48.415254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:04:48.538414 tst ping_idle_ping.py:24: start network... 19:04:48.757488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:49.262152 run create_hlr_db(pid=20382): Launched 19:04:49.387138 bus /gobi_6: Setting Powered False 19:04:50.451218 run create_hlr_db(pid=20382): Terminated: ok {rc=0} 19:04:50.883135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Launched 19:04:51.185211 run osmo-hlr_10.42.42.2(pid=20385): Launched 19:04:51.299303 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:51.822271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Launched 19:04:52.122557 run osmo-stp_10.42.42.5(pid=20388): Launched 19:04:52.238163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:04:52.755353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Launched 19:04:52.869763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:04:53.124167 run patchelf(pid=20391): Launched 19:04:53.290623 run osmo-stp_10.42.42.5(pid=20388): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] 19:04:53.417845 run osmo-stp_10.42.42.5(pid=20388): stdout: | (launched: 2022-12-13_19:04:52.067604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:53.546296 run osmo-stp_10.42.42.5(pid=20388): stderr: | 20221213190452234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190452235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190452235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190452235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190452236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190452236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190452236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:53.674588 run osmo-stp_10.42.42.5(pid=20388): stdout: | (launched: 2022-12-13_19:04:52.067604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:53.797530 run osmo-stp_10.42.42.5(pid=20388): stderr: | 20221213190452234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190452235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190452235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190452235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190452236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190452236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190452236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:53.943057 run patchelf(pid=20391): Terminating (SIGINT) 19:04:54.111171 run patchelf(pid=20391): Terminated: ok {rc=0} 19:04:54.232340 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20388): Process ended prematurely: osmo-stp_10.42.42.5(pid=20388) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:04:54.241223 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:04:54.267788 run osmo-hlr_10.42.42.2(pid=20385): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20385)] 19:04:54.315267 run osmo-hlr_10.42.42.2(pid=20385): stdout: | (launched: 2022-12-13_19:04:51.129660) 19:04:54.364881 run osmo-hlr_10.42.42.2(pid=20385): stderr: | 20221213190451304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190451304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190451304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190451304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190451304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190451304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190451316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190451325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190451325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190451325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:54.414650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Terminating (SIGTERM) 19:04:54.454335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Terminating (SIGTERM) 19:04:54.493855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Terminating (SIGTERM) 19:04:54.533672 --- ParallelTerminationStrategy: PID 20384 died... 19:04:54.552629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20384): Terminated: ok {rc=0} 19:04:54.596651 --- ParallelTerminationStrategy: PID 20387 died... 19:04:54.615209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20387): Terminated: ok {rc=0} 19:04:54.658624 --- ParallelTerminationStrategy: PID 20390 died... 19:04:54.677125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20390): Terminated: ok {rc=0} 19:04:54.760019 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:04:56.068725 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:56.075876 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:04:56.111595 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:04:56.152008 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:04:56.242216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:04:56.276505 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:04:56.316413 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:04:56.917975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:04:56.968621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:56.980227 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:04:57.032761 tst cs_paging_gprs_active.py: using LAC 35636 19:04:57.153368 tst cs_paging_gprs_active.py: using RAC 191 19:04:57.274571 tst cs_paging_gprs_active.py: using CellId 35636 19:04:57.398138 tst cs_paging_gprs_active.py: using BVCI 35637 19:04:57.510198 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.521621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.532689 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.543804 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.554851 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.566037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.577332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.588325 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:04:57.599849 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:04:57.721841 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:04:57.839729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:04:58.046519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:58.354661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20395): Launched 19:04:58.621173 run iperf3-srv_10.42.42.10(pid=20396): Launched 19:04:58.735882 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:04:58.941280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:04:59.249075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Launched 19:04:59.515599 run iperf3-srv_10.42.42.10(pid=20399): Launched 19:04:59.629568 tst cs_paging_gprs_active.py:38: start network... 19:04:59.834566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:00.306948 run create_hlr_db(pid=20400): Launched 19:05:00.431314 bus /gobi_6: Setting Powered False 19:05:01.490131 run create_hlr_db(pid=20400): Terminated: ok {rc=0} 19:05:01.924214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Launched 19:05:02.244802 run osmo-hlr_10.42.42.2(pid=20406): Launched 19:05:02.383463 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:02.953042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Launched 19:05:03.282450 run osmo-stp_10.42.42.5(pid=20409): Launched 19:05:03.408105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:05:03.974124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Launched 19:05:04.099903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:05:04.378300 run patchelf(pid=20412): Launched 19:05:04.561953 run osmo-stp_10.42.42.5(pid=20409): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] 19:05:04.701535 run osmo-stp_10.42.42.5(pid=20409): stdout: | (launched: 2022-12-13_19:05:03.222608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:04.842799 run osmo-stp_10.42.42.5(pid=20409): stderr: | 20221213190503411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190503411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190503412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190503412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190503412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190503413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190503413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:04.984027 run osmo-stp_10.42.42.5(pid=20409): stdout: | (launched: 2022-12-13_19:05:03.222608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:05.119247 run osmo-stp_10.42.42.5(pid=20409): stderr: | 20221213190503411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190503411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190503412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190503412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190503412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190503413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190503413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:05.279749 run patchelf(pid=20412): Terminating (SIGINT) 19:05:05.464053 run patchelf(pid=20412): Terminated: ok {rc=0} 19:05:05.596676 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20409): Process ended prematurely: osmo-stp_10.42.42.5(pid=20409) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:05:05.606953 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:05:05.635501 run osmo-hlr_10.42.42.2(pid=20406): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20406)] 19:05:05.686918 run osmo-hlr_10.42.42.2(pid=20406): stdout: | (launched: 2022-12-13_19:05:02.188875) 19:05:05.739974 run osmo-hlr_10.42.42.2(pid=20406): stderr: | 20221213190502390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190502390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190502390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190502390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190502390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190502390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190502403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190502411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190502411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190502412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:05.793368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20395): Terminating (SIGTERM) 19:05:05.836127 run iperf3-srv_10.42.42.10(pid=20396): Terminating (SIGTERM) 19:05:05.878979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Terminating (SIGTERM) 19:05:05.921933 run iperf3-srv_10.42.42.10(pid=20399): Terminating (SIGTERM) 19:05:05.964416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Terminating (SIGTERM) 19:05:06.007267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Terminating (SIGTERM) 19:05:06.050066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Terminating (SIGTERM) 19:05:06.092884 --- ParallelTerminationStrategy: PID 20395 died... 19:05:06.113580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20395): Terminated: ok {rc=0} 19:05:06.160646 --- ParallelTerminationStrategy: PID 20396 died... 19:05:06.180605 run iperf3-srv_10.42.42.10(pid=20396): Terminated {rc=256} 19:05:06.227194 --- ParallelTerminationStrategy: PID 20397 died... 19:05:06.247431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20397): Terminated: ok {rc=0} 19:05:06.294082 --- ParallelTerminationStrategy: PID 20399 died... 19:05:06.314121 run iperf3-srv_10.42.42.10(pid=20399): Terminated {rc=256} 19:05:06.360381 --- ParallelTerminationStrategy: PID 20405 died... 19:05:06.380450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20405): Terminated: ok {rc=0} 19:05:06.426917 --- ParallelTerminationStrategy: PID 20408 died... 19:05:06.446848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20408): Terminated: ok {rc=0} 19:05:06.493368 --- ParallelTerminationStrategy: PID 20411 died... 19:05:06.513446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20411): Terminated: ok {rc=0} 19:05:06.602441 bus /gobi_0: Setting Powered False 19:05:07.698644 bus /gobi_0: Setting Powered False 19:05:08.813661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:05:09.964569 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:09.977352 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:05:10.034896 tst iperf3.py: using LAC 35637 19:05:10.166503 tst iperf3.py: using RAC 192 19:05:10.288658 tst iperf3.py: using CellId 35637 19:05:10.410678 tst iperf3.py: using BVCI 35638 19:05:10.521793 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.533842 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.545200 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.556325 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.567532 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.578617 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.589945 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.600912 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:10.612142 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:10.732425 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:05:10.957162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:05:11.288050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20413): Launched 19:05:11.573333 run iperf3-srv_10.42.42.10(pid=20414): Launched 19:05:11.698553 tst iperf3.py:8: start network... 19:05:11.921314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:12.430181 run create_hlr_db(pid=20415): Launched 19:05:12.557469 bus /gobi_6: Setting Powered False 19:05:13.621630 run create_hlr_db(pid=20415): Terminated: ok {rc=0} 19:05:14.078291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20417): Launched 19:05:14.409390 run osmo-hlr_10.42.42.2(pid=20418): Launched 19:05:14.535060 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:15.099420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20420): Launched 19:05:15.430712 run osmo-stp_10.42.42.5(pid=20421): Launched 19:05:15.556137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:05:16.141257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20423): Launched 19:05:16.281697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:05:16.569047 run patchelf(pid=20424): Launched 19:05:16.766960 run osmo-stp_10.42.42.5(pid=20421): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20421)] 19:05:16.910562 run osmo-stp_10.42.42.5(pid=20421): stdout: | (launched: 2022-12-13_19:05:15.370636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:17.055129 run osmo-stp_10.42.42.5(pid=20421): stderr: | 20221213190515558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190515558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190515558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190515559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190515559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190515559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190515559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:17.199414 run osmo-stp_10.42.42.5(pid=20421): stdout: | (launched: 2022-12-13_19:05:15.370636) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:17.335395 run osmo-stp_10.42.42.5(pid=20421): stderr: | 20221213190515558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190515558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190515558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190515559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190515559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190515559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190515559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:17.496362 run patchelf(pid=20424): Terminating (SIGINT) 19:05:17.681338 run patchelf(pid=20424): Terminated: ok {rc=0} 19:05:17.814803 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20421): Process ended prematurely: osmo-stp_10.42.42.5(pid=20421) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20421)] [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:05:17.825094 tst iperf3.py:8: Test FAILED (7.9 sec) 19:05:17.854153 run osmo-hlr_10.42.42.2(pid=20418): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20418)] 19:05:17.905323 run osmo-hlr_10.42.42.2(pid=20418): stdout: | (launched: 2022-12-13_19:05:14.349394) 19:05:17.957964 run osmo-hlr_10.42.42.2(pid=20418): stderr: | 20221213190514544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190514544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190514544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190514544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190514544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190514544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190514556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190514565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190514565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190514565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:18.010627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20413): Terminating (SIGTERM) 19:05:18.052484 run iperf3-srv_10.42.42.10(pid=20414): Terminating (SIGTERM) 19:05:18.095117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20417): Terminating (SIGTERM) 19:05:18.137221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20420): Terminating (SIGTERM) 19:05:18.179455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20423): Terminating (SIGTERM) 19:05:18.221950 --- ParallelTerminationStrategy: PID 20413 died... 19:05:18.242463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20413): Terminated: ok {rc=0} 19:05:18.289311 --- ParallelTerminationStrategy: PID 20414 died... 19:05:18.309306 run iperf3-srv_10.42.42.10(pid=20414): Terminated {rc=256} 19:05:18.355827 --- ParallelTerminationStrategy: PID 20417 died... 19:05:18.375803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20417): Terminated: ok {rc=0} 19:05:18.422422 --- ParallelTerminationStrategy: PID 20420 died... 19:05:18.442479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20420): Terminated: ok {rc=0} 19:05:18.489268 --- ParallelTerminationStrategy: PID 20423 died... 19:05:18.509377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20423): Terminated: ok {rc=0} 19:05:18.598667 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:05:19.748046 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:19.759989 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:05:19.813105 tst iperf3m4.py: using LAC 35638 19:05:19.934593 tst iperf3m4.py: using RAC 193 19:05:20.056317 tst iperf3m4.py: using CellId 35638 19:05:20.176216 tst iperf3m4.py: using BVCI 35639 19:05:20.287015 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.298606 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.309769 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.320874 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.332081 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.343279 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.355072 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.366160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:20.377360 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:20.494074 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:20.618047 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:20.735387 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:20.852215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:05:21.058785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:05:21.367533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Launched 19:05:21.635022 run iperf3-srv_10.42.42.10(pid=20426): Launched 19:05:21.749654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:05:21.955361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:05:22.262842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Launched 19:05:22.529190 run iperf3-srv_10.42.42.10(pid=20428): Launched 19:05:22.643167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:05:22.847457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:05:23.155526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Launched 19:05:23.421785 run iperf3-srv_10.42.42.10(pid=20430): Launched 19:05:23.535599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:05:23.739131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:05:24.045527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Launched 19:05:24.311862 run iperf3-srv_10.42.42.10(pid=20432): Launched 19:05:24.425992 tst iperf3m4.py:8: start network... 19:05:24.630102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:25.103151 run create_hlr_db(pid=20433): Launched 19:05:25.227445 bus /gobi_6: Setting Powered False 19:05:26.288004 run create_hlr_db(pid=20433): Terminated: ok {rc=0} 19:05:26.735745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Launched 19:05:27.064104 run osmo-hlr_10.42.42.2(pid=20436): Launched 19:05:27.189133 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:27.762574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Launched 19:05:28.093053 run osmo-stp_10.42.42.5(pid=20439): Launched 19:05:28.218488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:05:28.784108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Launched 19:05:28.910115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:05:29.187391 run patchelf(pid=20442): Launched 19:05:29.368670 run osmo-stp_10.42.42.5(pid=20439): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] 19:05:29.507882 run osmo-stp_10.42.42.5(pid=20439): stdout: | (launched: 2022-12-13_19:05:28.032022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:29.648003 run osmo-stp_10.42.42.5(pid=20439): stderr: | 20221213190528223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190528223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190528223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190528224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190528224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190528224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190528224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:29.788065 run osmo-stp_10.42.42.5(pid=20439): stdout: | (launched: 2022-12-13_19:05:28.032022) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:29.923623 run osmo-stp_10.42.42.5(pid=20439): stderr: | 20221213190528223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190528223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190528223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190528224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190528224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190528224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190528224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:30.083402 run patchelf(pid=20442): Terminating (SIGINT) 19:05:30.266910 run patchelf(pid=20442): Terminated: ok {rc=0} 19:05:30.399614 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20439): Process ended prematurely: osmo-stp_10.42.42.5(pid=20439) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:05:30.410022 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:05:30.438967 run osmo-hlr_10.42.42.2(pid=20436): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20436)] 19:05:30.490854 run osmo-hlr_10.42.42.2(pid=20436): stdout: | (launched: 2022-12-13_19:05:27.004453) 19:05:30.543562 run osmo-hlr_10.42.42.2(pid=20436): stderr: | 20221213190527199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190527199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190527199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190527199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190527200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190527200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190527211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190527221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190527221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190527221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:30.596796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Terminating (SIGTERM) 19:05:30.639055 run iperf3-srv_10.42.42.10(pid=20426): Terminating (SIGTERM) 19:05:30.681739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Terminating (SIGTERM) 19:05:30.724452 run iperf3-srv_10.42.42.10(pid=20428): Terminating (SIGTERM) 19:05:30.767174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Terminating (SIGTERM) 19:05:30.809950 run iperf3-srv_10.42.42.10(pid=20430): Terminating (SIGTERM) 19:05:30.860236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Terminating (SIGTERM) 19:05:30.907143 run iperf3-srv_10.42.42.10(pid=20432): Terminating (SIGTERM) 19:05:30.955807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Terminating (SIGTERM) 19:05:30.999538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Terminating (SIGTERM) 19:05:31.042545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Terminating (SIGTERM) 19:05:31.085879 --- ParallelTerminationStrategy: PID 20425 died... 19:05:31.106797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20425): Terminated: ok {rc=0} 19:05:31.154455 --- ParallelTerminationStrategy: PID 20426 died... 19:05:31.175295 run iperf3-srv_10.42.42.10(pid=20426): Terminated {rc=256} 19:05:31.222793 --- ParallelTerminationStrategy: PID 20427 died... 19:05:31.243608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20427): Terminated: ok {rc=0} 19:05:31.291120 --- ParallelTerminationStrategy: PID 20428 died... 19:05:31.311925 run iperf3-srv_10.42.42.10(pid=20428): Terminated {rc=256} 19:05:31.359284 --- ParallelTerminationStrategy: PID 20429 died... 19:05:31.380122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20429): Terminated: ok {rc=0} 19:05:31.427827 --- ParallelTerminationStrategy: PID 20430 died... 19:05:31.450210 run iperf3-srv_10.42.42.10(pid=20430): Terminated {rc=256} 19:05:31.497619 --- ParallelTerminationStrategy: PID 20431 died... 19:05:31.518402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20431): Terminated: ok {rc=0} 19:05:31.565899 --- ParallelTerminationStrategy: PID 20432 died... 19:05:31.586691 run iperf3-srv_10.42.42.10(pid=20432): Terminated {rc=256} 19:05:31.633867 --- ParallelTerminationStrategy: PID 20435 died... 19:05:31.654714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20435): Terminated: ok {rc=0} 19:05:31.702339 --- ParallelTerminationStrategy: PID 20438 died... 19:05:31.723009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20438): Terminated: ok {rc=0} 19:05:31.770265 --- ParallelTerminationStrategy: PID 20441 died... 19:05:31.790897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20441): Terminated: ok {rc=0} 19:05:31.888227 bus /gobi_4: Setting Powered False 19:05:32.988813 bus /gobi_4: Setting Powered False 19:05:34.107227 bus /gobi_1: Setting Powered False 19:05:35.205926 bus /gobi_1: Setting Powered False 19:05:36.318166 bus /gobi_0: Setting Powered False 19:05:37.417720 bus /gobi_0: Setting Powered False 19:05:38.536132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:05:39.638551 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:39.651176 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:05:39.707023 tst ping.py: using LAC 35639 19:05:39.833980 tst ping.py: using RAC 194 19:05:39.961297 tst ping.py: using CellId 35639 19:05:40.089301 tst ping.py: using BVCI 35640 19:05:40.206280 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.218278 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.230059 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.241770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.253764 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.265840 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.278128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:40.290145 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:40.407748 tst ping.py:19: start network... 19:05:40.609169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:41.075101 run create_hlr_db(pid=20443): Launched 19:05:41.198802 bus /gobi_6: Setting Powered False 19:05:42.257419 run create_hlr_db(pid=20443): Terminated: ok {rc=0} 19:05:42.698196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20445): Launched 19:05:43.021569 run osmo-hlr_10.42.42.2(pid=20446): Launched 19:05:43.143967 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:43.704217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20448): Launched 19:05:44.028318 run osmo-stp_10.42.42.5(pid=20449): Launched 19:05:44.151423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:05:44.709469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20451): Launched 19:05:44.832350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:05:45.105639 run patchelf(pid=20452): Launched 19:05:45.284480 run osmo-stp_10.42.42.5(pid=20449): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20449)] 19:05:45.422062 run osmo-stp_10.42.42.5(pid=20449): stdout: | (launched: 2022-12-13_19:05:43.969246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:45.560690 run osmo-stp_10.42.42.5(pid=20449): stderr: | 20221213190544157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190544157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190544157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190544158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190544158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190544158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190544158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:45.699019 run osmo-stp_10.42.42.5(pid=20449): stdout: | (launched: 2022-12-13_19:05:43.969246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:45.831951 run osmo-stp_10.42.42.5(pid=20449): stderr: | 20221213190544157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190544157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190544157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190544158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190544158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190544158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190544158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:46.008166 run patchelf(pid=20452): Terminating (SIGINT) 19:05:46.195115 run patchelf(pid=20452): Terminated: ok {rc=0} 19:05:46.327360 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20449): Process ended prematurely: osmo-stp_10.42.42.5(pid=20449) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20449)] [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:05:46.337638 tst ping.py:22: Test FAILED (6.7 sec) 19:05:46.366865 run osmo-hlr_10.42.42.2(pid=20446): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20446)] 19:05:46.419827 run osmo-hlr_10.42.42.2(pid=20446): stdout: | (launched: 2022-12-13_19:05:42.962312) 19:05:46.473404 run osmo-hlr_10.42.42.2(pid=20446): stderr: | 20221213190543157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190543157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190543157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190543157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190543157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190543157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190543170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190543179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190543179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190543179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:46.527575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20445): Terminating (SIGTERM) 19:05:46.571036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20448): Terminating (SIGTERM) 19:05:46.617558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20451): Terminating (SIGTERM) 19:05:46.662867 --- ParallelTerminationStrategy: PID 20445 died... 19:05:46.683797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20445): Terminated: ok {rc=0} 19:05:46.731116 --- ParallelTerminationStrategy: PID 20448 died... 19:05:46.751954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20448): Terminated: ok {rc=0} 19:05:46.801974 --- ParallelTerminationStrategy: PID 20451 died... 19:05:46.822281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20451): Terminated: ok {rc=0} 19:05:46.913156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:05:47.999777 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.012061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:05:48.066270 tst ping_idle_ping.py: using LAC 35640 19:05:48.186843 tst ping_idle_ping.py: using RAC 195 19:05:48.306553 tst ping_idle_ping.py: using CellId 35640 19:05:48.426736 tst ping_idle_ping.py: using BVCI 35641 19:05:48.538130 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.549736 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.561275 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.572694 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.584177 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.595667 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.607409 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:05:48.619228 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:05:48.740266 tst ping_idle_ping.py:24: start network... 19:05:48.943461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:49.414635 run create_hlr_db(pid=20453): Launched 19:05:49.538536 bus /gobi_6: Setting Powered False 19:05:50.602668 run create_hlr_db(pid=20453): Terminated: ok {rc=0} 19:05:51.054110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Launched 19:05:51.380277 run osmo-hlr_10.42.42.2(pid=20456): Launched 19:05:51.503850 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:52.067022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20460): Launched 19:05:52.390825 run osmo-stp_10.42.42.5(pid=20461): Launched 19:05:52.514532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:05:53.072869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20463): Launched 19:05:53.196594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:05:53.469177 run patchelf(pid=20464): Launched 19:05:53.647747 run osmo-stp_10.42.42.5(pid=20461): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20461)] 19:05:53.784785 run osmo-stp_10.42.42.5(pid=20461): stdout: | (launched: 2022-12-13_19:05:52.331450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:53.923338 run osmo-stp_10.42.42.5(pid=20461): stderr: | 20221213190552519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190552519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190552519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190552519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190552520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190552520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190552520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:54.061441 run osmo-stp_10.42.42.5(pid=20461): stdout: | (launched: 2022-12-13_19:05:52.331450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:54.194410 run osmo-stp_10.42.42.5(pid=20461): stderr: | 20221213190552519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190552519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190552519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190552519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190552520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190552520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190552520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:54.351581 run patchelf(pid=20464): Terminating (SIGINT) 19:05:54.531930 run patchelf(pid=20464): Terminated: ok {rc=0} 19:05:54.662195 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20461): Process ended prematurely: osmo-stp_10.42.42.5(pid=20461) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20461)] [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:05:54.671807 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:05:54.699996 run osmo-hlr_10.42.42.2(pid=20456): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20456)] 19:05:54.751049 run osmo-hlr_10.42.42.2(pid=20456): stdout: | (launched: 2022-12-13_19:05:51.320935) 19:05:54.803681 run osmo-hlr_10.42.42.2(pid=20456): stderr: | 20221213190551514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190551514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190551514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190551514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190551514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190551514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190551527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190551537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190551537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190551537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:54.856680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Terminating (SIGTERM) 19:05:54.899131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20460): Terminating (SIGTERM) 19:05:54.942125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20463): Terminating (SIGTERM) 19:05:54.984624 --- ParallelTerminationStrategy: PID 20455 died... 19:05:55.005335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20455): Terminated: ok {rc=0} 19:05:55.051905 --- ParallelTerminationStrategy: PID 20460 died... 19:05:55.071952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20460): Terminated: ok {rc=0} 19:05:55.118457 --- ParallelTerminationStrategy: PID 20463 died... 19:05:55.138436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20463): Terminated: ok {rc=0} 19:05:55.227354 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:05:56.541103 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:56.548304 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:05:56.583156 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:05:56.619543 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:05:56.674222 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:05:56.708465 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:05:56.744170 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:05:57.300186 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:05:57.306297 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.318298 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:05:57.389984 tst switch_tch_pdch.py: using LAC 35641 19:05:57.508572 tst switch_tch_pdch.py: using RAC 196 19:05:57.631464 tst switch_tch_pdch.py: using CellId 35641 19:05:57.749355 tst switch_tch_pdch.py: using BVCI 35642 19:05:57.857937 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.869297 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.880348 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.891409 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.902471 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.913487 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.924663 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:05:57.935756 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:05:58.056775 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:05:58.177122 tst switch_tch_pdch.py:51: start network... 19:05:58.394756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:58.895317 run create_hlr_db(pid=20468): Launched 19:05:59.020003 bus /gobi_6: Setting Powered False 19:06:00.078173 run create_hlr_db(pid=20468): Terminated: ok {rc=0} 19:06:00.509356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Launched 19:06:00.809909 run osmo-hlr_10.42.42.2(pid=20471): Launched 19:06:01.046817 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:01.702736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Launched 19:06:02.047123 run osmo-stp_10.42.42.5(pid=20474): Launched 19:06:02.214784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:06:02.783601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Launched 19:06:02.907245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:06:03.179066 run patchelf(pid=20477): Launched 19:06:03.358940 run osmo-stp_10.42.42.5(pid=20474): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] 19:06:03.495819 run osmo-stp_10.42.42.5(pid=20474): stdout: | (launched: 2022-12-13_19:06:01.985424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:03.634248 run osmo-stp_10.42.42.5(pid=20474): stderr: | 20221213190602317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190602318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190602318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190602318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190602319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190602319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190602319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:03.773400 run osmo-stp_10.42.42.5(pid=20474): stdout: | (launched: 2022-12-13_19:06:01.985424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:03.906758 run osmo-stp_10.42.42.5(pid=20474): stderr: | 20221213190602317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190602318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190602318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190602318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190602319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190602319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190602319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:04.064350 run patchelf(pid=20477): Terminating (SIGINT) 19:06:04.244312 run patchelf(pid=20477): Terminated: ok {rc=0} 19:06:04.375057 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20474): Process ended prematurely: osmo-stp_10.42.42.5(pid=20474) [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:06:04.384520 tst switch_tch_pdch.py:54: Test FAILED (7.1 sec) 19:06:04.412679 run osmo-hlr_10.42.42.2(pid=20471): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20471)] 19:06:04.463736 run osmo-hlr_10.42.42.2(pid=20471): stdout: | (launched: 2022-12-13_19:06:00.754233) 19:06:04.516433 run osmo-hlr_10.42.42.2(pid=20471): stderr: | 20221213190601025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190601025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190601025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190601025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190601025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190601025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190601057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190601066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190601066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190601066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:04.569274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Terminating (SIGTERM) 19:06:04.611209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Terminating (SIGTERM) 19:06:04.653384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Terminating (SIGTERM) 19:06:04.696123 --- ParallelTerminationStrategy: PID 20470 died... 19:06:04.716563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20470): Terminated: ok {rc=0} 19:06:04.763194 --- ParallelTerminationStrategy: PID 20473 died... 19:06:04.783201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20473): Terminated: ok {rc=0} 19:06:04.829558 --- ParallelTerminationStrategy: PID 20476 died... 19:06:04.849491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20476): Terminated: ok {rc=0} 19:06:04.938921 bus /gobi_0: Setting Powered False 19:06:06.035552 bus /gobi_0: Setting Powered False 19:06:07.152454 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:06:08.406408 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:08.412267 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:06:08.445437 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:06:08.480049 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:06:08.532907 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:06:08.566375 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:06:08.600686 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:06:09.160906 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:06:09.167208 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.179299 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:06:09.253559 tst switch_tch_pdch.py: using LAC 35642 19:06:09.374783 tst switch_tch_pdch.py: using RAC 197 19:06:09.494775 tst switch_tch_pdch.py: using CellId 35642 19:06:09.614353 tst switch_tch_pdch.py: using BVCI 35643 19:06:09.725206 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.736314 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.747465 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.758291 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.769111 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.779927 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.790879 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:06:09.801762 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:06:09.917454 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:06:10.037577 tst switch_tch_pdch.py:51: start network... 19:06:10.254884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:10.726957 run create_hlr_db(pid=20482): Launched 19:06:10.849785 bus /gobi_6: Setting Powered False 19:06:11.914145 run create_hlr_db(pid=20482): Terminated: ok {rc=0} 19:06:12.318942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20484): Launched 19:06:12.619504 run osmo-hlr_10.42.42.2(pid=20485): Launched 19:06:12.733854 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:13.263374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20487): Launched 19:06:13.587324 run osmo-stp_10.42.42.5(pid=20488): Launched 19:06:13.709722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:06:14.236888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20490): Launched 19:06:14.359627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:06:14.631242 run patchelf(pid=20491): Launched 19:06:14.809360 run osmo-stp_10.42.42.5(pid=20488): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20488)] 19:06:14.945888 run osmo-stp_10.42.42.5(pid=20488): stdout: | (launched: 2022-12-13_19:06:13.528232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:15.083463 run osmo-stp_10.42.42.5(pid=20488): stderr: | 20221213190613717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190613717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190613717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190613718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190613718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190613718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190613718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:15.221334 run osmo-stp_10.42.42.5(pid=20488): stdout: | (launched: 2022-12-13_19:06:13.528232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:15.353350 run osmo-stp_10.42.42.5(pid=20488): stderr: | 20221213190613717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190613717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190613717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190613718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190613718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190613718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190613718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:15.509829 run patchelf(pid=20491): Terminating (SIGINT) 19:06:15.689461 run patchelf(pid=20491): Terminated: ok {rc=0} 19:06:15.819473 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20488): Process ended prematurely: osmo-stp_10.42.42.5(pid=20488) [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20488)] [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:06:15.829108 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 19:06:15.870857 run osmo-hlr_10.42.42.2(pid=20485): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20485)] 19:06:15.924059 run osmo-hlr_10.42.42.2(pid=20485): stdout: | (launched: 2022-12-13_19:06:12.564376) 19:06:15.978117 run osmo-hlr_10.42.42.2(pid=20485): stderr: | 20221213190612734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190612735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190612735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190612735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190612735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190612735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190612747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190612755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190612756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190612756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:16.032503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20484): Terminating (SIGTERM) 19:06:16.076066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20487): Terminating (SIGTERM) 19:06:16.121233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20490): Terminating (SIGTERM) 19:06:16.165221 --- ParallelTerminationStrategy: PID 20484 died... 19:06:16.186581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20484): Terminated: ok {rc=0} 19:06:16.234785 --- ParallelTerminationStrategy: PID 20487 died... 19:06:16.255929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20487): Terminated: ok {rc=0} 19:06:16.303728 --- ParallelTerminationStrategy: PID 20490 died... 19:06:16.325006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20490): Terminated: ok {rc=0} 19:06:16.415121 bus /gobi_0: Setting Powered False 19:06:17.515576 bus /gobi_0: Setting Powered False 19:06:18.633741 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:06:19.888243 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:19.892229 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:06:19.925848 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:06:19.933105 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:06:19.984363 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:06:20.018257 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:06:20.025516 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:06:20.566863 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:06:20.572721 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:06:20.584420 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:06:20.636343 tst mo_mt_sms.py: using LAC 35643 19:06:20.763549 tst mo_mt_sms.py: using RAC 198 19:06:20.889849 tst mo_mt_sms.py: using CellId 35643 19:06:21.016825 tst mo_mt_sms.py: using BVCI 35644 19:06:21.133428 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:06:21.249698 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:06:21.367925 tst mo_mt_sms.py:9: start nitb and bts... 19:06:21.586420 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:06:22.243339 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20495): Launched 19:06:22.566526 run osmo-nitb_10.42.42.2(pid=20496): Launched 19:06:22.746530 run osmo-nitb_10.42.42.2(pid=20496): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20496)] 19:06:22.891613 run osmo-nitb_10.42.42.2(pid=20496): stdout: | (launched: 2022-12-13_19:06:22.507960) 19:06:23.037571 run osmo-nitb_10.42.42.2(pid=20496): stderr: | (launched: 2022-12-13_19:06:22.555804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:06:23.183642 run osmo-nitb_10.42.42.2(pid=20496): stdout: | (launched: 2022-12-13_19:06:22.507960) 19:06:23.323732 run osmo-nitb_10.42.42.2(pid=20496): stderr: | (launched: 2022-12-13_19:06:22.555804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20496): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20496) [trial-2393↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20496)] 19:06:23.689510 tst osmo-nitb_10.42.42.2(pid=20496): stdout: | (launched: 2022-12-13_19:06:22.507960) 19:06:23.820108 tst osmo-nitb_10.42.42.2(pid=20496): stderr: | (launched: 2022-12-13_19:06:22.555804) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:06:23.975384 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20496): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20496) [trial-2393↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20496)] [trial-2393↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 19:06:23.984382 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 19:06:23.991523 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20495): Terminating (SIGTERM) 19:06:24.204078 --- ParallelTerminationStrategy: PID 20495 died... 19:06:24.225863 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20495): Terminated: ok {rc=0} 19:06:24.317791 bus /sierra_3: Setting Powered False 19:06:25.419551 bus /sierra_3: Setting Powered False 19:06:26.538998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:trx-sysmocell5000 --------------------------------------------------------------------- 19:06:27.741567 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:27.746009 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:06:27.780633 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:06:27.809013 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:06:27.864642 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:06:27.898891 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:06:27.925534 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:06:28.474722 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 19:06:28.480270 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:28.491732 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:06:28.544666 tst mo_mt_sms.py: using LAC 35644 19:06:28.672438 tst mo_mt_sms.py: using RAC 199 19:06:28.798400 tst mo_mt_sms.py: using CellId 35644 19:06:28.926763 tst mo_mt_sms.py: using BVCI 35645 19:06:29.045239 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:29.056404 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:29.067546 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:29.078671 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:29.090086 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:29.101542 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:06:29.217689 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:06:29.332334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:29.800850 run create_hlr_db(pid=20500): Launched 19:06:29.924860 bus /sierra_2: Setting Powered False 19:06:31.006426 run create_hlr_db(pid=20500): Terminated: ok {rc=0} 19:06:31.549772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Launched 19:06:31.881917 run osmo-hlr_10.42.42.2(pid=20503): Launched 19:06:32.124071 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:32.711660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Launched 19:06:33.013378 run osmo-stp_10.42.42.5(pid=20506): Launched 19:06:33.127551 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:33.706168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20508): Launched 19:06:34.031820 run osmo-msc_10.42.42.6(pid=20509): Launched 19:06:34.211731 run osmo-stp_10.42.42.5(pid=20506): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] 19:06:34.349255 run osmo-stp_10.42.42.5(pid=20506): stdout: | (launched: 2022-12-13_19:06:32.958005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:34.486572 run osmo-stp_10.42.42.5(pid=20506): stderr: | 20221213190633125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190633125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190633126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190633126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190633127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190633127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190633127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:34.622164 run osmo-stp_10.42.42.5(pid=20506): stdout: | (launched: 2022-12-13_19:06:32.958005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:34.751740 run osmo-stp_10.42.42.5(pid=20506): stderr: | 20221213190633125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190633125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190633126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190633126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190633127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190633127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190633127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:34.906833 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20506): Process ended prematurely: osmo-stp_10.42.42.5(pid=20506) [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 19:06:34.915886 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 19:06:34.943574 run osmo-hlr_10.42.42.2(pid=20503): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20503)] 19:06:34.995276 run osmo-hlr_10.42.42.2(pid=20503): stdout: | (launched: 2022-12-13_19:06:31.822691) 19:06:35.048353 run osmo-hlr_10.42.42.2(pid=20503): stderr: | 20221213190632128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190632128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190632128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190632128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190632128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190632128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190632145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190632154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190632154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190632154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:35.121282 run osmo-msc_10.42.42.6(pid=20509): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20509)] 19:06:35.171520 run osmo-msc_10.42.42.6(pid=20509): stdout: | (launched: 2022-12-13_19:06:33.972709) 19:06:35.224142 run osmo-msc_10.42.42.6(pid=20509): stderr: | 20221213190634292 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190634292 DLGLOBAL DEBUG validating counter group 0x7f36847f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190634292 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190634292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190634292 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190634292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190634294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190634295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190634295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190634295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:35.276911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Terminating (SIGTERM) 19:06:35.319307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Terminating (SIGTERM) 19:06:35.361884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20508): Terminating (SIGTERM) 19:06:35.404579 --- ParallelTerminationStrategy: PID 20502 died... 19:06:35.425454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20502): Terminated: ok {rc=0} 19:06:35.472805 --- ParallelTerminationStrategy: PID 20505 died... 19:06:35.493275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20505): Terminated: ok {rc=0} 19:06:35.540096 --- ParallelTerminationStrategy: PID 20508 died... 19:06:35.560502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20508): Terminated: ok {rc=0} 19:06:35.650138 bus /sierra_3: Setting Powered False 19:06:36.748833 bus /sierra_3: Setting Powered False 19:06:37.866428 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:06:39.104113 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:39.108399 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:06:39.143305 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 19:06:39.152044 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:06:39.191087 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:06:39.225428 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 19:06:39.232387 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:06:39.750930 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:06:39.757217 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 19:06:39.769252 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:06:39.821326 tst assert_extension.py: using LAC 35645 19:06:39.948036 tst assert_extension.py: using RAC 200 19:06:40.074351 tst assert_extension.py: using CellId 35645 19:06:40.199295 tst assert_extension.py: using BVCI 35646 19:06:40.316675 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:06:40.431729 tst assert_extension.py:10: start nitb and bts... 19:06:40.632346 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:06:41.246814 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20515): Launched 19:06:41.546865 run osmo-nitb_10.42.42.2(pid=20516): Launched 19:06:41.714326 run osmo-nitb_10.42.42.2(pid=20516): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20516)] 19:06:41.849480 run osmo-nitb_10.42.42.2(pid=20516): stdout: | (launched: 2022-12-13_19:06:41.491886) 19:06:41.987445 run osmo-nitb_10.42.42.2(pid=20516): stderr: | (launched: 2022-12-13_19:06:41.536473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:06:42.124196 run osmo-nitb_10.42.42.2(pid=20516): stdout: | (launched: 2022-12-13_19:06:41.491886) 19:06:42.255181 run osmo-nitb_10.42.42.2(pid=20516): stderr: | (launched: 2022-12-13_19:06:41.536473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20516): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20516) [trial-2393↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20516)] 19:06:42.661565 tst osmo-nitb_10.42.42.2(pid=20516): stdout: | (launched: 2022-12-13_19:06:41.491886) 19:06:42.784124 tst osmo-nitb_10.42.42.2(pid=20516): stderr: | (launched: 2022-12-13_19:06:41.536473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:06:42.928710 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20516): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20516) [trial-2393↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20516)] [trial-2393↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 19:06:42.937484 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:06:42.944260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20515): Terminating (SIGTERM) 19:06:43.153649 --- ParallelTerminationStrategy: PID 20515 died... 19:06:43.174920 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20515): Terminated: ok {rc=0} 19:06:43.262677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 19:06:44.445609 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:44.450417 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:06:44.486796 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:06:44.514774 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 19:06:44.551238 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:06:44.586742 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:06:44.614553 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 19:06:45.146676 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 19:06:45.152193 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.163717 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:06:45.217371 tst assert_extension.py: using LAC 35646 19:06:45.345389 tst assert_extension.py: using RAC 201 19:06:45.472000 tst assert_extension.py: using CellId 35646 19:06:45.597888 tst assert_extension.py: using BVCI 35647 19:06:45.717337 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.728661 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.739844 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.751077 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.763159 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:06:45.775260 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 19:06:45.912308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:46.424016 run create_hlr_db(pid=20520): Launched 19:06:46.601733 bus /sierra_2: Setting Powered False 19:06:47.661928 run create_hlr_db(pid=20520): Terminated: ok {rc=0} 19:06:48.166316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20522): Launched 19:06:48.489406 run osmo-hlr_10.42.42.2(pid=20523): Launched 19:06:48.612860 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:49.260785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Launched 19:06:49.579660 run osmo-stp_10.42.42.5(pid=20526): Launched 19:06:49.700673 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:50.273970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Launched 19:06:50.590436 run osmo-msc_10.42.42.6(pid=20529): Launched 19:06:50.766112 run osmo-stp_10.42.42.5(pid=20526): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] 19:06:50.900514 run osmo-stp_10.42.42.5(pid=20526): stdout: | (launched: 2022-12-13_19:06:49.521341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:51.035333 run osmo-stp_10.42.42.5(pid=20526): stderr: | 20221213190649709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190649709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190649709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190649709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190649710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190649710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190649710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:51.169598 run osmo-stp_10.42.42.5(pid=20526): stdout: | (launched: 2022-12-13_19:06:49.521341) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:51.296732 run osmo-stp_10.42.42.5(pid=20526): stderr: | 20221213190649709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190649709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190649709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190649709 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190649710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190649710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190649710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:51.448749 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20526): Process ended prematurely: osmo-stp_10.42.42.5(pid=20526) [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py:17] 19:06:51.457924 tst assert_extension.py:17: Test FAILED (6.3 sec) 19:06:51.485170 run osmo-hlr_10.42.42.2(pid=20523): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20523)] 19:06:51.536377 run osmo-hlr_10.42.42.2(pid=20523): stdout: | (launched: 2022-12-13_19:06:48.430675) 19:06:51.589461 run osmo-hlr_10.42.42.2(pid=20523): stderr: | 20221213190648625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190648625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190648625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190648625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190648625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190648625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190648638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190648646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190648646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190648646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:51.662511 run osmo-msc_10.42.42.6(pid=20529): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20529)] 19:06:51.712773 run osmo-msc_10.42.42.6(pid=20529): stdout: | (launched: 2022-12-13_19:06:50.532208) 19:06:51.765261 run osmo-msc_10.42.42.6(pid=20529): stderr: | 20221213190650849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190650849 DLGLOBAL DEBUG validating counter group 0x7fb95a933c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190650849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190650849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190650849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190650850 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190650851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190650852 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190650852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190650852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:51.818124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20522): Terminating (SIGTERM) 19:06:51.860134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Terminating (SIGTERM) 19:06:51.903541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Terminating (SIGTERM) 19:06:51.946780 --- ParallelTerminationStrategy: PID 20522 died... 19:06:51.967651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20522): Terminated: ok {rc=0} 19:06:52.014623 --- ParallelTerminationStrategy: PID 20525 died... 19:06:52.034527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20525): Terminated: ok {rc=0} 19:06:52.081483 --- ParallelTerminationStrategy: PID 20528 died... 19:06:52.101451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20528): Terminated: ok {rc=0} 19:06:52.190271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:06:53.400595 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:53.407470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:06:53.442183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:06:53.469318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:06:53.521142 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:06:53.555115 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:06:53.582396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:06:54.137385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:06:54.191362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.203308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:06:54.275599 tst mo_mt_call.py: using LAC 35647 19:06:54.405818 tst mo_mt_call.py: using RAC 202 19:06:54.532692 tst mo_mt_call.py: using CellId 35647 19:06:54.650460 tst mo_mt_call.py: using BVCI 35648 19:06:54.761277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.772581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.783916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.795215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.806580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:06:54.817644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:06:54.937861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:06:55.053783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:55.523338 run create_hlr_db(pid=20534): Launched 19:06:55.647091 bus /sierra_2: Setting Powered False 19:06:56.706820 run create_hlr_db(pid=20534): Terminated: ok {rc=0} 19:06:57.150244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Launched 19:06:57.473979 run osmo-hlr_10.42.42.2(pid=20537): Launched 19:06:57.599389 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:58.157713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Launched 19:06:58.484416 run osmo-stp_10.42.42.5(pid=20540): Launched 19:06:58.607457 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:59.197146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Launched 19:06:59.521015 run osmo-msc_10.42.42.6(pid=20543): Launched 19:06:59.703740 run osmo-stp_10.42.42.5(pid=20540): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] 19:06:59.841255 run osmo-stp_10.42.42.5(pid=20540): stdout: | (launched: 2022-12-13_19:06:58.423572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:59.979073 run osmo-stp_10.42.42.5(pid=20540): stderr: | 20221213190658613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190658614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190658614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190658614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190658615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190658615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190658615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:00.115224 run osmo-stp_10.42.42.5(pid=20540): stdout: | (launched: 2022-12-13_19:06:58.423572) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:00.245769 run osmo-stp_10.42.42.5(pid=20540): stderr: | 20221213190658613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190658614 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190658614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190658614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190658615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190658615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190658615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:00.401621 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20540): Process ended prematurely: osmo-stp_10.42.42.5(pid=20540) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:07:00.411268 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:07:00.439155 run osmo-hlr_10.42.42.2(pid=20537): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20537)] 19:07:00.490562 run osmo-hlr_10.42.42.2(pid=20537): stdout: | (launched: 2022-12-13_19:06:57.415452) 19:07:00.543268 run osmo-hlr_10.42.42.2(pid=20537): stderr: | 20221213190657610 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190657610 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190657610 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190657610 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190657610 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190657610 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190657629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190657638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190657638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190657638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:00.616376 run osmo-msc_10.42.42.6(pid=20543): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20543)] 19:07:00.666864 run osmo-msc_10.42.42.6(pid=20543): stdout: | (launched: 2022-12-13_19:06:59.462128) 19:07:00.719336 run osmo-msc_10.42.42.6(pid=20543): stderr: | 20221213190659779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190659779 DLGLOBAL DEBUG validating counter group 0x7fe9704b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190659779 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190659779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190659779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190659780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190659781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190659782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190659782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190659782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:00.772198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Terminating (SIGTERM) 19:07:00.814208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Terminating (SIGTERM) 19:07:00.861413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Terminating (SIGTERM) 19:07:00.909892 --- ParallelTerminationStrategy: PID 20536 died... 19:07:00.930593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20536): Terminated: ok {rc=0} 19:07:00.979664 --- ParallelTerminationStrategy: PID 20539 died... 19:07:01.000566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20539): Terminated: ok {rc=0} 19:07:01.048098 --- ParallelTerminationStrategy: PID 20542 died... 19:07:01.068890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20542): Terminated: ok {rc=0} 19:07:01.164293 bus /sierra_3: Setting Powered False 19:07:02.271271 bus /sierra_3: Setting Powered False 19:07:03.392657 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:07:04.541306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:04.553890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:07:04.625963 tst mo_mt_call_osmux.py: using LAC 35648 19:07:04.753846 tst mo_mt_call_osmux.py: using RAC 203 19:07:04.878910 tst mo_mt_call_osmux.py: using CellId 35648 19:07:05.005387 tst mo_mt_call_osmux.py: using BVCI 35649 19:07:05.124872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:05.136768 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:05.148471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:05.160235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:05.172224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:07:05.184142 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:07:05.299733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:07:05.421783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:05.925230 run create_hlr_db(pid=20545): Launched 19:07:06.048460 bus /sierra_2: Setting Powered False 19:07:07.112315 run create_hlr_db(pid=20545): Terminated: ok {rc=0} 19:07:07.564231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Launched 19:07:07.888316 run osmo-hlr_10.42.42.2(pid=20548): Launched 19:07:08.012848 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:08.572940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Launched 19:07:08.899108 run osmo-stp_10.42.42.5(pid=20551): Launched 19:07:09.023398 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:09.610284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Launched 19:07:09.933509 run osmo-msc_10.42.42.6(pid=20554): Launched 19:07:10.116329 run osmo-stp_10.42.42.5(pid=20551): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] 19:07:10.253408 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-13_19:07:08.839624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:10.390909 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221213190709027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190709028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190709028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190709028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190709029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190709029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190709029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:10.526254 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-13_19:07:08.839624) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:10.656023 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221213190709027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190709028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190709028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190709028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190709029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190709029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190709029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:10.810499 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:07:10.820074 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:07:10.847754 run osmo-hlr_10.42.42.2(pid=20548): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20548)] 19:07:10.899048 run osmo-hlr_10.42.42.2(pid=20548): stdout: | (launched: 2022-12-13_19:07:07.829589) 19:07:10.951619 run osmo-hlr_10.42.42.2(pid=20548): stderr: | 20221213190708024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190708024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190708024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190708024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190708024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190708024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190708036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190708045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190708045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190708045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:11.024354 run osmo-msc_10.42.42.6(pid=20554): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20554)] 19:07:11.074499 run osmo-msc_10.42.42.6(pid=20554): stdout: | (launched: 2022-12-13_19:07:09.874428) 19:07:11.126876 run osmo-msc_10.42.42.6(pid=20554): stderr: | 20221213190710193 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190710193 DLGLOBAL DEBUG validating counter group 0x7f6c58515c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190710193 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190710193 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190710193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190710194 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190710195 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190710196 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190710196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190710196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:11.179484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminating (SIGTERM) 19:07:11.221470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminating (SIGTERM) 19:07:11.263798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Terminating (SIGTERM) 19:07:11.306405 --- ParallelTerminationStrategy: PID 20547 died... 19:07:11.326857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminated: ok {rc=0} 19:07:11.373683 --- ParallelTerminationStrategy: PID 20550 died... 19:07:11.393586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminated: ok {rc=0} 19:07:11.440065 --- ParallelTerminationStrategy: PID 20553 died... 19:07:11.459974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20553): Terminated: ok {rc=0} 19:07:11.548890 bus /sierra_3: Setting Powered False 19:07:12.648116 bus /sierra_3: Setting Powered False 19:07:13.764355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:07:15.024828 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:15.033650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:07:15.069473 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:07:15.097503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:07:15.149215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:07:15.184103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:07:15.212503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:07:15.770942 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:07:15.823897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:15.836301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:07:15.913525 tst mo_mt_call.py: using LAC 35649 19:07:16.061243 tst mo_mt_call.py: using RAC 204 19:07:16.217403 tst mo_mt_call.py: using CellId 35649 19:07:16.345888 tst mo_mt_call.py: using BVCI 35650 19:07:16.466913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:16.479799 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:16.492593 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:16.505388 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:16.519191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:16.532525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:07:16.680218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:07:16.819259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:17.358403 run create_hlr_db(pid=20559): Launched 19:07:17.482449 bus /sierra_2: Setting Powered False 19:07:18.546301 run create_hlr_db(pid=20559): Terminated: ok {rc=0} 19:07:18.980392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20561): Launched 19:07:19.284292 run osmo-hlr_10.42.42.2(pid=20562): Launched 19:07:19.399425 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:19.925687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20564): Launched 19:07:20.228431 run osmo-stp_10.42.42.5(pid=20565): Launched 19:07:20.344342 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:20.895098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20567): Launched 19:07:21.197506 run osmo-msc_10.42.42.6(pid=20568): Launched 19:07:21.366232 run osmo-stp_10.42.42.5(pid=20565): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20565)] 19:07:21.494390 run osmo-stp_10.42.42.5(pid=20565): stdout: | (launched: 2022-12-13_19:07:20.172637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:21.622704 run osmo-stp_10.42.42.5(pid=20565): stderr: | 20221213190720339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190720339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190720339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190720340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190720340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190720340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190720341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:21.748734 run osmo-stp_10.42.42.5(pid=20565): stdout: | (launched: 2022-12-13_19:07:20.172637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:21.869481 run osmo-stp_10.42.42.5(pid=20565): stderr: | 20221213190720339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190720339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190720339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190720340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190720340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190720340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190720341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:22.014161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20565): Process ended prematurely: osmo-stp_10.42.42.5(pid=20565) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20565)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:07:22.023296 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:07:22.049679 run osmo-hlr_10.42.42.2(pid=20562): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20562)] 19:07:22.097957 run osmo-hlr_10.42.42.2(pid=20562): stdout: | (launched: 2022-12-13_19:07:19.228845) 19:07:22.147459 run osmo-hlr_10.42.42.2(pid=20562): stderr: | 20221213190719401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190719402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190719402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190719402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190719402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190719402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190719414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190719422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190719422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190719422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:22.216647 run osmo-msc_10.42.42.6(pid=20568): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20568)] 19:07:22.264738 run osmo-msc_10.42.42.6(pid=20568): stdout: | (launched: 2022-12-13_19:07:21.141976) 19:07:22.314815 run osmo-msc_10.42.42.6(pid=20568): stderr: | 20221213190721409 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190721409 DLGLOBAL DEBUG validating counter group 0x7f0b31b25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190721409 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190721409 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190721409 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190721410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190721412 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190721413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190721413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190721413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:22.364714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20561): Terminating (SIGTERM) 19:07:22.404293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20564): Terminating (SIGTERM) 19:07:22.443851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20567): Terminating (SIGTERM) 19:07:22.483604 --- ParallelTerminationStrategy: PID 20561 died... 19:07:22.502891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20561): Terminated: ok {rc=0} 19:07:22.546814 --- ParallelTerminationStrategy: PID 20564 died... 19:07:22.565329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20564): Terminated: ok {rc=0} 19:07:22.609012 --- ParallelTerminationStrategy: PID 20567 died... 19:07:22.627741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20567): Terminated: ok {rc=0} 19:07:22.713993 bus /sierra_3: Setting Powered False 19:07:23.815523 bus /sierra_3: Setting Powered False 19:07:24.932075 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:07:26.082135 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.094836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:07:26.168404 tst mo_mt_call_osmux.py: using LAC 35650 19:07:26.297180 tst mo_mt_call_osmux.py: using RAC 205 19:07:26.424902 tst mo_mt_call_osmux.py: using CellId 35650 19:07:26.552801 tst mo_mt_call_osmux.py: using BVCI 35651 19:07:26.663651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.675394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.686651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.697989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.709491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:07:26.721172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:07:26.840903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:07:26.959634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:27.429131 run create_hlr_db(pid=20570): Launched 19:07:27.553209 bus /sierra_2: Setting Powered False 19:07:28.613641 run create_hlr_db(pid=20570): Terminated: ok {rc=0} 19:07:29.037746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20572): Launched 19:07:29.341049 run osmo-hlr_10.42.42.2(pid=20573): Launched 19:07:29.455578 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:29.976303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20575): Launched 19:07:30.279830 run osmo-stp_10.42.42.5(pid=20576): Launched 19:07:30.396037 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:30.965805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20578): Launched 19:07:31.315878 run osmo-msc_10.42.42.6(pid=20579): Launched 19:07:31.683981 run osmo-stp_10.42.42.5(pid=20576): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20576)] 19:07:31.894519 run osmo-stp_10.42.42.5(pid=20576): stdout: | (launched: 2022-12-13_19:07:30.224231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:32.040498 run osmo-stp_10.42.42.5(pid=20576): stderr: | 20221213190730391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190730391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190730391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190730392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190730392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190730392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190730392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:32.285081 run osmo-stp_10.42.42.5(pid=20576): stdout: | (launched: 2022-12-13_19:07:30.224231) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:32.418044 run osmo-stp_10.42.42.5(pid=20576): stderr: | 20221213190730391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190730391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190730391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190730392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190730392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190730392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190730392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:32.575250 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20576): Process ended prematurely: osmo-stp_10.42.42.5(pid=20576) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20576)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:07:32.585345 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:07:32.613339 run osmo-hlr_10.42.42.2(pid=20573): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20573)] 19:07:32.665521 run osmo-hlr_10.42.42.2(pid=20573): stdout: | (launched: 2022-12-13_19:07:29.285176) 19:07:32.718490 run osmo-hlr_10.42.42.2(pid=20573): stderr: | 20221213190729460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190729460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190729460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190729460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190729460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190729460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190729473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190729481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190729482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190729482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:32.792142 run osmo-msc_10.42.42.6(pid=20579): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20579)] 19:07:32.842949 run osmo-msc_10.42.42.6(pid=20579): stdout: | (launched: 2022-12-13_19:07:31.253043) 19:07:32.896105 run osmo-msc_10.42.42.6(pid=20579): stderr: | 20221213190731888 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190731888 DLGLOBAL DEBUG validating counter group 0x7f5e70d71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190731888 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190731897 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190731897 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190731897 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190731899 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190731899 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190731900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190731900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:32.949741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20572): Terminating (SIGTERM) 19:07:32.992288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20575): Terminating (SIGTERM) 19:07:33.035150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20578): Terminating (SIGTERM) 19:07:33.078587 --- ParallelTerminationStrategy: PID 20572 died... 19:07:33.099216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20572): Terminated: ok {rc=0} 19:07:33.146519 --- ParallelTerminationStrategy: PID 20575 died... 19:07:33.166965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20575): Terminated: ok {rc=0} 19:07:33.213927 --- ParallelTerminationStrategy: PID 20578 died... 19:07:33.234246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20578): Terminated: ok {rc=0} 19:07:33.323682 bus /sierra_3: Setting Powered False 19:07:34.422008 bus /sierra_3: Setting Powered False 19:07:35.538201 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:07:36.792646 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:36.801896 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:07:36.837984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:07:36.866346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:07:36.919349 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:07:36.953140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:07:36.980059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:07:37.533382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:07:37.582478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:37.594057 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:07:37.663070 tst mo_mt_call.py: using LAC 35651 19:07:37.780452 tst mo_mt_call.py: using RAC 206 19:07:37.898404 tst mo_mt_call.py: using CellId 35651 19:07:38.015688 tst mo_mt_call.py: using BVCI 35652 19:07:38.125520 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:38.136844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:38.147950 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:38.158983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:38.170132 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:38.181239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:07:38.300819 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:07:38.418504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:38.891169 run create_hlr_db(pid=20584): Launched 19:07:39.015713 bus /sierra_2: Setting Powered False 19:07:40.076036 run create_hlr_db(pid=20584): Terminated: ok {rc=0} 19:07:40.522697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Launched 19:07:40.847466 run osmo-hlr_10.42.42.2(pid=20587): Launched 19:07:40.972365 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:41.534516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Launched 19:07:41.861543 run osmo-stp_10.42.42.5(pid=20590): Launched 19:07:41.987508 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:42.575500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20592): Launched 19:07:42.902622 run osmo-msc_10.42.42.6(pid=20593): Launched 19:07:43.087203 run osmo-stp_10.42.42.5(pid=20590): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] 19:07:43.225829 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-13_19:07:41.802554) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:43.363960 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221213190741990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190741991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190741991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190741991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190741992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190741992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190741992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:43.500825 run osmo-stp_10.42.42.5(pid=20590): stdout: | (launched: 2022-12-13_19:07:41.802554) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:43.631790 run osmo-stp_10.42.42.5(pid=20590): stderr: | 20221213190741990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190741991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190741991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190741991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190741992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190741992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190741992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:43.788826 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:07:43.798712 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:07:43.826527 run osmo-hlr_10.42.42.2(pid=20587): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20587)] 19:07:43.877855 run osmo-hlr_10.42.42.2(pid=20587): stdout: | (launched: 2022-12-13_19:07:40.788549) 19:07:43.931040 run osmo-hlr_10.42.42.2(pid=20587): stderr: | 20221213190740981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190740981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190740981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190740981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190740981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190740982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190740994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190741006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190741006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190741006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:44.004093 run osmo-msc_10.42.42.6(pid=20593): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20593)] 19:07:44.054343 run osmo-msc_10.42.42.6(pid=20593): stdout: | (launched: 2022-12-13_19:07:42.843426) 19:07:44.107250 run osmo-msc_10.42.42.6(pid=20593): stderr: | 20221213190743162 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190743162 DLGLOBAL DEBUG validating counter group 0x7f4b22ac0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190743162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190743162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190743162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190743162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190743164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190743164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190743164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190743164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:44.159514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminating (SIGTERM) 19:07:44.201500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminating (SIGTERM) 19:07:44.244172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20592): Terminating (SIGTERM) 19:07:44.287453 --- ParallelTerminationStrategy: PID 20586 died... 19:07:44.308182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20586): Terminated: ok {rc=0} 19:07:44.355263 --- ParallelTerminationStrategy: PID 20589 died... 19:07:44.375447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20589): Terminated: ok {rc=0} 19:07:44.422150 --- ParallelTerminationStrategy: PID 20592 died... 19:07:44.442427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20592): Terminated: ok {rc=0} 19:07:44.531026 bus /sierra_3: Setting Powered False 19:07:45.628090 bus /sierra_3: Setting Powered False 19:07:46.745695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:07:47.899362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:47.912054 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:07:47.986286 tst mo_mt_call_osmux.py: using LAC 35652 19:07:48.114696 tst mo_mt_call_osmux.py: using RAC 207 19:07:48.242122 tst mo_mt_call_osmux.py: using CellId 35652 19:07:48.368788 tst mo_mt_call_osmux.py: using BVCI 35653 19:07:48.487044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:48.499106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:48.510962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:48.523095 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:48.535552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:07:48.547810 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:07:48.665323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:07:48.787136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:07:49.296057 run create_hlr_db(pid=20595): Launched 19:07:49.420397 bus /sierra_2: Setting Powered False 19:07:50.485508 run create_hlr_db(pid=20595): Terminated: ok {rc=0} 19:07:50.921626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Launched 19:07:51.225219 run osmo-hlr_10.42.42.2(pid=20598): Launched 19:07:51.340675 run osmo-stp_10.42.42.5: Starting osmo-stp 19:07:51.879120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Launched 19:07:52.183596 run osmo-stp_10.42.42.5(pid=20601): Launched 19:07:52.299158 run osmo-msc_10.42.42.6: Starting osmo-msc 19:07:52.849519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20603): Launched 19:07:53.153836 run osmo-msc_10.42.42.6(pid=20604): Launched 19:07:53.324821 run osmo-stp_10.42.42.5(pid=20601): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] 19:07:53.454973 run osmo-stp_10.42.42.5(pid=20601): stdout: | (launched: 2022-12-13_19:07:52.128214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:53.584280 run osmo-stp_10.42.42.5(pid=20601): stderr: | 20221213190752295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190752295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190752296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190752296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190752297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190752297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190752297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:53.711583 run osmo-stp_10.42.42.5(pid=20601): stdout: | (launched: 2022-12-13_19:07:52.128214) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:07:53.833240 run osmo-stp_10.42.42.5(pid=20601): stderr: | 20221213190752295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190752295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190752296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190752296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190752297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190752297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190752297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:07:53.979531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20601): Process ended prematurely: osmo-stp_10.42.42.5(pid=20601) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:07:53.988445 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:07:54.014792 run osmo-hlr_10.42.42.2(pid=20598): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20598)] 19:07:54.064288 run osmo-hlr_10.42.42.2(pid=20598): stdout: | (launched: 2022-12-13_19:07:51.169782) 19:07:54.114934 run osmo-hlr_10.42.42.2(pid=20598): stderr: | 20221213190751341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190751341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190751341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190751341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190751342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190751342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190751354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190751362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190751363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190751363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:07:54.185576 run osmo-msc_10.42.42.6(pid=20604): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20604)] 19:07:54.233339 run osmo-msc_10.42.42.6(pid=20604): stdout: | (launched: 2022-12-13_19:07:53.098219) 19:07:54.283166 run osmo-msc_10.42.42.6(pid=20604): stderr: | 20221213190753366 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190753366 DLGLOBAL DEBUG validating counter group 0x7f32fde93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190753366 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190753366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190753366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190753367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190753368 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190753369 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190753369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190753369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:07:54.333600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Terminating (SIGTERM) 19:07:54.374004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Terminating (SIGTERM) 19:07:54.414193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20603): Terminating (SIGTERM) 19:07:54.454713 --- ParallelTerminationStrategy: PID 20597 died... 19:07:54.474410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20597): Terminated: ok {rc=0} 19:07:54.518743 --- ParallelTerminationStrategy: PID 20600 died... 19:07:54.538131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20600): Terminated: ok {rc=0} 19:07:54.583010 --- ParallelTerminationStrategy: PID 20603 died... 19:07:54.602150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20603): Terminated: ok {rc=0} 19:07:54.689146 bus /sierra_3: Setting Powered False 19:07:55.788571 bus /sierra_3: Setting Powered False 19:07:56.904815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:07:58.156860 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:07:58.163471 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:07:58.197121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:07:58.224218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:07:58.276494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:07:58.310660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:07:58.337428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:07:58.897417 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:07:58.950776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:58.962678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:07:59.035039 tst mo_mt_call.py: using LAC 35653 19:07:59.162276 tst mo_mt_call.py: using RAC 208 19:07:59.289053 tst mo_mt_call.py: using CellId 35653 19:07:59.415428 tst mo_mt_call.py: using BVCI 35654 19:07:59.526426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:59.537922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:59.549205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:59.560392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:59.571870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:07:59.583234 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:07:59.703666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:07:59.821013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:00.292116 run create_hlr_db(pid=20609): Launched 19:08:00.414981 bus /sierra_2: Setting Powered False 19:08:01.493219 run create_hlr_db(pid=20609): Terminated: ok {rc=0} 19:08:01.977621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20611): Launched 19:08:02.320346 run osmo-hlr_10.42.42.2(pid=20612): Launched 19:08:02.445411 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:03.005661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20614): Launched 19:08:03.331360 run osmo-stp_10.42.42.5(pid=20615): Launched 19:08:03.455205 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:04.044803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20617): Launched 19:08:04.371581 run osmo-msc_10.42.42.6(pid=20618): Launched 19:08:04.553110 run osmo-stp_10.42.42.5(pid=20615): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20615)] 19:08:04.690865 run osmo-stp_10.42.42.5(pid=20615): stdout: | (launched: 2022-12-13_19:08:03.272320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:04.828932 run osmo-stp_10.42.42.5(pid=20615): stderr: | 20221213190803460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190803460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190803460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190803460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190803461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190803461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190803461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:04.966160 run osmo-stp_10.42.42.5(pid=20615): stdout: | (launched: 2022-12-13_19:08:03.272320) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:05.097882 run osmo-stp_10.42.42.5(pid=20615): stderr: | 20221213190803460 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190803460 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190803460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190803460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190803461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190803461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190803461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:05.254534 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20615): Process ended prematurely: osmo-stp_10.42.42.5(pid=20615) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20615)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:08:05.264307 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:08:05.291978 run osmo-hlr_10.42.42.2(pid=20612): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20612)] 19:08:05.343495 run osmo-hlr_10.42.42.2(pid=20612): stdout: | (launched: 2022-12-13_19:08:02.260677) 19:08:05.395691 run osmo-hlr_10.42.42.2(pid=20612): stderr: | 20221213190802454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190802454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190802454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190802454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190802454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190802454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190802467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190802478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190802478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190802478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:05.468597 run osmo-msc_10.42.42.6(pid=20618): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20618)] 19:08:05.518816 run osmo-msc_10.42.42.6(pid=20618): stdout: | (launched: 2022-12-13_19:08:04.311629) 19:08:05.571664 run osmo-msc_10.42.42.6(pid=20618): stderr: | 20221213190804631 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190804631 DLGLOBAL DEBUG validating counter group 0x7f764adcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190804631 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190804631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190804632 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190804632 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190804634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190804634 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190804634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190804634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:05.623950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20611): Terminating (SIGTERM) 19:08:05.666064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20614): Terminating (SIGTERM) 19:08:05.708541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20617): Terminating (SIGTERM) 19:08:05.751305 --- ParallelTerminationStrategy: PID 20611 died... 19:08:05.771995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20611): Terminated: ok {rc=0} 19:08:05.818825 --- ParallelTerminationStrategy: PID 20614 died... 19:08:05.838840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20614): Terminated: ok {rc=0} 19:08:05.885360 --- ParallelTerminationStrategy: PID 20617 died... 19:08:05.905189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20617): Terminated: ok {rc=0} 19:08:05.993586 bus /sierra_3: Setting Powered False 19:08:07.093233 bus /sierra_3: Setting Powered False 19:08:08.208807 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:08:09.363414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:09.376033 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:08:09.449285 tst mo_mt_call_osmux.py: using LAC 35654 19:08:09.578716 tst mo_mt_call_osmux.py: using RAC 209 19:08:09.708141 tst mo_mt_call_osmux.py: using CellId 35654 19:08:09.834658 tst mo_mt_call_osmux.py: using BVCI 35655 19:08:09.953452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:09.965264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:09.976861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:09.988565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:10.000763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:08:10.012894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:08:10.133600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:08:10.251198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:10.723780 run create_hlr_db(pid=20620): Launched 19:08:10.847977 bus /sierra_2: Setting Powered False 19:08:11.909360 run create_hlr_db(pid=20620): Terminated: ok {rc=0} 19:08:12.333411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20622): Launched 19:08:12.638311 run osmo-hlr_10.42.42.2(pid=20623): Launched 19:08:12.756574 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:13.284021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Launched 19:08:13.588610 run osmo-stp_10.42.42.5(pid=20626): Launched 19:08:13.704157 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:14.254174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20628): Launched 19:08:14.559436 run osmo-msc_10.42.42.6(pid=20629): Launched 19:08:14.730651 run osmo-stp_10.42.42.5(pid=20626): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] 19:08:14.858823 run osmo-stp_10.42.42.5(pid=20626): stdout: | (launched: 2022-12-13_19:08:13.532540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:14.987109 run osmo-stp_10.42.42.5(pid=20626): stderr: | 20221213190813700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190813701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190813701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190813701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190813702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190813702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190813702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:15.113357 run osmo-stp_10.42.42.5(pid=20626): stdout: | (launched: 2022-12-13_19:08:13.532540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:15.235193 run osmo-stp_10.42.42.5(pid=20626): stderr: | 20221213190813700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190813701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190813701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190813701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190813702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190813702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190813702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:15.380268 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20626): Process ended prematurely: osmo-stp_10.42.42.5(pid=20626) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:08:15.389404 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:08:15.415977 run osmo-hlr_10.42.42.2(pid=20623): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20623)] 19:08:15.463934 run osmo-hlr_10.42.42.2(pid=20623): stdout: | (launched: 2022-12-13_19:08:12.582066) 19:08:15.513561 run osmo-hlr_10.42.42.2(pid=20623): stderr: | 20221213190812757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190812757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190812758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190812758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190812758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190812758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190812770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190812778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190812778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190812778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:15.582588 run osmo-msc_10.42.42.6(pid=20629): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20629)] 19:08:15.630422 run osmo-msc_10.42.42.6(pid=20629): stdout: | (launched: 2022-12-13_19:08:14.502873) 19:08:15.679798 run osmo-msc_10.42.42.6(pid=20629): stderr: | 20221213190814773 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190814773 DLGLOBAL DEBUG validating counter group 0x7fa8158aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190814773 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190814773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190814773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190814773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190814775 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190814775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190814775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190814776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:15.729615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20622): Terminating (SIGTERM) 19:08:15.769251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Terminating (SIGTERM) 19:08:15.808887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20628): Terminating (SIGTERM) 19:08:15.875279 --- ParallelTerminationStrategy: PID 20622 died... 19:08:15.899055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20622): Terminated: ok {rc=0} 19:08:15.951178 --- ParallelTerminationStrategy: PID 20625 died... 19:08:15.971900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Terminated: ok {rc=0} 19:08:16.022898 --- ParallelTerminationStrategy: PID 20628 died... 19:08:16.044937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20628): Terminated: ok {rc=0} 19:08:16.138213 bus /sierra_3: Setting Powered False 19:08:17.238366 bus /sierra_3: Setting Powered False 19:08:18.357376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:08:19.613496 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:08:19.620528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:08:19.656631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:08:19.684897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:08:19.738831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:08:19.774102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:08:19.802494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:08:20.354073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:08:20.407211 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:20.419240 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:08:20.491725 tst mo_mt_call.py: using LAC 35655 19:08:20.619422 tst mo_mt_call.py: using RAC 210 19:08:20.738310 tst mo_mt_call.py: using CellId 35655 19:08:20.860351 tst mo_mt_call.py: using BVCI 35656 19:08:20.971583 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:20.982982 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:20.994290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:21.005379 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:21.016529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:21.027657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:08:21.147313 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:08:21.264549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:21.737143 run create_hlr_db(pid=20634): Launched 19:08:21.861788 bus /sierra_2: Setting Powered False 19:08:22.922465 run create_hlr_db(pid=20634): Terminated: ok {rc=0} 19:08:23.347672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Launched 19:08:23.652457 run osmo-hlr_10.42.42.2(pid=20637): Launched 19:08:23.768531 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:24.310719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Launched 19:08:24.615941 run osmo-stp_10.42.42.5(pid=20640): Launched 19:08:24.742400 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:25.335746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Launched 19:08:25.663804 run osmo-msc_10.42.42.6(pid=20643): Launched 19:08:25.846010 run osmo-stp_10.42.42.5(pid=20640): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] 19:08:25.984209 run osmo-stp_10.42.42.5(pid=20640): stdout: | (launched: 2022-12-13_19:08:24.559185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:26.123876 run osmo-stp_10.42.42.5(pid=20640): stderr: | 20221213190824743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190824743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190824743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190824744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190824744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190824744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190824744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:26.260896 run osmo-stp_10.42.42.5(pid=20640): stdout: | (launched: 2022-12-13_19:08:24.559185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:26.392187 run osmo-stp_10.42.42.5(pid=20640): stderr: | 20221213190824743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190824743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190824743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190824744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190824744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190824744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190824744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:26.549045 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20640): Process ended prematurely: osmo-stp_10.42.42.5(pid=20640) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:08:26.558511 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:08:26.586093 run osmo-hlr_10.42.42.2(pid=20637): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20637)] 19:08:26.636882 run osmo-hlr_10.42.42.2(pid=20637): stdout: | (launched: 2022-12-13_19:08:23.596669) 19:08:26.689442 run osmo-hlr_10.42.42.2(pid=20637): stderr: | 20221213190823769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190823769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190823769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190823769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190823769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190823769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190823781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190823789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190823789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190823789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:26.762333 run osmo-msc_10.42.42.6(pid=20643): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20643)] 19:08:26.812502 run osmo-msc_10.42.42.6(pid=20643): stdout: | (launched: 2022-12-13_19:08:25.603765) 19:08:26.864899 run osmo-msc_10.42.42.6(pid=20643): stderr: | 20221213190825922 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190825922 DLGLOBAL DEBUG validating counter group 0x7fb9e2245c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190825922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190825922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190825922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190825922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190825924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190825924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190825924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190825925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:26.917517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Terminating (SIGTERM) 19:08:26.959763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Terminating (SIGTERM) 19:08:27.002226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Terminating (SIGTERM) 19:08:27.044762 --- ParallelTerminationStrategy: PID 20636 died... 19:08:27.065412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Terminated: ok {rc=0} 19:08:27.111935 --- ParallelTerminationStrategy: PID 20639 died... 19:08:27.131769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Terminated: ok {rc=0} 19:08:27.178105 --- ParallelTerminationStrategy: PID 20642 died... 19:08:27.197967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Terminated: ok {rc=0} 19:08:27.286613 bus /sierra_3: Setting Powered False 19:08:28.386450 bus /sierra_3: Setting Powered False 19:08:29.503053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:08:30.653562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:30.666116 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:08:30.739850 tst mo_mt_call_osmux.py: using LAC 35656 19:08:30.874785 tst mo_mt_call_osmux.py: using RAC 211 19:08:31.027416 tst mo_mt_call_osmux.py: using CellId 35656 19:08:31.185142 tst mo_mt_call_osmux.py: using BVCI 35657 19:08:31.314106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:31.326596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:31.338844 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:31.351273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:31.363725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:08:31.375993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:08:31.491480 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:08:31.610527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:32.139933 run create_hlr_db(pid=20645): Launched 19:08:32.299283 bus /sierra_2: Setting Powered False 19:08:33.363155 run create_hlr_db(pid=20645): Terminated: ok {rc=0} 19:08:33.799653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20647): Launched 19:08:34.105085 run osmo-hlr_10.42.42.2(pid=20648): Launched 19:08:34.220541 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:34.747517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20650): Launched 19:08:35.052626 run osmo-stp_10.42.42.5(pid=20651): Launched 19:08:35.168307 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:35.717292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20653): Launched 19:08:36.022930 run osmo-msc_10.42.42.6(pid=20654): Launched 19:08:36.193138 run osmo-stp_10.42.42.5(pid=20651): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20651)] 19:08:36.321863 run osmo-stp_10.42.42.5(pid=20651): stdout: | (launched: 2022-12-13_19:08:34.997117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:36.450359 run osmo-stp_10.42.42.5(pid=20651): stderr: | 20221213190835161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190835161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190835162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190835162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190835163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190835163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190835163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:36.578004 run osmo-stp_10.42.42.5(pid=20651): stdout: | (launched: 2022-12-13_19:08:34.997117) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:36.700134 run osmo-stp_10.42.42.5(pid=20651): stderr: | 20221213190835161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190835161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190835162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190835162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190835163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190835163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190835163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:36.846317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20651): Process ended prematurely: osmo-stp_10.42.42.5(pid=20651) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20651)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:08:36.855589 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:08:36.882636 run osmo-hlr_10.42.42.2(pid=20648): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20648)] 19:08:36.931727 run osmo-hlr_10.42.42.2(pid=20648): stdout: | (launched: 2022-12-13_19:08:34.048380) 19:08:36.982654 run osmo-hlr_10.42.42.2(pid=20648): stderr: | 20221213190834224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190834224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190834224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190834224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190834224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190834224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190834236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190834245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190834245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190834245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:37.052620 run osmo-msc_10.42.42.6(pid=20654): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20654)] 19:08:37.100874 run osmo-msc_10.42.42.6(pid=20654): stdout: | (launched: 2022-12-13_19:08:35.967010) 19:08:37.150477 run osmo-msc_10.42.42.6(pid=20654): stderr: | 20221213190836237 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190836237 DLGLOBAL DEBUG validating counter group 0x7f8689ec0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190836237 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190836237 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190836237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190836238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190836239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190836240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190836240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190836240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:37.200874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20647): Terminating (SIGTERM) 19:08:37.241110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20650): Terminating (SIGTERM) 19:08:37.281192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20653): Terminating (SIGTERM) 19:08:37.322127 --- ParallelTerminationStrategy: PID 20647 died... 19:08:37.341724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20647): Terminated: ok {rc=0} 19:08:37.386340 --- ParallelTerminationStrategy: PID 20650 died... 19:08:37.405424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20650): Terminated: ok {rc=0} 19:08:37.449929 --- ParallelTerminationStrategy: PID 20653 died... 19:08:37.468870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20653): Terminated: ok {rc=0} 19:08:37.555583 bus /sierra_3: Setting Powered False 19:08:38.655250 bus /sierra_3: Setting Powered False 19:08:39.771597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:08:41.031217 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:08:41.037758 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:08:41.071225 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:08:41.097945 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:08:41.151292 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:08:41.187389 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:08:41.215184 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:08:41.762053 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:08:41.811283 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:41.823104 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:08:41.893318 tst mo_mt_call.py: using LAC 35657 19:08:42.012923 tst mo_mt_call.py: using RAC 212 19:08:42.131152 tst mo_mt_call.py: using CellId 35657 19:08:42.250684 tst mo_mt_call.py: using BVCI 35658 19:08:42.361871 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:42.373464 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:42.384770 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:42.396083 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:42.407451 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:42.418838 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:08:42.538228 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:08:42.655758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:43.127787 run create_hlr_db(pid=20662): Launched 19:08:43.251131 bus /sierra_2: Setting Powered False 19:08:44.311836 run create_hlr_db(pid=20662): Terminated: ok {rc=0} 19:08:44.755827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Launched 19:08:45.081702 run osmo-hlr_10.42.42.2(pid=20665): Launched 19:08:45.207390 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:45.768881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Launched 19:08:46.109684 run osmo-stp_10.42.42.5(pid=20668): Launched 19:08:46.361572 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:47.030306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20670): Launched 19:08:47.370777 run osmo-msc_10.42.42.6(pid=20671): Launched 19:08:47.554442 run osmo-stp_10.42.42.5(pid=20668): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] 19:08:47.693935 run osmo-stp_10.42.42.5(pid=20668): stdout: | (launched: 2022-12-13_19:08:46.047685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:47.833440 run osmo-stp_10.42.42.5(pid=20668): stderr: | 20221213190846339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190846339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190846339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190846339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190846340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190846340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190846340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:47.970570 run osmo-stp_10.42.42.5(pid=20668): stdout: | (launched: 2022-12-13_19:08:46.047685) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:48.102089 run osmo-stp_10.42.42.5(pid=20668): stderr: | 20221213190846339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190846339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190846339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190846339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190846340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190846340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190846340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:48.259210 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20668): Process ended prematurely: osmo-stp_10.42.42.5(pid=20668) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:08:48.269145 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:08:48.296918 run osmo-hlr_10.42.42.2(pid=20665): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20665)] 19:08:48.347920 run osmo-hlr_10.42.42.2(pid=20665): stdout: | (launched: 2022-12-13_19:08:45.022765) 19:08:48.400313 run osmo-hlr_10.42.42.2(pid=20665): stderr: | 20221213190845217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190845217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190845218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190845218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190845218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190845218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190845230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190845241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190845242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190845242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:48.473075 run osmo-msc_10.42.42.6(pid=20671): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20671)] 19:08:48.523175 run osmo-msc_10.42.42.6(pid=20671): stdout: | (launched: 2022-12-13_19:08:47.311311) 19:08:48.575565 run osmo-msc_10.42.42.6(pid=20671): stderr: | 20221213190847629 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190847629 DLGLOBAL DEBUG validating counter group 0x7ff0c9fdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190847629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190847629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190847630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190847630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190847631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190847632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190847632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190847632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:48.627981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Terminating (SIGTERM) 19:08:48.670201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Terminating (SIGTERM) 19:08:48.712572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20670): Terminating (SIGTERM) 19:08:48.755116 --- ParallelTerminationStrategy: PID 20664 died... 19:08:48.775502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20664): Terminated: ok {rc=0} 19:08:48.821863 --- ParallelTerminationStrategy: PID 20667 died... 19:08:48.841665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20667): Terminated: ok {rc=0} 19:08:48.887816 --- ParallelTerminationStrategy: PID 20670 died... 19:08:48.907606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20670): Terminated: ok {rc=0} 19:08:48.996093 bus /sierra_3: Setting Powered False 19:08:50.095286 bus /sierra_3: Setting Powered False 19:08:51.212415 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:08:52.361581 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.374156 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:08:52.450681 tst mo_mt_call_osmux.py: using LAC 35658 19:08:52.569385 tst mo_mt_call_osmux.py: using RAC 213 19:08:52.696458 tst mo_mt_call_osmux.py: using CellId 35658 19:08:52.820791 tst mo_mt_call_osmux.py: using BVCI 35659 19:08:52.932144 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.943732 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.955377 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.966623 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.978036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:08:52.989352 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:08:53.109698 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:08:53.227502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:08:53.699761 run create_hlr_db(pid=20673): Launched 19:08:53.824640 bus /sierra_2: Setting Powered False 19:08:54.885376 run create_hlr_db(pid=20673): Terminated: ok {rc=0} 19:08:55.311738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20675): Launched 19:08:55.616839 run osmo-hlr_10.42.42.2(pid=20676): Launched 19:08:55.731988 run osmo-stp_10.42.42.5: Starting osmo-stp 19:08:56.271781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20678): Launched 19:08:56.574595 run osmo-stp_10.42.42.5(pid=20679): Launched 19:08:56.689249 run osmo-msc_10.42.42.6: Starting osmo-msc 19:08:57.236608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20681): Launched 19:08:57.539464 run osmo-msc_10.42.42.6(pid=20682): Launched 19:08:57.708895 run osmo-stp_10.42.42.5(pid=20679): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20679)] 19:08:57.836658 run osmo-stp_10.42.42.5(pid=20679): stdout: | (launched: 2022-12-13_19:08:56.519252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:57.964474 run osmo-stp_10.42.42.5(pid=20679): stderr: | 20221213190856687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190856687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190856687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190856688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190856688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190856688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190856688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:58.091301 run osmo-stp_10.42.42.5(pid=20679): stdout: | (launched: 2022-12-13_19:08:56.519252) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:08:58.212487 run osmo-stp_10.42.42.5(pid=20679): stderr: | 20221213190856687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190856687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190856687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190856688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190856688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190856688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190856688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:08:58.357674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20679): Process ended prematurely: osmo-stp_10.42.42.5(pid=20679) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20679)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:08:58.366727 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:08:58.393157 run osmo-hlr_10.42.42.2(pid=20676): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20676)] 19:08:58.441281 run osmo-hlr_10.42.42.2(pid=20676): stdout: | (launched: 2022-12-13_19:08:55.559789) 19:08:58.490867 run osmo-hlr_10.42.42.2(pid=20676): stderr: | 20221213190855732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190855732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190855732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190855732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190855732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190855732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190855745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190855753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190855753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190855753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:08:58.559560 run osmo-msc_10.42.42.6(pid=20682): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20682)] 19:08:58.607330 run osmo-msc_10.42.42.6(pid=20682): stdout: | (launched: 2022-12-13_19:08:57.483728) 19:08:58.656387 run osmo-msc_10.42.42.6(pid=20682): stderr: | 20221213190857752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190857752 DLGLOBAL DEBUG validating counter group 0x7f9d63af3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190857752 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190857753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190857753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190857753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190857755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190857755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190857755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190857755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:08:58.706110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20675): Terminating (SIGTERM) 19:08:58.745736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20678): Terminating (SIGTERM) 19:08:58.785428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20681): Terminating (SIGTERM) 19:08:58.825422 --- ParallelTerminationStrategy: PID 20675 died... 19:08:58.844576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20675): Terminated: ok {rc=0} 19:08:58.888486 --- ParallelTerminationStrategy: PID 20678 died... 19:08:58.907352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20678): Terminated: ok {rc=0} 19:08:58.951215 --- ParallelTerminationStrategy: PID 20681 died... 19:08:58.970012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20681): Terminated: ok {rc=0} 19:08:59.056250 bus /sierra_3: Setting Powered False 19:09:00.154927 bus /sierra_3: Setting Powered False 19:09:01.286533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:09:02.673218 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:09:02.679126 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:09:02.733610 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:09:02.780472 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:09:02.871574 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:09:02.947975 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:09:02.993642 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:09:03.519803 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:09:03.590359 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:03.602626 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:09:03.675058 tst mo_mt_call.py: using LAC 35659 19:09:03.796359 tst mo_mt_call.py: using RAC 214 19:09:03.924309 tst mo_mt_call.py: using CellId 35659 19:09:04.049495 tst mo_mt_call.py: using BVCI 35660 19:09:04.164107 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:04.176269 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:04.188280 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:04.200345 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:04.212831 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:04.225188 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:09:04.346198 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:09:04.466152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:04.948611 run create_hlr_db(pid=20956): Launched 19:09:05.080912 bus /sierra_2: Setting Powered False 19:09:06.146710 run create_hlr_db(pid=20956): Terminated: ok {rc=0} 19:09:06.613734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20960): Launched 19:09:06.960471 run osmo-hlr_10.42.42.2(pid=20961): Launched 19:09:07.217257 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:07.892142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20963): Launched 19:09:08.241448 run osmo-stp_10.42.42.5(pid=20964): Launched 19:09:08.491377 run osmo-msc_10.42.42.6: Starting osmo-msc 19:09:09.176056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20966): Launched 19:09:09.525038 run osmo-msc_10.42.42.6(pid=20967): Launched 19:09:09.896932 run osmo-stp_10.42.42.5(pid=20964): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20964)] 19:09:10.196616 run osmo-stp_10.42.42.5(pid=20964): stdout: | (launched: 2022-12-13_19:09:08.179600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:10.361211 run osmo-stp_10.42.42.5(pid=20964): stderr: | 20221213190908468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190908468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190908473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190908474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190908474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190908474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190908474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:10.503870 run osmo-stp_10.42.42.5(pid=20964): stdout: | (launched: 2022-12-13_19:09:08.179600) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:10.641182 run osmo-stp_10.42.42.5(pid=20964): stderr: | 20221213190908468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190908468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190908473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190908474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190908474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190908474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190908474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:10.803791 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20964): Process ended prematurely: osmo-stp_10.42.42.5(pid=20964) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20964)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:09:10.815856 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 19:09:10.845363 run osmo-hlr_10.42.42.2(pid=20961): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20961)] 19:09:10.901159 run osmo-hlr_10.42.42.2(pid=20961): stdout: | (launched: 2022-12-13_19:09:06.899988) 19:09:10.958118 run osmo-hlr_10.42.42.2(pid=20961): stderr: | 20221213190907211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190907211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190907211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190907211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190907211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190907211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190907231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190907239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190907240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190907240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:11.035407 run osmo-msc_10.42.42.6(pid=20967): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20967)] 19:09:11.090966 run osmo-msc_10.42.42.6(pid=20967): stdout: | (launched: 2022-12-13_19:09:09.463917) 19:09:11.145712 run osmo-msc_10.42.42.6(pid=20967): stderr: | 20221213190909963 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190909963 DLGLOBAL DEBUG validating counter group 0x7f2869cacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190909963 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190909963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190909963 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190909963 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190909973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190909974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190909974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190909974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:09:11.201911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20960): Terminating (SIGTERM) 19:09:11.247152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20963): Terminating (SIGTERM) 19:09:11.294073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20966): Terminating (SIGTERM) 19:09:11.341196 --- ParallelTerminationStrategy: PID 20960 died... 19:09:11.363506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20960): Terminated: ok {rc=0} 19:09:11.416041 --- ParallelTerminationStrategy: PID 20963 died... 19:09:11.436890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20963): Terminated: ok {rc=0} 19:09:11.487285 --- ParallelTerminationStrategy: PID 20966 died... 19:09:11.508007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20966): Terminated: ok {rc=0} 19:09:11.602304 bus /sierra_3: Setting Powered False 19:09:12.709354 bus /sierra_3: Setting Powered False 19:09:13.831907 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:09:14.991988 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.006140 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:09:15.086689 tst mo_mt_call_osmux.py: using LAC 35660 19:09:15.221175 tst mo_mt_call_osmux.py: using RAC 215 19:09:15.354626 tst mo_mt_call_osmux.py: using CellId 35660 19:09:15.492225 tst mo_mt_call_osmux.py: using BVCI 35661 19:09:15.619008 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.632751 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.645406 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.658540 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.672258 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:09:15.687637 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:09:15.815368 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:09:15.966279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:16.519560 run create_hlr_db(pid=20969): Launched 19:09:16.687727 bus /sierra_2: Setting Powered False 19:09:17.768221 run create_hlr_db(pid=20969): Terminated: ok {rc=0} 19:09:18.203539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Launched 19:09:18.529509 run osmo-hlr_10.42.42.2(pid=20972): Launched 19:09:18.764916 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:19.477661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Launched 19:09:19.804704 run osmo-stp_10.42.42.5(pid=20975): Launched 19:09:20.053735 run osmo-msc_10.42.42.6: Starting osmo-msc 19:09:20.753781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20977): Launched 19:09:21.080082 run osmo-msc_10.42.42.6(pid=20978): Launched 19:09:21.434233 run osmo-stp_10.42.42.5(pid=20975): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] 19:09:21.706077 run osmo-stp_10.42.42.5(pid=20975): stdout: | (launched: 2022-12-13_19:09:19.746560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:21.994226 run osmo-stp_10.42.42.5(pid=20975): stderr: | 20221213190920065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190920065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190920065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190920066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190920066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190920066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190920066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:22.143058 run osmo-stp_10.42.42.5(pid=20975): stdout: | (launched: 2022-12-13_19:09:19.746560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:22.268803 run osmo-stp_10.42.42.5(pid=20975): stderr: | 20221213190920065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190920065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190920065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190920066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190920066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190920066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190920066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:22.419454 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20975): Process ended prematurely: osmo-stp_10.42.42.5(pid=20975) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:09:22.429942 tst mo_mt_call_osmux.py:8: Test FAILED (7.5 sec) 19:09:22.458367 run osmo-hlr_10.42.42.2(pid=20972): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20972)] 19:09:22.508681 run osmo-hlr_10.42.42.2(pid=20972): stdout: | (launched: 2022-12-13_19:09:18.471020) 19:09:22.560615 run osmo-hlr_10.42.42.2(pid=20972): stderr: | 20221213190918804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190918804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190918805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190918805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190918805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190918805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190918823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190918840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190918840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190918840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:22.632783 run osmo-msc_10.42.42.6(pid=20978): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20978)] 19:09:22.682842 run osmo-msc_10.42.42.6(pid=20978): stdout: | (launched: 2022-12-13_19:09:21.021760) 19:09:22.734674 run osmo-msc_10.42.42.6(pid=20978): stderr: | 20221213190921610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190921610 DLGLOBAL DEBUG validating counter group 0x7f5114acac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190921610 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190921610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190921610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190921610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190921612 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190921617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190921617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190921617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:09:22.786832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Terminating (SIGTERM) 19:09:22.829116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Terminating (SIGTERM) 19:09:22.873398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20977): Terminating (SIGTERM) 19:09:22.917471 --- ParallelTerminationStrategy: PID 20971 died... 19:09:22.938052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20971): Terminated: ok {rc=0} 19:09:22.986187 --- ParallelTerminationStrategy: PID 20974 died... 19:09:23.006249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20974): Terminated: ok {rc=0} 19:09:23.051905 --- ParallelTerminationStrategy: PID 20977 died... 19:09:23.072042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20977): Terminated: ok {rc=0} 19:09:23.159806 bus /sierra_3: Setting Powered False 19:09:24.254863 bus /sierra_3: Setting Powered False 19:09:25.370597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 19:09:26.624450 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:09:26.629142 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:09:26.662582 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:09:26.690102 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:09:26.774549 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:09:26.807790 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:09:26.834143 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:09:27.420943 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 19:09:27.425880 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:27.436722 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:09:27.486959 tst emergency_mo_mt_call.py: using LAC 35661 19:09:27.614350 tst emergency_mo_mt_call.py: using RAC 216 19:09:27.741707 tst emergency_mo_mt_call.py: using CellId 35661 19:09:27.870135 tst emergency_mo_mt_call.py: using BVCI 35662 19:09:27.988212 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:27.999791 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:28.010992 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:28.022335 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:28.033993 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:28.045605 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:28.165745 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:28.282365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:28.750030 run create_hlr_db(pid=20984): Launched 19:09:28.873176 bus /sierra_2: Setting Powered False 19:09:29.933228 run create_hlr_db(pid=20984): Terminated: ok {rc=0} 19:09:30.354153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Launched 19:09:30.653969 run osmo-hlr_10.42.42.2(pid=20987): Launched 19:09:30.767706 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:31.367451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Launched 19:09:31.697712 run osmo-stp_10.42.42.5(pid=20990): Launched 19:09:31.955259 tst emergency_mo_mt_call.py: using MSISDN 8286 19:09:32.178525 run osmo-msc_10.42.42.6: Starting osmo-msc 19:09:32.722059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Launched 19:09:33.022856 run osmo-msc_10.42.42.6(pid=20993): Launched 19:09:33.190019 run osmo-stp_10.42.42.5(pid=20990): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] 19:09:33.316359 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-13_19:09:31.629263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:33.443800 run osmo-stp_10.42.42.5(pid=20990): stderr: | 20221213190931898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190931898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190931899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190931899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190931899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190931900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190931900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:33.568179 run osmo-stp_10.42.42.5(pid=20990): stdout: | (launched: 2022-12-13_19:09:31.629263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:33.687362 run osmo-stp_10.42.42.5(pid=20990): stderr: | 20221213190931898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190931898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190931899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190931899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190931899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190931900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190931900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:33.829887 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 19:09:33.838122 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 19:09:33.863974 run osmo-hlr_10.42.42.2(pid=20987): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20987)] 19:09:33.911883 run osmo-hlr_10.42.42.2(pid=20987): stdout: | (launched: 2022-12-13_19:09:30.598090) 19:09:33.961392 run osmo-hlr_10.42.42.2(pid=20987): stderr: | 20221213190930776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190930776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190930776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190930776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190930776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190930777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190930789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190930800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190930800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190930800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:34.030625 run osmo-msc_10.42.42.6(pid=20993): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20993)] 19:09:34.078704 run osmo-msc_10.42.42.6(pid=20993): stdout: | (launched: 2022-12-13_19:09:32.965902) 19:09:34.128305 run osmo-msc_10.42.42.6(pid=20993): stderr: | 20221213190933240 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190933240 DLGLOBAL DEBUG validating counter group 0x7f732e9f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190933240 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190933240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190933240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190933240 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190933242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190933243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190933243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190933243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:09:34.178244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminating (SIGTERM) 19:09:34.218198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminating (SIGTERM) 19:09:34.257971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Terminating (SIGTERM) 19:09:34.297965 --- ParallelTerminationStrategy: PID 20986 died... 19:09:34.317242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20986): Terminated: ok {rc=0} 19:09:34.361427 --- ParallelTerminationStrategy: PID 20989 died... 19:09:34.380074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20989): Terminated: ok {rc=0} 19:09:34.424843 --- ParallelTerminationStrategy: PID 20992 died... 19:09:34.444000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20992): Terminated: ok {rc=0} 19:09:34.528490 bus /sierra_3: Setting Powered False 19:09:35.627509 bus /sierra_3: Setting Powered False 19:09:36.746782 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 19:09:37.835433 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:37.846943 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:09:37.899760 tst emergency_preemptive_call.py: using LAC 35662 19:09:38.019205 tst emergency_preemptive_call.py: using RAC 217 19:09:38.138491 tst emergency_preemptive_call.py: using CellId 35662 19:09:38.255776 tst emergency_preemptive_call.py: using BVCI 35663 19:09:38.363448 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:38.374454 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:38.385212 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:38.395836 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:38.406682 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:09:38.417358 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:38.533211 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:38.653883 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:38.768545 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:38.887091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:39.390470 run create_hlr_db(pid=20995): Launched 19:09:39.515991 bus /sierra_2: Setting Powered False 19:09:40.580609 run create_hlr_db(pid=20995): Terminated: ok {rc=0} 19:09:41.012792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Launched 19:09:41.315436 run osmo-hlr_10.42.42.2(pid=20998): Launched 19:09:41.431075 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:41.967354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Launched 19:09:42.269731 run osmo-stp_10.42.42.5(pid=21001): Launched 19:09:42.393908 tst emergency_preemptive_call.py: using MSISDN 8287 19:09:42.546676 run osmo-msc_10.42.42.6: Starting osmo-msc 19:09:43.087977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21003): Launched 19:09:43.388379 run osmo-msc_10.42.42.6(pid=21004): Launched 19:09:43.556660 run osmo-stp_10.42.42.5(pid=21001): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] 19:09:43.683807 run osmo-stp_10.42.42.5(pid=21001): stdout: | (launched: 2022-12-13_19:09:42.213307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:43.810355 run osmo-stp_10.42.42.5(pid=21001): stderr: | 20221213190942385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190942386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190942386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190942386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190942387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190942387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190942387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:43.935032 run osmo-stp_10.42.42.5(pid=21001): stdout: | (launched: 2022-12-13_19:09:42.213307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:09:44.054727 run osmo-stp_10.42.42.5(pid=21001): stderr: | 20221213190942385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213190942386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213190942386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213190942386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213190942387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213190942387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213190942387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:09:44.197485 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21001): Process ended prematurely: osmo-stp_10.42.42.5(pid=21001) [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 19:09:44.205900 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 19:09:44.231711 run osmo-hlr_10.42.42.2(pid=20998): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20998)] 19:09:44.280049 run osmo-hlr_10.42.42.2(pid=20998): stdout: | (launched: 2022-12-13_19:09:41.259537) 19:09:44.330366 run osmo-hlr_10.42.42.2(pid=20998): stderr: | 20221213190941435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190941435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190941435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190941435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190941435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190941435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190941447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190941458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190941458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190941458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:09:44.400255 run osmo-msc_10.42.42.6(pid=21004): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21004)] 19:09:44.448576 run osmo-msc_10.42.42.6(pid=21004): stdout: | (launched: 2022-12-13_19:09:43.332538) 19:09:44.498559 run osmo-msc_10.42.42.6(pid=21004): stderr: | 20221213190943606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213190943606 DLGLOBAL DEBUG validating counter group 0x7f3e13e30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213190943606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213190943606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213190943607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213190943607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213190943609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213190943609 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213190943609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213190943609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:09:44.548374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Terminating (SIGTERM) 19:09:44.588147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Terminating (SIGTERM) 19:09:44.627751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21003): Terminating (SIGTERM) 19:09:44.667511 --- ParallelTerminationStrategy: PID 20997 died... 19:09:44.686215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20997): Terminated: ok {rc=0} 19:09:44.730233 --- ParallelTerminationStrategy: PID 21000 died... 19:09:44.749046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21000): Terminated: ok {rc=0} 19:09:44.792778 --- ParallelTerminationStrategy: PID 21003 died... 19:09:44.811513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21003): Terminated: ok {rc=0} 19:09:44.897207 bus /sierra_9: Setting Powered False 19:09:45.999877 bus /sierra_9: Setting Powered False 19:09:47.127340 bus /sierra_8: Setting Powered False 19:09:48.228507 bus /sierra_8: Setting Powered False 19:09:49.343895 bus /sierra_3: Setting Powered False 19:09:50.442761 bus /sierra_3: Setting Powered False 19:09:51.558552 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 19:09:52.844529 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:09:52.848792 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 19:09:52.882114 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 19:09:52.920207 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 19:09:53.008924 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 19:09:53.044159 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 19:09:53.084416 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 19:09:53.676584 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 19:09:53.730453 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:53.741883 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:09:53.792103 tst cs_paging_gprs_active.py: using LAC 35663 19:09:53.922160 tst cs_paging_gprs_active.py: using RAC 218 19:09:54.052625 tst cs_paging_gprs_active.py: using CellId 35663 19:09:54.181303 tst cs_paging_gprs_active.py: using BVCI 35664 19:09:54.293828 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.304690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.315489 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.326336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.336928 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.347786 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.358472 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.368924 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:09:54.379743 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:54.499563 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:09:54.616728 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:09:54.823432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:55.132558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Launched 19:09:55.400369 run iperf3-srv_10.42.42.10(pid=21011): Launched 19:09:55.515636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:09:55.720869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:09:56.028480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21012): Launched 19:09:56.296395 run iperf3-srv_10.42.42.10(pid=21013): Launched 19:09:56.410834 tst cs_paging_gprs_active.py:38: start network... 19:09:56.616167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:09:57.092146 run create_hlr_db(pid=21014): Launched 19:09:57.217467 bus /sierra_2: Setting Powered False 19:09:58.278482 run create_hlr_db(pid=21014): Terminated: ok {rc=0} 19:09:58.728310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Launched 19:09:59.060882 run osmo-hlr_10.42.42.2(pid=21017): Launched 19:09:59.189412 run osmo-stp_10.42.42.5: Starting osmo-stp 19:09:59.759183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Launched 19:10:00.088152 run osmo-stp_10.42.42.5(pid=21020): Launched 19:10:00.214366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:00.780863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21022): Launched 19:10:00.928152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:01.213444 run patchelf(pid=21023): Launched 19:10:01.422813 run osmo-stp_10.42.42.5(pid=21020): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] 19:10:01.570546 run osmo-stp_10.42.42.5(pid=21020): stdout: | (launched: 2022-12-13_19:10:00.027606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:01.714719 run osmo-stp_10.42.42.5(pid=21020): stderr: | 20221213191000243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191000243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191000243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191000244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191000244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191000244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191000244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:01.870632 run osmo-stp_10.42.42.5(pid=21020): stdout: | (launched: 2022-12-13_19:10:00.027606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:02.053401 run osmo-stp_10.42.42.5(pid=21020): stderr: | 20221213191000243 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191000243 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191000243 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191000244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191000244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191000244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191000244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:02.216712 run patchelf(pid=21023): Terminating (SIGINT) 19:10:02.403003 run patchelf(pid=21023): Terminated: ok {rc=0} 19:10:02.535977 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21020): Process ended prematurely: osmo-stp_10.42.42.5(pid=21020) [trial-2393↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] [trial-2393↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 19:10:02.546481 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:10:02.575108 run osmo-hlr_10.42.42.2(pid=21017): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21017)] 19:10:02.626723 run osmo-hlr_10.42.42.2(pid=21017): stdout: | (launched: 2022-12-13_19:09:59.000134) 19:10:02.679600 run osmo-hlr_10.42.42.2(pid=21017): stderr: | 20221213190959199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213190959199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213190959199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213190959199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213190959199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213190959199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213190959212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213190959221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213190959221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213190959221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:02.732631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminating (SIGTERM) 19:10:02.774704 run iperf3-srv_10.42.42.10(pid=21011): Terminating (SIGTERM) 19:10:02.817158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21012): Terminating (SIGTERM) 19:10:02.859599 run iperf3-srv_10.42.42.10(pid=21013): Terminating (SIGTERM) 19:10:02.901825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Terminating (SIGTERM) 19:10:02.944219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Terminating (SIGTERM) 19:10:02.987126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21022): Terminating (SIGTERM) 19:10:03.029683 --- ParallelTerminationStrategy: PID 21010 died... 19:10:03.050248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21010): Terminated: ok {rc=0} 19:10:03.097124 --- ParallelTerminationStrategy: PID 21011 died... 19:10:03.116876 run iperf3-srv_10.42.42.10(pid=21011): Terminated {rc=256} 19:10:03.163191 --- ParallelTerminationStrategy: PID 21012 died... 19:10:03.183119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21012): Terminated: ok {rc=0} 19:10:03.229406 --- ParallelTerminationStrategy: PID 21013 died... 19:10:03.249279 run iperf3-srv_10.42.42.10(pid=21013): Terminated {rc=256} 19:10:03.295457 --- ParallelTerminationStrategy: PID 21016 died... 19:10:03.315360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21016): Terminated: ok {rc=0} 19:10:03.361716 --- ParallelTerminationStrategy: PID 21019 died... 19:10:03.381646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21019): Terminated: ok {rc=0} 19:10:03.427743 --- ParallelTerminationStrategy: PID 21022 died... 19:10:03.447703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21022): Terminated: ok {rc=0} 19:10:03.536375 bus /gobi_0: Setting Powered False 19:10:04.636341 bus /gobi_0: Setting Powered False 19:10:05.752304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 19:10:06.901787 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:06.913717 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:10:06.968134 tst iperf3.py: using LAC 35664 19:10:07.097578 tst iperf3.py: using RAC 219 19:10:07.224938 tst iperf3.py: using CellId 35664 19:10:07.352080 tst iperf3.py: using BVCI 35665 19:10:07.471945 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.483352 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.494988 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.506188 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.517690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.529105 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.540598 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.551955 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:07.563441 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:07.681050 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:10:07.887831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:08.197895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Launched 19:10:08.486221 run iperf3-srv_10.42.42.10(pid=21028): Launched 19:10:08.610407 tst iperf3.py:8: start network... 19:10:08.832929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:09.345282 run create_hlr_db(pid=21029): Launched 19:10:09.470602 bus /gobi_6: Setting Powered False 19:10:10.531093 run create_hlr_db(pid=21029): Terminated: ok {rc=0} 19:10:10.971869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21031): Launched 19:10:11.279935 run osmo-hlr_10.42.42.2(pid=21032): Launched 19:10:11.397307 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:11.933476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21034): Launched 19:10:12.241080 run osmo-stp_10.42.42.5(pid=21035): Launched 19:10:12.357929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:12.887343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21037): Launched 19:10:13.005802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:13.266460 run patchelf(pid=21038): Launched 19:10:13.436531 run osmo-stp_10.42.42.5(pid=21035): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21035)] 19:10:13.566350 run osmo-stp_10.42.42.5(pid=21035): stdout: | (launched: 2022-12-13_19:10:12.183931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:13.697895 run osmo-stp_10.42.42.5(pid=21035): stderr: | 20221213191012355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191012355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191012355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191012356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191012356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191012356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191012356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:13.828809 run osmo-stp_10.42.42.5(pid=21035): stdout: | (launched: 2022-12-13_19:10:12.183931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:13.954569 run osmo-stp_10.42.42.5(pid=21035): stderr: | 20221213191012355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191012355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191012355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191012356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191012356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191012356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191012356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:14.103297 run patchelf(pid=21038): Terminating (SIGINT) 19:10:14.274716 run patchelf(pid=21038): Terminated: ok {rc=0} 19:10:14.398304 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21035): Process ended prematurely: osmo-stp_10.42.42.5(pid=21035) [trial-2393↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21035)] [trial-2393↪gprs:trx-sysmocell5000↪iperf3.py:8] 19:10:14.407770 tst iperf3.py:8: Test FAILED (7.5 sec) 19:10:14.434959 run osmo-hlr_10.42.42.2(pid=21032): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21032)] 19:10:14.482955 run osmo-hlr_10.42.42.2(pid=21032): stdout: | (launched: 2022-12-13_19:10:11.222847) 19:10:14.532721 run osmo-hlr_10.42.42.2(pid=21032): stderr: | 20221213191011398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191011398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191011398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191011398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191011399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191011399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191011411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191011419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191011419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191011419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:14.583037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Terminating (SIGTERM) 19:10:14.623551 run iperf3-srv_10.42.42.10(pid=21028): Terminating (SIGTERM) 19:10:14.663864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21031): Terminating (SIGTERM) 19:10:14.704296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21034): Terminating (SIGTERM) 19:10:14.744553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21037): Terminating (SIGTERM) 19:10:14.785740 --- ParallelTerminationStrategy: PID 21027 died... 19:10:14.805305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21027): Terminated: ok {rc=0} 19:10:14.850213 --- ParallelTerminationStrategy: PID 21028 died... 19:10:14.869192 run iperf3-srv_10.42.42.10(pid=21028): Terminated {rc=256} 19:10:14.913370 --- ParallelTerminationStrategy: PID 21031 died... 19:10:14.932235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21031): Terminated: ok {rc=0} 19:10:14.976479 --- ParallelTerminationStrategy: PID 21034 died... 19:10:14.995230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21034): Terminated: ok {rc=0} 19:10:15.039435 --- ParallelTerminationStrategy: PID 21037 died... 19:10:15.058646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21037): Terminated: ok {rc=0} 19:10:15.145942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 19:10:16.293291 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:16.305872 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:10:16.357537 tst iperf3m4.py: using LAC 35665 19:10:16.500810 tst iperf3m4.py: using RAC 220 19:10:16.658118 tst iperf3m4.py: using CellId 35665 19:10:16.824094 tst iperf3m4.py: using BVCI 35666 19:10:16.977202 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:16.989237 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.000900 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.017739 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.030193 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.041915 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.054643 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.067164 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:17.079101 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:17.201248 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:17.322264 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:17.442925 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:17.566499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:10:17.789267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:18.119695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21039): Launched 19:10:18.407867 run iperf3-srv_10.42.42.10(pid=21040): Launched 19:10:18.532840 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:10:18.754172 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:19.085281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21041): Launched 19:10:19.371150 run iperf3-srv_10.42.42.10(pid=21042): Launched 19:10:19.496037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:10:19.718023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:20.049042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21043): Launched 19:10:20.336116 run iperf3-srv_10.42.42.10(pid=21044): Launched 19:10:20.461058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:10:20.682738 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:21.014263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Launched 19:10:21.300340 run iperf3-srv_10.42.42.10(pid=21046): Launched 19:10:21.425127 tst iperf3m4.py:8: start network... 19:10:21.646842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:22.159002 run create_hlr_db(pid=21047): Launched 19:10:22.284609 bus /gobi_6: Setting Powered False 19:10:23.349698 run create_hlr_db(pid=21047): Terminated: ok {rc=0} 19:10:23.790487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Launched 19:10:24.099594 run osmo-hlr_10.42.42.2(pid=21050): Launched 19:10:24.219011 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:24.763973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Launched 19:10:25.073128 run osmo-stp_10.42.42.5(pid=21053): Launched 19:10:25.190527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:25.721455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21055): Launched 19:10:25.841065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:26.100720 run patchelf(pid=21056): Launched 19:10:26.272043 run osmo-stp_10.42.42.5(pid=21053): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] 19:10:26.402010 run osmo-stp_10.42.42.5(pid=21053): stdout: | (launched: 2022-12-13_19:10:25.015595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:26.532907 run osmo-stp_10.42.42.5(pid=21053): stderr: | 20221213191025189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191025189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191025189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191025190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191025190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191025190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191025191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:26.664360 run osmo-stp_10.42.42.5(pid=21053): stdout: | (launched: 2022-12-13_19:10:25.015595) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:26.789790 run osmo-stp_10.42.42.5(pid=21053): stderr: | 20221213191025189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191025189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191025189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191025190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191025190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191025190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191025191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:26.938744 run patchelf(pid=21056): Terminating (SIGINT) 19:10:27.110490 run patchelf(pid=21056): Terminated: ok {rc=0} 19:10:27.234247 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21053): Process ended prematurely: osmo-stp_10.42.42.5(pid=21053) [trial-2393↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] [trial-2393↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 19:10:27.243713 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:10:27.271301 run osmo-hlr_10.42.42.2(pid=21050): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21050)] 19:10:27.319451 run osmo-hlr_10.42.42.2(pid=21050): stdout: | (launched: 2022-12-13_19:10:24.042390) 19:10:27.369288 run osmo-hlr_10.42.42.2(pid=21050): stderr: | 20221213191024218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191024218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191024218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191024218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191024219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191024219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191024229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191024238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191024238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191024238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:27.419416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21039): Terminating (SIGTERM) 19:10:27.459335 run iperf3-srv_10.42.42.10(pid=21040): Terminating (SIGTERM) 19:10:27.499213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21041): Terminating (SIGTERM) 19:10:27.539212 run iperf3-srv_10.42.42.10(pid=21042): Terminating (SIGTERM) 19:10:27.578874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21043): Terminating (SIGTERM) 19:10:27.618698 run iperf3-srv_10.42.42.10(pid=21044): Terminating (SIGTERM) 19:10:27.658286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Terminating (SIGTERM) 19:10:27.698143 run iperf3-srv_10.42.42.10(pid=21046): Terminating (SIGTERM) 19:10:27.737686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Terminating (SIGTERM) 19:10:27.777957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Terminating (SIGTERM) 19:10:27.817932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21055): Terminating (SIGTERM) 19:10:27.858143 --- ParallelTerminationStrategy: PID 21039 died... 19:10:27.877723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21039): Terminated: ok {rc=0} 19:10:27.921834 --- ParallelTerminationStrategy: PID 21040 died... 19:10:27.940450 run iperf3-srv_10.42.42.10(pid=21040): Terminated {rc=256} 19:10:27.984349 --- ParallelTerminationStrategy: PID 21041 died... 19:10:28.003208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21041): Terminated: ok {rc=0} 19:10:28.046997 --- ParallelTerminationStrategy: PID 21042 died... 19:10:28.065762 run iperf3-srv_10.42.42.10(pid=21042): Terminated {rc=256} 19:10:28.109631 --- ParallelTerminationStrategy: PID 21043 died... 19:10:28.128366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21043): Terminated: ok {rc=0} 19:10:28.172854 --- ParallelTerminationStrategy: PID 21044 died... 19:10:28.192144 run iperf3-srv_10.42.42.10(pid=21044): Terminated {rc=256} 19:10:28.235967 --- ParallelTerminationStrategy: PID 21045 died... 19:10:28.254891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21045): Terminated: ok {rc=0} 19:10:28.298550 --- ParallelTerminationStrategy: PID 21046 died... 19:10:28.317400 run iperf3-srv_10.42.42.10(pid=21046): Terminated {rc=256} 19:10:28.361215 --- ParallelTerminationStrategy: PID 21049 died... 19:10:28.379790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21049): Terminated: ok {rc=0} 19:10:28.424296 --- ParallelTerminationStrategy: PID 21052 died... 19:10:28.443245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21052): Terminated: ok {rc=0} 19:10:28.487293 --- ParallelTerminationStrategy: PID 21055 died... 19:10:28.506202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21055): Terminated: ok {rc=0} 19:10:28.592071 bus /gobi_4: Setting Powered False 19:10:29.692292 bus /gobi_4: Setting Powered False 19:10:30.807925 bus /gobi_1: Setting Powered False 19:10:31.914929 bus /gobi_1: Setting Powered False 19:10:33.035008 bus /gobi_0: Setting Powered False 19:10:34.135160 bus /gobi_0: Setting Powered False 19:10:35.253632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 19:10:36.355793 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.367484 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:10:36.417223 tst ping.py: using LAC 35666 19:10:36.537943 tst ping.py: using RAC 221 19:10:36.657046 tst ping.py: using CellId 35666 19:10:36.775546 tst ping.py: using BVCI 35667 19:10:36.885779 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.896741 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.907799 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.918653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.929629 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.940492 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.951376 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:36.962304 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:37.082223 tst ping.py:19: start network... 19:10:37.301227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:37.802532 run create_hlr_db(pid=21057): Launched 19:10:37.927555 bus /gobi_6: Setting Powered False 19:10:38.991547 run create_hlr_db(pid=21057): Terminated: ok {rc=0} 19:10:39.422461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21059): Launched 19:10:39.723578 run osmo-hlr_10.42.42.2(pid=21060): Launched 19:10:39.837529 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:40.357175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21062): Launched 19:10:40.658794 run osmo-stp_10.42.42.5(pid=21063): Launched 19:10:40.774661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:41.292700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21065): Launched 19:10:41.407584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:41.662302 run patchelf(pid=21066): Launched 19:10:41.829588 run osmo-stp_10.42.42.5(pid=21063): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21063)] 19:10:41.957847 run osmo-stp_10.42.42.5(pid=21063): stdout: | (launched: 2022-12-13_19:10:40.602725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:42.087055 run osmo-stp_10.42.42.5(pid=21063): stderr: | 20221213191040773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191040773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191040774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191040774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191040774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191040774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191040775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:42.216326 run osmo-stp_10.42.42.5(pid=21063): stdout: | (launched: 2022-12-13_19:10:40.602725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:42.339866 run osmo-stp_10.42.42.5(pid=21063): stderr: | 20221213191040773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191040773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191040774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191040774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191040774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191040774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191040775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:42.486397 run patchelf(pid=21066): Terminating (SIGINT) 19:10:42.655001 run patchelf(pid=21066): Terminated: ok {rc=0} 19:10:42.776455 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21063): Process ended prematurely: osmo-stp_10.42.42.5(pid=21063) [trial-2393↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21063)] [trial-2393↪gprs:trx-sysmocell5000↪ping.py:22] 19:10:42.785602 tst ping.py:22: Test FAILED (6.4 sec) 19:10:42.812539 run osmo-hlr_10.42.42.2(pid=21060): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21060)] 19:10:42.860875 run osmo-hlr_10.42.42.2(pid=21060): stdout: | (launched: 2022-12-13_19:10:39.667590) 19:10:42.910761 run osmo-hlr_10.42.42.2(pid=21060): stderr: | 20221213191039844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191039844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191039844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191039844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191039844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191039844 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191039856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191039864 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191039865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191039865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:42.960780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21059): Terminating (SIGTERM) 19:10:43.001120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21062): Terminating (SIGTERM) 19:10:43.041344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21065): Terminating (SIGTERM) 19:10:43.081708 --- ParallelTerminationStrategy: PID 21059 died... 19:10:43.100905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21059): Terminated: ok {rc=0} 19:10:43.145476 --- ParallelTerminationStrategy: PID 21062 died... 19:10:43.164500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21062): Terminated: ok {rc=0} 19:10:43.209157 --- ParallelTerminationStrategy: PID 21065 died... 19:10:43.228037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21065): Terminated: ok {rc=0} 19:10:43.312221 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 19:10:44.400018 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:44.412169 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 19:10:44.475358 tst ping_idle_ping.py: using LAC 35667 19:10:44.601929 tst ping_idle_ping.py: using RAC 222 19:10:44.731859 tst ping_idle_ping.py: using CellId 35667 19:10:44.857833 tst ping_idle_ping.py: using BVCI 35668 19:10:44.976518 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:44.988091 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:44.999334 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:45.010959 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:45.022527 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:45.034136 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:45.045900 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 19:10:45.057506 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 19:10:45.180183 tst ping_idle_ping.py:24: start network... 19:10:45.384553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:45.862598 run create_hlr_db(pid=21067): Launched 19:10:46.023025 bus /gobi_6: Setting Powered False 19:10:47.084089 run create_hlr_db(pid=21067): Terminated: ok {rc=0} 19:10:47.511857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Launched 19:10:47.815758 run osmo-hlr_10.42.42.2(pid=21070): Launched 19:10:47.931952 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:48.453620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Launched 19:10:48.756029 run osmo-stp_10.42.42.5(pid=21073): Launched 19:10:48.871413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:10:49.409758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Launched 19:10:49.524747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:10:49.780887 run patchelf(pid=21076): Launched 19:10:49.950079 run osmo-stp_10.42.42.5(pid=21073): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] 19:10:50.078519 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-13_19:10:48.699394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:50.207870 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221213191048872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191048872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191048872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191048874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191048874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191048874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191048874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:50.337455 run osmo-stp_10.42.42.5(pid=21073): stdout: | (launched: 2022-12-13_19:10:48.699394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:10:50.461346 run osmo-stp_10.42.42.5(pid=21073): stderr: | 20221213191048872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191048872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191048872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191048874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191048874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191048874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191048874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:10:50.607758 run patchelf(pid=21076): Terminating (SIGINT) 19:10:50.777561 run patchelf(pid=21076): Terminated: ok {rc=0} 19:10:50.899830 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2393↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] [trial-2393↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 19:10:50.908805 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:10:50.935700 run osmo-hlr_10.42.42.2(pid=21070): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21070)] 19:10:50.984246 run osmo-hlr_10.42.42.2(pid=21070): stdout: | (launched: 2022-12-13_19:10:47.759440) 19:10:51.034229 run osmo-hlr_10.42.42.2(pid=21070): stderr: | 20221213191047935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191047935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191047935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191047935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191047935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191047935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191047985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191047996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191047996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191047996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:10:51.084810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminating (SIGTERM) 19:10:51.125332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminating (SIGTERM) 19:10:51.165580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Terminating (SIGTERM) 19:10:51.206107 --- ParallelTerminationStrategy: PID 21069 died... 19:10:51.225646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21069): Terminated: ok {rc=0} 19:10:51.270361 --- ParallelTerminationStrategy: PID 21072 died... 19:10:51.289559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21072): Terminated: ok {rc=0} 19:10:51.333971 --- ParallelTerminationStrategy: PID 21075 died... 19:10:51.353028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21075): Terminated: ok {rc=0} 19:10:51.439602 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 19:10:52.748901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:10:52.754748 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:10:52.788639 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:10:52.827732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:10:52.914387 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:10:52.947773 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:10:52.985803 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:10:53.581222 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:10:53.630253 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:53.641393 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:10:53.692880 tst cs_paging_gprs_active.py: using LAC 35668 19:10:53.814369 tst cs_paging_gprs_active.py: using RAC 223 19:10:53.935555 tst cs_paging_gprs_active.py: using CellId 35668 19:10:54.060775 tst cs_paging_gprs_active.py: using BVCI 35669 19:10:54.171513 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.182610 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.193494 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.204229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.214885 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.225694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.236610 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.247385 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:10:54.258375 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:10:54.379924 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:10:54.499153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:10:54.706656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:55.016495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21081): Launched 19:10:55.285481 run iperf3-srv_10.42.42.10(pid=21082): Launched 19:10:55.400377 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:10:55.606274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:10:55.915414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21083): Launched 19:10:56.185113 run iperf3-srv_10.42.42.10(pid=21084): Launched 19:10:56.299809 tst cs_paging_gprs_active.py:38: start network... 19:10:56.506324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:10:56.983224 run create_hlr_db(pid=21085): Launched 19:10:57.111313 bus /gobi_6: Setting Powered False 19:10:58.172356 run create_hlr_db(pid=21085): Terminated: ok {rc=0} 19:10:58.601465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Launched 19:10:58.909901 run osmo-hlr_10.42.42.2(pid=21088): Launched 19:10:59.027190 run osmo-stp_10.42.42.5: Starting osmo-stp 19:10:59.559481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Launched 19:10:59.866689 run osmo-stp_10.42.42.5(pid=21091): Launched 19:10:59.984461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:00.514955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21093): Launched 19:11:00.632196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:00.917766 run patchelf(pid=21094): Launched 19:11:01.131617 run osmo-stp_10.42.42.5(pid=21091): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] 19:11:01.322336 run osmo-stp_10.42.42.5(pid=21091): stdout: | (launched: 2022-12-13_19:10:59.809763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:01.458452 run osmo-stp_10.42.42.5(pid=21091): stderr: | 20221213191059979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191059979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191059980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191059980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191059981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191059981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191059981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:01.592362 run osmo-stp_10.42.42.5(pid=21091): stdout: | (launched: 2022-12-13_19:10:59.809763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:01.720532 run osmo-stp_10.42.42.5(pid=21091): stderr: | 20221213191059979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191059979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191059980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191059980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191059981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191059981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191059981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:01.872527 run patchelf(pid=21094): Terminating (SIGINT) 19:11:02.048474 run patchelf(pid=21094): Terminated: ok {rc=0} 19:11:02.175809 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21091): Process ended prematurely: osmo-stp_10.42.42.5(pid=21091) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:11:02.186691 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:11:02.215290 run osmo-hlr_10.42.42.2(pid=21088): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21088)] 19:11:02.264267 run osmo-hlr_10.42.42.2(pid=21088): stdout: | (launched: 2022-12-13_19:10:58.852089) 19:11:02.314928 run osmo-hlr_10.42.42.2(pid=21088): stderr: | 20221213191059030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191059030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191059030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191059030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191059030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191059030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191059043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191059053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191059053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191059053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:02.365770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21081): Terminating (SIGTERM) 19:11:02.406130 run iperf3-srv_10.42.42.10(pid=21082): Terminating (SIGTERM) 19:11:02.446281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21083): Terminating (SIGTERM) 19:11:02.486592 run iperf3-srv_10.42.42.10(pid=21084): Terminating (SIGTERM) 19:11:02.526761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Terminating (SIGTERM) 19:11:02.567292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Terminating (SIGTERM) 19:11:02.607488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21093): Terminating (SIGTERM) 19:11:02.648347 --- ParallelTerminationStrategy: PID 21081 died... 19:11:02.667669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21081): Terminated: ok {rc=0} 19:11:02.711983 --- ParallelTerminationStrategy: PID 21082 died... 19:11:02.730718 run iperf3-srv_10.42.42.10(pid=21082): Terminated {rc=256} 19:11:02.774766 --- ParallelTerminationStrategy: PID 21083 died... 19:11:02.793670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21083): Terminated: ok {rc=0} 19:11:02.838032 --- ParallelTerminationStrategy: PID 21084 died... 19:11:02.856739 run iperf3-srv_10.42.42.10(pid=21084): Terminated {rc=256} 19:11:02.900616 --- ParallelTerminationStrategy: PID 21087 died... 19:11:02.919536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21087): Terminated: ok {rc=0} 19:11:02.964259 --- ParallelTerminationStrategy: PID 21090 died... 19:11:02.983124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21090): Terminated: ok {rc=0} 19:11:03.027419 --- ParallelTerminationStrategy: PID 21093 died... 19:11:03.046237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21093): Terminated: ok {rc=0} 19:11:03.132642 bus /gobi_0: Setting Powered False 19:11:04.232672 bus /gobi_0: Setting Powered False 19:11:05.349202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:11:06.496639 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:06.508380 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:11:06.562809 tst iperf3.py: using LAC 35669 19:11:06.684736 tst iperf3.py: using RAC 224 19:11:06.804263 tst iperf3.py: using CellId 35669 19:11:06.924997 tst iperf3.py: using BVCI 35670 19:11:07.034960 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.046287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.057525 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.068323 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.079169 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.090069 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.100931 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.111691 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:07.122691 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:07.239454 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:11:07.443862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:07.751517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Launched 19:11:08.018608 run iperf3-srv_10.42.42.10(pid=21096): Launched 19:11:08.135776 tst iperf3.py:8: start network... 19:11:08.340196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:08.813873 run create_hlr_db(pid=21097): Launched 19:11:08.941443 bus /gobi_6: Setting Powered False 19:11:10.002395 run create_hlr_db(pid=21097): Terminated: ok {rc=0} 19:11:10.453116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Launched 19:11:10.783934 run osmo-hlr_10.42.42.2(pid=21100): Launched 19:11:10.909779 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:11.482075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Launched 19:11:11.811452 run osmo-stp_10.42.42.5(pid=21103): Launched 19:11:11.938856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:12.507529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Launched 19:11:12.635104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:12.914023 run patchelf(pid=21106): Launched 19:11:13.097510 run osmo-stp_10.42.42.5(pid=21103): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] 19:11:13.237261 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-13_19:11:11.751242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:13.378276 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221213191111943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191111943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191111944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191111944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191111945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191111945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191111945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:13.520161 run osmo-stp_10.42.42.5(pid=21103): stdout: | (launched: 2022-12-13_19:11:11.751242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:13.655561 run osmo-stp_10.42.42.5(pid=21103): stderr: | 20221213191111943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191111943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191111944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191111944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191111945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191111945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191111945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:13.816238 run patchelf(pid=21106): Terminating (SIGINT) 19:11:13.999918 run patchelf(pid=21106): Terminated: ok {rc=0} 19:11:14.133216 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 19:11:14.143506 tst iperf3.py:8: Test FAILED (7.7 sec) 19:11:14.172162 run osmo-hlr_10.42.42.2(pid=21100): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21100)] 19:11:14.223763 run osmo-hlr_10.42.42.2(pid=21100): stdout: | (launched: 2022-12-13_19:11:10.723449) 19:11:14.276245 run osmo-hlr_10.42.42.2(pid=21100): stderr: | 20221213191110924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191110924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191110924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191110924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191110924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191110925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191110937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191110946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191110946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191110946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:14.329667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminating (SIGTERM) 19:11:14.372147 run iperf3-srv_10.42.42.10(pid=21096): Terminating (SIGTERM) 19:11:14.415167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminating (SIGTERM) 19:11:14.458390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminating (SIGTERM) 19:11:14.501372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Terminating (SIGTERM) 19:11:14.544330 --- ParallelTerminationStrategy: PID 21095 died... 19:11:14.565111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21095): Terminated: ok {rc=0} 19:11:14.612237 --- ParallelTerminationStrategy: PID 21096 died... 19:11:14.632322 run iperf3-srv_10.42.42.10(pid=21096): Terminated {rc=256} 19:11:14.679170 --- ParallelTerminationStrategy: PID 21099 died... 19:11:14.699148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21099): Terminated: ok {rc=0} 19:11:14.745847 --- ParallelTerminationStrategy: PID 21102 died... 19:11:14.766038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21102): Terminated: ok {rc=0} 19:11:14.812651 --- ParallelTerminationStrategy: PID 21105 died... 19:11:14.832865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21105): Terminated: ok {rc=0} 19:11:14.921497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:11:16.078805 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.092054 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:11:16.148331 tst iperf3m4.py: using LAC 35670 19:11:16.312503 tst iperf3m4.py: using RAC 225 19:11:16.434922 tst iperf3m4.py: using CellId 35670 19:11:16.582937 tst iperf3m4.py: using BVCI 35671 19:11:16.707970 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.720633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.733097 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.745631 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.758974 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.773241 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.787230 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.800656 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:16.814656 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:16.959729 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:17.101126 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:17.236920 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:17.362903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:11:17.586182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:17.917607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21107): Launched 19:11:18.206761 run iperf3-srv_10.42.42.10(pid=21108): Launched 19:11:18.332781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:11:18.555436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:18.887898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21109): Launched 19:11:19.175956 run iperf3-srv_10.42.42.10(pid=21110): Launched 19:11:19.301510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:11:19.523929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:19.855403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21111): Launched 19:11:20.143635 run iperf3-srv_10.42.42.10(pid=21112): Launched 19:11:20.269668 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:11:20.492583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:20.824762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21113): Launched 19:11:21.113744 run iperf3-srv_10.42.42.10(pid=21114): Launched 19:11:21.237613 tst iperf3m4.py:8: start network... 19:11:21.460164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:21.970720 run create_hlr_db(pid=21115): Launched 19:11:22.096814 bus /gobi_6: Setting Powered False 19:11:23.161755 run create_hlr_db(pid=21115): Terminated: ok {rc=0} 19:11:23.601529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21117): Launched 19:11:23.910084 run osmo-hlr_10.42.42.2(pid=21118): Launched 19:11:24.027168 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:24.564850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21120): Launched 19:11:24.876054 run osmo-stp_10.42.42.5(pid=21121): Launched 19:11:24.994306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:25.524686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21123): Launched 19:11:25.642063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:25.902436 run patchelf(pid=21124): Launched 19:11:26.072585 run osmo-stp_10.42.42.5(pid=21121): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21121)] 19:11:26.202375 run osmo-stp_10.42.42.5(pid=21121): stdout: | (launched: 2022-12-13_19:11:24.818427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:26.334458 run osmo-stp_10.42.42.5(pid=21121): stderr: | 20221213191124989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191124989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191124989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191124990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191124990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191124990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191124990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:26.465590 run osmo-stp_10.42.42.5(pid=21121): stdout: | (launched: 2022-12-13_19:11:24.818427) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:26.591353 run osmo-stp_10.42.42.5(pid=21121): stderr: | 20221213191124989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191124989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191124989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191124990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191124990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191124990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191124990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:26.740024 run patchelf(pid=21124): Terminating (SIGINT) 19:11:26.911440 run patchelf(pid=21124): Terminated: ok {rc=0} 19:11:27.035006 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21121): Process ended prematurely: osmo-stp_10.42.42.5(pid=21121) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21121)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 19:11:27.044431 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:11:27.072034 run osmo-hlr_10.42.42.2(pid=21118): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21118)] 19:11:27.120204 run osmo-hlr_10.42.42.2(pid=21118): stdout: | (launched: 2022-12-13_19:11:23.853042) 19:11:27.170191 run osmo-hlr_10.42.42.2(pid=21118): stderr: | 20221213191124030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191124030 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191124030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191124030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191124030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191124030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191124043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191124052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191124052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191124052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:27.220220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21107): Terminating (SIGTERM) 19:11:27.260317 run iperf3-srv_10.42.42.10(pid=21108): Terminating (SIGTERM) 19:11:27.300408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21109): Terminating (SIGTERM) 19:11:27.340331 run iperf3-srv_10.42.42.10(pid=21110): Terminating (SIGTERM) 19:11:27.380121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21111): Terminating (SIGTERM) 19:11:27.420208 run iperf3-srv_10.42.42.10(pid=21112): Terminating (SIGTERM) 19:11:27.460153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21113): Terminating (SIGTERM) 19:11:27.500014 run iperf3-srv_10.42.42.10(pid=21114): Terminating (SIGTERM) 19:11:27.539789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21117): Terminating (SIGTERM) 19:11:27.579790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21120): Terminating (SIGTERM) 19:11:27.619603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21123): Terminating (SIGTERM) 19:11:27.659987 --- ParallelTerminationStrategy: PID 21107 died... 19:11:27.679373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21107): Terminated: ok {rc=0} 19:11:27.723582 --- ParallelTerminationStrategy: PID 21108 died... 19:11:27.742312 run iperf3-srv_10.42.42.10(pid=21108): Terminated {rc=256} 19:11:27.786216 --- ParallelTerminationStrategy: PID 21109 died... 19:11:27.805020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21109): Terminated: ok {rc=0} 19:11:27.849148 --- ParallelTerminationStrategy: PID 21110 died... 19:11:27.867835 run iperf3-srv_10.42.42.10(pid=21110): Terminated {rc=256} 19:11:27.911697 --- ParallelTerminationStrategy: PID 21111 died... 19:11:27.930508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21111): Terminated: ok {rc=0} 19:11:27.974454 --- ParallelTerminationStrategy: PID 21112 died... 19:11:27.993086 run iperf3-srv_10.42.42.10(pid=21112): Terminated {rc=256} 19:11:28.036700 --- ParallelTerminationStrategy: PID 21113 died... 19:11:28.055494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21113): Terminated: ok {rc=0} 19:11:28.099442 --- ParallelTerminationStrategy: PID 21114 died... 19:11:28.118338 run iperf3-srv_10.42.42.10(pid=21114): Terminated {rc=256} 19:11:28.162047 --- ParallelTerminationStrategy: PID 21117 died... 19:11:28.181298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21117): Terminated: ok {rc=0} 19:11:28.225338 --- ParallelTerminationStrategy: PID 21120 died... 19:11:28.244367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21120): Terminated: ok {rc=0} 19:11:28.288272 --- ParallelTerminationStrategy: PID 21123 died... 19:11:28.307118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21123): Terminated: ok {rc=0} 19:11:28.393634 bus /gobi_4: Setting Powered False 19:11:29.494736 bus /gobi_4: Setting Powered False 19:11:30.612812 bus /gobi_1: Setting Powered False 19:11:31.708584 bus /gobi_1: Setting Powered False 19:11:32.823583 bus /gobi_0: Setting Powered False 19:11:33.922510 bus /gobi_0: Setting Powered False 19:11:35.039661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 19:11:36.140872 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.152753 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:11:36.205147 tst ping.py: using LAC 35671 19:11:36.324680 tst ping.py: using RAC 226 19:11:36.442748 tst ping.py: using CellId 35671 19:11:36.563627 tst ping.py: using BVCI 35672 19:11:36.674287 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.685734 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.696743 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.707779 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.718921 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.730044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.741429 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:36.752277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:36.869224 tst ping.py:19: start network... 19:11:37.070477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:37.538237 run create_hlr_db(pid=21125): Launched 19:11:37.662997 bus /gobi_6: Setting Powered False 19:11:38.723171 run create_hlr_db(pid=21125): Terminated: ok {rc=0} 19:11:39.144241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Launched 19:11:39.446504 run osmo-hlr_10.42.42.2(pid=21128): Launched 19:11:39.562969 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:40.085608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Launched 19:11:40.387747 run osmo-stp_10.42.42.5(pid=21131): Launched 19:11:40.503862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:41.024198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Launched 19:11:41.139238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:41.394506 run patchelf(pid=21134): Launched 19:11:41.563713 run osmo-stp_10.42.42.5(pid=21131): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] 19:11:41.691359 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-13_19:11:40.331103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:41.820227 run osmo-stp_10.42.42.5(pid=21131): stderr: | 20221213191140502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191140502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191140502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191140503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191140503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191140503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191140503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:41.949555 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-13_19:11:40.331103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:42.073081 run osmo-stp_10.42.42.5(pid=21131): stderr: | 20221213191140502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191140502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191140502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191140503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191140503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191140503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191140503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:42.219339 run patchelf(pid=21134): Terminating (SIGINT) 19:11:42.388903 run patchelf(pid=21134): Terminated: ok {rc=0} 19:11:42.510825 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 19:11:42.519649 tst ping.py:22: Test FAILED (6.4 sec) 19:11:42.546436 run osmo-hlr_10.42.42.2(pid=21128): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21128)] 19:11:42.594718 run osmo-hlr_10.42.42.2(pid=21128): stdout: | (launched: 2022-12-13_19:11:39.390310) 19:11:42.644337 run osmo-hlr_10.42.42.2(pid=21128): stderr: | 20221213191139567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191139567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191139567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191139567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191139568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191139568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191139580 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191139589 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191139589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191139589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:42.694266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminating (SIGTERM) 19:11:42.734432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminating (SIGTERM) 19:11:42.774327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminating (SIGTERM) 19:11:42.814641 --- ParallelTerminationStrategy: PID 21127 died... 19:11:42.834197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminated: ok {rc=0} 19:11:42.878597 --- ParallelTerminationStrategy: PID 21130 died... 19:11:42.897645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminated: ok {rc=0} 19:11:42.941832 --- ParallelTerminationStrategy: PID 21133 died... 19:11:42.960658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminated: ok {rc=0} 19:11:43.047611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:11:44.136452 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.149003 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:11:44.204936 tst ping_idle_ping.py: using LAC 35672 19:11:44.332422 tst ping_idle_ping.py: using RAC 227 19:11:44.459348 tst ping_idle_ping.py: using CellId 35672 19:11:44.586974 tst ping_idle_ping.py: using BVCI 35673 19:11:44.704618 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.716374 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.727770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.739168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.750796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.762442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.774363 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:11:44.786145 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:11:44.902804 tst ping_idle_ping.py:24: start network... 19:11:45.106714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:45.580652 run create_hlr_db(pid=21135): Launched 19:11:45.705239 bus /gobi_6: Setting Powered False 19:11:46.764145 run create_hlr_db(pid=21135): Terminated: ok {rc=0} 19:11:47.208285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Launched 19:11:47.524229 run osmo-hlr_10.42.42.2(pid=21138): Launched 19:11:47.640812 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:48.175956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Launched 19:11:48.503347 run osmo-stp_10.42.42.5(pid=21141): Launched 19:11:48.627235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:11:49.191321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Launched 19:11:49.317176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:11:49.592838 run patchelf(pid=21144): Launched 19:11:49.774844 run osmo-stp_10.42.42.5(pid=21141): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] 19:11:49.912633 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-13_19:11:48.442545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:50.052203 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221213191148636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191148636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191148636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191148637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191148637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191148637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191148637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:50.191919 run osmo-stp_10.42.42.5(pid=21141): stdout: | (launched: 2022-12-13_19:11:48.442545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:11:50.325571 run osmo-stp_10.42.42.5(pid=21141): stderr: | 20221213191148636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191148636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191148636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191148637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191148637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191148637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191148637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:11:50.483932 run patchelf(pid=21144): Terminating (SIGINT) 19:11:50.665127 run patchelf(pid=21144): Terminated: ok {rc=0} 19:11:50.795703 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 19:11:50.805357 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:11:50.833637 run osmo-hlr_10.42.42.2(pid=21138): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21138)] 19:11:50.884778 run osmo-hlr_10.42.42.2(pid=21138): stdout: | (launched: 2022-12-13_19:11:47.467451) 19:11:50.937715 run osmo-hlr_10.42.42.2(pid=21138): stderr: | 20221213191147646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191147646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191147646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191147646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191147646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191147646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191147658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191147667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191147667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191147667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:11:50.990736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminating (SIGTERM) 19:11:51.032799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminating (SIGTERM) 19:11:51.075794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminating (SIGTERM) 19:11:51.118598 --- ParallelTerminationStrategy: PID 21137 died... 19:11:51.139473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21137): Terminated: ok {rc=0} 19:11:51.186502 --- ParallelTerminationStrategy: PID 21140 died... 19:11:51.206585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21140): Terminated: ok {rc=0} 19:11:51.253345 --- ParallelTerminationStrategy: PID 21143 died... 19:11:51.273477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21143): Terminated: ok {rc=0} 19:11:51.362814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:11:52.679533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:11:52.686168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:11:52.721196 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:11:52.762111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:11:52.854850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:11:52.888780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:11:52.927168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:11:53.521462 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:11:53.570911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:53.582301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:11:53.653021 tst cs_paging_gprs_active.py: using LAC 35673 19:11:53.773159 tst cs_paging_gprs_active.py: using RAC 228 19:11:53.893729 tst cs_paging_gprs_active.py: using CellId 35673 19:11:54.027248 tst cs_paging_gprs_active.py: using BVCI 35674 19:11:54.149298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.160863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.172302 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.183681 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.195350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.206951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.218773 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.230433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:11:54.242387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:11:54.360005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:11:54.481172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:11:54.704853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:55.035473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21149): Launched 19:11:55.324927 run iperf3-srv_10.42.42.10(pid=21150): Launched 19:11:55.448133 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:11:55.671228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:11:56.002717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21151): Launched 19:11:56.290288 run iperf3-srv_10.42.42.10(pid=21152): Launched 19:11:56.415188 tst cs_paging_gprs_active.py:38: start network... 19:11:56.638725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:11:57.150452 run create_hlr_db(pid=21153): Launched 19:11:57.277341 bus /gobi_6: Setting Powered False 19:11:58.342880 run create_hlr_db(pid=21153): Terminated: ok {rc=0} 19:11:58.782354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21155): Launched 19:11:59.090318 run osmo-hlr_10.42.42.2(pid=21156): Launched 19:11:59.209861 run osmo-stp_10.42.42.5: Starting osmo-stp 19:11:59.756814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21158): Launched 19:12:00.063913 run osmo-stp_10.42.42.5(pid=21160): Launched 19:12:00.180848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:00.713333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21162): Launched 19:12:00.830539 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:01.101332 run patchelf(pid=21163): Launched 19:12:01.312406 run osmo-stp_10.42.42.5(pid=21160): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21160)] 19:12:01.448914 run osmo-stp_10.42.42.5(pid=21160): stdout: | (launched: 2022-12-13_19:12:00.006942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:01.583945 run osmo-stp_10.42.42.5(pid=21160): stderr: | 20221213191200177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191200177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191200177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191200177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191200178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191200178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191200178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:01.719251 run osmo-stp_10.42.42.5(pid=21160): stdout: | (launched: 2022-12-13_19:12:00.006942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:01.847826 run osmo-stp_10.42.42.5(pid=21160): stderr: | 20221213191200177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191200177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191200177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191200177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191200178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191200178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191200178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:02.000717 run patchelf(pid=21163): Terminating (SIGINT) 19:12:02.177685 run patchelf(pid=21163): Terminated: ok {rc=0} 19:12:02.310239 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21160): Process ended prematurely: osmo-stp_10.42.42.5(pid=21160) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21160)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:12:02.321082 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:12:02.350365 run osmo-hlr_10.42.42.2(pid=21156): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21156)] 19:12:02.402712 run osmo-hlr_10.42.42.2(pid=21156): stdout: | (launched: 2022-12-13_19:11:59.033267) 19:12:02.456131 run osmo-hlr_10.42.42.2(pid=21156): stderr: | 20221213191159210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191159210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191159210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191159210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191159210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191159210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191159222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191159230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191159230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191159230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:02.509740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21149): Terminating (SIGTERM) 19:12:02.552402 run iperf3-srv_10.42.42.10(pid=21150): Terminating (SIGTERM) 19:12:02.594824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21151): Terminating (SIGTERM) 19:12:02.637371 run iperf3-srv_10.42.42.10(pid=21152): Terminating (SIGTERM) 19:12:02.679684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21155): Terminating (SIGTERM) 19:12:02.722202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21158): Terminating (SIGTERM) 19:12:02.764865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21162): Terminating (SIGTERM) 19:12:02.807585 --- ParallelTerminationStrategy: PID 21149 died... 19:12:02.828231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21149): Terminated: ok {rc=0} 19:12:02.875635 --- ParallelTerminationStrategy: PID 21150 died... 19:12:02.895926 run iperf3-srv_10.42.42.10(pid=21150): Terminated {rc=256} 19:12:02.942960 --- ParallelTerminationStrategy: PID 21151 died... 19:12:02.963278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21151): Terminated: ok {rc=0} 19:12:03.010074 --- ParallelTerminationStrategy: PID 21152 died... 19:12:03.030191 run iperf3-srv_10.42.42.10(pid=21152): Terminated {rc=256} 19:12:03.077262 --- ParallelTerminationStrategy: PID 21155 died... 19:12:03.097697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21155): Terminated: ok {rc=0} 19:12:03.144557 --- ParallelTerminationStrategy: PID 21158 died... 19:12:03.164788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21158): Terminated: ok {rc=0} 19:12:03.211844 --- ParallelTerminationStrategy: PID 21162 died... 19:12:03.232099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21162): Terminated: ok {rc=0} 19:12:03.328860 bus /gobi_0: Setting Powered False 19:12:04.429441 bus /gobi_0: Setting Powered False 19:12:05.546019 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:12:06.693881 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:06.705714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:12:06.779069 tst iperf3.py: using LAC 35674 19:12:06.899786 tst iperf3.py: using RAC 229 19:12:07.020869 tst iperf3.py: using CellId 35674 19:12:07.140374 tst iperf3.py: using BVCI 35675 19:12:07.261766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.273587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.285124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.296675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.308801 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.320886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.333328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.345139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:07.357285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:07.478059 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:12:07.701075 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:08.031817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21164): Launched 19:12:08.321185 run iperf3-srv_10.42.42.10(pid=21165): Launched 19:12:08.446193 tst iperf3.py:8: start network... 19:12:08.668587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:09.179663 run create_hlr_db(pid=21166): Launched 19:12:09.305278 bus /gobi_6: Setting Powered False 19:12:10.371153 run create_hlr_db(pid=21166): Terminated: ok {rc=0} 19:12:10.829966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21168): Launched 19:12:11.160464 run osmo-hlr_10.42.42.2(pid=21169): Launched 19:12:11.288302 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:11.859686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21171): Launched 19:12:12.191117 run osmo-stp_10.42.42.5(pid=21172): Launched 19:12:12.317930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:12.885667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21174): Launched 19:12:13.011159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:13.289962 run patchelf(pid=21175): Launched 19:12:13.472197 run osmo-stp_10.42.42.5(pid=21172): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21172)] 19:12:13.611555 run osmo-stp_10.42.42.5(pid=21172): stdout: | (launched: 2022-12-13_19:12:12.130579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:13.752247 run osmo-stp_10.42.42.5(pid=21172): stderr: | 20221213191212325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191212325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191212325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191212326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191212326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191212326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191212326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:13.893587 run osmo-stp_10.42.42.5(pid=21172): stdout: | (launched: 2022-12-13_19:12:12.130579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:14.028483 run osmo-stp_10.42.42.5(pid=21172): stderr: | 20221213191212325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191212325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191212325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191212326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191212326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191212326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191212326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:14.189892 run patchelf(pid=21175): Terminating (SIGINT) 19:12:14.374505 run patchelf(pid=21175): Terminated: ok {rc=0} 19:12:14.507842 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21172): Process ended prematurely: osmo-stp_10.42.42.5(pid=21172) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21172)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 19:12:14.518464 tst iperf3.py:8: Test FAILED (7.9 sec) 19:12:14.547139 run osmo-hlr_10.42.42.2(pid=21169): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21169)] 19:12:14.598452 run osmo-hlr_10.42.42.2(pid=21169): stdout: | (launched: 2022-12-13_19:12:11.099740) 19:12:14.651646 run osmo-hlr_10.42.42.2(pid=21169): stderr: | 20221213191211299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191211299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191211299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191211299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191211299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191211299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191211312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191211320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191211321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191211321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:14.704534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21164): Terminating (SIGTERM) 19:12:14.747067 run iperf3-srv_10.42.42.10(pid=21165): Terminating (SIGTERM) 19:12:14.789620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21168): Terminating (SIGTERM) 19:12:14.832586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21171): Terminating (SIGTERM) 19:12:14.875072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21174): Terminating (SIGTERM) 19:12:14.918412 --- ParallelTerminationStrategy: PID 21164 died... 19:12:14.939542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21164): Terminated: ok {rc=0} 19:12:14.986610 --- ParallelTerminationStrategy: PID 21165 died... 19:12:15.006559 run iperf3-srv_10.42.42.10(pid=21165): Terminated {rc=256} 19:12:15.053541 --- ParallelTerminationStrategy: PID 21168 died... 19:12:15.073683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21168): Terminated: ok {rc=0} 19:12:15.120579 --- ParallelTerminationStrategy: PID 21171 died... 19:12:15.140786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21171): Terminated: ok {rc=0} 19:12:15.186880 --- ParallelTerminationStrategy: PID 21174 died... 19:12:15.207004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21174): Terminated: ok {rc=0} 19:12:15.295434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:12:16.446012 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:16.458937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:12:16.530795 tst iperf3m4.py: using LAC 35675 19:12:16.657150 tst iperf3m4.py: using RAC 230 19:12:16.788608 tst iperf3m4.py: using CellId 35675 19:12:16.920798 tst iperf3m4.py: using BVCI 35676 19:12:17.050718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.063653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.076228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.088909 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.103674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.117352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.132077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.144421 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:17.157882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:17.288241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:17.407863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:17.529148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:17.647060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:12:17.853145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:18.161835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21176): Launched 19:12:18.430198 run iperf3-srv_10.42.42.10(pid=21177): Launched 19:12:18.547417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:12:18.754354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:19.063092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21178): Launched 19:12:19.331032 run iperf3-srv_10.42.42.10(pid=21179): Launched 19:12:19.447782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:12:19.652438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:19.961151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21180): Launched 19:12:20.229142 run iperf3-srv_10.42.42.10(pid=21181): Launched 19:12:20.343765 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:12:20.548421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:20.858022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21182): Launched 19:12:21.127338 run iperf3-srv_10.42.42.10(pid=21183): Launched 19:12:21.243590 tst iperf3m4.py:8: start network... 19:12:21.448039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:21.924203 run create_hlr_db(pid=21184): Launched 19:12:22.049602 bus /gobi_6: Setting Powered False 19:12:23.115472 run create_hlr_db(pid=21184): Terminated: ok {rc=0} 19:12:23.575223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21186): Launched 19:12:23.908132 run osmo-hlr_10.42.42.2(pid=21187): Launched 19:12:24.035984 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:24.605142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21189): Launched 19:12:24.936382 run osmo-stp_10.42.42.5(pid=21190): Launched 19:12:25.064404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:25.634107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21192): Launched 19:12:25.761408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:26.040696 run patchelf(pid=21193): Launched 19:12:26.223950 run osmo-stp_10.42.42.5(pid=21190): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21190)] 19:12:26.363438 run osmo-stp_10.42.42.5(pid=21190): stdout: | (launched: 2022-12-13_19:12:24.875469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:26.504051 run osmo-stp_10.42.42.5(pid=21190): stderr: | 20221213191225068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191225068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191225069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191225069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191225070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191225070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191225070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:26.644464 run osmo-stp_10.42.42.5(pid=21190): stdout: | (launched: 2022-12-13_19:12:24.875469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:26.779685 run osmo-stp_10.42.42.5(pid=21190): stderr: | 20221213191225068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191225068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191225069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191225069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191225070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191225070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191225070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:26.939732 run patchelf(pid=21193): Terminating (SIGINT) 19:12:27.123953 run patchelf(pid=21193): Terminated: ok {rc=0} 19:12:27.256384 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21190): Process ended prematurely: osmo-stp_10.42.42.5(pid=21190) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21190)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:12:27.266719 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:12:27.295483 run osmo-hlr_10.42.42.2(pid=21187): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21187)] 19:12:27.346713 run osmo-hlr_10.42.42.2(pid=21187): stdout: | (launched: 2022-12-13_19:12:23.847290) 19:12:27.399023 run osmo-hlr_10.42.42.2(pid=21187): stderr: | 20221213191224049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191224049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191224049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191224049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191224049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191224049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191224060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191224069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191224069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191224069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:27.451673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21176): Terminating (SIGTERM) 19:12:27.493545 run iperf3-srv_10.42.42.10(pid=21177): Terminating (SIGTERM) 19:12:27.535736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21178): Terminating (SIGTERM) 19:12:27.578121 run iperf3-srv_10.42.42.10(pid=21179): Terminating (SIGTERM) 19:12:27.620080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21180): Terminating (SIGTERM) 19:12:27.662321 run iperf3-srv_10.42.42.10(pid=21181): Terminating (SIGTERM) 19:12:27.704037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21182): Terminating (SIGTERM) 19:12:27.746065 run iperf3-srv_10.42.42.10(pid=21183): Terminating (SIGTERM) 19:12:27.788090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21186): Terminating (SIGTERM) 19:12:27.830284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21189): Terminating (SIGTERM) 19:12:27.872328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21192): Terminating (SIGTERM) 19:12:27.915178 --- ParallelTerminationStrategy: PID 21176 died... 19:12:27.935762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21176): Terminated: ok {rc=0} 19:12:27.982408 --- ParallelTerminationStrategy: PID 21177 died... 19:12:28.002316 run iperf3-srv_10.42.42.10(pid=21177): Terminated {rc=256} 19:12:28.048654 --- ParallelTerminationStrategy: PID 21178 died... 19:12:28.069059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21178): Terminated: ok {rc=0} 19:12:28.115477 --- ParallelTerminationStrategy: PID 21179 died... 19:12:28.135407 run iperf3-srv_10.42.42.10(pid=21179): Terminated {rc=256} 19:12:28.181704 --- ParallelTerminationStrategy: PID 21180 died... 19:12:28.201707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21180): Terminated: ok {rc=0} 19:12:28.247885 --- ParallelTerminationStrategy: PID 21181 died... 19:12:28.267753 run iperf3-srv_10.42.42.10(pid=21181): Terminated {rc=256} 19:12:28.313883 --- ParallelTerminationStrategy: PID 21182 died... 19:12:28.334004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21182): Terminated: ok {rc=0} 19:12:28.380171 --- ParallelTerminationStrategy: PID 21183 died... 19:12:28.400117 run iperf3-srv_10.42.42.10(pid=21183): Terminated {rc=256} 19:12:28.446478 --- ParallelTerminationStrategy: PID 21186 died... 19:12:28.466514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21186): Terminated: ok {rc=0} 19:12:28.512940 --- ParallelTerminationStrategy: PID 21189 died... 19:12:28.533090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21189): Terminated: ok {rc=0} 19:12:28.579356 --- ParallelTerminationStrategy: PID 21192 died... 19:12:28.599326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21192): Terminated: ok {rc=0} 19:12:28.687528 bus /gobi_4: Setting Powered False 19:12:29.786617 bus /gobi_4: Setting Powered False 19:12:30.917325 bus /gobi_1: Setting Powered False 19:12:32.014233 bus /gobi_1: Setting Powered False 19:12:33.134848 bus /gobi_0: Setting Powered False 19:12:34.234007 bus /gobi_0: Setting Powered False 19:12:35.351320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:12:36.455232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:36.467213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:12:36.538188 tst ping.py: using LAC 35676 19:12:36.660738 tst ping.py: using RAC 231 19:12:36.778098 tst ping.py: using CellId 35676 19:12:36.894328 tst ping.py: using BVCI 35677 19:12:37.003464 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.014777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.026079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.037279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.048141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.059057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.070146 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:37.081062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:37.195893 tst ping.py:19: start network... 19:12:37.396094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:37.861713 run create_hlr_db(pid=21194): Launched 19:12:37.984072 bus /gobi_6: Setting Powered False 19:12:39.044571 run create_hlr_db(pid=21194): Terminated: ok {rc=0} 19:12:39.486512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21196): Launched 19:12:39.808515 run osmo-hlr_10.42.42.2(pid=21197): Launched 19:12:39.933671 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:40.498622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21199): Launched 19:12:40.822601 run osmo-stp_10.42.42.5(pid=21200): Launched 19:12:40.947269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:41.506417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21202): Launched 19:12:41.631504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:41.906131 run patchelf(pid=21203): Launched 19:12:42.086222 run osmo-stp_10.42.42.5(pid=21200): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21200)] 19:12:42.223430 run osmo-stp_10.42.42.5(pid=21200): stdout: | (launched: 2022-12-13_19:12:40.762812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:42.361920 run osmo-stp_10.42.42.5(pid=21200): stderr: | 20221213191240957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191240957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191240957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191240957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191240958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191240958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191240958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:42.500113 run osmo-stp_10.42.42.5(pid=21200): stdout: | (launched: 2022-12-13_19:12:40.762812) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:42.633082 run osmo-stp_10.42.42.5(pid=21200): stderr: | 20221213191240957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191240957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191240957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191240957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191240958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191240958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191240958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:42.790576 run patchelf(pid=21203): Terminating (SIGINT) 19:12:42.971498 run patchelf(pid=21203): Terminated: ok {rc=0} 19:12:43.102540 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21200): Process ended prematurely: osmo-stp_10.42.42.5(pid=21200) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21200)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 19:12:43.112212 tst ping.py:22: Test FAILED (6.6 sec) 19:12:43.140470 run osmo-hlr_10.42.42.2(pid=21197): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21197)] 19:12:43.192245 run osmo-hlr_10.42.42.2(pid=21197): stdout: | (launched: 2022-12-13_19:12:39.749056) 19:12:43.245160 run osmo-hlr_10.42.42.2(pid=21197): stderr: | 20221213191239949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191239950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191239950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191239950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191239950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191239950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191239965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191239975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191239975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191239975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:43.298391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21196): Terminating (SIGTERM) 19:12:43.340780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21199): Terminating (SIGTERM) 19:12:43.383601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21202): Terminating (SIGTERM) 19:12:43.426681 --- ParallelTerminationStrategy: PID 21196 died... 19:12:43.447448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21196): Terminated: ok {rc=0} 19:12:43.494632 --- ParallelTerminationStrategy: PID 21199 died... 19:12:43.514867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21199): Terminated: ok {rc=0} 19:12:43.561693 --- ParallelTerminationStrategy: PID 21202 died... 19:12:43.581772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21202): Terminated: ok {rc=0} 19:12:43.671182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:12:44.758640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:44.771519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:12:44.846602 tst ping_idle_ping.py: using LAC 35677 19:12:44.974105 tst ping_idle_ping.py: using RAC 232 19:12:45.105693 tst ping_idle_ping.py: using CellId 35677 19:12:45.224790 tst ping_idle_ping.py: using BVCI 35678 19:12:45.334327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.345859 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.356994 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.367914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.378946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.389962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.400888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:12:45.411829 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:12:45.530060 tst ping_idle_ping.py:24: start network... 19:12:45.750304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:46.272496 run create_hlr_db(pid=21204): Launched 19:12:46.435532 bus /gobi_6: Setting Powered False 19:12:47.499664 run create_hlr_db(pid=21204): Terminated: ok {rc=0} 19:12:47.934073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Launched 19:12:48.237276 run osmo-hlr_10.42.42.2(pid=21207): Launched 19:12:48.353084 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:48.871832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Launched 19:12:49.176148 run osmo-stp_10.42.42.5(pid=21210): Launched 19:12:49.290477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:12:49.811089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Launched 19:12:49.927583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:12:50.182770 run patchelf(pid=21213): Launched 19:12:50.349843 run osmo-stp_10.42.42.5(pid=21210): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] 19:12:50.477085 run osmo-stp_10.42.42.5(pid=21210): stdout: | (launched: 2022-12-13_19:12:49.120103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:50.605531 run osmo-stp_10.42.42.5(pid=21210): stderr: | 20221213191249292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191249292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191249292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191249293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191249293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191249293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191249293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:50.734361 run osmo-stp_10.42.42.5(pid=21210): stdout: | (launched: 2022-12-13_19:12:49.120103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:12:50.857441 run osmo-stp_10.42.42.5(pid=21210): stderr: | 20221213191249292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191249292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191249292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191249293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191249293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191249293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191249293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:12:51.004170 run patchelf(pid=21213): Terminating (SIGINT) 19:12:51.172777 run patchelf(pid=21213): Terminated: ok {rc=0} 19:12:51.294245 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21210): Process ended prematurely: osmo-stp_10.42.42.5(pid=21210) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:12:51.303147 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:12:51.329894 run osmo-hlr_10.42.42.2(pid=21207): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21207)] 19:12:51.378164 run osmo-hlr_10.42.42.2(pid=21207): stdout: | (launched: 2022-12-13_19:12:48.181090) 19:12:51.427574 run osmo-hlr_10.42.42.2(pid=21207): stderr: | 20221213191248357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191248357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191248358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191248358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191248358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191248358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191248383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191248393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191248393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191248393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:12:51.477529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Terminating (SIGTERM) 19:12:51.518338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Terminating (SIGTERM) 19:12:51.558619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Terminating (SIGTERM) 19:12:51.599330 --- ParallelTerminationStrategy: PID 21206 died... 19:12:51.618607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21206): Terminated: ok {rc=0} 19:12:51.662751 --- ParallelTerminationStrategy: PID 21209 died... 19:12:51.681828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21209): Terminated: ok {rc=0} 19:12:51.725732 --- ParallelTerminationStrategy: PID 21212 died... 19:12:51.744068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21212): Terminated: ok {rc=0} 19:12:51.836307 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:12:53.145385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:12:53.152014 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:12:53.186656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:12:53.225363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:12:53.314260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:12:53.348288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:12:53.387237 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:12:53.982206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:12:54.032238 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.043665 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:12:54.115440 tst cs_paging_gprs_active.py: using LAC 35678 19:12:54.241769 tst cs_paging_gprs_active.py: using RAC 233 19:12:54.363767 tst cs_paging_gprs_active.py: using CellId 35678 19:12:54.483109 tst cs_paging_gprs_active.py: using BVCI 35679 19:12:54.594894 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.606122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.617177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.628059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.639234 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.650350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.661419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.672594 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:12:54.684043 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:12:54.803367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:12:54.921822 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:12:55.129489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:55.439446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21217): Launched 19:12:55.708710 run iperf3-srv_10.42.42.10(pid=21218): Launched 19:12:55.823970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:12:56.029928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:12:56.338855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Launched 19:12:56.607866 run iperf3-srv_10.42.42.10(pid=21220): Launched 19:12:56.723293 tst cs_paging_gprs_active.py:38: start network... 19:12:56.930228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:12:57.407790 run create_hlr_db(pid=21221): Launched 19:12:57.534251 bus /gobi_6: Setting Powered False 19:12:58.595009 run create_hlr_db(pid=21221): Terminated: ok {rc=0} 19:12:59.023985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21223): Launched 19:12:59.331742 run osmo-hlr_10.42.42.2(pid=21224): Launched 19:12:59.449398 run osmo-stp_10.42.42.5: Starting osmo-stp 19:12:59.976932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21226): Launched 19:13:00.283887 run osmo-stp_10.42.42.5(pid=21227): Launched 19:13:00.401234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:00.937674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21229): Launched 19:13:01.097439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:01.376165 run patchelf(pid=21230): Launched 19:13:01.562624 run osmo-stp_10.42.42.5(pid=21227): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21227)] 19:13:01.694872 run osmo-stp_10.42.42.5(pid=21227): stdout: | (launched: 2022-12-13_19:13:00.227061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:01.828430 run osmo-stp_10.42.42.5(pid=21227): stderr: | 20221213191300399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191300400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191300400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191300400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191300401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191300401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191300401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:01.963267 run osmo-stp_10.42.42.5(pid=21227): stdout: | (launched: 2022-12-13_19:13:00.227061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:02.092100 run osmo-stp_10.42.42.5(pid=21227): stderr: | 20221213191300399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191300400 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191300400 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191300400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191300401 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191300401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191300401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:02.244276 run patchelf(pid=21230): Terminating (SIGINT) 19:13:02.417999 run patchelf(pid=21230): Terminated: ok {rc=0} 19:13:02.542282 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21227): Process ended prematurely: osmo-stp_10.42.42.5(pid=21227) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21227)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:13:02.552058 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:13:02.579412 run osmo-hlr_10.42.42.2(pid=21224): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21224)] 19:13:02.627673 run osmo-hlr_10.42.42.2(pid=21224): stdout: | (launched: 2022-12-13_19:12:59.274647) 19:13:02.677386 run osmo-hlr_10.42.42.2(pid=21224): stderr: | 20221213191259451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191259451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191259451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191259451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191259451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191259451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191259464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191259472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191259473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191259473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:02.727394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21217): Terminating (SIGTERM) 19:13:02.767546 run iperf3-srv_10.42.42.10(pid=21218): Terminating (SIGTERM) 19:13:02.807920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Terminating (SIGTERM) 19:13:02.847924 run iperf3-srv_10.42.42.10(pid=21220): Terminating (SIGTERM) 19:13:02.888246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21223): Terminating (SIGTERM) 19:13:02.928335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21226): Terminating (SIGTERM) 19:13:02.968594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21229): Terminating (SIGTERM) 19:13:03.009401 --- ParallelTerminationStrategy: PID 21217 died... 19:13:03.028794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21217): Terminated: ok {rc=0} 19:13:03.073129 --- ParallelTerminationStrategy: PID 21218 died... 19:13:03.092024 run iperf3-srv_10.42.42.10(pid=21218): Terminated {rc=256} 19:13:03.136057 --- ParallelTerminationStrategy: PID 21219 died... 19:13:03.154987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Terminated: ok {rc=0} 19:13:03.199012 --- ParallelTerminationStrategy: PID 21220 died... 19:13:03.217763 run iperf3-srv_10.42.42.10(pid=21220): Terminated {rc=256} 19:13:03.261828 --- ParallelTerminationStrategy: PID 21223 died... 19:13:03.280725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21223): Terminated: ok {rc=0} 19:13:03.324999 --- ParallelTerminationStrategy: PID 21226 died... 19:13:03.343831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21226): Terminated: ok {rc=0} 19:13:03.387903 --- ParallelTerminationStrategy: PID 21229 died... 19:13:03.406803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21229): Terminated: ok {rc=0} 19:13:03.492760 bus /gobi_0: Setting Powered False 19:13:04.593079 bus /gobi_0: Setting Powered False 19:13:05.707915 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:13:06.855248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:06.867034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:13:06.941422 tst iperf3.py: using LAC 35679 19:13:07.063255 tst iperf3.py: using RAC 234 19:13:07.186181 tst iperf3.py: using CellId 35679 19:13:07.308198 tst iperf3.py: using BVCI 35680 19:13:07.421309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.432419 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.443556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.454527 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.465452 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.476184 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.487178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.498162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:07.509156 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:07.629127 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:13:07.853167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:13:08.186432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21231): Launched 19:13:08.476377 run iperf3-srv_10.42.42.10(pid=21232): Launched 19:13:08.600397 tst iperf3.py:8: start network... 19:13:08.823474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:09.336923 run create_hlr_db(pid=21233): Launched 19:13:09.463720 bus /gobi_6: Setting Powered False 19:13:10.528437 run create_hlr_db(pid=21233): Terminated: ok {rc=0} 19:13:10.987561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Launched 19:13:11.320637 run osmo-hlr_10.42.42.2(pid=21236): Launched 19:13:11.448937 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:12.018827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Launched 19:13:12.350863 run osmo-stp_10.42.42.5(pid=21239): Launched 19:13:12.477250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:13.044133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21241): Launched 19:13:13.171932 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:13.451205 run patchelf(pid=21242): Launched 19:13:13.633847 run osmo-stp_10.42.42.5(pid=21239): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] 19:13:13.773391 run osmo-stp_10.42.42.5(pid=21239): stdout: | (launched: 2022-12-13_19:13:12.290309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:13.914302 run osmo-stp_10.42.42.5(pid=21239): stderr: | 20221213191312483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191312483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191312484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191312484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191312485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191312485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191312485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:14.055537 run osmo-stp_10.42.42.5(pid=21239): stdout: | (launched: 2022-12-13_19:13:12.290309) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:14.191464 run osmo-stp_10.42.42.5(pid=21239): stderr: | 20221213191312483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191312483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191312484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191312484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191312485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191312485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191312485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:14.351727 run patchelf(pid=21242): Terminating (SIGINT) 19:13:14.535257 run patchelf(pid=21242): Terminated: ok {rc=0} 19:13:14.667896 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21239): Process ended prematurely: osmo-stp_10.42.42.5(pid=21239) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 19:13:14.678090 tst iperf3.py:8: Test FAILED (7.9 sec) 19:13:14.706716 run osmo-hlr_10.42.42.2(pid=21236): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21236)] 19:13:14.758389 run osmo-hlr_10.42.42.2(pid=21236): stdout: | (launched: 2022-12-13_19:13:11.259762) 19:13:14.810654 run osmo-hlr_10.42.42.2(pid=21236): stderr: | 20221213191311460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191311460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191311460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191311460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191311460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191311461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191311473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191311482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191311482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191311482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:14.863255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21231): Terminating (SIGTERM) 19:13:14.905029 run iperf3-srv_10.42.42.10(pid=21232): Terminating (SIGTERM) 19:13:14.946936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Terminating (SIGTERM) 19:13:14.988809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Terminating (SIGTERM) 19:13:15.030714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21241): Terminating (SIGTERM) 19:13:15.072803 --- ParallelTerminationStrategy: PID 21231 died... 19:13:15.093710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21231): Terminated: ok {rc=0} 19:13:15.140248 --- ParallelTerminationStrategy: PID 21232 died... 19:13:15.159985 run iperf3-srv_10.42.42.10(pid=21232): Terminated {rc=256} 19:13:15.206646 --- ParallelTerminationStrategy: PID 21235 died... 19:13:15.226443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21235): Terminated: ok {rc=0} 19:13:15.273008 --- ParallelTerminationStrategy: PID 21238 died... 19:13:15.292838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21238): Terminated: ok {rc=0} 19:13:15.339120 --- ParallelTerminationStrategy: PID 21241 died... 19:13:15.358968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21241): Terminated: ok {rc=0} 19:13:15.447477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:13:16.599850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:16.612732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:13:16.689123 tst iperf3m4.py: using LAC 35680 19:13:16.825905 tst iperf3m4.py: using RAC 235 19:13:16.969499 tst iperf3m4.py: using CellId 35680 19:13:17.092119 tst iperf3m4.py: using BVCI 35681 19:13:17.216283 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.228490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.241547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.254703 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.267009 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.279215 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.291351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.303623 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:17.316477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:17.439208 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:17.560455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:17.683170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:17.806635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:13:18.030346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:13:18.363783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21243): Launched 19:13:18.654274 run iperf3-srv_10.42.42.10(pid=21244): Launched 19:13:18.778524 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:13:19.001516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:13:19.334716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Launched 19:13:19.623910 run iperf3-srv_10.42.42.10(pid=21246): Launched 19:13:19.749496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:13:19.971868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:13:20.304485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Launched 19:13:20.593895 run iperf3-srv_10.42.42.10(pid=21248): Launched 19:13:20.719788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:13:20.941754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:13:21.273620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Launched 19:13:21.560796 run iperf3-srv_10.42.42.10(pid=21250): Launched 19:13:21.686790 tst iperf3m4.py:8: start network... 19:13:21.909261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:22.421620 run create_hlr_db(pid=21251): Launched 19:13:22.547023 bus /gobi_6: Setting Powered False 19:13:23.612179 run create_hlr_db(pid=21251): Terminated: ok {rc=0} 19:13:24.071872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Launched 19:13:24.402724 run osmo-hlr_10.42.42.2(pid=21254): Launched 19:13:24.529690 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:25.061645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Launched 19:13:25.370247 run osmo-stp_10.42.42.5(pid=21257): Launched 19:13:25.486778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:26.016930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Launched 19:13:26.134416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:26.394059 run patchelf(pid=21260): Launched 19:13:26.565854 run osmo-stp_10.42.42.5(pid=21257): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] 19:13:26.695463 run osmo-stp_10.42.42.5(pid=21257): stdout: | (launched: 2022-12-13_19:13:25.312845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:26.826408 run osmo-stp_10.42.42.5(pid=21257): stderr: | 20221213191325486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191325486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191325487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191325487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191325487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191325488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191325488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:26.957803 run osmo-stp_10.42.42.5(pid=21257): stdout: | (launched: 2022-12-13_19:13:25.312845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:27.083255 run osmo-stp_10.42.42.5(pid=21257): stderr: | 20221213191325486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191325486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191325487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191325487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191325487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191325488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191325488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:27.233343 run patchelf(pid=21260): Terminating (SIGINT) 19:13:27.405784 run patchelf(pid=21260): Terminated: ok {rc=0} 19:13:27.530062 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21257): Process ended prematurely: osmo-stp_10.42.42.5(pid=21257) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:13:27.539793 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:13:27.567721 run osmo-hlr_10.42.42.2(pid=21254): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21254)] 19:13:27.616675 run osmo-hlr_10.42.42.2(pid=21254): stdout: | (launched: 2022-12-13_19:13:24.341905) 19:13:27.666975 run osmo-hlr_10.42.42.2(pid=21254): stderr: | 20221213191324530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191324530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191324530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191324530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191324530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191324530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191324545 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191324555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191324555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191324555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:27.718151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21243): Terminating (SIGTERM) 19:13:27.758651 run iperf3-srv_10.42.42.10(pid=21244): Terminating (SIGTERM) 19:13:27.799329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Terminating (SIGTERM) 19:13:27.839824 run iperf3-srv_10.42.42.10(pid=21246): Terminating (SIGTERM) 19:13:27.880093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminating (SIGTERM) 19:13:27.920335 run iperf3-srv_10.42.42.10(pid=21248): Terminating (SIGTERM) 19:13:27.961035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Terminating (SIGTERM) 19:13:28.001763 run iperf3-srv_10.42.42.10(pid=21250): Terminating (SIGTERM) 19:13:28.042026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Terminating (SIGTERM) 19:13:28.082264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Terminating (SIGTERM) 19:13:28.123003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Terminating (SIGTERM) 19:13:28.163747 --- ParallelTerminationStrategy: PID 21243 died... 19:13:28.183352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21243): Terminated: ok {rc=0} 19:13:28.228261 --- ParallelTerminationStrategy: PID 21244 died... 19:13:28.247282 run iperf3-srv_10.42.42.10(pid=21244): Terminated {rc=256} 19:13:28.291519 --- ParallelTerminationStrategy: PID 21245 died... 19:13:28.310537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Terminated: ok {rc=0} 19:13:28.354995 --- ParallelTerminationStrategy: PID 21246 died... 19:13:28.374105 run iperf3-srv_10.42.42.10(pid=21246): Terminated {rc=256} 19:13:28.418431 --- ParallelTerminationStrategy: PID 21247 died... 19:13:28.437487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminated: ok {rc=0} 19:13:28.481968 --- ParallelTerminationStrategy: PID 21248 died... 19:13:28.500768 run iperf3-srv_10.42.42.10(pid=21248): Terminated {rc=256} 19:13:28.545309 --- ParallelTerminationStrategy: PID 21249 died... 19:13:28.564265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21249): Terminated: ok {rc=0} 19:13:28.608799 --- ParallelTerminationStrategy: PID 21250 died... 19:13:28.628303 run iperf3-srv_10.42.42.10(pid=21250): Terminated {rc=256} 19:13:28.673225 --- ParallelTerminationStrategy: PID 21253 died... 19:13:28.692295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21253): Terminated: ok {rc=0} 19:13:28.737077 --- ParallelTerminationStrategy: PID 21256 died... 19:13:28.756100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21256): Terminated: ok {rc=0} 19:13:28.800495 --- ParallelTerminationStrategy: PID 21259 died... 19:13:28.819599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21259): Terminated: ok {rc=0} 19:13:28.907103 bus /gobi_4: Setting Powered False 19:13:30.010525 bus /gobi_4: Setting Powered False 19:13:31.129977 bus /gobi_1: Setting Powered False 19:13:32.230867 bus /gobi_1: Setting Powered False 19:13:33.347138 bus /gobi_0: Setting Powered False 19:13:34.448377 bus /gobi_0: Setting Powered False 19:13:35.566566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:13:36.670603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:36.683173 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:13:36.758269 tst ping.py: using LAC 35681 19:13:36.886322 tst ping.py: using RAC 236 19:13:37.012102 tst ping.py: using CellId 35681 19:13:37.138345 tst ping.py: using BVCI 35682 19:13:37.255542 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.267274 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.278803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.290280 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.301967 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.313716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.325677 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:37.337651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:37.453888 tst ping.py:19: start network... 19:13:37.655157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:38.124340 run create_hlr_db(pid=21261): Launched 19:13:38.248045 bus /gobi_6: Setting Powered False 19:13:39.308062 run create_hlr_db(pid=21261): Terminated: ok {rc=0} 19:13:39.751000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Launched 19:13:40.078687 run osmo-hlr_10.42.42.2(pid=21264): Launched 19:13:40.204869 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:40.771300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Launched 19:13:41.095478 run osmo-stp_10.42.42.5(pid=21267): Launched 19:13:41.218979 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:41.778060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Launched 19:13:41.903337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:42.177244 run patchelf(pid=21270): Launched 19:13:42.355813 run osmo-stp_10.42.42.5(pid=21267): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] 19:13:42.492745 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-13_19:13:41.035297) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:42.631310 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221213191341227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191341227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191341228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191341228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191341229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191341229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191341229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:42.769695 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-13_19:13:41.035297) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:42.902594 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221213191341227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191341227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191341228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191341228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191341229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191341229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191341229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:43.059969 run patchelf(pid=21270): Terminating (SIGINT) 19:13:43.241190 run patchelf(pid=21270): Terminated: ok {rc=0} 19:13:43.371834 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 19:13:43.381451 tst ping.py:22: Test FAILED (6.7 sec) 19:13:43.409487 run osmo-hlr_10.42.42.2(pid=21264): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21264)] 19:13:43.461252 run osmo-hlr_10.42.42.2(pid=21264): stdout: | (launched: 2022-12-13_19:13:40.018593) 19:13:43.513826 run osmo-hlr_10.42.42.2(pid=21264): stderr: | 20221213191340216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191340216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191340216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191340216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191340216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191340216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191340228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191340237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191340237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191340237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:43.566687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminating (SIGTERM) 19:13:43.608887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminating (SIGTERM) 19:13:43.651366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Terminating (SIGTERM) 19:13:43.694287 --- ParallelTerminationStrategy: PID 21263 died... 19:13:43.715253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminated: ok {rc=0} 19:13:43.762569 --- ParallelTerminationStrategy: PID 21266 died... 19:13:43.782668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminated: ok {rc=0} 19:13:43.829761 --- ParallelTerminationStrategy: PID 21269 died... 19:13:43.849928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Terminated: ok {rc=0} 19:13:43.938456 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:13:45.025802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.037975 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:13:45.110284 tst ping_idle_ping.py: using LAC 35682 19:13:45.229600 tst ping_idle_ping.py: using RAC 237 19:13:45.347977 tst ping_idle_ping.py: using CellId 35682 19:13:45.466558 tst ping_idle_ping.py: using BVCI 35683 19:13:45.577233 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.588409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.599384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.610408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.621287 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.632249 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.643382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:13:45.654361 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:13:45.773588 tst ping_idle_ping.py:24: start network... 19:13:46.005231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:46.530073 run create_hlr_db(pid=21271): Launched 19:13:46.696127 bus /gobi_6: Setting Powered False 19:13:47.756054 run create_hlr_db(pid=21271): Terminated: ok {rc=0} 19:13:48.217533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21273): Launched 19:13:48.542928 run osmo-hlr_10.42.42.2(pid=21274): Launched 19:13:48.669137 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:49.230812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21276): Launched 19:13:49.558559 run osmo-stp_10.42.42.5(pid=21277): Launched 19:13:49.683887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:50.245877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21279): Launched 19:13:50.371034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:50.647111 run patchelf(pid=21280): Launched 19:13:50.829080 run osmo-stp_10.42.42.5(pid=21277): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21277)] 19:13:50.966722 run osmo-stp_10.42.42.5(pid=21277): stdout: | (launched: 2022-12-13_19:13:49.498265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:51.106461 run osmo-stp_10.42.42.5(pid=21277): stderr: | 20221213191349692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191349692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191349693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191349693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191349694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191349694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191349694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:51.245948 run osmo-stp_10.42.42.5(pid=21277): stdout: | (launched: 2022-12-13_19:13:49.498265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:13:51.379858 run osmo-stp_10.42.42.5(pid=21277): stderr: | 20221213191349692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191349692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191349693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191349693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191349694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191349694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191349694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:13:51.538565 run patchelf(pid=21280): Terminating (SIGINT) 19:13:51.720107 run patchelf(pid=21280): Terminated: ok {rc=0} 19:13:51.851112 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21277): Process ended prematurely: osmo-stp_10.42.42.5(pid=21277) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21277)] [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:13:51.860711 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:13:51.889234 run osmo-hlr_10.42.42.2(pid=21274): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21274)] 19:13:51.941191 run osmo-hlr_10.42.42.2(pid=21274): stdout: | (launched: 2022-12-13_19:13:48.483080) 19:13:51.993791 run osmo-hlr_10.42.42.2(pid=21274): stderr: | 20221213191348682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191348682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191348682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191348682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191348682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191348682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191348695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191348704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191348704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191348704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:13:52.046903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21273): Terminating (SIGTERM) 19:13:52.089355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21276): Terminating (SIGTERM) 19:13:52.132604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21279): Terminating (SIGTERM) 19:13:52.175739 --- ParallelTerminationStrategy: PID 21273 died... 19:13:52.196631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21273): Terminated: ok {rc=0} 19:13:52.243822 --- ParallelTerminationStrategy: PID 21276 died... 19:13:52.264075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21276): Terminated: ok {rc=0} 19:13:52.310932 --- ParallelTerminationStrategy: PID 21279 died... 19:13:52.331151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21279): Terminated: ok {rc=0} 19:13:52.421309 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:13:53.734709 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:13:53.742980 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:13:53.777111 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:13:53.811886 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:13:53.866538 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:13:53.901037 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:13:53.935453 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:13:54.494078 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:13:54.499083 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:54.510717 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:13:54.586026 tst switch_tch_pdch.py: using LAC 35683 19:13:54.704159 tst switch_tch_pdch.py: using RAC 238 19:13:54.821581 tst switch_tch_pdch.py: using CellId 35683 19:13:54.948260 tst switch_tch_pdch.py: using BVCI 35684 19:13:55.065595 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.077518 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.089253 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.101789 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.114028 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.125929 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.138015 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:13:55.150092 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:55.271859 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:13:55.388224 tst switch_tch_pdch.py:51: start network... 19:13:55.590546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:56.058798 run create_hlr_db(pid=21284): Launched 19:13:56.184383 bus /gobi_6: Setting Powered False 19:13:57.244766 run create_hlr_db(pid=21284): Terminated: ok {rc=0} 19:13:57.668156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21286): Launched 19:13:57.970593 run osmo-hlr_10.42.42.2(pid=21287): Launched 19:13:58.086677 run osmo-stp_10.42.42.5: Starting osmo-stp 19:13:58.622728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21289): Launched 19:13:58.924680 run osmo-stp_10.42.42.5(pid=21290): Launched 19:13:59.039007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:13:59.559524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21292): Launched 19:13:59.674201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:13:59.928539 run patchelf(pid=21293): Launched 19:14:00.095063 run osmo-stp_10.42.42.5(pid=21290): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21290)] 19:14:00.222564 run osmo-stp_10.42.42.5(pid=21290): stdout: | (launched: 2022-12-13_19:13:58.868494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:00.351399 run osmo-stp_10.42.42.5(pid=21290): stderr: | 20221213191359039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191359040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191359040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191359040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191359041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191359041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191359041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:00.480724 run osmo-stp_10.42.42.5(pid=21290): stdout: | (launched: 2022-12-13_19:13:58.868494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:00.604183 run osmo-stp_10.42.42.5(pid=21290): stderr: | 20221213191359039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191359040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191359040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191359040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191359041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191359041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191359041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:00.750418 run patchelf(pid=21293): Terminating (SIGINT) 19:14:00.931471 run patchelf(pid=21293): Terminated: ok {rc=0} 19:14:01.066376 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21290): Process ended prematurely: osmo-stp_10.42.42.5(pid=21290) [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21290)] [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:14:01.076523 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 19:14:01.104658 run osmo-hlr_10.42.42.2(pid=21287): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21287)] 19:14:01.154275 run osmo-hlr_10.42.42.2(pid=21287): stdout: | (launched: 2022-12-13_19:13:57.914450) 19:14:01.205793 run osmo-hlr_10.42.42.2(pid=21287): stderr: | 20221213191358091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191358091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191358091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191358091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191358091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191358091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191358103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191358112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191358112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191358112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:01.257285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21286): Terminating (SIGTERM) 19:14:01.298670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21289): Terminating (SIGTERM) 19:14:01.339848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21292): Terminating (SIGTERM) 19:14:01.381759 --- ParallelTerminationStrategy: PID 21286 died... 19:14:01.401373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21286): Terminated: ok {rc=0} 19:14:01.448363 --- ParallelTerminationStrategy: PID 21289 died... 19:14:01.468401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21289): Terminated: ok {rc=0} 19:14:01.514136 --- ParallelTerminationStrategy: PID 21292 died... 19:14:01.533501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21292): Terminated: ok {rc=0} 19:14:01.621147 bus /gobi_0: Setting Powered False 19:14:02.728223 bus /gobi_0: Setting Powered False 19:14:03.845791 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:14:05.097929 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:05.103781 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:14:05.137381 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:14:05.172219 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:14:05.226304 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:14:05.259866 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:14:05.294188 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:14:05.855106 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:14:05.860407 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:05.872098 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:14:05.945194 tst switch_tch_pdch.py: using LAC 35684 19:14:06.072366 tst switch_tch_pdch.py: using RAC 239 19:14:06.198618 tst switch_tch_pdch.py: using CellId 35684 19:14:06.327827 tst switch_tch_pdch.py: using BVCI 35685 19:14:06.446646 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.458321 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.469796 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.481274 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.493036 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.504828 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.516783 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:14:06.528596 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:14:06.646038 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:14:06.767833 tst switch_tch_pdch.py:51: start network... 19:14:06.972393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:07.417096 run create_hlr_db(pid=21299): Launched 19:14:07.542777 bus /gobi_6: Setting Powered False 19:14:08.604115 run create_hlr_db(pid=21299): Terminated: ok {rc=0} 19:14:09.020282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Launched 19:14:09.346771 run osmo-hlr_10.42.42.2(pid=21302): Launched 19:14:09.471985 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:10.001704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Launched 19:14:10.324773 run osmo-stp_10.42.42.5(pid=21305): Launched 19:14:10.449756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:14:10.980156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Launched 19:14:11.105894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:14:11.379756 run patchelf(pid=21308): Launched 19:14:11.560097 run osmo-stp_10.42.42.5(pid=21305): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] 19:14:11.697061 run osmo-stp_10.42.42.5(pid=21305): stdout: | (launched: 2022-12-13_19:14:10.265246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:11.835496 run osmo-stp_10.42.42.5(pid=21305): stderr: | 20221213191410459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191410459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191410460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191410460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191410461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191410461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191410461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:11.975014 run osmo-stp_10.42.42.5(pid=21305): stdout: | (launched: 2022-12-13_19:14:10.265246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:12.108179 run osmo-stp_10.42.42.5(pid=21305): stderr: | 20221213191410459 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191410459 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191410460 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191410460 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191410461 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191410461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191410461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:12.265692 run patchelf(pid=21308): Terminating (SIGINT) 19:14:12.446473 run patchelf(pid=21308): Terminated: ok {rc=0} 19:14:12.576897 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21305): Process ended prematurely: osmo-stp_10.42.42.5(pid=21305) [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:14:12.586597 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 19:14:12.614636 run osmo-hlr_10.42.42.2(pid=21302): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21302)] 19:14:12.666531 run osmo-hlr_10.42.42.2(pid=21302): stdout: | (launched: 2022-12-13_19:14:09.286969) 19:14:12.718754 run osmo-hlr_10.42.42.2(pid=21302): stderr: | 20221213191409485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191409486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191409486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191409486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191409486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191409486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191409498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191409506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191409506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191409506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:12.772267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Terminating (SIGTERM) 19:14:12.814562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Terminating (SIGTERM) 19:14:12.857154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Terminating (SIGTERM) 19:14:12.899856 --- ParallelTerminationStrategy: PID 21301 died... 19:14:12.920506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Terminated: ok {rc=0} 19:14:12.967450 --- ParallelTerminationStrategy: PID 21304 died... 19:14:12.987495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Terminated: ok {rc=0} 19:14:13.034275 --- ParallelTerminationStrategy: PID 21307 died... 19:14:13.054455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Terminated: ok {rc=0} 19:14:13.144561 bus /gobi_0: Setting Powered False 19:14:14.244042 bus /gobi_0: Setting Powered False 19:14:15.361786 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:trx-umtrx --------------------------------------------------------------------- 19:14:16.624024 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:16.628660 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:14:16.682001 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:14:16.692915 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:14:16.746251 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:14:16.781532 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:14:16.788797 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:14:17.325644 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:14:17.330962 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:14:17.342490 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:14:17.394739 tst mo_mt_sms.py: using LAC 35685 19:14:17.522822 tst mo_mt_sms.py: using RAC 240 19:14:17.643901 tst mo_mt_sms.py: using CellId 35685 19:14:17.761372 tst mo_mt_sms.py: using BVCI 35686 19:14:17.869775 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:14:17.989529 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:14:18.108407 tst mo_mt_sms.py:9: start nitb and bts... 19:14:18.310559 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:14:18.925757 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21314): Launched 19:14:19.228682 run osmo-nitb_10.42.42.2(pid=21315): Launched 19:14:19.396259 run osmo-nitb_10.42.42.2(pid=21315): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21315)] 19:14:19.531761 run osmo-nitb_10.42.42.2(pid=21315): stdout: | (launched: 2022-12-13_19:14:19.172390) 19:14:19.670111 run osmo-nitb_10.42.42.2(pid=21315): stderr: | (launched: 2022-12-13_19:14:19.217425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:14:19.806863 run osmo-nitb_10.42.42.2(pid=21315): stdout: | (launched: 2022-12-13_19:14:19.172390) 19:14:19.938434 run osmo-nitb_10.42.42.2(pid=21315): stderr: | (launched: 2022-12-13_19:14:19.217425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21315) [trial-2393↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21315)] 19:14:20.342839 tst osmo-nitb_10.42.42.2(pid=21315): stdout: | (launched: 2022-12-13_19:14:19.172390) 19:14:20.465346 tst osmo-nitb_10.42.42.2(pid=21315): stderr: | (launched: 2022-12-13_19:14:19.217425) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:14:20.610166 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21315) [trial-2393↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21315)] [trial-2393↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 19:14:20.618861 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:14:20.625408 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21314): Terminating (SIGTERM) 19:14:20.835641 --- ParallelTerminationStrategy: PID 21314 died... 19:14:20.856499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21314): Terminated: ok {rc=0} 19:14:20.944144 bus /sierra_3: Setting Powered False 19:14:22.045811 bus /sierra_3: Setting Powered False 19:14:23.164708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:trx-umtrx --------------------------------------------------------------------- 19:14:24.364174 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:24.368198 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:14:24.400593 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:14:24.427576 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 19:14:24.478825 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:14:24.510998 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:14:24.537863 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 19:14:25.085582 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 19:14:25.090638 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.101605 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 19:14:25.152231 tst mo_mt_sms.py: using LAC 35686 19:14:25.269024 tst mo_mt_sms.py: using RAC 241 19:14:25.385074 tst mo_mt_sms.py: using CellId 35686 19:14:25.501159 tst mo_mt_sms.py: using BVCI 35687 19:14:25.609787 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.620519 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.630993 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.641681 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.652432 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:25.663289 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:14:25.784410 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 19:14:25.899805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:26.367108 run create_hlr_db(pid=21319): Launched 19:14:26.492253 bus /sierra_2: Setting Powered False 19:14:27.552740 run create_hlr_db(pid=21319): Terminated: ok {rc=0} 19:14:27.973769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21321): Launched 19:14:28.274761 run osmo-hlr_10.42.42.2(pid=21322): Launched 19:14:28.390788 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:28.907966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21324): Launched 19:14:29.211691 run osmo-stp_10.42.42.5(pid=21325): Launched 19:14:29.326917 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:29.889617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21327): Launched 19:14:30.191193 run osmo-msc_10.42.42.6(pid=21328): Launched 19:14:30.360170 run osmo-stp_10.42.42.5(pid=21325): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21325)] 19:14:30.487861 run osmo-stp_10.42.42.5(pid=21325): stdout: | (launched: 2022-12-13_19:14:29.155203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:30.615827 run osmo-stp_10.42.42.5(pid=21325): stderr: | 20221213191429329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191429329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191429329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191429330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191429330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191429330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191429330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:30.741400 run osmo-stp_10.42.42.5(pid=21325): stdout: | (launched: 2022-12-13_19:14:29.155203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:30.873873 run osmo-stp_10.42.42.5(pid=21325): stderr: | 20221213191429329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191429329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191429329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191429330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191429330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191429330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191429330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:31.021323 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21325): Process ended prematurely: osmo-stp_10.42.42.5(pid=21325) [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21325)] [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py:16] 19:14:31.030970 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 19:14:31.058250 run osmo-hlr_10.42.42.2(pid=21322): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21322)] 19:14:31.107654 run osmo-hlr_10.42.42.2(pid=21322): stdout: | (launched: 2022-12-13_19:14:28.218489) 19:14:31.158944 run osmo-hlr_10.42.42.2(pid=21322): stderr: | 20221213191428396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191428396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191428396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191428396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191428396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191428396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191428408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191428417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191428417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191428417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:31.230316 run osmo-msc_10.42.42.6(pid=21328): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21328)] 19:14:31.279786 run osmo-msc_10.42.42.6(pid=21328): stdout: | (launched: 2022-12-13_19:14:30.135067) 19:14:31.330594 run osmo-msc_10.42.42.6(pid=21328): stderr: | 20221213191430408 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191430408 DLGLOBAL DEBUG validating counter group 0x7f53eba19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191430408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191430408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191430408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191430408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191430410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191430410 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191430411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191430411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:31.382087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21321): Terminating (SIGTERM) 19:14:31.422778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21324): Terminating (SIGTERM) 19:14:31.463772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21327): Terminating (SIGTERM) 19:14:31.505119 --- ParallelTerminationStrategy: PID 21321 died... 19:14:31.524554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21321): Terminated: ok {rc=0} 19:14:31.569675 --- ParallelTerminationStrategy: PID 21324 died... 19:14:31.589061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21324): Terminated: ok {rc=0} 19:14:31.634277 --- ParallelTerminationStrategy: PID 21327 died... 19:14:31.653700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21327): Terminated: ok {rc=0} 19:14:31.740471 bus /sierra_3: Setting Powered False 19:14:32.838001 bus /sierra_3: Setting Powered False 19:14:33.953574 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 19:14:35.181814 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:35.185621 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:14:35.218111 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 19:14:35.225204 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:14:35.263661 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:14:35.298563 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 19:14:35.306297 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:14:35.818941 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:14:35.824026 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 19:14:35.835059 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:14:35.881305 tst assert_extension.py: using LAC 35687 19:14:36.004314 tst assert_extension.py: using RAC 242 19:14:36.124999 tst assert_extension.py: using CellId 35687 19:14:36.244326 tst assert_extension.py: using BVCI 35688 19:14:36.354952 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:14:36.474163 tst assert_extension.py:10: start nitb and bts... 19:14:36.692497 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:14:37.354699 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21334): Launched 19:14:37.680516 run osmo-nitb_10.42.42.2(pid=21335): Launched 19:14:37.861304 run osmo-nitb_10.42.42.2(pid=21335): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21335)] 19:14:38.005925 run osmo-nitb_10.42.42.2(pid=21335): stdout: | (launched: 2022-12-13_19:14:37.620774) 19:14:38.152653 run osmo-nitb_10.42.42.2(pid=21335): stderr: | (launched: 2022-12-13_19:14:37.669124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:14:38.299374 run osmo-nitb_10.42.42.2(pid=21335): stdout: | (launched: 2022-12-13_19:14:37.620774) 19:14:38.440226 run osmo-nitb_10.42.42.2(pid=21335): stderr: | (launched: 2022-12-13_19:14:37.669124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21335) [trial-2393↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21335)] 19:14:38.804218 tst osmo-nitb_10.42.42.2(pid=21335): stdout: | (launched: 2022-12-13_19:14:37.620774) 19:14:38.935715 tst osmo-nitb_10.42.42.2(pid=21335): stderr: | (launched: 2022-12-13_19:14:37.669124) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:14:39.091027 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21335) [trial-2393↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21335)] [trial-2393↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 19:14:39.100266 tst assert_extension.py:12: Test FAILED (3.3 sec) 19:14:39.107590 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21334): Terminating (SIGTERM) 19:14:39.319498 --- ParallelTerminationStrategy: PID 21334 died... 19:14:39.341616 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21334): Terminated: ok {rc=0} 19:14:39.433211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:trx-umtrx --------------------------------------------------------------------- 19:14:40.613778 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:40.618275 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:14:40.651212 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:14:40.678904 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 19:14:40.714655 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:14:40.747098 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:14:40.773810 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 19:14:41.301945 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 19:14:41.308392 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.320574 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 19:14:41.373815 tst assert_extension.py: using LAC 35688 19:14:41.500113 tst assert_extension.py: using RAC 243 19:14:41.625360 tst assert_extension.py: using CellId 35688 19:14:41.750136 tst assert_extension.py: using BVCI 35689 19:14:41.867884 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.879104 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.890192 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.901150 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.912884 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:14:41.924706 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 19:14:42.041839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:42.511354 run create_hlr_db(pid=21339): Launched 19:14:42.635482 bus /sierra_2: Setting Powered False 19:14:43.696515 run create_hlr_db(pid=21339): Terminated: ok {rc=0} 19:14:44.141721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21341): Launched 19:14:44.465322 run osmo-hlr_10.42.42.2(pid=21342): Launched 19:14:44.591647 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:45.154616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21344): Launched 19:14:45.478772 run osmo-stp_10.42.42.5(pid=21345): Launched 19:14:45.604512 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:46.196400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21347): Launched 19:14:46.521332 run osmo-msc_10.42.42.6(pid=21348): Launched 19:14:46.866105 run osmo-stp_10.42.42.5(pid=21345): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21345)] 19:14:47.158474 run osmo-stp_10.42.42.5(pid=21345): stdout: | (launched: 2022-12-13_19:14:45.418892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:47.342156 run osmo-stp_10.42.42.5(pid=21345): stderr: | 20221213191445610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191445610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191445611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191445611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191445611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191445612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191445612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:47.478069 run osmo-stp_10.42.42.5(pid=21345): stdout: | (launched: 2022-12-13_19:14:45.418892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:47.607840 run osmo-stp_10.42.42.5(pid=21345): stderr: | 20221213191445610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191445610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191445611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191445611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191445611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191445612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191445612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:47.763017 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21345): Process ended prematurely: osmo-stp_10.42.42.5(pid=21345) [trial-2393↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21345)] [trial-2393↪ussd:trx-umtrx↪assert_extension.py:17] 19:14:47.772081 tst assert_extension.py:17: Test FAILED (6.5 sec) 19:14:47.799986 run osmo-hlr_10.42.42.2(pid=21342): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21342)] 19:14:47.852072 run osmo-hlr_10.42.42.2(pid=21342): stdout: | (launched: 2022-12-13_19:14:44.405475) 19:14:47.905162 run osmo-hlr_10.42.42.2(pid=21342): stderr: | 20221213191444604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191444604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191444604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191444604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191444604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191444604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191444617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191444625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191444626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191444626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:47.978291 run osmo-msc_10.42.42.6(pid=21348): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21348)] 19:14:48.028864 run osmo-msc_10.42.42.6(pid=21348): stdout: | (launched: 2022-12-13_19:14:46.463741) 19:14:48.081737 run osmo-msc_10.42.42.6(pid=21348): stderr: | 20221213191447065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191447065 DLGLOBAL DEBUG validating counter group 0x7f575c4dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191447066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191447066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191447066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191447066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191447068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191447068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191447068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191447068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:48.135401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21341): Terminating (SIGTERM) 19:14:48.178113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21344): Terminating (SIGTERM) 19:14:48.220825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21347): Terminating (SIGTERM) 19:14:48.263992 --- ParallelTerminationStrategy: PID 21341 died... 19:14:48.284901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21341): Terminated: ok {rc=0} 19:14:48.332771 --- ParallelTerminationStrategy: PID 21344 died... 19:14:48.353101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21344): Terminated: ok {rc=0} 19:14:48.400075 --- ParallelTerminationStrategy: PID 21347 died... 19:14:48.420162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21347): Terminated: ok {rc=0} 19:14:48.511222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:14:49.722802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:14:49.729984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:14:49.765030 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:14:49.793294 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:14:49.847116 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:14:49.880599 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:14:49.908507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:14:50.457057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:14:50.506979 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:50.518399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:14:50.587556 tst mo_mt_call.py: using LAC 35689 19:14:50.708078 tst mo_mt_call.py: using RAC 244 19:14:50.829410 tst mo_mt_call.py: using CellId 35689 19:14:50.954319 tst mo_mt_call.py: using BVCI 35690 19:14:51.066444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:51.077953 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:51.089072 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:51.100011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:51.111249 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:14:51.122482 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:14:51.240759 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:14:51.361023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:14:51.873196 run create_hlr_db(pid=21353): Launched 19:14:52.001178 bus /sierra_2: Setting Powered False 19:14:53.065931 run create_hlr_db(pid=21353): Terminated: ok {rc=0} 19:14:53.525712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21355): Launched 19:14:53.855499 run osmo-hlr_10.42.42.2(pid=21356): Launched 19:14:53.982866 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:54.553884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21358): Launched 19:14:54.885669 run osmo-stp_10.42.42.5(pid=21359): Launched 19:14:55.013574 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:55.611156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21361): Launched 19:14:55.941976 run osmo-msc_10.42.42.6(pid=21362): Launched 19:14:56.127786 run osmo-stp_10.42.42.5(pid=21359): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21359)] 19:14:56.267013 run osmo-stp_10.42.42.5(pid=21359): stdout: | (launched: 2022-12-13_19:14:54.825116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:56.407010 run osmo-stp_10.42.42.5(pid=21359): stderr: | 20221213191455016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191455016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191455017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191455017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191455018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191455018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191455018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:56.544439 run osmo-stp_10.42.42.5(pid=21359): stdout: | (launched: 2022-12-13_19:14:54.825116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:14:56.676211 run osmo-stp_10.42.42.5(pid=21359): stderr: | 20221213191455016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191455016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191455017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191455017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191455018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191455018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191455018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:14:56.833893 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21359): Process ended prematurely: osmo-stp_10.42.42.5(pid=21359) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21359)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:14:56.843688 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:14:56.871659 run osmo-hlr_10.42.42.2(pid=21356): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21356)] 19:14:56.923078 run osmo-hlr_10.42.42.2(pid=21356): stdout: | (launched: 2022-12-13_19:14:53.795102) 19:14:56.975333 run osmo-hlr_10.42.42.2(pid=21356): stderr: | 20221213191453993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191453993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191453993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191453993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191453993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191453993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191454006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191454014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191454015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191454015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:14:57.048146 run osmo-msc_10.42.42.6(pid=21362): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21362)] 19:14:57.098560 run osmo-msc_10.42.42.6(pid=21362): stdout: | (launched: 2022-12-13_19:14:55.880735) 19:14:57.151680 run osmo-msc_10.42.42.6(pid=21362): stderr: | 20221213191456203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191456203 DLGLOBAL DEBUG validating counter group 0x7f34c48d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191456203 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191456203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191456203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191456204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191456205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191456206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191456206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191456206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:14:57.204337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21355): Terminating (SIGTERM) 19:14:57.246345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21358): Terminating (SIGTERM) 19:14:57.288687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21361): Terminating (SIGTERM) 19:14:57.331214 --- ParallelTerminationStrategy: PID 21355 died... 19:14:57.351815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21355): Terminated: ok {rc=0} 19:14:57.398497 --- ParallelTerminationStrategy: PID 21358 died... 19:14:57.418589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21358): Terminated: ok {rc=0} 19:14:57.465125 --- ParallelTerminationStrategy: PID 21361 died... 19:14:57.484853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21361): Terminated: ok {rc=0} 19:14:57.574275 bus /sierra_3: Setting Powered False 19:14:58.673281 bus /sierra_3: Setting Powered False 19:14:59.791478 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:15:00.960849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:00.973917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:15:01.053659 tst mo_mt_call_osmux.py: using LAC 35690 19:15:01.184709 tst mo_mt_call_osmux.py: using RAC 245 19:15:01.357062 tst mo_mt_call_osmux.py: using CellId 35690 19:15:01.486749 tst mo_mt_call_osmux.py: using BVCI 35691 19:15:01.649588 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:01.668125 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:01.684771 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:01.703113 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:01.721451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:15:01.734181 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:15:01.874209 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:15:02.027450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:02.514065 run create_hlr_db(pid=21367): Launched 19:15:02.641899 bus /sierra_2: Setting Powered False 19:15:03.702660 run create_hlr_db(pid=21367): Terminated: ok {rc=0} 19:15:04.131834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Launched 19:15:04.438959 run osmo-hlr_10.42.42.2(pid=21370): Launched 19:15:04.557458 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:05.099051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Launched 19:15:05.407391 run osmo-stp_10.42.42.5(pid=21373): Launched 19:15:05.523714 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:06.078049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21375): Launched 19:15:06.386753 run osmo-msc_10.42.42.6(pid=21376): Launched 19:15:06.558003 run osmo-stp_10.42.42.5(pid=21373): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] 19:15:06.687615 run osmo-stp_10.42.42.5(pid=21373): stdout: | (launched: 2022-12-13_19:15:05.350584) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:06.817308 run osmo-stp_10.42.42.5(pid=21373): stderr: | 20221213191505522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191505523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191505523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191505523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191505524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191505524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191505524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:06.944641 run osmo-stp_10.42.42.5(pid=21373): stdout: | (launched: 2022-12-13_19:15:05.350584) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:07.066689 run osmo-stp_10.42.42.5(pid=21373): stderr: | 20221213191505522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191505523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191505523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191505523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191505524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191505524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191505524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:07.212598 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21373): Process ended prematurely: osmo-stp_10.42.42.5(pid=21373) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:15:07.221629 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:15:07.248106 run osmo-hlr_10.42.42.2(pid=21370): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21370)] 19:15:07.296036 run osmo-hlr_10.42.42.2(pid=21370): stdout: | (launched: 2022-12-13_19:15:04.381862) 19:15:07.345759 run osmo-hlr_10.42.42.2(pid=21370): stderr: | 20221213191504559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191504559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191504559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191504559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191504559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191504559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191504572 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191504581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191504581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191504581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:07.415196 run osmo-msc_10.42.42.6(pid=21376): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21376)] 19:15:07.462728 run osmo-msc_10.42.42.6(pid=21376): stdout: | (launched: 2022-12-13_19:15:06.329761) 19:15:07.512065 run osmo-msc_10.42.42.6(pid=21376): stderr: | 20221213191506604 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191506604 DLGLOBAL DEBUG validating counter group 0x7f1a7a060c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191506604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191506604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191506604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191506605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191506606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191506607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191506607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191506607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:07.562096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Terminating (SIGTERM) 19:15:07.601925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Terminating (SIGTERM) 19:15:07.641683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21375): Terminating (SIGTERM) 19:15:07.681976 --- ParallelTerminationStrategy: PID 21369 died... 19:15:07.701406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Terminated: ok {rc=0} 19:15:07.745687 --- ParallelTerminationStrategy: PID 21372 died... 19:15:07.764515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Terminated: ok {rc=0} 19:15:07.808564 --- ParallelTerminationStrategy: PID 21375 died... 19:15:07.827373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21375): Terminated: ok {rc=0} 19:15:07.913800 bus /sierra_3: Setting Powered False 19:15:09.012861 bus /sierra_3: Setting Powered False 19:15:10.130406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:15:11.380459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:11.389383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:15:11.424057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:15:11.452462 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:15:11.507500 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:15:11.541677 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:15:11.570034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:15:12.120350 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:15:12.174528 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.186739 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:15:12.258575 tst mo_mt_call.py: using LAC 35691 19:15:12.388418 tst mo_mt_call.py: using RAC 246 19:15:12.516668 tst mo_mt_call.py: using CellId 35691 19:15:12.645161 tst mo_mt_call.py: using BVCI 35692 19:15:12.756674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.767968 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.779038 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.790011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.801132 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:12.812224 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:15:12.931820 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:15:13.047739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:13.523174 run create_hlr_db(pid=21381): Launched 19:15:13.650384 bus /sierra_2: Setting Powered False 19:15:14.711949 run create_hlr_db(pid=21381): Terminated: ok {rc=0} 19:15:15.161980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Launched 19:15:15.493346 run osmo-hlr_10.42.42.2(pid=21384): Launched 19:15:15.620674 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:16.215189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Launched 19:15:16.543941 run osmo-stp_10.42.42.5(pid=21387): Launched 19:15:16.827728 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:17.482768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Launched 19:15:17.792895 run osmo-msc_10.42.42.6(pid=21390): Launched 19:15:17.965862 run osmo-stp_10.42.42.5(pid=21387): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] 19:15:18.097140 run osmo-stp_10.42.42.5(pid=21387): stdout: | (launched: 2022-12-13_19:15:16.486206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:18.226683 run osmo-stp_10.42.42.5(pid=21387): stderr: | 20221213191516808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191516808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191516808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191516813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191516814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191516814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191516814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:18.354193 run osmo-stp_10.42.42.5(pid=21387): stdout: | (launched: 2022-12-13_19:15:16.486206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:18.476256 run osmo-stp_10.42.42.5(pid=21387): stderr: | 20221213191516808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191516808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191516808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191516813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191516814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191516814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191516814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:18.622345 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21387): Process ended prematurely: osmo-stp_10.42.42.5(pid=21387) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:15:18.631108 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:15:18.657887 run osmo-hlr_10.42.42.2(pid=21384): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21384)] 19:15:18.706746 run osmo-hlr_10.42.42.2(pid=21384): stdout: | (launched: 2022-12-13_19:15:15.432545) 19:15:18.757227 run osmo-hlr_10.42.42.2(pid=21384): stderr: | 20221213191515632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191515632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191515632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191515632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191515632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191515632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191515645 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191515654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191515654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191515654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:18.827673 run osmo-msc_10.42.42.6(pid=21390): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21390)] 19:15:18.876320 run osmo-msc_10.42.42.6(pid=21390): stdout: | (launched: 2022-12-13_19:15:17.735691) 19:15:18.926574 run osmo-msc_10.42.42.6(pid=21390): stderr: | 20221213191518009 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191518009 DLGLOBAL DEBUG validating counter group 0x7f9b838dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191518009 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191518009 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191518010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191518010 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191518011 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191518012 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191518012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191518012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:18.977649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Terminating (SIGTERM) 19:15:19.018085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Terminating (SIGTERM) 19:15:19.058480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Terminating (SIGTERM) 19:15:19.099131 --- ParallelTerminationStrategy: PID 21383 died... 19:15:19.118690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21383): Terminated: ok {rc=0} 19:15:19.163451 --- ParallelTerminationStrategy: PID 21386 died... 19:15:19.182408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21386): Terminated: ok {rc=0} 19:15:19.226916 --- ParallelTerminationStrategy: PID 21389 died... 19:15:19.245941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21389): Terminated: ok {rc=0} 19:15:19.332817 bus /sierra_3: Setting Powered False 19:15:20.432344 bus /sierra_3: Setting Powered False 19:15:21.548422 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:15:22.697236 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:22.709381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:15:22.779604 tst mo_mt_call_osmux.py: using LAC 35692 19:15:22.901781 tst mo_mt_call_osmux.py: using RAC 247 19:15:23.022641 tst mo_mt_call_osmux.py: using CellId 35692 19:15:23.145084 tst mo_mt_call_osmux.py: using BVCI 35693 19:15:23.256352 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:23.267849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:23.279058 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:23.290244 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:23.301614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:15:23.312765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:15:23.432684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:15:23.555154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:24.032139 run create_hlr_db(pid=21392): Launched 19:15:24.159220 bus /sierra_2: Setting Powered False 19:15:25.220396 run create_hlr_db(pid=21392): Terminated: ok {rc=0} 19:15:25.672613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Launched 19:15:26.002834 run osmo-hlr_10.42.42.2(pid=21395): Launched 19:15:26.130705 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:26.697904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Launched 19:15:27.026897 run osmo-stp_10.42.42.5(pid=21398): Launched 19:15:27.154524 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:27.750335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21400): Launched 19:15:28.079962 run osmo-msc_10.42.42.6(pid=21401): Launched 19:15:28.265125 run osmo-stp_10.42.42.5(pid=21398): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] 19:15:28.403213 run osmo-stp_10.42.42.5(pid=21398): stdout: | (launched: 2022-12-13_19:15:26.966388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:28.542010 run osmo-stp_10.42.42.5(pid=21398): stderr: | 20221213191527159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191527159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191527159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191527160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191527160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191527160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191527160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:28.679946 run osmo-stp_10.42.42.5(pid=21398): stdout: | (launched: 2022-12-13_19:15:26.966388) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:28.811951 run osmo-stp_10.42.42.5(pid=21398): stderr: | 20221213191527159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191527159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191527159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191527160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191527160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191527160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191527160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:28.969307 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21398): Process ended prematurely: osmo-stp_10.42.42.5(pid=21398) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:15:28.979109 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:15:29.006992 run osmo-hlr_10.42.42.2(pid=21395): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21395)] 19:15:29.058058 run osmo-hlr_10.42.42.2(pid=21395): stdout: | (launched: 2022-12-13_19:15:25.942413) 19:15:29.110529 run osmo-hlr_10.42.42.2(pid=21395): stderr: | 20221213191526143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191526143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191526143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191526143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191526143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191526143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191526156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191526164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191526164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191526164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:29.183799 run osmo-msc_10.42.42.6(pid=21401): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21401)] 19:15:29.233937 run osmo-msc_10.42.42.6(pid=21401): stdout: | (launched: 2022-12-13_19:15:28.019420) 19:15:29.286099 run osmo-msc_10.42.42.6(pid=21401): stderr: | 20221213191528344 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191528345 DLGLOBAL DEBUG validating counter group 0x7f8281f60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191528345 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191528345 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191528345 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191528345 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191528347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191528347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191528347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191528347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:29.338595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Terminating (SIGTERM) 19:15:29.380765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Terminating (SIGTERM) 19:15:29.423319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21400): Terminating (SIGTERM) 19:15:29.465654 --- ParallelTerminationStrategy: PID 21394 died... 19:15:29.486078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21394): Terminated: ok {rc=0} 19:15:29.532401 --- ParallelTerminationStrategy: PID 21397 died... 19:15:29.552341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21397): Terminated: ok {rc=0} 19:15:29.598624 --- ParallelTerminationStrategy: PID 21400 died... 19:15:29.618483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21400): Terminated: ok {rc=0} 19:15:29.706752 bus /sierra_3: Setting Powered False 19:15:30.805148 bus /sierra_3: Setting Powered False 19:15:31.931378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:15:33.180278 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:33.188152 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:15:33.222596 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:15:33.250957 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:15:33.304635 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:15:33.338387 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:15:33.366394 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:15:33.918556 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:15:33.971881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:33.983662 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:15:34.054812 tst mo_mt_call.py: using LAC 35693 19:15:34.184517 tst mo_mt_call.py: using RAC 248 19:15:34.315755 tst mo_mt_call.py: using CellId 35693 19:15:34.445398 tst mo_mt_call.py: using BVCI 35694 19:15:34.566950 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:34.578618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:34.590149 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:34.601675 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:34.613560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:34.625326 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:15:34.742608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:15:34.863385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:35.339276 run create_hlr_db(pid=21406): Launched 19:15:35.465459 bus /sierra_2: Setting Powered False 19:15:36.526434 run create_hlr_db(pid=21406): Terminated: ok {rc=0} 19:15:36.955275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Launched 19:15:37.263603 run osmo-hlr_10.42.42.2(pid=21409): Launched 19:15:37.380130 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:37.906779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Launched 19:15:38.213663 run osmo-stp_10.42.42.5(pid=21412): Launched 19:15:38.330525 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:38.883960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Launched 19:15:39.191698 run osmo-msc_10.42.42.6(pid=21415): Launched 19:15:39.364325 run osmo-stp_10.42.42.5(pid=21412): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] 19:15:39.494846 run osmo-stp_10.42.42.5(pid=21412): stdout: | (launched: 2022-12-13_19:15:38.156644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:39.624388 run osmo-stp_10.42.42.5(pid=21412): stderr: | 20221213191538329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191538329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191538329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191538330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191538330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191538330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191538331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:39.751666 run osmo-stp_10.42.42.5(pid=21412): stdout: | (launched: 2022-12-13_19:15:38.156644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:39.874085 run osmo-stp_10.42.42.5(pid=21412): stderr: | 20221213191538329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191538329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191538329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191538330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191538330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191538330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191538331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:40.020359 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21412): Process ended prematurely: osmo-stp_10.42.42.5(pid=21412) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:15:40.029442 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:15:40.056279 run osmo-hlr_10.42.42.2(pid=21409): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21409)] 19:15:40.104187 run osmo-hlr_10.42.42.2(pid=21409): stdout: | (launched: 2022-12-13_19:15:37.206607) 19:15:40.153949 run osmo-hlr_10.42.42.2(pid=21409): stderr: | 20221213191537383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191537383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191537383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191537383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191537383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191537383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191537396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191537406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191537407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191537407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:40.223375 run osmo-msc_10.42.42.6(pid=21415): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21415)] 19:15:40.272056 run osmo-msc_10.42.42.6(pid=21415): stdout: | (launched: 2022-12-13_19:15:39.134373) 19:15:40.321868 run osmo-msc_10.42.42.6(pid=21415): stderr: | 20221213191539405 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191539406 DLGLOBAL DEBUG validating counter group 0x7f3487a02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191539406 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191539406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191539406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191539406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191539408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191539408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191539408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191539408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:40.371815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Terminating (SIGTERM) 19:15:40.411705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Terminating (SIGTERM) 19:15:40.451593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Terminating (SIGTERM) 19:15:40.491653 --- ParallelTerminationStrategy: PID 21408 died... 19:15:40.510995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21408): Terminated: ok {rc=0} 19:15:40.555116 --- ParallelTerminationStrategy: PID 21411 died... 19:15:40.574040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21411): Terminated: ok {rc=0} 19:15:40.618018 --- ParallelTerminationStrategy: PID 21414 died... 19:15:40.636760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21414): Terminated: ok {rc=0} 19:15:40.723242 bus /sierra_3: Setting Powered False 19:15:41.823538 bus /sierra_3: Setting Powered False 19:15:42.936473 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:15:44.086755 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.099228 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:15:44.171413 tst mo_mt_call_osmux.py: using LAC 35694 19:15:44.301241 tst mo_mt_call_osmux.py: using RAC 249 19:15:44.431136 tst mo_mt_call_osmux.py: using CellId 35694 19:15:44.559735 tst mo_mt_call_osmux.py: using BVCI 35695 19:15:44.678779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.690523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.701997 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.713456 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.725509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:15:44.737339 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:15:44.854994 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:15:44.971721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:45.450415 run create_hlr_db(pid=21417): Launched 19:15:45.577970 bus /sierra_2: Setting Powered False 19:15:46.638026 run create_hlr_db(pid=21417): Terminated: ok {rc=0} 19:15:47.079077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21419): Launched 19:15:47.390005 run osmo-hlr_10.42.42.2(pid=21420): Launched 19:15:47.510554 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:48.054965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21422): Launched 19:15:48.364211 run osmo-stp_10.42.42.5(pid=21423): Launched 19:15:48.480208 run osmo-msc_10.42.42.6: Starting osmo-msc 19:15:49.031891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21425): Launched 19:15:49.337800 run osmo-msc_10.42.42.6(pid=21426): Launched 19:15:49.509119 run osmo-stp_10.42.42.5(pid=21423): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21423)] 19:15:49.638811 run osmo-stp_10.42.42.5(pid=21423): stdout: | (launched: 2022-12-13_19:15:48.306879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:49.767639 run osmo-stp_10.42.42.5(pid=21423): stderr: | 20221213191548478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191548478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191548479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191548479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191548479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191548480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191548480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:49.894483 run osmo-stp_10.42.42.5(pid=21423): stdout: | (launched: 2022-12-13_19:15:48.306879) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:15:50.016110 run osmo-stp_10.42.42.5(pid=21423): stderr: | 20221213191548478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191548478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191548479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191548479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191548479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191548480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191548480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:15:50.161651 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21423): Process ended prematurely: osmo-stp_10.42.42.5(pid=21423) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21423)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:15:50.170528 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:15:50.197101 run osmo-hlr_10.42.42.2(pid=21420): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21420)] 19:15:50.245176 run osmo-hlr_10.42.42.2(pid=21420): stdout: | (launched: 2022-12-13_19:15:47.332698) 19:15:50.294633 run osmo-hlr_10.42.42.2(pid=21420): stderr: | 20221213191547508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191547508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191547508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191547508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191547508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191547508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191547520 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191547531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191547531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191547531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:15:50.364513 run osmo-msc_10.42.42.6(pid=21426): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21426)] 19:15:50.412150 run osmo-msc_10.42.42.6(pid=21426): stdout: | (launched: 2022-12-13_19:15:49.280741) 19:15:50.461349 run osmo-msc_10.42.42.6(pid=21426): stderr: | 20221213191549554 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191549554 DLGLOBAL DEBUG validating counter group 0x7fca2f723c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191549555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191549555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191549555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191549555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191549557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191549557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191549558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191549558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:15:50.510690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21419): Terminating (SIGTERM) 19:15:50.550003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21422): Terminating (SIGTERM) 19:15:50.590179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21425): Terminating (SIGTERM) 19:15:50.630265 --- ParallelTerminationStrategy: PID 21419 died... 19:15:50.649224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21419): Terminated: ok {rc=0} 19:15:50.693351 --- ParallelTerminationStrategy: PID 21422 died... 19:15:50.711890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21422): Terminated: ok {rc=0} 19:15:50.755917 --- ParallelTerminationStrategy: PID 21425 died... 19:15:50.774514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21425): Terminated: ok {rc=0} 19:15:50.860201 bus /sierra_3: Setting Powered False 19:15:51.959903 bus /sierra_3: Setting Powered False 19:15:53.075890 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:15:54.332804 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:15:54.340176 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:15:54.375748 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:15:54.404327 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:15:54.458888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:15:54.492378 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:15:54.520916 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:15:55.072661 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:15:55.127216 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.139182 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:15:55.212177 tst mo_mt_call.py: using LAC 35695 19:15:55.333894 tst mo_mt_call.py: using RAC 250 19:15:55.456279 tst mo_mt_call.py: using CellId 35695 19:15:55.578626 tst mo_mt_call.py: using BVCI 35696 19:15:55.690983 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.702504 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.713593 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.724482 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.735574 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:15:55.746536 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:15:55.860942 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:15:55.985424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:15:56.500055 run create_hlr_db(pid=21431): Launched 19:15:56.627960 bus /sierra_2: Setting Powered False 19:15:57.692567 run create_hlr_db(pid=21431): Terminated: ok {rc=0} 19:15:58.132754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21433): Launched 19:15:58.441415 run osmo-hlr_10.42.42.2(pid=21434): Launched 19:15:58.559091 run osmo-stp_10.42.42.5: Starting osmo-stp 19:15:59.087733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21436): Launched 19:15:59.395602 run osmo-stp_10.42.42.5(pid=21437): Launched 19:15:59.512448 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:00.067426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21439): Launched 19:16:00.374406 run osmo-msc_10.42.42.6(pid=21440): Launched 19:16:00.546472 run osmo-stp_10.42.42.5(pid=21437): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21437)] 19:16:00.676203 run osmo-stp_10.42.42.5(pid=21437): stdout: | (launched: 2022-12-13_19:15:59.338512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:00.805751 run osmo-stp_10.42.42.5(pid=21437): stderr: | 20221213191559510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191559511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191559511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191559511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191559512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191559512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191559512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:00.941740 run osmo-stp_10.42.42.5(pid=21437): stdout: | (launched: 2022-12-13_19:15:59.338512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:01.065740 run osmo-stp_10.42.42.5(pid=21437): stderr: | 20221213191559510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191559511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191559511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191559511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191559512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191559512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191559512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:01.216128 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21437): Process ended prematurely: osmo-stp_10.42.42.5(pid=21437) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21437)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:16:01.226063 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:16:01.253597 run osmo-hlr_10.42.42.2(pid=21434): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21434)] 19:16:01.304330 run osmo-hlr_10.42.42.2(pid=21434): stdout: | (launched: 2022-12-13_19:15:58.384029) 19:16:01.355149 run osmo-hlr_10.42.42.2(pid=21434): stderr: | 20221213191558563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191558563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191558563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191558564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191558564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191558564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191558577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191558587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191558587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191558587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:01.426422 run osmo-msc_10.42.42.6(pid=21440): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21440)] 19:16:01.475700 run osmo-msc_10.42.42.6(pid=21440): stdout: | (launched: 2022-12-13_19:16:00.317148) 19:16:01.526787 run osmo-msc_10.42.42.6(pid=21440): stderr: | 20221213191600590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191600590 DLGLOBAL DEBUG validating counter group 0x7f9ba7ed7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191600590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191600590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191600591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [38;5;43m20221213191600591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191600593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191600593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191600593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191600593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:01.578174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21433): Terminating (SIGTERM) 19:16:01.619522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21436): Terminating (SIGTERM) 19:16:01.660106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21439): Terminating (SIGTERM) 19:16:01.703526 --- ParallelTerminationStrategy: PID 21433 died... 19:16:01.723734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21433): Terminated: ok {rc=0} 19:16:01.787745 --- ParallelTerminationStrategy: PID 21436 died... 19:16:01.814906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21436): Terminated: ok {rc=0} 19:16:01.879419 --- ParallelTerminationStrategy: PID 21439 died... 19:16:01.905619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21439): Terminated: ok {rc=0} 19:16:02.010350 bus /sierra_3: Setting Powered False 19:16:03.108150 bus /sierra_3: Setting Powered False 19:16:04.224292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:16:05.372424 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:05.384360 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:16:05.456335 tst mo_mt_call_osmux.py: using LAC 35696 19:16:05.584922 tst mo_mt_call_osmux.py: using RAC 251 19:16:05.711862 tst mo_mt_call_osmux.py: using CellId 35696 19:16:05.838273 tst mo_mt_call_osmux.py: using BVCI 35697 19:16:05.957451 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:05.969146 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:05.980598 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:05.992085 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:06.004008 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:16:06.015787 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:16:06.136715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:16:06.257453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:06.768113 run create_hlr_db(pid=21442): Launched 19:16:06.894550 bus /sierra_2: Setting Powered False 19:16:07.959466 run create_hlr_db(pid=21442): Terminated: ok {rc=0} 19:16:08.398458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21444): Launched 19:16:08.706457 run osmo-hlr_10.42.42.2(pid=21445): Launched 19:16:08.823264 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:09.350968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21447): Launched 19:16:09.659723 run osmo-stp_10.42.42.5(pid=21448): Launched 19:16:09.777173 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:10.331695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21450): Launched 19:16:10.640467 run osmo-msc_10.42.42.6(pid=21451): Launched 19:16:10.811412 run osmo-stp_10.42.42.5(pid=21448): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21448)] 19:16:10.940724 run osmo-stp_10.42.42.5(pid=21448): stdout: | (launched: 2022-12-13_19:16:09.602862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:11.069204 run osmo-stp_10.42.42.5(pid=21448): stderr: | 20221213191609774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191609774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191609774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191609775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191609775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191609775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191609775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:11.195945 run osmo-stp_10.42.42.5(pid=21448): stdout: | (launched: 2022-12-13_19:16:09.602862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:11.317481 run osmo-stp_10.42.42.5(pid=21448): stderr: | 20221213191609774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191609774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191609774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191609775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191609775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191609775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191609775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:11.463711 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21448): Process ended prematurely: osmo-stp_10.42.42.5(pid=21448) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21448)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:16:11.472743 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:16:11.499363 run osmo-hlr_10.42.42.2(pid=21445): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21445)] 19:16:11.547418 run osmo-hlr_10.42.42.2(pid=21445): stdout: | (launched: 2022-12-13_19:16:08.649379) 19:16:11.597086 run osmo-hlr_10.42.42.2(pid=21445): stderr: | 20221213191608826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191608826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191608826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191608826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191608826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191608826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191608841 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191608851 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191608851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191608851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:11.666095 run osmo-msc_10.42.42.6(pid=21451): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21451)] 19:16:11.713847 run osmo-msc_10.42.42.6(pid=21451): stdout: | (launched: 2022-12-13_19:16:10.583484) 19:16:11.762906 run osmo-msc_10.42.42.6(pid=21451): stderr: | 20221213191610858 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191610859 DLGLOBAL DEBUG validating counter group 0x7f38d4052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191610859 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191610859 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191610859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191610859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191610861 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191610861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191610861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191610861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:11.812353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21444): Terminating (SIGTERM) 19:16:11.851968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21447): Terminating (SIGTERM) 19:16:11.891943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21450): Terminating (SIGTERM) 19:16:11.931974 --- ParallelTerminationStrategy: PID 21444 died... 19:16:11.951390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21444): Terminated: ok {rc=0} 19:16:11.995391 --- ParallelTerminationStrategy: PID 21447 died... 19:16:12.013956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21447): Terminated: ok {rc=0} 19:16:12.057553 --- ParallelTerminationStrategy: PID 21450 died... 19:16:12.076254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21450): Terminated: ok {rc=0} 19:16:12.159908 bus /sierra_3: Setting Powered False 19:16:13.255924 bus /sierra_3: Setting Powered False 19:16:14.370868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:16:15.620382 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:15.626917 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:16:15.659117 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:16:15.686469 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:16:15.737712 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:16:15.770248 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:16:15.797010 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:16:16.394580 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:16:16.446756 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:16.458809 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:16:16.529020 tst mo_mt_call.py: using LAC 35697 19:16:16.654857 tst mo_mt_call.py: using RAC 252 19:16:16.778334 tst mo_mt_call.py: using CellId 35697 19:16:16.938269 tst mo_mt_call.py: using BVCI 35698 19:16:17.063259 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:17.076050 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:17.088588 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:17.101337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:17.115278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:17.128726 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:16:17.263941 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:16:17.390243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:17.900618 run create_hlr_db(pid=21457): Launched 19:16:18.027880 bus /sierra_2: Setting Powered False 19:16:19.092506 run create_hlr_db(pid=21457): Terminated: ok {rc=0} 19:16:19.551153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21459): Launched 19:16:19.882396 run osmo-hlr_10.42.42.2(pid=21460): Launched 19:16:20.009990 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:20.576825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21462): Launched 19:16:20.908312 run osmo-stp_10.42.42.5(pid=21463): Launched 19:16:21.035455 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:21.629551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21465): Launched 19:16:21.959348 run osmo-msc_10.42.42.6(pid=21466): Launched 19:16:22.142004 run osmo-stp_10.42.42.5(pid=21463): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21463)] 19:16:22.281321 run osmo-stp_10.42.42.5(pid=21463): stdout: | (launched: 2022-12-13_19:16:20.847456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:22.421074 run osmo-stp_10.42.42.5(pid=21463): stderr: | 20221213191621042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191621042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191621042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191621043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191621043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191621043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191621043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:22.559788 run osmo-stp_10.42.42.5(pid=21463): stdout: | (launched: 2022-12-13_19:16:20.847456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:22.691615 run osmo-stp_10.42.42.5(pid=21463): stderr: | 20221213191621042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191621042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191621042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191621043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191621043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191621043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191621043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:22.849285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21463): Process ended prematurely: osmo-stp_10.42.42.5(pid=21463) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21463)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:16:22.858942 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:16:22.886841 run osmo-hlr_10.42.42.2(pid=21460): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21460)] 19:16:22.937957 run osmo-hlr_10.42.42.2(pid=21460): stdout: | (launched: 2022-12-13_19:16:19.821726) 19:16:22.990616 run osmo-hlr_10.42.42.2(pid=21460): stderr: | 20221213191620019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191620019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191620019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191620019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191620019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191620019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191620031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191620039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191620040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191620040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:23.063799 run osmo-msc_10.42.42.6(pid=21466): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21466)] 19:16:23.114307 run osmo-msc_10.42.42.6(pid=21466): stdout: | (launched: 2022-12-13_19:16:21.899228) 19:16:23.167039 run osmo-msc_10.42.42.6(pid=21466): stderr: | 20221213191622220 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191622220 DLGLOBAL DEBUG validating counter group 0x7f154843dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191622221 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191622221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191622221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191622221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191622223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191622223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191622223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191622223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:23.219895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21459): Terminating (SIGTERM) 19:16:23.262503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21462): Terminating (SIGTERM) 19:16:23.305279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21465): Terminating (SIGTERM) 19:16:23.347866 --- ParallelTerminationStrategy: PID 21459 died... 19:16:23.368433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21459): Terminated: ok {rc=0} 19:16:23.415313 --- ParallelTerminationStrategy: PID 21462 died... 19:16:23.435546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21462): Terminated: ok {rc=0} 19:16:23.482231 --- ParallelTerminationStrategy: PID 21465 died... 19:16:23.502378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21465): Terminated: ok {rc=0} 19:16:23.591459 bus /sierra_3: Setting Powered False 19:16:24.691044 bus /sierra_3: Setting Powered False 19:16:25.808767 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:16:26.959530 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:26.972076 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:16:27.048920 tst mo_mt_call_osmux.py: using LAC 35698 19:16:27.169482 tst mo_mt_call_osmux.py: using RAC 253 19:16:27.290206 tst mo_mt_call_osmux.py: using CellId 35698 19:16:27.408387 tst mo_mt_call_osmux.py: using BVCI 35699 19:16:27.519444 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:27.530840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:27.541807 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:27.552609 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:27.563718 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:16:27.574680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:16:27.695611 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:16:27.812610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:28.288295 run create_hlr_db(pid=21468): Launched 19:16:28.412720 bus /sierra_2: Setting Powered False 19:16:29.473942 run create_hlr_db(pid=21468): Terminated: ok {rc=0} 19:16:29.923323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Launched 19:16:30.254786 run osmo-hlr_10.42.42.2(pid=21471): Launched 19:16:30.382973 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:30.969720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Launched 19:16:31.314183 run osmo-stp_10.42.42.5(pid=21474): Launched 19:16:31.585743 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:32.229113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21476): Launched 19:16:32.560284 run osmo-msc_10.42.42.6(pid=21477): Launched 19:16:32.745922 run osmo-stp_10.42.42.5(pid=21474): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] 19:16:32.884559 run osmo-stp_10.42.42.5(pid=21474): stdout: | (launched: 2022-12-13_19:16:31.252407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:33.023937 run osmo-stp_10.42.42.5(pid=21474): stderr: | 20221213191631511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191631511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191631512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191631512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191631512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191631513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191631513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:33.162226 run osmo-stp_10.42.42.5(pid=21474): stdout: | (launched: 2022-12-13_19:16:31.252407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:33.295187 run osmo-stp_10.42.42.5(pid=21474): stderr: | 20221213191631511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191631511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191631512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191631512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191631512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191631513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191631513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:33.453317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21474): Process ended prematurely: osmo-stp_10.42.42.5(pid=21474) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:16:33.462897 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:16:33.490984 run osmo-hlr_10.42.42.2(pid=21471): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21471)] 19:16:33.542470 run osmo-hlr_10.42.42.2(pid=21471): stdout: | (launched: 2022-12-13_19:16:30.193689) 19:16:33.595287 run osmo-hlr_10.42.42.2(pid=21471): stderr: | 20221213191630392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191630392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191630392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191630392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191630392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191630392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191630404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191630413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191630414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191630414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:33.668516 run osmo-msc_10.42.42.6(pid=21477): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21477)] 19:16:33.719019 run osmo-msc_10.42.42.6(pid=21477): stdout: | (launched: 2022-12-13_19:16:32.499408) 19:16:33.771052 run osmo-msc_10.42.42.6(pid=21477): stderr: | 20221213191632823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191632823 DLGLOBAL DEBUG validating counter group 0x7fc810f62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191632823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191632823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191632823 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191632823 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191632825 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191632825 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191632825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191632826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:33.823509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Terminating (SIGTERM) 19:16:33.865750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Terminating (SIGTERM) 19:16:33.908313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21476): Terminating (SIGTERM) 19:16:33.951312 --- ParallelTerminationStrategy: PID 21470 died... 19:16:33.971798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21470): Terminated: ok {rc=0} 19:16:34.018978 --- ParallelTerminationStrategy: PID 21473 died... 19:16:34.039095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21473): Terminated: ok {rc=0} 19:16:34.085724 --- ParallelTerminationStrategy: PID 21476 died... 19:16:34.105824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21476): Terminated: ok {rc=0} 19:16:34.195170 bus /sierra_3: Setting Powered False 19:16:35.295653 bus /sierra_3: Setting Powered False 19:16:36.413418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:16:37.672696 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:37.680006 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:16:37.713974 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:16:37.742364 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:16:37.795491 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:16:37.829526 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:16:37.857461 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:16:38.406756 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:16:38.455992 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:38.467446 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:16:38.541945 tst mo_mt_call.py: using LAC 35699 19:16:38.661416 tst mo_mt_call.py: using RAC 254 19:16:38.783146 tst mo_mt_call.py: using CellId 35699 19:16:38.903561 tst mo_mt_call.py: using BVCI 35700 19:16:39.015494 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:39.026802 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:39.037934 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:39.048805 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:39.059897 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:39.070917 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:16:39.192924 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:16:39.315024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:39.793111 run create_hlr_db(pid=21482): Launched 19:16:39.918532 bus /sierra_2: Setting Powered False 19:16:40.979264 run create_hlr_db(pid=21482): Terminated: ok {rc=0} 19:16:41.429261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Launched 19:16:41.761738 run osmo-hlr_10.42.42.2(pid=21485): Launched 19:16:41.890455 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:42.458974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Launched 19:16:42.791235 run osmo-stp_10.42.42.5(pid=21488): Launched 19:16:42.917220 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:43.513578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21490): Launched 19:16:43.843324 run osmo-msc_10.42.42.6(pid=21491): Launched 19:16:44.028685 run osmo-stp_10.42.42.5(pid=21488): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] 19:16:44.168213 run osmo-stp_10.42.42.5(pid=21488): stdout: | (launched: 2022-12-13_19:16:42.730166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:44.308508 run osmo-stp_10.42.42.5(pid=21488): stderr: | 20221213191642924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191642924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191642924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191642925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191642925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191642925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191642925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:44.447635 run osmo-stp_10.42.42.5(pid=21488): stdout: | (launched: 2022-12-13_19:16:42.730166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:44.580084 run osmo-stp_10.42.42.5(pid=21488): stderr: | 20221213191642924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191642924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191642924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191642925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191642925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191642925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191642925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:44.738435 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:16:44.748267 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:16:44.776655 run osmo-hlr_10.42.42.2(pid=21485): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21485)] 19:16:44.828508 run osmo-hlr_10.42.42.2(pid=21485): stdout: | (launched: 2022-12-13_19:16:41.700827) 19:16:44.881797 run osmo-hlr_10.42.42.2(pid=21485): stderr: | 20221213191641902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191641902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191641902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191641902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191641902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191641902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191641914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191641923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191641923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191641923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:44.955378 run osmo-msc_10.42.42.6(pid=21491): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21491)] 19:16:45.005880 run osmo-msc_10.42.42.6(pid=21491): stdout: | (launched: 2022-12-13_19:16:43.782693) 19:16:45.058823 run osmo-msc_10.42.42.6(pid=21491): stderr: | 20221213191644106 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191644106 DLGLOBAL DEBUG validating counter group 0x7fb83f104c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191644106 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191644106 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191644107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191644107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191644108 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191644109 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191644109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191644109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:45.111844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminating (SIGTERM) 19:16:45.154664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminating (SIGTERM) 19:16:45.197987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21490): Terminating (SIGTERM) 19:16:45.241068 --- ParallelTerminationStrategy: PID 21484 died... 19:16:45.261954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminated: ok {rc=0} 19:16:45.309212 --- ParallelTerminationStrategy: PID 21487 died... 19:16:45.329629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminated: ok {rc=0} 19:16:45.376622 --- ParallelTerminationStrategy: PID 21490 died... 19:16:45.397158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21490): Terminated: ok {rc=0} 19:16:45.486443 bus /sierra_3: Setting Powered False 19:16:46.583348 bus /sierra_3: Setting Powered False 19:16:47.703668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:16:48.851542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:48.863750 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:16:48.933732 tst mo_mt_call_osmux.py: using LAC 35700 19:16:49.054781 tst mo_mt_call_osmux.py: using RAC 255 19:16:49.177138 tst mo_mt_call_osmux.py: using CellId 35700 19:16:49.296885 tst mo_mt_call_osmux.py: using BVCI 35701 19:16:49.409244 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:49.420615 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:49.431841 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:49.442962 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:49.454155 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:16:49.465346 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:16:49.582497 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:16:49.702307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:16:50.179531 run create_hlr_db(pid=21493): Launched 19:16:50.304394 bus /sierra_2: Setting Powered False 19:16:51.366101 run create_hlr_db(pid=21493): Terminated: ok {rc=0} 19:16:51.794023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Launched 19:16:52.102257 run osmo-hlr_10.42.42.2(pid=21496): Launched 19:16:52.220298 run osmo-stp_10.42.42.5: Starting osmo-stp 19:16:52.748401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Launched 19:16:53.057694 run osmo-stp_10.42.42.5(pid=21499): Launched 19:16:53.174732 run osmo-msc_10.42.42.6: Starting osmo-msc 19:16:53.727894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21501): Launched 19:16:54.035854 run osmo-msc_10.42.42.6(pid=21502): Launched 19:16:54.208371 run osmo-stp_10.42.42.5(pid=21499): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] 19:16:54.338302 run osmo-stp_10.42.42.5(pid=21499): stdout: | (launched: 2022-12-13_19:16:52.999831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:54.467814 run osmo-stp_10.42.42.5(pid=21499): stderr: | 20221213191653171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191653171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191653172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191653172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191653173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191653173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191653173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:54.595156 run osmo-stp_10.42.42.5(pid=21499): stdout: | (launched: 2022-12-13_19:16:52.999831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:16:54.717383 run osmo-stp_10.42.42.5(pid=21499): stderr: | 20221213191653171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191653171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191653172 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191653172 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191653173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191653173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191653173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:16:54.864384 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21499): Process ended prematurely: osmo-stp_10.42.42.5(pid=21499) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:16:54.873455 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:16:54.899959 run osmo-hlr_10.42.42.2(pid=21496): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21496)] 19:16:54.948098 run osmo-hlr_10.42.42.2(pid=21496): stdout: | (launched: 2022-12-13_19:16:52.044530) 19:16:54.997853 run osmo-hlr_10.42.42.2(pid=21496): stderr: | 20221213191652222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191652222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191652222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191652222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191652222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191652222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191652234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191652242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191652242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191652242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:16:55.067253 run osmo-msc_10.42.42.6(pid=21502): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21502)] 19:16:55.115313 run osmo-msc_10.42.42.6(pid=21502): stdout: | (launched: 2022-12-13_19:16:53.978756) 19:16:55.164915 run osmo-msc_10.42.42.6(pid=21502): stderr: | 20221213191654252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191654252 DLGLOBAL DEBUG validating counter group 0x7f48d1afac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191654252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191654252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191654253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191654253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191654254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191654255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191654255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191654255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:16:55.214843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Terminating (SIGTERM) 19:16:55.254934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Terminating (SIGTERM) 19:16:55.294877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21501): Terminating (SIGTERM) 19:16:55.335098 --- ParallelTerminationStrategy: PID 21495 died... 19:16:55.354453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21495): Terminated: ok {rc=0} 19:16:55.398774 --- ParallelTerminationStrategy: PID 21498 died... 19:16:55.417610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21498): Terminated: ok {rc=0} 19:16:55.461635 --- ParallelTerminationStrategy: PID 21501 died... 19:16:55.480298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21501): Terminated: ok {rc=0} 19:16:55.566568 bus /sierra_3: Setting Powered False 19:16:56.667482 bus /sierra_3: Setting Powered False 19:16:57.782225 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:16:59.040089 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:16:59.046434 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:16:59.080389 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:16:59.109689 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:16:59.161673 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:16:59.195775 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:16:59.224328 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:16:59.775090 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:16:59.828599 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:16:59.840235 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:16:59.911430 tst mo_mt_call.py: using LAC 35701 19:17:00.038326 tst mo_mt_call.py: using RAC 1 19:17:00.169063 tst mo_mt_call.py: using CellId 35701 19:17:00.305257 tst mo_mt_call.py: using BVCI 35702 19:17:00.417628 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:00.428700 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:00.439712 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:00.450782 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:00.461697 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:00.472768 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:17:00.591915 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:17:00.707935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:01.205672 run create_hlr_db(pid=21507): Launched 19:17:01.369829 bus /sierra_2: Setting Powered False 19:17:02.434289 run create_hlr_db(pid=21507): Terminated: ok {rc=0} 19:17:02.880153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21512): Launched 19:17:03.184282 run osmo-hlr_10.42.42.2(pid=21513): Launched 19:17:03.299309 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:03.823688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21515): Launched 19:17:04.127546 run osmo-stp_10.42.42.5(pid=21516): Launched 19:17:04.242246 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:04.787670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21518): Launched 19:17:05.091327 run osmo-msc_10.42.42.6(pid=21519): Launched 19:17:05.260013 run osmo-stp_10.42.42.5(pid=21516): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21516)] 19:17:05.388171 run osmo-stp_10.42.42.5(pid=21516): stdout: | (launched: 2022-12-13_19:17:04.070999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:05.515847 run osmo-stp_10.42.42.5(pid=21516): stderr: | 20221213191704239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191704239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191704239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191704240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191704240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191704240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191704240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:05.642034 run osmo-stp_10.42.42.5(pid=21516): stdout: | (launched: 2022-12-13_19:17:04.070999) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:05.763658 run osmo-stp_10.42.42.5(pid=21516): stderr: | 20221213191704239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191704239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191704239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191704240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191704240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191704240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191704240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:05.908730 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21516): Process ended prematurely: osmo-stp_10.42.42.5(pid=21516) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21516)] [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:17:05.917805 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:17:05.944272 run osmo-hlr_10.42.42.2(pid=21513): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21513)] 19:17:05.992424 run osmo-hlr_10.42.42.2(pid=21513): stdout: | (launched: 2022-12-13_19:17:03.128059) 19:17:06.042214 run osmo-hlr_10.42.42.2(pid=21513): stderr: | 20221213191703302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191703302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191703302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191703302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191703302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191703302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191703315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191703324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191703324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191703324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:06.111752 run osmo-msc_10.42.42.6(pid=21519): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21519)] 19:17:06.159650 run osmo-msc_10.42.42.6(pid=21519): stdout: | (launched: 2022-12-13_19:17:05.035034) 19:17:06.209352 run osmo-msc_10.42.42.6(pid=21519): stderr: | 20221213191705306 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191705306 DLGLOBAL DEBUG validating counter group 0x7f2bc7c11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191705306 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191705307 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191705307 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191705307 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191705309 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191705309 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191705309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191705309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:06.259269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21512): Terminating (SIGTERM) 19:17:06.299146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21515): Terminating (SIGTERM) 19:17:06.339040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21518): Terminating (SIGTERM) 19:17:06.379073 --- ParallelTerminationStrategy: PID 21512 died... 19:17:06.398249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21512): Terminated: ok {rc=0} 19:17:06.442315 --- ParallelTerminationStrategy: PID 21515 died... 19:17:06.460852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21515): Terminated: ok {rc=0} 19:17:06.505250 --- ParallelTerminationStrategy: PID 21518 died... 19:17:06.524124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21518): Terminated: ok {rc=0} 19:17:06.610982 bus /sierra_3: Setting Powered False 19:17:07.710322 bus /sierra_3: Setting Powered False 19:17:08.827132 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:17:09.974610 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:09.986360 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:17:10.057399 tst mo_mt_call_osmux.py: using LAC 35702 19:17:10.178434 tst mo_mt_call_osmux.py: using RAC 2 19:17:10.298001 tst mo_mt_call_osmux.py: using CellId 35702 19:17:10.418927 tst mo_mt_call_osmux.py: using BVCI 35703 19:17:10.528244 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:10.539275 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:10.550046 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:10.560717 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:10.571605 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:17:10.582886 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:17:10.702132 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:17:10.818249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:11.289682 run create_hlr_db(pid=21521): Launched 19:17:11.413366 bus /sierra_2: Setting Powered False 19:17:12.474338 run create_hlr_db(pid=21521): Terminated: ok {rc=0} 19:17:12.897356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21523): Launched 19:17:13.200311 run osmo-hlr_10.42.42.2(pid=21524): Launched 19:17:13.314242 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:13.832879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Launched 19:17:14.135603 run osmo-stp_10.42.42.5(pid=21527): Launched 19:17:14.251232 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:14.802964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21529): Launched 19:17:15.107627 run osmo-msc_10.42.42.6(pid=21530): Launched 19:17:15.275990 run osmo-stp_10.42.42.5(pid=21527): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] 19:17:15.403991 run osmo-stp_10.42.42.5(pid=21527): stdout: | (launched: 2022-12-13_19:17:14.079184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:15.531790 run osmo-stp_10.42.42.5(pid=21527): stderr: | 20221213191714245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191714246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191714246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191714246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191714247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191714247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191714247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:15.657665 run osmo-stp_10.42.42.5(pid=21527): stdout: | (launched: 2022-12-13_19:17:14.079184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:15.778505 run osmo-stp_10.42.42.5(pid=21527): stderr: | 20221213191714245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191714246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191714246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191714246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191714247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191714247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191714247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:15.926042 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21527): Process ended prematurely: osmo-stp_10.42.42.5(pid=21527) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:17:15.935282 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:17:15.962058 run osmo-hlr_10.42.42.2(pid=21524): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21524)] 19:17:16.011066 run osmo-hlr_10.42.42.2(pid=21524): stdout: | (launched: 2022-12-13_19:17:13.143967) 19:17:16.061307 run osmo-hlr_10.42.42.2(pid=21524): stderr: | 20221213191713319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191713320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191713320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191713320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191713320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191713320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191713332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191713341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191713341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191713341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:16.131585 run osmo-msc_10.42.42.6(pid=21530): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21530)] 19:17:16.180228 run osmo-msc_10.42.42.6(pid=21530): stdout: | (launched: 2022-12-13_19:17:15.050963) 19:17:16.230570 run osmo-msc_10.42.42.6(pid=21530): stderr: | 20221213191715321 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191715321 DLGLOBAL DEBUG validating counter group 0x7f7605ad1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191715321 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191715321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191715321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191715321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191715323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191715323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191715324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191715324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:16.281397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21523): Terminating (SIGTERM) 19:17:16.322502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Terminating (SIGTERM) 19:17:16.365221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21529): Terminating (SIGTERM) 19:17:16.407569 --- ParallelTerminationStrategy: PID 21523 died... 19:17:16.427135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21523): Terminated: ok {rc=0} 19:17:16.471719 --- ParallelTerminationStrategy: PID 21526 died... 19:17:16.490960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Terminated: ok {rc=0} 19:17:16.535551 --- ParallelTerminationStrategy: PID 21529 died... 19:17:16.554653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21529): Terminated: ok {rc=0} 19:17:16.639233 bus /sierra_3: Setting Powered False 19:17:17.734148 bus /sierra_3: Setting Powered False 19:17:18.847784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:17:20.099401 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:17:20.106101 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:17:20.140386 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:17:20.168646 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:17:20.223746 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:17:20.258457 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:17:20.285912 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:17:20.836298 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:17:20.889468 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:20.901585 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:17:20.955359 tst mo_mt_call.py: using LAC 35703 19:17:21.079681 tst mo_mt_call.py: using RAC 3 19:17:21.198666 tst mo_mt_call.py: using CellId 35703 19:17:21.315275 tst mo_mt_call.py: using BVCI 35704 19:17:21.435338 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:21.447342 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:21.459248 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:21.471003 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:21.483314 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:21.495577 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:17:21.611949 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:17:21.728693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:22.199625 run create_hlr_db(pid=21535): Launched 19:17:22.323019 bus /sierra_2: Setting Powered False 19:17:23.383284 run create_hlr_db(pid=21535): Terminated: ok {rc=0} 19:17:23.827028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Launched 19:17:24.135283 run osmo-hlr_10.42.42.2(pid=21538): Launched 19:17:24.250127 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:24.769388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Launched 19:17:25.072506 run osmo-stp_10.42.42.5(pid=21541): Launched 19:17:25.187197 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:25.733674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Launched 19:17:26.036792 run osmo-msc_10.42.42.6(pid=21544): Launched 19:17:26.206316 run osmo-stp_10.42.42.5(pid=21541): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] 19:17:26.334536 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-13_19:17:25.016044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:26.462175 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221213191725186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191725186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191725186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191725186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191725187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191725187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191725187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:26.587833 run osmo-stp_10.42.42.5(pid=21541): stdout: | (launched: 2022-12-13_19:17:25.016044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:26.708073 run osmo-stp_10.42.42.5(pid=21541): stderr: | 20221213191725186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191725186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191725186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191725186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191725187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191725187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191725187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:26.852321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:17:26.861341 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:17:26.887615 run osmo-hlr_10.42.42.2(pid=21538): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21538)] 19:17:26.935838 run osmo-hlr_10.42.42.2(pid=21538): stdout: | (launched: 2022-12-13_19:17:24.078712) 19:17:26.985189 run osmo-hlr_10.42.42.2(pid=21538): stderr: | 20221213191724254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191724254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191724254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191724254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191724254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191724254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191724267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191724276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191724276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191724276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:27.053955 run osmo-msc_10.42.42.6(pid=21544): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21544)] 19:17:27.101881 run osmo-msc_10.42.42.6(pid=21544): stdout: | (launched: 2022-12-13_19:17:25.980341) 19:17:27.151094 run osmo-msc_10.42.42.6(pid=21544): stderr: | 20221213191726251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191726251 DLGLOBAL DEBUG validating counter group 0x7f24151dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191726251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191726251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191726252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191726252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191726254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191726254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191726254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191726254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:27.200545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminating (SIGTERM) 19:17:27.240061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminating (SIGTERM) 19:17:27.279370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminating (SIGTERM) 19:17:27.319136 --- ParallelTerminationStrategy: PID 21537 died... 19:17:27.338322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21537): Terminated: ok {rc=0} 19:17:27.382352 --- ParallelTerminationStrategy: PID 21540 died... 19:17:27.401033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21540): Terminated: ok {rc=0} 19:17:27.444658 --- ParallelTerminationStrategy: PID 21543 died... 19:17:27.463390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21543): Terminated: ok {rc=0} 19:17:27.549533 bus /sierra_3: Setting Powered False 19:17:28.648833 bus /sierra_3: Setting Powered False 19:17:29.761631 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:17:30.937123 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:30.950767 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:17:31.011988 tst mo_mt_call_osmux.py: using LAC 35704 19:17:31.134874 tst mo_mt_call_osmux.py: using RAC 4 19:17:31.270465 tst mo_mt_call_osmux.py: using CellId 35704 19:17:31.400723 tst mo_mt_call_osmux.py: using BVCI 35705 19:17:31.524762 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:31.537676 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:31.550591 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:31.563649 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:31.577699 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:17:31.591362 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:17:31.718015 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:17:31.866539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:32.413426 run create_hlr_db(pid=21546): Launched 19:17:32.538988 bus /sierra_2: Setting Powered False 19:17:33.603215 run create_hlr_db(pid=21546): Terminated: ok {rc=0} 19:17:34.037050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Launched 19:17:34.340835 run osmo-hlr_10.42.42.2(pid=21549): Launched 19:17:34.456317 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:34.981929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Launched 19:17:35.286541 run osmo-stp_10.42.42.5(pid=21552): Launched 19:17:35.401719 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:35.947121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Launched 19:17:36.250673 run osmo-msc_10.42.42.6(pid=21555): Launched 19:17:36.419890 run osmo-stp_10.42.42.5(pid=21552): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] 19:17:36.547703 run osmo-stp_10.42.42.5(pid=21552): stdout: | (launched: 2022-12-13_19:17:35.230560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:36.675752 run osmo-stp_10.42.42.5(pid=21552): stderr: | 20221213191735398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191735398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191735398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191735398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191735399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191735399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191735399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:36.802071 run osmo-stp_10.42.42.5(pid=21552): stdout: | (launched: 2022-12-13_19:17:35.230560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:36.923694 run osmo-stp_10.42.42.5(pid=21552): stderr: | 20221213191735398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191735398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191735398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191735398 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191735399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191735399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191735399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:37.068758 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21552): Process ended prematurely: osmo-stp_10.42.42.5(pid=21552) [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:17:37.077827 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:17:37.104233 run osmo-hlr_10.42.42.2(pid=21549): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21549)] 19:17:37.152428 run osmo-hlr_10.42.42.2(pid=21549): stdout: | (launched: 2022-12-13_19:17:34.284939) 19:17:37.202596 run osmo-hlr_10.42.42.2(pid=21549): stderr: | 20221213191734460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191734460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191734460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191734460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191734460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191734461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191734473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191734482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191734482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191734482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:37.271406 run osmo-msc_10.42.42.6(pid=21555): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21555)] 19:17:37.318839 run osmo-msc_10.42.42.6(pid=21555): stdout: | (launched: 2022-12-13_19:17:36.194878) 19:17:37.367822 run osmo-msc_10.42.42.6(pid=21555): stderr: | 20221213191736466 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191736467 DLGLOBAL DEBUG validating counter group 0x7f670ff2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191736467 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191736467 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191736467 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191736467 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191736469 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191736469 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191736470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191736470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:37.417453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Terminating (SIGTERM) 19:17:37.457146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Terminating (SIGTERM) 19:17:37.496596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Terminating (SIGTERM) 19:17:37.536402 --- ParallelTerminationStrategy: PID 21548 died... 19:17:37.555633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21548): Terminated: ok {rc=0} 19:17:37.599765 --- ParallelTerminationStrategy: PID 21551 died... 19:17:37.618637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21551): Terminated: ok {rc=0} 19:17:37.662239 --- ParallelTerminationStrategy: PID 21554 died... 19:17:37.681111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21554): Terminated: ok {rc=0} 19:17:37.766894 bus /sierra_3: Setting Powered False 19:17:38.866616 bus /sierra_3: Setting Powered False 19:17:39.981323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:trx-umtrx --------------------------------------------------------------------- 19:17:41.234364 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:17:41.239161 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:17:41.272682 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:17:41.301556 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:17:41.388926 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:17:41.422599 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:17:41.450332 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:17:42.034784 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 19:17:42.040213 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.051321 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:17:42.101646 tst emergency_mo_mt_call.py: using LAC 35705 19:17:42.220599 tst emergency_mo_mt_call.py: using RAC 5 19:17:42.335088 tst emergency_mo_mt_call.py: using CellId 35705 19:17:42.448692 tst emergency_mo_mt_call.py: using BVCI 35706 19:17:42.555038 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.565742 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.576213 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.586660 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.596936 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:42.607855 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:42.727071 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:42.844020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:43.300596 run create_hlr_db(pid=21560): Launched 19:17:43.422320 bus /sierra_2: Setting Powered False 19:17:44.483188 run create_hlr_db(pid=21560): Terminated: ok {rc=0} 19:17:44.919347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Launched 19:17:45.221333 run osmo-hlr_10.42.42.2(pid=21563): Launched 19:17:45.334676 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:45.861884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Launched 19:17:46.201758 run osmo-stp_10.42.42.5(pid=21566): Launched 19:17:46.438953 tst emergency_mo_mt_call.py: using MSISDN 8288 19:17:46.679943 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:47.253737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Launched 19:17:47.586477 run osmo-msc_10.42.42.6(pid=21569): Launched 19:17:47.766963 run osmo-stp_10.42.42.5(pid=21566): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] 19:17:47.903795 run osmo-stp_10.42.42.5(pid=21566): stdout: | (launched: 2022-12-13_19:17:46.130324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:48.040833 run osmo-stp_10.42.42.5(pid=21566): stderr: | 20221213191746430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191746430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191746430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191746431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191746433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191746433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191746436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:48.177058 run osmo-stp_10.42.42.5(pid=21566): stdout: | (launched: 2022-12-13_19:17:46.130324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:48.307696 run osmo-stp_10.42.42.5(pid=21566): stderr: | 20221213191746430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191746430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191746430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191746431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191746433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191746433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191746436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:48.463304 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21566): Process ended prematurely: osmo-stp_10.42.42.5(pid=21566) [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 19:17:48.472445 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 19:17:48.500058 run osmo-hlr_10.42.42.2(pid=21563): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21563)] 19:17:48.551987 run osmo-hlr_10.42.42.2(pid=21563): stdout: | (launched: 2022-12-13_19:17:45.166803) 19:17:48.604816 run osmo-hlr_10.42.42.2(pid=21563): stderr: | 20221213191745339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191745339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191745340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191745340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191745340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191745340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191745352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191745361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191745361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191745361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:48.677984 run osmo-msc_10.42.42.6(pid=21569): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21569)] 19:17:48.728414 run osmo-msc_10.42.42.6(pid=21569): stdout: | (launched: 2022-12-13_19:17:47.526772) 19:17:48.781714 run osmo-msc_10.42.42.6(pid=21569): stderr: | 20221213191747845 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191747845 DLGLOBAL DEBUG validating counter group 0x7f395bb71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191747845 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191747845 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191747845 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191747845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191747847 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191747848 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191747848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191747848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:48.835181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Terminating (SIGTERM) 19:17:48.877203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Terminating (SIGTERM) 19:17:48.920079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Terminating (SIGTERM) 19:17:48.962711 --- ParallelTerminationStrategy: PID 21562 died... 19:17:48.983536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21562): Terminated: ok {rc=0} 19:17:49.030598 --- ParallelTerminationStrategy: PID 21565 died... 19:17:49.050841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21565): Terminated: ok {rc=0} 19:17:49.097711 --- ParallelTerminationStrategy: PID 21568 died... 19:17:49.117854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21568): Terminated: ok {rc=0} 19:17:49.206794 bus /sierra_3: Setting Powered False 19:17:50.305469 bus /sierra_3: Setting Powered False 19:17:51.422271 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 19:17:52.507772 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:52.519265 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 19:17:52.572698 tst emergency_preemptive_call.py: using LAC 35706 19:17:52.690914 tst emergency_preemptive_call.py: using RAC 6 19:17:52.807026 tst emergency_preemptive_call.py: using CellId 35706 19:17:52.924733 tst emergency_preemptive_call.py: using BVCI 35707 19:17:53.033369 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:53.044145 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:53.054771 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:53.065703 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:53.076194 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 19:17:53.086737 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:53.201388 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:53.315562 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:53.433148 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 19:17:53.547289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:17:54.054016 run create_hlr_db(pid=21572): Launched 19:17:54.179240 bus /sierra_2: Setting Powered False 19:17:55.244034 run create_hlr_db(pid=21572): Terminated: ok {rc=0} 19:17:55.696208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Launched 19:17:56.020867 run osmo-hlr_10.42.42.2(pid=21575): Launched 19:17:56.144881 run osmo-stp_10.42.42.5: Starting osmo-stp 19:17:56.704754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Launched 19:17:57.028727 run osmo-stp_10.42.42.5(pid=21578): Launched 19:17:57.162265 tst emergency_preemptive_call.py: using MSISDN 8289 19:17:57.326484 run osmo-msc_10.42.42.6: Starting osmo-msc 19:17:57.907854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Launched 19:17:58.231191 run osmo-msc_10.42.42.6(pid=21581): Launched 19:17:58.412138 run osmo-stp_10.42.42.5(pid=21578): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] 19:17:58.549639 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-13_19:17:56.969525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:58.687540 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221213191757159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191757159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191757159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191757160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191757160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191757160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191757160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:58.823620 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-13_19:17:56.969525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:17:58.953405 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221213191757159 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191757159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191757159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191757160 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191757160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191757160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191757160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:17:59.108014 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 19:17:59.117106 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 19:17:59.144837 run osmo-hlr_10.42.42.2(pid=21575): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21575)] 19:17:59.196659 run osmo-hlr_10.42.42.2(pid=21575): stdout: | (launched: 2022-12-13_19:17:55.961561) 19:17:59.250445 run osmo-hlr_10.42.42.2(pid=21575): stderr: | 20221213191756157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191756157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191756157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191756157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191756157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191756157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191756169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191756178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191756178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191756178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:17:59.325223 run osmo-msc_10.42.42.6(pid=21581): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21581)] 19:17:59.376328 run osmo-msc_10.42.42.6(pid=21581): stdout: | (launched: 2022-12-13_19:17:58.171704) 19:17:59.429664 run osmo-msc_10.42.42.6(pid=21581): stderr: | 20221213191758490 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213191758490 DLGLOBAL DEBUG validating counter group 0x7f668f82dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213191758490 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213191758490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213191758491 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213191758491 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213191758493 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213191758493 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213191758493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213191758493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:17:59.483036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminating (SIGTERM) 19:17:59.525714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminating (SIGTERM) 19:17:59.568630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Terminating (SIGTERM) 19:17:59.611797 --- ParallelTerminationStrategy: PID 21574 died... 19:17:59.632638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminated: ok {rc=0} 19:17:59.680083 --- ParallelTerminationStrategy: PID 21577 died... 19:17:59.700247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminated: ok {rc=0} 19:17:59.747186 --- ParallelTerminationStrategy: PID 21580 died... 19:17:59.767350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Terminated: ok {rc=0} 19:17:59.856070 bus /sierra_9: Setting Powered False 19:18:00.956303 bus /sierra_9: Setting Powered False 19:18:02.114176 bus /sierra_8: Setting Powered False 19:18:03.227416 bus /sierra_8: Setting Powered False 19:18:04.347778 bus /sierra_3: Setting Powered False 19:18:05.449028 bus /sierra_3: Setting Powered False 19:18:06.566769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx --------------------------------------------------------------------- 19:18:07.844907 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:18:07.850292 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 19:18:07.883203 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 19:18:07.921788 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 19:18:08.006677 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 19:18:08.039037 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 19:18:08.077294 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 19:18:08.669422 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 19:18:08.719185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:08.729987 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:18:08.776340 tst cs_paging_gprs_active.py: using LAC 35707 19:18:08.899191 tst cs_paging_gprs_active.py: using RAC 7 19:18:09.019172 tst cs_paging_gprs_active.py: using CellId 35707 19:18:09.137603 tst cs_paging_gprs_active.py: using BVCI 35708 19:18:09.260281 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.271738 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.282916 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.294226 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.305648 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.317032 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.328621 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.339815 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:09.351269 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:09.468539 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:09.585572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:18:09.793268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:10.102353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21587): Launched 19:18:10.370253 run iperf3-srv_10.42.42.10(pid=21588): Launched 19:18:10.485165 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:18:10.691145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:10.999195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Launched 19:18:11.267195 run iperf3-srv_10.42.42.10(pid=21590): Launched 19:18:11.381902 tst cs_paging_gprs_active.py:38: start network... 19:18:11.589036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:12.065026 run create_hlr_db(pid=21591): Launched 19:18:12.191092 bus /sierra_2: Setting Powered False 19:18:13.252547 run create_hlr_db(pid=21591): Terminated: ok {rc=0} 19:18:13.703779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Launched 19:18:14.034723 run osmo-hlr_10.42.42.2(pid=21594): Launched 19:18:14.161403 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:14.733894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Launched 19:18:15.064528 run osmo-stp_10.42.42.5(pid=21597): Launched 19:18:15.190606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:15.759261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Launched 19:18:15.887347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:16.186740 run patchelf(pid=21600): Launched 19:18:16.384132 run osmo-stp_10.42.42.5(pid=21597): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] 19:18:16.526620 run osmo-stp_10.42.42.5(pid=21597): stdout: | (launched: 2022-12-13_19:18:15.004255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:16.671622 run osmo-stp_10.42.42.5(pid=21597): stderr: | 20221213191815194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191815194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191815194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191815194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191815195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191815195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191815195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:16.816591 run osmo-stp_10.42.42.5(pid=21597): stdout: | (launched: 2022-12-13_19:18:15.004255) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:16.955264 run osmo-stp_10.42.42.5(pid=21597): stderr: | 20221213191815194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191815194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191815194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191815194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191815195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191815195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191815195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:17.120275 run patchelf(pid=21600): Terminating (SIGINT) 19:18:17.309331 run patchelf(pid=21600): Terminated: ok {rc=0} 19:18:17.442353 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21597): Process ended prematurely: osmo-stp_10.42.42.5(pid=21597) [trial-2393↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] [trial-2393↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 19:18:17.452519 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:18:17.481628 run osmo-hlr_10.42.42.2(pid=21594): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21594)] 19:18:17.534297 run osmo-hlr_10.42.42.2(pid=21594): stdout: | (launched: 2022-12-13_19:18:13.974548) 19:18:17.587967 run osmo-hlr_10.42.42.2(pid=21594): stderr: | 20221213191814169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191814169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191814170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191814170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191814170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191814170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191814182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191814190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191814190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191814190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:17.641740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21587): Terminating (SIGTERM) 19:18:17.684655 run iperf3-srv_10.42.42.10(pid=21588): Terminating (SIGTERM) 19:18:17.727874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Terminating (SIGTERM) 19:18:17.770995 run iperf3-srv_10.42.42.10(pid=21590): Terminating (SIGTERM) 19:18:17.813906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Terminating (SIGTERM) 19:18:17.857133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Terminating (SIGTERM) 19:18:17.900435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Terminating (SIGTERM) 19:18:17.943804 --- ParallelTerminationStrategy: PID 21587 died... 19:18:17.964627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21587): Terminated: ok {rc=0} 19:18:18.011790 --- ParallelTerminationStrategy: PID 21588 died... 19:18:18.031950 run iperf3-srv_10.42.42.10(pid=21588): Terminated {rc=256} 19:18:18.078911 --- ParallelTerminationStrategy: PID 21589 died... 19:18:18.099172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21589): Terminated: ok {rc=0} 19:18:18.146489 --- ParallelTerminationStrategy: PID 21590 died... 19:18:18.166666 run iperf3-srv_10.42.42.10(pid=21590): Terminated {rc=256} 19:18:18.213997 --- ParallelTerminationStrategy: PID 21593 died... 19:18:18.234645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21593): Terminated: ok {rc=0} 19:18:18.281599 --- ParallelTerminationStrategy: PID 21596 died... 19:18:18.301962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21596): Terminated: ok {rc=0} 19:18:18.349230 --- ParallelTerminationStrategy: PID 21599 died... 19:18:18.369455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21599): Terminated: ok {rc=0} 19:18:18.459022 bus /gobi_0: Setting Powered False 19:18:19.558809 bus /gobi_0: Setting Powered False 19:18:20.676093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx iperf3.py ---------------------------------------------- 19:18:21.827541 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:21.839671 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:18:21.892882 tst iperf3.py: using LAC 35708 19:18:22.021368 tst iperf3.py: using RAC 8 19:18:22.150179 tst iperf3.py: using CellId 35708 19:18:22.283938 tst iperf3.py: using BVCI 35709 19:18:22.404481 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.415806 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.426840 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.437875 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.449091 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.460242 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.471709 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.482969 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:22.494376 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:22.611799 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:18:22.818596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:23.126310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Launched 19:18:23.393421 run iperf3-srv_10.42.42.10(pid=21602): Launched 19:18:23.508430 tst iperf3.py:8: start network... 19:18:23.714336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:24.188622 run create_hlr_db(pid=21603): Launched 19:18:24.315142 bus /gobi_6: Setting Powered False 19:18:25.375881 run create_hlr_db(pid=21603): Terminated: ok {rc=0} 19:18:25.825727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Launched 19:18:26.155664 run osmo-hlr_10.42.42.2(pid=21606): Launched 19:18:26.281729 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:26.852083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Launched 19:18:27.180237 run osmo-stp_10.42.42.5(pid=21609): Launched 19:18:27.305738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:27.871237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21611): Launched 19:18:27.997030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:28.275280 run patchelf(pid=21612): Launched 19:18:28.458323 run osmo-stp_10.42.42.5(pid=21609): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] 19:18:28.597863 run osmo-stp_10.42.42.5(pid=21609): stdout: | (launched: 2022-12-13_19:18:27.120132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:28.739374 run osmo-stp_10.42.42.5(pid=21609): stderr: | 20221213191827309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191827309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191827309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191827310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191827310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191827310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191827310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:28.880761 run osmo-stp_10.42.42.5(pid=21609): stdout: | (launched: 2022-12-13_19:18:27.120132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:29.016220 run osmo-stp_10.42.42.5(pid=21609): stderr: | 20221213191827309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191827309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191827309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191827310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191827310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191827310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191827310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:29.177022 run patchelf(pid=21612): Terminating (SIGINT) 19:18:29.361661 run patchelf(pid=21612): Terminated: ok {rc=0} 19:18:29.494317 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21609): Process ended prematurely: osmo-stp_10.42.42.5(pid=21609) [trial-2393↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] [trial-2393↪gprs:trx-umtrx↪iperf3.py:8] 19:18:29.504321 tst iperf3.py:8: Test FAILED (7.7 sec) 19:18:29.532742 run osmo-hlr_10.42.42.2(pid=21606): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21606)] 19:18:29.583871 run osmo-hlr_10.42.42.2(pid=21606): stdout: | (launched: 2022-12-13_19:18:26.095554) 19:18:29.636703 run osmo-hlr_10.42.42.2(pid=21606): stderr: | 20221213191826291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191826291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191826291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191826291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191826291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191826291 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191826303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191826314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191826315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191826315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:29.689827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Terminating (SIGTERM) 19:18:29.731708 run iperf3-srv_10.42.42.10(pid=21602): Terminating (SIGTERM) 19:18:29.774482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Terminating (SIGTERM) 19:18:29.817135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Terminating (SIGTERM) 19:18:29.859742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21611): Terminating (SIGTERM) 19:18:29.902886 --- ParallelTerminationStrategy: PID 21601 died... 19:18:29.923601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21601): Terminated: ok {rc=0} 19:18:29.970238 --- ParallelTerminationStrategy: PID 21602 died... 19:18:29.990341 run iperf3-srv_10.42.42.10(pid=21602): Terminated {rc=256} 19:18:30.036852 --- ParallelTerminationStrategy: PID 21605 died... 19:18:30.057288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21605): Terminated: ok {rc=0} 19:18:30.103903 --- ParallelTerminationStrategy: PID 21608 died... 19:18:30.124057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21608): Terminated: ok {rc=0} 19:18:30.170620 --- ParallelTerminationStrategy: PID 21611 died... 19:18:30.190765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21611): Terminated: ok {rc=0} 19:18:30.279203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 19:18:31.448294 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:31.464187 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:18:31.518124 tst iperf3m4.py: using LAC 35709 19:18:31.643631 tst iperf3m4.py: using RAC 9 19:18:31.805708 tst iperf3m4.py: using CellId 35709 19:18:31.976046 tst iperf3m4.py: using BVCI 35710 19:18:32.122624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.137691 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.150897 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.170184 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.185689 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.200789 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.216236 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.231059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:32.244899 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:32.372295 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:32.498728 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:32.619427 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:32.739275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:18:32.946647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:33.255604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21613): Launched 19:18:33.522491 run iperf3-srv_10.42.42.10(pid=21614): Launched 19:18:33.638429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:18:33.844015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:34.151706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21615): Launched 19:18:34.419165 run iperf3-srv_10.42.42.10(pid=21616): Launched 19:18:34.534510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:18:34.739931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:35.047988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21617): Launched 19:18:35.315424 run iperf3-srv_10.42.42.10(pid=21618): Launched 19:18:35.430788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:18:35.637801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:18:35.946566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Launched 19:18:36.213748 run iperf3-srv_10.42.42.10(pid=21620): Launched 19:18:36.328821 tst iperf3m4.py:8: start network... 19:18:36.534342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:37.009215 run create_hlr_db(pid=21621): Launched 19:18:37.135734 bus /gobi_6: Setting Powered False 19:18:38.196180 run create_hlr_db(pid=21621): Terminated: ok {rc=0} 19:18:38.644415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21623): Launched 19:18:38.973698 run osmo-hlr_10.42.42.2(pid=21624): Launched 19:18:39.098328 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:39.667428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21626): Launched 19:18:39.997750 run osmo-stp_10.42.42.5(pid=21627): Launched 19:18:40.122788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:40.690097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21629): Launched 19:18:40.816511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:41.094712 run patchelf(pid=21630): Launched 19:18:41.277619 run osmo-stp_10.42.42.5(pid=21627): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21627)] 19:18:41.417140 run osmo-stp_10.42.42.5(pid=21627): stdout: | (launched: 2022-12-13_19:18:39.937392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:41.558054 run osmo-stp_10.42.42.5(pid=21627): stderr: | 20221213191840126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191840126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191840126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191840127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191840127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191840127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191840127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:41.699583 run osmo-stp_10.42.42.5(pid=21627): stdout: | (launched: 2022-12-13_19:18:39.937392) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:41.834938 run osmo-stp_10.42.42.5(pid=21627): stderr: | 20221213191840126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191840126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191840126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191840127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191840127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191840127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191840127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:41.995696 run patchelf(pid=21630): Terminating (SIGINT) 19:18:42.179685 run patchelf(pid=21630): Terminated: ok {rc=0} 19:18:42.313460 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21627): Process ended prematurely: osmo-stp_10.42.42.5(pid=21627) [trial-2393↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21627)] [trial-2393↪gprs:trx-umtrx↪iperf3m4.py:8] 19:18:42.323583 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:18:42.352323 run osmo-hlr_10.42.42.2(pid=21624): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21624)] 19:18:42.403507 run osmo-hlr_10.42.42.2(pid=21624): stdout: | (launched: 2022-12-13_19:18:38.913707) 19:18:42.455771 run osmo-hlr_10.42.42.2(pid=21624): stderr: | 20221213191839109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191839109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191839109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191839109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191839109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191839109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191839122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191839131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191839131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191839131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:42.508733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21613): Terminating (SIGTERM) 19:18:42.551045 run iperf3-srv_10.42.42.10(pid=21614): Terminating (SIGTERM) 19:18:42.593848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21615): Terminating (SIGTERM) 19:18:42.636350 run iperf3-srv_10.42.42.10(pid=21616): Terminating (SIGTERM) 19:18:42.679027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21617): Terminating (SIGTERM) 19:18:42.721668 run iperf3-srv_10.42.42.10(pid=21618): Terminating (SIGTERM) 19:18:42.764154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Terminating (SIGTERM) 19:18:42.806483 run iperf3-srv_10.42.42.10(pid=21620): Terminating (SIGTERM) 19:18:42.848839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21623): Terminating (SIGTERM) 19:18:42.891221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21626): Terminating (SIGTERM) 19:18:42.933538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21629): Terminating (SIGTERM) 19:18:42.976072 --- ParallelTerminationStrategy: PID 21613 died... 19:18:42.996879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21613): Terminated: ok {rc=0} 19:18:43.044042 --- ParallelTerminationStrategy: PID 21614 died... 19:18:43.064260 run iperf3-srv_10.42.42.10(pid=21614): Terminated {rc=256} 19:18:43.110989 --- ParallelTerminationStrategy: PID 21615 died... 19:18:43.131034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21615): Terminated: ok {rc=0} 19:18:43.177982 --- ParallelTerminationStrategy: PID 21616 died... 19:18:43.198054 run iperf3-srv_10.42.42.10(pid=21616): Terminated {rc=256} 19:18:43.244838 --- ParallelTerminationStrategy: PID 21617 died... 19:18:43.265532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21617): Terminated: ok {rc=0} 19:18:43.312649 --- ParallelTerminationStrategy: PID 21618 died... 19:18:43.332912 run iperf3-srv_10.42.42.10(pid=21618): Terminated {rc=256} 19:18:43.379526 --- ParallelTerminationStrategy: PID 21619 died... 19:18:43.399421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21619): Terminated: ok {rc=0} 19:18:43.445827 --- ParallelTerminationStrategy: PID 21620 died... 19:18:43.465813 run iperf3-srv_10.42.42.10(pid=21620): Terminated {rc=256} 19:18:43.512348 --- ParallelTerminationStrategy: PID 21623 died... 19:18:43.532560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21623): Terminated: ok {rc=0} 19:18:43.579141 --- ParallelTerminationStrategy: PID 21626 died... 19:18:43.599348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21626): Terminated: ok {rc=0} 19:18:43.645791 --- ParallelTerminationStrategy: PID 21629 died... 19:18:43.665941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21629): Terminated: ok {rc=0} 19:18:43.754915 bus /gobi_4: Setting Powered False 19:18:44.854140 bus /gobi_4: Setting Powered False 19:18:45.992421 bus /gobi_1: Setting Powered False 19:18:47.091830 bus /gobi_1: Setting Powered False 19:18:48.205169 bus /gobi_0: Setting Powered False 19:18:49.303692 bus /gobi_0: Setting Powered False 19:18:50.420655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx ping.py ---------------------------------------------- 19:18:51.525225 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:51.537280 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:18:51.588018 tst ping.py: using LAC 35710 19:18:51.716230 tst ping.py: using RAC 10 19:18:51.842404 tst ping.py: using CellId 35710 19:18:51.973724 tst ping.py: using BVCI 35711 19:18:52.093306 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.104574 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.115602 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.126610 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.138324 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.150066 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.162047 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:52.173878 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:18:52.290444 tst ping.py:19: start network... 19:18:52.492406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:18:52.959606 run create_hlr_db(pid=21631): Launched 19:18:53.083123 bus /gobi_6: Setting Powered False 19:18:54.143047 run create_hlr_db(pid=21631): Terminated: ok {rc=0} 19:18:54.585090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Launched 19:18:54.908676 run osmo-hlr_10.42.42.2(pid=21634): Launched 19:18:55.031468 run osmo-stp_10.42.42.5: Starting osmo-stp 19:18:55.589077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Launched 19:18:55.912577 run osmo-stp_10.42.42.5(pid=21637): Launched 19:18:56.035657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:18:56.594805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21639): Launched 19:18:56.718540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:18:56.992459 run patchelf(pid=21640): Launched 19:18:57.172226 run osmo-stp_10.42.42.5(pid=21637): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] 19:18:57.310125 run osmo-stp_10.42.42.5(pid=21637): stdout: | (launched: 2022-12-13_19:18:55.852835) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:57.448495 run osmo-stp_10.42.42.5(pid=21637): stderr: | 20221213191856040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191856040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191856040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191856041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191856041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191856041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191856041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:57.587408 run osmo-stp_10.42.42.5(pid=21637): stdout: | (launched: 2022-12-13_19:18:55.852835) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:18:57.720465 run osmo-stp_10.42.42.5(pid=21637): stderr: | 20221213191856040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191856040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191856040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191856041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191856041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191856041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191856041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:18:57.878426 run patchelf(pid=21640): Terminating (SIGINT) 19:18:58.059421 run patchelf(pid=21640): Terminated: ok {rc=0} 19:18:58.190338 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21637): Process ended prematurely: osmo-stp_10.42.42.5(pid=21637) [trial-2393↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] [trial-2393↪gprs:trx-umtrx↪ping.py:22] 19:18:58.199750 tst ping.py:22: Test FAILED (6.7 sec) 19:18:58.227971 run osmo-hlr_10.42.42.2(pid=21634): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21634)] 19:18:58.279646 run osmo-hlr_10.42.42.2(pid=21634): stdout: | (launched: 2022-12-13_19:18:54.849645) 19:18:58.332835 run osmo-hlr_10.42.42.2(pid=21634): stderr: | 20221213191855044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191855044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191855044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191855044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191855044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191855044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191855057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191855066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191855066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191855066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:18:58.385918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Terminating (SIGTERM) 19:18:58.428436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Terminating (SIGTERM) 19:18:58.471401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21639): Terminating (SIGTERM) 19:18:58.514526 --- ParallelTerminationStrategy: PID 21633 died... 19:18:58.535275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21633): Terminated: ok {rc=0} 19:18:58.582261 --- ParallelTerminationStrategy: PID 21636 died... 19:18:58.602668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21636): Terminated: ok {rc=0} 19:18:58.649377 --- ParallelTerminationStrategy: PID 21639 died... 19:18:58.669589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21639): Terminated: ok {rc=0} 19:18:58.757572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 19:18:59.846163 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:18:59.859203 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 19:18:59.909815 tst ping_idle_ping.py: using LAC 35711 19:19:00.030395 tst ping_idle_ping.py: using RAC 11 19:19:00.151027 tst ping_idle_ping.py: using CellId 35711 19:19:00.271640 tst ping_idle_ping.py: using BVCI 35712 19:19:00.383491 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.394509 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.406042 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.416628 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.427356 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.437957 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.448740 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 19:19:00.459594 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 19:19:00.579530 tst ping_idle_ping.py:24: start network... 19:19:00.799193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:01.323741 run create_hlr_db(pid=21641): Launched 19:19:01.478139 bus /gobi_6: Setting Powered False 19:19:02.542207 run create_hlr_db(pid=21641): Terminated: ok {rc=0} 19:19:02.976504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21643): Launched 19:19:03.280381 run osmo-hlr_10.42.42.2(pid=21644): Launched 19:19:03.395403 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:03.915730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21646): Launched 19:19:04.219575 run osmo-stp_10.42.42.5(pid=21647): Launched 19:19:04.335700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:04.859406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21649): Launched 19:19:04.974736 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:05.230570 run patchelf(pid=21650): Launched 19:19:05.398123 run osmo-stp_10.42.42.5(pid=21647): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21647)] 19:19:05.526056 run osmo-stp_10.42.42.5(pid=21647): stdout: | (launched: 2022-12-13_19:19:04.163208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:05.655118 run osmo-stp_10.42.42.5(pid=21647): stderr: | 20221213191904331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191904331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191904331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191904331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191904332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191904332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191904332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:05.784348 run osmo-stp_10.42.42.5(pid=21647): stdout: | (launched: 2022-12-13_19:19:04.163208) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:05.908350 run osmo-stp_10.42.42.5(pid=21647): stderr: | 20221213191904331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191904331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191904331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191904331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191904332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191904332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191904332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:06.054949 run patchelf(pid=21650): Terminating (SIGINT) 19:19:06.223555 run patchelf(pid=21650): Terminated: ok {rc=0} 19:19:06.345145 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21647): Process ended prematurely: osmo-stp_10.42.42.5(pid=21647) [trial-2393↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21647)] [trial-2393↪gprs:trx-umtrx↪ping_idle_ping.py:27] 19:19:06.354116 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:19:06.380677 run osmo-hlr_10.42.42.2(pid=21644): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21644)] 19:19:06.428585 run osmo-hlr_10.42.42.2(pid=21644): stdout: | (launched: 2022-12-13_19:19:03.224389) 19:19:06.477942 run osmo-hlr_10.42.42.2(pid=21644): stderr: | 20221213191903396 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191903396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191903396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191903396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191903397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191903397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191903421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191903430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191903431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191903431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:06.528042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21643): Terminating (SIGTERM) 19:19:06.568125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21646): Terminating (SIGTERM) 19:19:06.608023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21649): Terminating (SIGTERM) 19:19:06.648434 --- ParallelTerminationStrategy: PID 21643 died... 19:19:06.667949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21643): Terminated: ok {rc=0} 19:19:06.712130 --- ParallelTerminationStrategy: PID 21646 died... 19:19:06.730885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21646): Terminated: ok {rc=0} 19:19:06.774920 --- ParallelTerminationStrategy: PID 21649 died... 19:19:06.793752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21649): Terminated: ok {rc=0} 19:19:06.877334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 19:19:08.183672 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:19:08.189941 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:19:08.225045 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:19:08.265983 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:19:08.357683 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:19:08.391929 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:19:08.432224 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:19:09.024798 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:19:09.078591 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.090056 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:19:09.141568 tst cs_paging_gprs_active.py: using LAC 35712 19:19:09.264293 tst cs_paging_gprs_active.py: using RAC 12 19:19:09.387269 tst cs_paging_gprs_active.py: using CellId 35712 19:19:09.510222 tst cs_paging_gprs_active.py: using BVCI 35713 19:19:09.623740 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.634926 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.645772 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.656602 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.667530 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.678333 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.689369 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.700135 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:09.711253 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:09.832475 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:09.951698 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:19:10.160234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:10.471213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21654): Launched 19:19:10.739466 run iperf3-srv_10.42.42.10(pid=21655): Launched 19:19:10.854394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:19:11.059852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:11.368530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Launched 19:19:11.636454 run iperf3-srv_10.42.42.10(pid=21657): Launched 19:19:11.751772 tst cs_paging_gprs_active.py:38: start network... 19:19:11.959133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:12.435576 run create_hlr_db(pid=21658): Launched 19:19:12.561138 bus /gobi_6: Setting Powered False 19:19:13.622476 run create_hlr_db(pid=21658): Terminated: ok {rc=0} 19:19:14.049701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Launched 19:19:14.356441 run osmo-hlr_10.42.42.2(pid=21661): Launched 19:19:14.473184 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:15.014620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Launched 19:19:15.321078 run osmo-stp_10.42.42.5(pid=21664): Launched 19:19:15.437576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:15.981662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Launched 19:19:16.100501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:16.366514 run patchelf(pid=21667): Launched 19:19:16.555113 run osmo-stp_10.42.42.5(pid=21664): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] 19:19:16.710905 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-13_19:19:15.264310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:16.904741 run osmo-stp_10.42.42.5(pid=21664): stderr: | 20221213191915430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191915430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191915430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191915431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191915431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191915431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191915431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:17.097438 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-13_19:19:15.264310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:17.228794 run osmo-stp_10.42.42.5(pid=21664): stderr: | 20221213191915430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191915430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191915430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191915431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191915431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191915431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191915431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:17.383077 run patchelf(pid=21667): Terminating (SIGINT) 19:19:17.556160 run patchelf(pid=21667): Terminated: ok {rc=0} 19:19:17.680505 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:19:17.690081 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:19:17.717447 run osmo-hlr_10.42.42.2(pid=21661): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21661)] 19:19:17.765461 run osmo-hlr_10.42.42.2(pid=21661): stdout: | (launched: 2022-12-13_19:19:14.300135) 19:19:17.814950 run osmo-hlr_10.42.42.2(pid=21661): stderr: | 20221213191914473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191914473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191914473 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191914473 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191914473 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191914473 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191914485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191914493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191914494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191914494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:17.864900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21654): Terminating (SIGTERM) 19:19:17.904785 run iperf3-srv_10.42.42.10(pid=21655): Terminating (SIGTERM) 19:19:17.944587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Terminating (SIGTERM) 19:19:17.984997 run iperf3-srv_10.42.42.10(pid=21657): Terminating (SIGTERM) 19:19:18.024732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminating (SIGTERM) 19:19:18.064491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminating (SIGTERM) 19:19:18.104108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Terminating (SIGTERM) 19:19:18.144007 --- ParallelTerminationStrategy: PID 21654 died... 19:19:18.163441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21654): Terminated: ok {rc=0} 19:19:18.207568 --- ParallelTerminationStrategy: PID 21655 died... 19:19:18.226099 run iperf3-srv_10.42.42.10(pid=21655): Terminated {rc=256} 19:19:18.270125 --- ParallelTerminationStrategy: PID 21656 died... 19:19:18.288712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21656): Terminated: ok {rc=0} 19:19:18.332906 --- ParallelTerminationStrategy: PID 21657 died... 19:19:18.351982 run iperf3-srv_10.42.42.10(pid=21657): Terminated {rc=256} 19:19:18.395949 --- ParallelTerminationStrategy: PID 21660 died... 19:19:18.414793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminated: ok {rc=0} 19:19:18.458863 --- ParallelTerminationStrategy: PID 21663 died... 19:19:18.477558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminated: ok {rc=0} 19:19:18.521520 --- ParallelTerminationStrategy: PID 21666 died... 19:19:18.540172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21666): Terminated: ok {rc=0} 19:19:18.625640 bus /gobi_0: Setting Powered False 19:19:19.724531 bus /gobi_0: Setting Powered False 19:19:20.838583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:19:21.985508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:21.997502 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:19:22.050326 tst iperf3.py: using LAC 35713 19:19:22.173223 tst iperf3.py: using RAC 13 19:19:22.295679 tst iperf3.py: using CellId 35713 19:19:22.418252 tst iperf3.py: using BVCI 35714 19:19:22.531264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.542384 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.553144 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.563902 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.574787 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.585659 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.596719 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.607641 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:22.618725 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:22.739733 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:19:22.963623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:23.296539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21668): Launched 19:19:23.584087 run iperf3-srv_10.42.42.10(pid=21669): Launched 19:19:23.708350 tst iperf3.py:8: start network... 19:19:23.931495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:24.443072 run create_hlr_db(pid=21670): Launched 19:19:24.569804 bus /gobi_6: Setting Powered False 19:19:25.634550 run create_hlr_db(pid=21670): Terminated: ok {rc=0} 19:19:26.073589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21672): Launched 19:19:26.381517 run osmo-hlr_10.42.42.2(pid=21673): Launched 19:19:26.498631 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:27.032594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21675): Launched 19:19:27.339313 run osmo-stp_10.42.42.5(pid=21676): Launched 19:19:27.456079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:27.985387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21678): Launched 19:19:28.103292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:28.362593 run patchelf(pid=21679): Launched 19:19:28.532340 run osmo-stp_10.42.42.5(pid=21676): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21676)] 19:19:28.661434 run osmo-stp_10.42.42.5(pid=21676): stdout: | (launched: 2022-12-13_19:19:27.282864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:28.792015 run osmo-stp_10.42.42.5(pid=21676): stderr: | 20221213191927449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191927449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191927450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191927450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191927451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191927451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191927451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:28.922865 run osmo-stp_10.42.42.5(pid=21676): stdout: | (launched: 2022-12-13_19:19:27.282864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:29.047783 run osmo-stp_10.42.42.5(pid=21676): stderr: | 20221213191927449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191927449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191927450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191927450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191927451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191927451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191927451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:29.195874 run patchelf(pid=21679): Terminating (SIGINT) 19:19:29.367200 run patchelf(pid=21679): Terminated: ok {rc=0} 19:19:29.490478 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21676): Process ended prematurely: osmo-stp_10.42.42.5(pid=21676) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21676)] [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 19:19:29.499853 tst iperf3.py:8: Test FAILED (7.6 sec) 19:19:29.527087 run osmo-hlr_10.42.42.2(pid=21673): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21673)] 19:19:29.574926 run osmo-hlr_10.42.42.2(pid=21673): stdout: | (launched: 2022-12-13_19:19:26.325101) 19:19:29.624439 run osmo-hlr_10.42.42.2(pid=21673): stderr: | 20221213191926498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191926498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191926498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191926498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191926499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191926499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191926511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191926519 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191926519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191926519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:29.674313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21668): Terminating (SIGTERM) 19:19:29.714430 run iperf3-srv_10.42.42.10(pid=21669): Terminating (SIGTERM) 19:19:29.754339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21672): Terminating (SIGTERM) 19:19:29.794329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21675): Terminating (SIGTERM) 19:19:29.834209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21678): Terminating (SIGTERM) 19:19:29.874429 --- ParallelTerminationStrategy: PID 21668 died... 19:19:29.893871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21668): Terminated: ok {rc=0} 19:19:29.938035 --- ParallelTerminationStrategy: PID 21669 died... 19:19:29.956691 run iperf3-srv_10.42.42.10(pid=21669): Terminated {rc=256} 19:19:30.000817 --- ParallelTerminationStrategy: PID 21672 died... 19:19:30.020111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21672): Terminated: ok {rc=0} 19:19:30.064472 --- ParallelTerminationStrategy: PID 21675 died... 19:19:30.083496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21675): Terminated: ok {rc=0} 19:19:30.127773 --- ParallelTerminationStrategy: PID 21678 died... 19:19:30.146749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21678): Terminated: ok {rc=0} 19:19:30.233036 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:19:31.415170 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:31.432660 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:19:31.496222 tst iperf3m4.py: using LAC 35714 19:19:31.633565 tst iperf3m4.py: using RAC 14 19:19:31.768651 tst iperf3m4.py: using CellId 35714 19:19:31.904350 tst iperf3m4.py: using BVCI 35715 19:19:32.023773 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.036566 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.047692 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.059702 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.070701 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.082127 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.093432 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.104383 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:32.116541 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:32.233956 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:32.351495 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:32.472143 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:32.590277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:19:32.796692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:33.106222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21680): Launched 19:19:33.374798 run iperf3-srv_10.42.42.10(pid=21681): Launched 19:19:33.490164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:19:33.695274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:34.003951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21682): Launched 19:19:34.273235 run iperf3-srv_10.42.42.10(pid=21683): Launched 19:19:34.388859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:19:34.594399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:34.903129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21684): Launched 19:19:35.172866 run iperf3-srv_10.42.42.10(pid=21685): Launched 19:19:35.288649 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:19:35.494681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:19:35.803699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Launched 19:19:36.071998 run iperf3-srv_10.42.42.10(pid=21687): Launched 19:19:36.187981 tst iperf3m4.py:8: start network... 19:19:36.394185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:36.871464 run create_hlr_db(pid=21688): Launched 19:19:36.996555 bus /gobi_6: Setting Powered False 19:19:38.057296 run create_hlr_db(pid=21688): Terminated: ok {rc=0} 19:19:38.487401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21690): Launched 19:19:38.795076 run osmo-hlr_10.42.42.2(pid=21691): Launched 19:19:38.911733 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:39.441996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21693): Launched 19:19:39.750086 run osmo-stp_10.42.42.5(pid=21694): Launched 19:19:39.867499 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:40.399425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21696): Launched 19:19:40.516896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:40.776729 run patchelf(pid=21697): Launched 19:19:40.947593 run osmo-stp_10.42.42.5(pid=21694): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21694)] 19:19:41.077799 run osmo-stp_10.42.42.5(pid=21694): stdout: | (launched: 2022-12-13_19:19:39.692790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:41.209650 run osmo-stp_10.42.42.5(pid=21694): stderr: | 20221213191939861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191939862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191939862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191939862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191939863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191939863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191939863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:41.341048 run osmo-stp_10.42.42.5(pid=21694): stdout: | (launched: 2022-12-13_19:19:39.692790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:41.467420 run osmo-stp_10.42.42.5(pid=21694): stderr: | 20221213191939861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191939862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191939862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191939862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191939863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191939863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191939863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:41.616514 run patchelf(pid=21697): Terminating (SIGINT) 19:19:41.788717 run patchelf(pid=21697): Terminated: ok {rc=0} 19:19:41.912769 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21694): Process ended prematurely: osmo-stp_10.42.42.5(pid=21694) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21694)] [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 19:19:41.922313 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:19:41.949905 run osmo-hlr_10.42.42.2(pid=21691): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21691)] 19:19:41.998127 run osmo-hlr_10.42.42.2(pid=21691): stdout: | (launched: 2022-12-13_19:19:38.738031) 19:19:42.047920 run osmo-hlr_10.42.42.2(pid=21691): stderr: | 20221213191938912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191938912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191938912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191938912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191938912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191938912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191938923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191938932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191938932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191938932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:42.098475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21680): Terminating (SIGTERM) 19:19:42.138714 run iperf3-srv_10.42.42.10(pid=21681): Terminating (SIGTERM) 19:19:42.179365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21682): Terminating (SIGTERM) 19:19:42.219621 run iperf3-srv_10.42.42.10(pid=21683): Terminating (SIGTERM) 19:19:42.259569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21684): Terminating (SIGTERM) 19:19:42.299583 run iperf3-srv_10.42.42.10(pid=21685): Terminating (SIGTERM) 19:19:42.339203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Terminating (SIGTERM) 19:19:42.379097 run iperf3-srv_10.42.42.10(pid=21687): Terminating (SIGTERM) 19:19:42.418984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21690): Terminating (SIGTERM) 19:19:42.459082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21693): Terminating (SIGTERM) 19:19:42.499056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21696): Terminating (SIGTERM) 19:19:42.539417 --- ParallelTerminationStrategy: PID 21680 died... 19:19:42.558943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21680): Terminated: ok {rc=0} 19:19:42.603539 --- ParallelTerminationStrategy: PID 21681 died... 19:19:42.622392 run iperf3-srv_10.42.42.10(pid=21681): Terminated {rc=256} 19:19:42.666619 --- ParallelTerminationStrategy: PID 21682 died... 19:19:42.685566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21682): Terminated: ok {rc=0} 19:19:42.729711 --- ParallelTerminationStrategy: PID 21683 died... 19:19:42.748520 run iperf3-srv_10.42.42.10(pid=21683): Terminated {rc=256} 19:19:42.792446 --- ParallelTerminationStrategy: PID 21684 died... 19:19:42.811292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21684): Terminated: ok {rc=0} 19:19:42.855565 --- ParallelTerminationStrategy: PID 21685 died... 19:19:42.874653 run iperf3-srv_10.42.42.10(pid=21685): Terminated {rc=256} 19:19:42.918656 --- ParallelTerminationStrategy: PID 21686 died... 19:19:42.937583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21686): Terminated: ok {rc=0} 19:19:42.981797 --- ParallelTerminationStrategy: PID 21687 died... 19:19:43.000740 run iperf3-srv_10.42.42.10(pid=21687): Terminated {rc=256} 19:19:43.045047 --- ParallelTerminationStrategy: PID 21690 died... 19:19:43.064091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21690): Terminated: ok {rc=0} 19:19:43.108599 --- ParallelTerminationStrategy: PID 21693 died... 19:19:43.127698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21693): Terminated: ok {rc=0} 19:19:43.171930 --- ParallelTerminationStrategy: PID 21696 died... 19:19:43.190996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21696): Terminated: ok {rc=0} 19:19:43.275627 bus /gobi_4: Setting Powered False 19:19:44.374684 bus /gobi_4: Setting Powered False 19:19:45.493084 bus /gobi_1: Setting Powered False 19:19:46.593893 bus /gobi_1: Setting Powered False 19:19:47.713294 bus /gobi_0: Setting Powered False 19:19:48.812610 bus /gobi_0: Setting Powered False 19:19:49.930130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 19:19:51.030803 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.042514 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:19:51.092676 tst ping.py: using LAC 35715 19:19:51.221213 tst ping.py: using RAC 15 19:19:51.350115 tst ping.py: using CellId 35715 19:19:51.478785 tst ping.py: using BVCI 35716 19:19:51.599411 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.611080 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.622617 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.634089 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.645627 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.657144 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.668897 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:51.680535 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:19:51.796638 tst ping.py:19: start network... 19:19:51.998549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:19:52.467918 run create_hlr_db(pid=21699): Launched 19:19:52.592689 bus /gobi_6: Setting Powered False 19:19:53.653465 run create_hlr_db(pid=21699): Terminated: ok {rc=0} 19:19:54.097674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21701): Launched 19:19:54.422742 run osmo-hlr_10.42.42.2(pid=21702): Launched 19:19:54.546839 run osmo-stp_10.42.42.5: Starting osmo-stp 19:19:55.106263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21704): Launched 19:19:55.430099 run osmo-stp_10.42.42.5(pid=21705): Launched 19:19:55.553141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:19:56.110258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21707): Launched 19:19:56.234262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:19:56.509575 run patchelf(pid=21708): Launched 19:19:56.689661 run osmo-stp_10.42.42.5(pid=21705): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21705)] 19:19:56.827023 run osmo-stp_10.42.42.5(pid=21705): stdout: | (launched: 2022-12-13_19:19:55.370699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:56.965641 run osmo-stp_10.42.42.5(pid=21705): stderr: | 20221213191955559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191955559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191955560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191955560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191955561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191955561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191955561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:57.104278 run osmo-stp_10.42.42.5(pid=21705): stdout: | (launched: 2022-12-13_19:19:55.370699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:19:57.237238 run osmo-stp_10.42.42.5(pid=21705): stderr: | 20221213191955559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213191955559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213191955560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213191955560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213191955561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213191955561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213191955561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:19:57.395638 run patchelf(pid=21708): Terminating (SIGINT) 19:19:57.576357 run patchelf(pid=21708): Terminated: ok {rc=0} 19:19:57.706718 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21705): Process ended prematurely: osmo-stp_10.42.42.5(pid=21705) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21705)] [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 19:19:57.716242 tst ping.py:22: Test FAILED (6.7 sec) 19:19:57.744465 run osmo-hlr_10.42.42.2(pid=21702): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21702)] 19:19:57.795761 run osmo-hlr_10.42.42.2(pid=21702): stdout: | (launched: 2022-12-13_19:19:54.363388) 19:19:57.848601 run osmo-hlr_10.42.42.2(pid=21702): stderr: | 20221213191954558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213191954558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213191954558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213191954558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213191954558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213191954558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213191954599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213191954609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213191954609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213191954609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:19:57.901868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21701): Terminating (SIGTERM) 19:19:57.944137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21704): Terminating (SIGTERM) 19:19:57.986865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21707): Terminating (SIGTERM) 19:19:58.030022 --- ParallelTerminationStrategy: PID 21701 died... 19:19:58.050919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21701): Terminated: ok {rc=0} 19:19:58.097988 --- ParallelTerminationStrategy: PID 21704 died... 19:19:58.118064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21704): Terminated: ok {rc=0} 19:19:58.164232 --- ParallelTerminationStrategy: PID 21707 died... 19:19:58.184396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21707): Terminated: ok {rc=0} 19:19:58.273378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:19:59.361052 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.373315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:19:59.427582 tst ping_idle_ping.py: using LAC 35716 19:19:59.555528 tst ping_idle_ping.py: using RAC 16 19:19:59.679526 tst ping_idle_ping.py: using CellId 35716 19:19:59.797541 tst ping_idle_ping.py: using BVCI 35717 19:19:59.909189 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.920392 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.931787 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.942714 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.953563 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.964588 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.975883 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:19:59.987046 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:20:00.105102 tst ping_idle_ping.py:24: start network... 19:20:00.325443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:00.835759 run create_hlr_db(pid=21709): Launched 19:20:01.006977 bus /gobi_6: Setting Powered False 19:20:02.067646 run create_hlr_db(pid=21709): Terminated: ok {rc=0} 19:20:02.526449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21714): Launched 19:20:02.853812 run osmo-hlr_10.42.42.2(pid=21715): Launched 19:20:02.977760 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:03.543973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21717): Launched 19:20:03.869611 run osmo-stp_10.42.42.5(pid=21718): Launched 19:20:03.993422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:04.556351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21720): Launched 19:20:04.681298 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:04.957137 run patchelf(pid=21721): Launched 19:20:05.138576 run osmo-stp_10.42.42.5(pid=21718): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21718)] 19:20:05.277184 run osmo-stp_10.42.42.5(pid=21718): stdout: | (launched: 2022-12-13_19:20:03.810043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:05.417264 run osmo-stp_10.42.42.5(pid=21718): stderr: | 20221213192003998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192003999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192003999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192003999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192004000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192004000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192004000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:05.556690 run osmo-stp_10.42.42.5(pid=21718): stdout: | (launched: 2022-12-13_19:20:03.810043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:05.691116 run osmo-stp_10.42.42.5(pid=21718): stderr: | 20221213192003998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192003999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192003999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192003999 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192004000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192004000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192004000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:05.850193 run patchelf(pid=21721): Terminating (SIGINT) 19:20:06.032653 run patchelf(pid=21721): Terminated: ok {rc=0} 19:20:06.164231 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21718): Process ended prematurely: osmo-stp_10.42.42.5(pid=21718) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21718)] [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 19:20:06.173903 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:20:06.202125 run osmo-hlr_10.42.42.2(pid=21715): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21715)] 19:20:06.253454 run osmo-hlr_10.42.42.2(pid=21715): stdout: | (launched: 2022-12-13_19:20:02.794134) 19:20:06.306669 run osmo-hlr_10.42.42.2(pid=21715): stderr: | 20221213192002989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192002989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192002989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192002989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192002989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192002989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192003003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192003013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192003013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192003013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:06.360309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21714): Terminating (SIGTERM) 19:20:06.402552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21717): Terminating (SIGTERM) 19:20:06.445466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21720): Terminating (SIGTERM) 19:20:06.488109 --- ParallelTerminationStrategy: PID 21714 died... 19:20:06.508464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21714): Terminated: ok {rc=0} 19:20:06.555429 --- ParallelTerminationStrategy: PID 21717 died... 19:20:06.575266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21717): Terminated: ok {rc=0} 19:20:06.622129 --- ParallelTerminationStrategy: PID 21720 died... 19:20:06.642228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21720): Terminated: ok {rc=0} 19:20:06.730334 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:20:08.030176 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:20:08.038267 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:20:08.072500 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:20:08.112686 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:20:08.202734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:20:08.236319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:20:08.276416 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:20:08.872130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:20:08.925960 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:08.937603 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:20:09.009053 tst cs_paging_gprs_active.py: using LAC 35717 19:20:09.140539 tst cs_paging_gprs_active.py: using RAC 17 19:20:09.262904 tst cs_paging_gprs_active.py: using CellId 35717 19:20:09.390370 tst cs_paging_gprs_active.py: using BVCI 35718 19:20:09.509006 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.520667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.532251 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.543783 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.556055 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.568540 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.581129 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.593457 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:09.605708 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:09.726223 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:09.848514 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:20:10.074187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:10.407521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Launched 19:20:10.695680 run iperf3-srv_10.42.42.10(pid=21726): Launched 19:20:10.819769 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:20:11.044668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:11.378053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21727): Launched 19:20:11.664553 run iperf3-srv_10.42.42.10(pid=21728): Launched 19:20:11.787851 tst cs_paging_gprs_active.py:38: start network... 19:20:12.011127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:12.523962 run create_hlr_db(pid=21729): Launched 19:20:12.650689 bus /gobi_6: Setting Powered False 19:20:13.715358 run create_hlr_db(pid=21729): Terminated: ok {rc=0} 19:20:14.155509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21731): Launched 19:20:14.464322 run osmo-hlr_10.42.42.2(pid=21732): Launched 19:20:14.581868 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:15.109752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21734): Launched 19:20:15.416679 run osmo-stp_10.42.42.5(pid=21735): Launched 19:20:15.534178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:16.085371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21737): Launched 19:20:16.216772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:16.491778 run patchelf(pid=21738): Launched 19:20:16.682638 run osmo-stp_10.42.42.5(pid=21735): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21735)] 19:20:16.816109 run osmo-stp_10.42.42.5(pid=21735): stdout: | (launched: 2022-12-13_19:20:15.359987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:16.951312 run osmo-stp_10.42.42.5(pid=21735): stderr: | 20221213192015529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192015529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192015529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192015530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192015530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192015530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192015530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:17.086285 run osmo-stp_10.42.42.5(pid=21735): stdout: | (launched: 2022-12-13_19:20:15.359987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:17.215666 run osmo-stp_10.42.42.5(pid=21735): stderr: | 20221213192015529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192015529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192015529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192015530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192015530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192015530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192015530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:17.365464 run patchelf(pid=21738): Terminating (SIGINT) 19:20:17.539028 run patchelf(pid=21738): Terminated: ok {rc=0} 19:20:17.664800 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21735): Process ended prematurely: osmo-stp_10.42.42.5(pid=21735) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21735)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:20:17.674775 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:20:17.702570 run osmo-hlr_10.42.42.2(pid=21732): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21732)] 19:20:17.751500 run osmo-hlr_10.42.42.2(pid=21732): stdout: | (launched: 2022-12-13_19:20:14.407195) 19:20:17.801849 run osmo-hlr_10.42.42.2(pid=21732): stderr: | 20221213192014580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192014580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192014580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192014580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192014580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192014580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192014597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192014607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192014608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192014608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:17.852461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Terminating (SIGTERM) 19:20:17.893128 run iperf3-srv_10.42.42.10(pid=21726): Terminating (SIGTERM) 19:20:17.933580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21727): Terminating (SIGTERM) 19:20:17.974030 run iperf3-srv_10.42.42.10(pid=21728): Terminating (SIGTERM) 19:20:18.014305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21731): Terminating (SIGTERM) 19:20:18.054743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21734): Terminating (SIGTERM) 19:20:18.095323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21737): Terminating (SIGTERM) 19:20:18.136019 --- ParallelTerminationStrategy: PID 21725 died... 19:20:18.155513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Terminated: ok {rc=0} 19:20:18.200582 --- ParallelTerminationStrategy: PID 21726 died... 19:20:18.219808 run iperf3-srv_10.42.42.10(pid=21726): Terminated {rc=256} 19:20:18.264451 --- ParallelTerminationStrategy: PID 21727 died... 19:20:18.283723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21727): Terminated: ok {rc=0} 19:20:18.328585 --- ParallelTerminationStrategy: PID 21728 died... 19:20:18.347842 run iperf3-srv_10.42.42.10(pid=21728): Terminated {rc=256} 19:20:18.392295 --- ParallelTerminationStrategy: PID 21731 died... 19:20:18.411597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21731): Terminated: ok {rc=0} 19:20:18.456692 --- ParallelTerminationStrategy: PID 21734 died... 19:20:18.475989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21734): Terminated: ok {rc=0} 19:20:18.520678 --- ParallelTerminationStrategy: PID 21737 died... 19:20:18.539906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21737): Terminated: ok {rc=0} 19:20:18.624159 bus /gobi_0: Setting Powered False 19:20:19.723284 bus /gobi_0: Setting Powered False 19:20:20.842642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:20:21.990962 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.002801 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:20:22.072915 tst iperf3.py: using LAC 35718 19:20:22.193028 tst iperf3.py: using RAC 18 19:20:22.312936 tst iperf3.py: using CellId 35718 19:20:22.445453 tst iperf3.py: using BVCI 35719 19:20:22.558787 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.570026 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.581120 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.592051 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.603109 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.614376 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.625617 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.636405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:22.647528 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:22.763003 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:20:22.969517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:23.277837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21739): Launched 19:20:23.545963 run iperf3-srv_10.42.42.10(pid=21740): Launched 19:20:23.661370 tst iperf3.py:8: start network... 19:20:23.867108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:24.343193 run create_hlr_db(pid=21741): Launched 19:20:24.468241 bus /gobi_6: Setting Powered False 19:20:25.528315 run create_hlr_db(pid=21741): Terminated: ok {rc=0} 19:20:25.976882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Launched 19:20:26.307564 run osmo-hlr_10.42.42.2(pid=21744): Launched 19:20:26.434585 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:27.095749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Launched 19:20:27.419360 run osmo-stp_10.42.42.5(pid=21747): Launched 19:20:27.543288 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:28.101079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21749): Launched 19:20:28.223635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:28.497302 run patchelf(pid=21750): Launched 19:20:28.676770 run osmo-stp_10.42.42.5(pid=21747): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] 19:20:28.813792 run osmo-stp_10.42.42.5(pid=21747): stdout: | (launched: 2022-12-13_19:20:27.360380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:28.951961 run osmo-stp_10.42.42.5(pid=21747): stderr: | 20221213192027551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192027551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192027551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192027552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192027552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192027552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192027552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:29.090567 run osmo-stp_10.42.42.5(pid=21747): stdout: | (launched: 2022-12-13_19:20:27.360380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:29.223385 run osmo-stp_10.42.42.5(pid=21747): stderr: | 20221213192027551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192027551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192027551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192027552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192027552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192027552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192027552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:29.381527 run patchelf(pid=21750): Terminating (SIGINT) 19:20:29.561727 run patchelf(pid=21750): Terminated: ok {rc=0} 19:20:29.692167 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21747): Process ended prematurely: osmo-stp_10.42.42.5(pid=21747) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 19:20:29.702376 tst iperf3.py:8: Test FAILED (7.7 sec) 19:20:29.730985 run osmo-hlr_10.42.42.2(pid=21744): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21744)] 19:20:29.781996 run osmo-hlr_10.42.42.2(pid=21744): stdout: | (launched: 2022-12-13_19:20:26.247028) 19:20:29.834158 run osmo-hlr_10.42.42.2(pid=21744): stderr: | 20221213192026441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192026441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192026441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192026441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192026441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192026441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192026452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192026463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192026463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192026463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:29.887123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21739): Terminating (SIGTERM) 19:20:29.929406 run iperf3-srv_10.42.42.10(pid=21740): Terminating (SIGTERM) 19:20:29.971941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Terminating (SIGTERM) 19:20:30.014354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Terminating (SIGTERM) 19:20:30.056803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21749): Terminating (SIGTERM) 19:20:30.099065 --- ParallelTerminationStrategy: PID 21739 died... 19:20:30.119627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21739): Terminated: ok {rc=0} 19:20:30.166667 --- ParallelTerminationStrategy: PID 21740 died... 19:20:30.186801 run iperf3-srv_10.42.42.10(pid=21740): Terminated {rc=256} 19:20:30.233390 --- ParallelTerminationStrategy: PID 21743 died... 19:20:30.253693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21743): Terminated: ok {rc=0} 19:20:30.300775 --- ParallelTerminationStrategy: PID 21746 died... 19:20:30.321478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21746): Terminated: ok {rc=0} 19:20:30.368429 --- ParallelTerminationStrategy: PID 21749 died... 19:20:30.388346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21749): Terminated: ok {rc=0} 19:20:30.475999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:20:31.635054 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:31.648206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:20:31.722722 tst iperf3m4.py: using LAC 35719 19:20:31.874748 tst iperf3m4.py: using RAC 19 19:20:32.003739 tst iperf3m4.py: using CellId 35719 19:20:32.165404 tst iperf3m4.py: using BVCI 35720 19:20:32.291645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.303639 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.315100 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.326620 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.338406 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.350242 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.361923 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.373337 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:32.385255 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:32.501629 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:32.623794 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:32.740102 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:32.861284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:20:33.078767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:33.403346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21751): Launched 19:20:33.684312 run iperf3-srv_10.42.42.10(pid=21752): Launched 19:20:33.805161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:20:34.022182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:34.346821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21753): Launched 19:20:34.627830 run iperf3-srv_10.42.42.10(pid=21754): Launched 19:20:34.748806 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:20:34.966051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:35.289346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Launched 19:20:35.570251 run iperf3-srv_10.42.42.10(pid=21756): Launched 19:20:35.690855 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:20:35.907888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:20:36.231119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Launched 19:20:36.511849 run iperf3-srv_10.42.42.10(pid=21758): Launched 19:20:36.633286 tst iperf3m4.py:8: start network... 19:20:36.850639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:37.353643 run create_hlr_db(pid=21759): Launched 19:20:37.477190 bus /gobi_6: Setting Powered False 19:20:38.540779 run create_hlr_db(pid=21759): Terminated: ok {rc=0} 19:20:38.992184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Launched 19:20:39.315787 run osmo-hlr_10.42.42.2(pid=21762): Launched 19:20:39.439971 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:39.996482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Launched 19:20:40.318782 run osmo-stp_10.42.42.5(pid=21765): Launched 19:20:40.441871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:40.997026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Launched 19:20:41.120254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:41.394210 run patchelf(pid=21768): Launched 19:20:41.573289 run osmo-stp_10.42.42.5(pid=21765): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] 19:20:41.710103 run osmo-stp_10.42.42.5(pid=21765): stdout: | (launched: 2022-12-13_19:20:40.259440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:41.848405 run osmo-stp_10.42.42.5(pid=21765): stderr: | 20221213192040446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192040447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192040447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192040447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192040448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192040448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192040448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:41.987369 run osmo-stp_10.42.42.5(pid=21765): stdout: | (launched: 2022-12-13_19:20:40.259440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:42.119911 run osmo-stp_10.42.42.5(pid=21765): stderr: | 20221213192040446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192040447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192040447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192040447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192040448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192040448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192040448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:42.276820 run patchelf(pid=21768): Terminating (SIGINT) 19:20:42.458082 run patchelf(pid=21768): Terminated: ok {rc=0} 19:20:42.588930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21765): Process ended prematurely: osmo-stp_10.42.42.5(pid=21765) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:20:42.599217 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:20:42.628025 run osmo-hlr_10.42.42.2(pid=21762): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21762)] 19:20:42.679558 run osmo-hlr_10.42.42.2(pid=21762): stdout: | (launched: 2022-12-13_19:20:39.256255) 19:20:42.732484 run osmo-hlr_10.42.42.2(pid=21762): stderr: | 20221213192039449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192039449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192039449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192039449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192039450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192039450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192039462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192039472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192039472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192039472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:42.785762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21751): Terminating (SIGTERM) 19:20:42.828378 run iperf3-srv_10.42.42.10(pid=21752): Terminating (SIGTERM) 19:20:42.870887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21753): Terminating (SIGTERM) 19:20:42.913741 run iperf3-srv_10.42.42.10(pid=21754): Terminating (SIGTERM) 19:20:42.956091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Terminating (SIGTERM) 19:20:42.998234 run iperf3-srv_10.42.42.10(pid=21756): Terminating (SIGTERM) 19:20:43.040582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Terminating (SIGTERM) 19:20:43.082892 run iperf3-srv_10.42.42.10(pid=21758): Terminating (SIGTERM) 19:20:43.125212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Terminating (SIGTERM) 19:20:43.167526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Terminating (SIGTERM) 19:20:43.209667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Terminating (SIGTERM) 19:20:43.252115 --- ParallelTerminationStrategy: PID 21751 died... 19:20:43.272635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21751): Terminated: ok {rc=0} 19:20:43.320410 --- ParallelTerminationStrategy: PID 21752 died... 19:20:43.340347 run iperf3-srv_10.42.42.10(pid=21752): Terminated {rc=256} 19:20:43.386781 --- ParallelTerminationStrategy: PID 21753 died... 19:20:43.406599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21753): Terminated: ok {rc=0} 19:20:43.453108 --- ParallelTerminationStrategy: PID 21754 died... 19:20:43.473094 run iperf3-srv_10.42.42.10(pid=21754): Terminated {rc=256} 19:20:43.519306 --- ParallelTerminationStrategy: PID 21755 died... 19:20:43.539292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21755): Terminated: ok {rc=0} 19:20:43.585725 --- ParallelTerminationStrategy: PID 21756 died... 19:20:43.605665 run iperf3-srv_10.42.42.10(pid=21756): Terminated {rc=256} 19:20:43.652017 --- ParallelTerminationStrategy: PID 21757 died... 19:20:43.672009 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21757): Terminated: ok {rc=0} 19:20:43.718499 --- ParallelTerminationStrategy: PID 21758 died... 19:20:43.738485 run iperf3-srv_10.42.42.10(pid=21758): Terminated {rc=256} 19:20:43.784634 --- ParallelTerminationStrategy: PID 21761 died... 19:20:43.804539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21761): Terminated: ok {rc=0} 19:20:43.850724 --- ParallelTerminationStrategy: PID 21764 died... 19:20:43.870664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21764): Terminated: ok {rc=0} 19:20:43.916941 --- ParallelTerminationStrategy: PID 21767 died... 19:20:43.937105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21767): Terminated: ok {rc=0} 19:20:44.025968 bus /gobi_4: Setting Powered False 19:20:45.125725 bus /gobi_4: Setting Powered False 19:20:46.242456 bus /gobi_1: Setting Powered False 19:20:47.337809 bus /gobi_1: Setting Powered False 19:20:48.453222 bus /gobi_0: Setting Powered False 19:20:49.551769 bus /gobi_0: Setting Powered False 19:20:50.666609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:20:51.770202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:51.781727 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:20:51.854293 tst ping.py: using LAC 35720 19:20:51.972435 tst ping.py: using RAC 20 19:20:52.086977 tst ping.py: using CellId 35720 19:20:52.201325 tst ping.py: using BVCI 35721 19:20:52.319161 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.330900 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.342408 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.354191 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.366320 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.378629 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.391004 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:52.403139 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:20:52.521364 tst ping.py:19: start network... 19:20:52.720287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:20:53.183826 run create_hlr_db(pid=21775): Launched 19:20:53.305501 bus /gobi_6: Setting Powered False 19:20:54.365338 run create_hlr_db(pid=21775): Terminated: ok {rc=0} 19:20:54.800411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Launched 19:20:55.117949 run osmo-hlr_10.42.42.2(pid=21778): Launched 19:20:55.238701 run osmo-stp_10.42.42.5: Starting osmo-stp 19:20:55.788606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Launched 19:20:56.107672 run osmo-stp_10.42.42.5(pid=21781): Launched 19:20:56.228590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:20:56.779574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Launched 19:20:56.897908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:20:57.149633 run patchelf(pid=21784): Launched 19:20:57.313743 run osmo-stp_10.42.42.5(pid=21781): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] 19:20:57.439385 run osmo-stp_10.42.42.5(pid=21781): stdout: | (launched: 2022-12-13_19:20:56.049232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:57.566478 run osmo-stp_10.42.42.5(pid=21781): stderr: | 20221213192056237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192056237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192056238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192056238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192056238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192056239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192056239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:57.693624 run osmo-stp_10.42.42.5(pid=21781): stdout: | (launched: 2022-12-13_19:20:56.049232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:20:57.815482 run osmo-stp_10.42.42.5(pid=21781): stderr: | 20221213192056237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192056237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192056238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192056238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192056238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192056239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192056239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:20:57.959574 run patchelf(pid=21784): Terminating (SIGINT) 19:20:58.125269 run patchelf(pid=21784): Terminated: ok {rc=0} 19:20:58.245259 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21781): Process ended prematurely: osmo-stp_10.42.42.5(pid=21781) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 19:20:58.254160 tst ping.py:22: Test FAILED (6.5 sec) 19:20:58.280710 run osmo-hlr_10.42.42.2(pid=21778): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21778)] 19:20:58.328775 run osmo-hlr_10.42.42.2(pid=21778): stdout: | (launched: 2022-12-13_19:20:55.059766) 19:20:58.378645 run osmo-hlr_10.42.42.2(pid=21778): stderr: | 20221213192055251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192055251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192055251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192055252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192055252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192055252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192055264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192055273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192055273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192055273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:20:58.428698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Terminating (SIGTERM) 19:20:58.468867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Terminating (SIGTERM) 19:20:58.508819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Terminating (SIGTERM) 19:20:58.549054 --- ParallelTerminationStrategy: PID 21777 died... 19:20:58.568255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21777): Terminated: ok {rc=0} 19:20:58.612527 --- ParallelTerminationStrategy: PID 21780 died... 19:20:58.631237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21780): Terminated: ok {rc=0} 19:20:58.675376 --- ParallelTerminationStrategy: PID 21783 died... 19:20:58.694152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21783): Terminated: ok {rc=0} 19:20:58.780301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:20:59.868084 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:20:59.879767 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:20:59.950679 tst ping_idle_ping.py: using LAC 35721 19:21:00.066779 tst ping_idle_ping.py: using RAC 21 19:21:00.184222 tst ping_idle_ping.py: using CellId 35721 19:21:00.299993 tst ping_idle_ping.py: using BVCI 35722 19:21:00.407500 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.418461 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.429139 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.439887 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.450646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.461520 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.472222 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:21:00.482955 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:21:00.596593 tst ping_idle_ping.py:24: start network... 19:21:00.795358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:01.280410 run create_hlr_db(pid=21785): Launched 19:21:01.434550 bus /gobi_6: Setting Powered False 19:21:02.494206 run create_hlr_db(pid=21785): Terminated: ok {rc=0} 19:21:02.931491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21787): Launched 19:21:03.250486 run osmo-hlr_10.42.42.2(pid=21788): Launched 19:21:03.375448 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:03.926160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21790): Launched 19:21:04.245949 run osmo-stp_10.42.42.5(pid=21791): Launched 19:21:04.368215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:04.919086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21793): Launched 19:21:05.040903 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:05.310740 run patchelf(pid=21794): Launched 19:21:05.488145 run osmo-stp_10.42.42.5(pid=21791): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21791)] 19:21:05.623914 run osmo-stp_10.42.42.5(pid=21791): stdout: | (launched: 2022-12-13_19:21:04.187443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:05.760759 run osmo-stp_10.42.42.5(pid=21791): stderr: | 20221213192104376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192104376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192104376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192104376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192104377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192104377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192104377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:05.897914 run osmo-stp_10.42.42.5(pid=21791): stdout: | (launched: 2022-12-13_19:21:04.187443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:06.029344 run osmo-stp_10.42.42.5(pid=21791): stderr: | 20221213192104376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192104376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192104376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192104376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192104377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192104377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192104377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:06.185215 run patchelf(pid=21794): Terminating (SIGINT) 19:21:06.364628 run patchelf(pid=21794): Terminated: ok {rc=0} 19:21:06.493779 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21791): Process ended prematurely: osmo-stp_10.42.42.5(pid=21791) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21791)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:21:06.503392 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:21:06.531626 run osmo-hlr_10.42.42.2(pid=21788): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21788)] 19:21:06.582738 run osmo-hlr_10.42.42.2(pid=21788): stdout: | (launched: 2022-12-13_19:21:03.192455) 19:21:06.635840 run osmo-hlr_10.42.42.2(pid=21788): stderr: | 20221213192103386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192103386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192103386 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192103386 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192103387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192103387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192103400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192103410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192103410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192103410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:06.688747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21787): Terminating (SIGTERM) 19:21:06.730901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21790): Terminating (SIGTERM) 19:21:06.773687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21793): Terminating (SIGTERM) 19:21:06.816178 --- ParallelTerminationStrategy: PID 21787 died... 19:21:06.836673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21787): Terminated: ok {rc=0} 19:21:06.883453 --- ParallelTerminationStrategy: PID 21790 died... 19:21:06.903234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21790): Terminated: ok {rc=0} 19:21:06.949633 --- ParallelTerminationStrategy: PID 21793 died... 19:21:06.969413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21793): Terminated: ok {rc=0} 19:21:07.058168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:21:08.367136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:21:08.373732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:21:08.407312 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:21:08.447995 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:21:08.538326 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:21:08.571741 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:21:08.611638 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:21:09.208926 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:21:09.261540 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.273041 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:21:09.344711 tst cs_paging_gprs_active.py: using LAC 35722 19:21:09.470852 tst cs_paging_gprs_active.py: using RAC 22 19:21:09.596430 tst cs_paging_gprs_active.py: using CellId 35722 19:21:09.723710 tst cs_paging_gprs_active.py: using BVCI 35723 19:21:09.840841 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.852284 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.863558 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.874886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.886431 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.898026 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.909759 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.921347 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:09.933090 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:10.049907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:10.175173 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:21:10.396568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:10.722882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21798): Launched 19:21:11.005746 run iperf3-srv_10.42.42.10(pid=21799): Launched 19:21:11.127203 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:21:11.346678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:11.671448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21800): Launched 19:21:11.953547 run iperf3-srv_10.42.42.10(pid=21801): Launched 19:21:12.074617 tst cs_paging_gprs_active.py:38: start network... 19:21:12.293702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:12.797524 run create_hlr_db(pid=21802): Launched 19:21:12.920711 bus /gobi_6: Setting Powered False 19:21:13.985203 run create_hlr_db(pid=21802): Terminated: ok {rc=0} 19:21:14.420342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Launched 19:21:14.723764 run osmo-hlr_10.42.42.2(pid=21805): Launched 19:21:14.839275 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:15.374165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Launched 19:21:15.675352 run osmo-stp_10.42.42.5(pid=21808): Launched 19:21:15.790434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:16.393151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Launched 19:21:16.526668 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:16.814175 run patchelf(pid=21811): Launched 19:21:17.012528 run osmo-stp_10.42.42.5(pid=21808): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] 19:21:17.155237 run osmo-stp_10.42.42.5(pid=21808): stdout: | (launched: 2022-12-13_19:21:15.619766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:17.296903 run osmo-stp_10.42.42.5(pid=21808): stderr: | 20221213192115784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192115784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192115785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192115785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192115786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192115786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192115786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:17.436757 run osmo-stp_10.42.42.5(pid=21808): stdout: | (launched: 2022-12-13_19:21:15.619766) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:17.570006 run osmo-stp_10.42.42.5(pid=21808): stderr: | 20221213192115784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192115784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192115785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192115785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192115786 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192115786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192115786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:17.728019 run patchelf(pid=21811): Terminating (SIGINT) 19:21:17.910303 run patchelf(pid=21811): Terminated: ok {rc=0} 19:21:18.041634 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21808): Process ended prematurely: osmo-stp_10.42.42.5(pid=21808) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:21:18.051879 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:21:18.080554 run osmo-hlr_10.42.42.2(pid=21805): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21805)] 19:21:18.131811 run osmo-hlr_10.42.42.2(pid=21805): stdout: | (launched: 2022-12-13_19:21:14.668105) 19:21:18.184510 run osmo-hlr_10.42.42.2(pid=21805): stderr: | 20221213192114839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192114840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192114840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192114840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192114840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192114840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192114852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192114863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192114864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192114864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:18.237537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21798): Terminating (SIGTERM) 19:21:18.279665 run iperf3-srv_10.42.42.10(pid=21799): Terminating (SIGTERM) 19:21:18.322474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21800): Terminating (SIGTERM) 19:21:18.364678 run iperf3-srv_10.42.42.10(pid=21801): Terminating (SIGTERM) 19:21:18.407213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Terminating (SIGTERM) 19:21:18.449540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Terminating (SIGTERM) 19:21:18.492293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Terminating (SIGTERM) 19:21:18.535260 --- ParallelTerminationStrategy: PID 21798 died... 19:21:18.555668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21798): Terminated: ok {rc=0} 19:21:18.602432 --- ParallelTerminationStrategy: PID 21799 died... 19:21:18.622390 run iperf3-srv_10.42.42.10(pid=21799): Terminated {rc=256} 19:21:18.668890 --- ParallelTerminationStrategy: PID 21800 died... 19:21:18.689298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21800): Terminated: ok {rc=0} 19:21:18.735924 --- ParallelTerminationStrategy: PID 21801 died... 19:21:18.755888 run iperf3-srv_10.42.42.10(pid=21801): Terminated {rc=256} 19:21:18.802344 --- ParallelTerminationStrategy: PID 21804 died... 19:21:18.822290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21804): Terminated: ok {rc=0} 19:21:18.868835 --- ParallelTerminationStrategy: PID 21807 died... 19:21:18.889365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21807): Terminated: ok {rc=0} 19:21:18.936010 --- ParallelTerminationStrategy: PID 21810 died... 19:21:18.956013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21810): Terminated: ok {rc=0} 19:21:19.046097 bus /gobi_0: Setting Powered False 19:21:20.145453 bus /gobi_0: Setting Powered False 19:21:21.261263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:21:22.410824 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:22.423005 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:21:22.496446 tst iperf3.py: using LAC 35723 19:21:22.624674 tst iperf3.py: using RAC 23 19:21:22.745193 tst iperf3.py: using CellId 35723 19:21:22.863733 tst iperf3.py: using BVCI 35724 19:21:22.974982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:22.986184 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:22.997240 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.008235 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.018964 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.029862 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.040686 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.051486 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:23.062472 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:23.182457 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:21:23.401609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:23.725773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21812): Launched 19:21:24.006839 run iperf3-srv_10.42.42.10(pid=21813): Launched 19:21:24.127990 tst iperf3.py:8: start network... 19:21:24.346346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:24.846873 run create_hlr_db(pid=21814): Launched 19:21:24.970147 bus /gobi_6: Setting Powered False 19:21:26.033762 run create_hlr_db(pid=21814): Terminated: ok {rc=0} 19:21:26.483558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21816): Launched 19:21:26.806987 run osmo-hlr_10.42.42.2(pid=21817): Launched 19:21:26.930028 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:27.489539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21819): Launched 19:21:27.814039 run osmo-stp_10.42.42.5(pid=21820): Launched 19:21:27.937330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:28.496905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21822): Launched 19:21:28.620906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:28.894710 run patchelf(pid=21823): Launched 19:21:29.074292 run osmo-stp_10.42.42.5(pid=21820): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21820)] 19:21:29.211321 run osmo-stp_10.42.42.5(pid=21820): stdout: | (launched: 2022-12-13_19:21:27.754539) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:29.350319 run osmo-stp_10.42.42.5(pid=21820): stderr: | 20221213192127942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192127942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192127942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192127943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192127943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192127943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192127943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:29.488767 run osmo-stp_10.42.42.5(pid=21820): stdout: | (launched: 2022-12-13_19:21:27.754539) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:29.621831 run osmo-stp_10.42.42.5(pid=21820): stderr: | 20221213192127942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192127942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192127942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192127943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192127943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192127943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192127943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:29.779658 run patchelf(pid=21823): Terminating (SIGINT) 19:21:29.961089 run patchelf(pid=21823): Terminated: ok {rc=0} 19:21:30.091966 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21820): Process ended prematurely: osmo-stp_10.42.42.5(pid=21820) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21820)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 19:21:30.102271 tst iperf3.py:8: Test FAILED (7.7 sec) 19:21:30.130724 run osmo-hlr_10.42.42.2(pid=21817): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21817)] 19:21:30.181953 run osmo-hlr_10.42.42.2(pid=21817): stdout: | (launched: 2022-12-13_19:21:26.747740) 19:21:30.234869 run osmo-hlr_10.42.42.2(pid=21817): stderr: | 20221213192126941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192126941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192126941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192126942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192126942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192126942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192126954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192126962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192126962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192126962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:30.287892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21812): Terminating (SIGTERM) 19:21:30.330473 run iperf3-srv_10.42.42.10(pid=21813): Terminating (SIGTERM) 19:21:30.373167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21816): Terminating (SIGTERM) 19:21:30.415707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21819): Terminating (SIGTERM) 19:21:30.458766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21822): Terminating (SIGTERM) 19:21:30.501811 --- ParallelTerminationStrategy: PID 21812 died... 19:21:30.522511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21812): Terminated: ok {rc=0} 19:21:30.569911 --- ParallelTerminationStrategy: PID 21813 died... 19:21:30.590014 run iperf3-srv_10.42.42.10(pid=21813): Terminated {rc=256} 19:21:30.637160 --- ParallelTerminationStrategy: PID 21816 died... 19:21:30.657347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21816): Terminated: ok {rc=0} 19:21:30.704422 --- ParallelTerminationStrategy: PID 21819 died... 19:21:30.724603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21819): Terminated: ok {rc=0} 19:21:30.771788 --- ParallelTerminationStrategy: PID 21822 died... 19:21:30.791981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21822): Terminated: ok {rc=0} 19:21:30.885131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:21:32.049407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.062115 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:21:32.132504 tst iperf3m4.py: using LAC 35724 19:21:32.266596 tst iperf3m4.py: using RAC 24 19:21:32.387314 tst iperf3m4.py: using CellId 35724 19:21:32.508069 tst iperf3m4.py: using BVCI 35725 19:21:32.619114 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.630120 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.641411 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.652162 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.662930 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.673792 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.684656 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.695444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:32.706411 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:32.822313 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:32.940135 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:33.060717 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:33.178698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:21:33.381388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:33.684725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21824): Launched 19:21:33.948405 run iperf3-srv_10.42.42.10(pid=21825): Launched 19:21:34.063022 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:21:34.265501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:34.569573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21826): Launched 19:21:34.831698 run iperf3-srv_10.42.42.10(pid=21827): Launched 19:21:34.944635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:21:35.147407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:35.450861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21828): Launched 19:21:35.714376 run iperf3-srv_10.42.42.10(pid=21829): Launched 19:21:35.827371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:21:36.029681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:21:36.333749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Launched 19:21:36.595965 run iperf3-srv_10.42.42.10(pid=21831): Launched 19:21:36.708880 tst iperf3m4.py:8: start network... 19:21:36.910183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:37.378548 run create_hlr_db(pid=21832): Launched 19:21:37.501635 bus /gobi_6: Setting Powered False 19:21:38.561665 run create_hlr_db(pid=21832): Terminated: ok {rc=0} 19:21:39.004128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Launched 19:21:39.329809 run osmo-hlr_10.42.42.2(pid=21835): Launched 19:21:39.453848 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:40.015694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Launched 19:21:40.340158 run osmo-stp_10.42.42.5(pid=21838): Launched 19:21:40.464761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:41.025173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Launched 19:21:41.149834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:41.424492 run patchelf(pid=21841): Launched 19:21:41.604144 run osmo-stp_10.42.42.5(pid=21838): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] 19:21:41.742033 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-13_19:21:40.280644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:41.881377 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221213192140469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192140469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192140469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192140470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192140470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192140470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192140470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:42.020424 run osmo-stp_10.42.42.5(pid=21838): stdout: | (launched: 2022-12-13_19:21:40.280644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:42.153829 run osmo-stp_10.42.42.5(pid=21838): stderr: | 20221213192140469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192140469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192140469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192140470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192140470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192140470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192140470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:42.311647 run patchelf(pid=21841): Terminating (SIGINT) 19:21:42.493998 run patchelf(pid=21841): Terminated: ok {rc=0} 19:21:42.625379 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:21:42.635617 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:21:42.664683 run osmo-hlr_10.42.42.2(pid=21835): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21835)] 19:21:42.716159 run osmo-hlr_10.42.42.2(pid=21835): stdout: | (launched: 2022-12-13_19:21:39.270190) 19:21:42.769622 run osmo-hlr_10.42.42.2(pid=21835): stderr: | 20221213192139463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192139463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192139463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192139463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192139463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192139463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192139476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192139486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192139486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192139486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:42.823104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21824): Terminating (SIGTERM) 19:21:42.865641 run iperf3-srv_10.42.42.10(pid=21825): Terminating (SIGTERM) 19:21:42.908330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21826): Terminating (SIGTERM) 19:21:42.950958 run iperf3-srv_10.42.42.10(pid=21827): Terminating (SIGTERM) 19:21:42.993527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21828): Terminating (SIGTERM) 19:21:43.035824 run iperf3-srv_10.42.42.10(pid=21829): Terminating (SIGTERM) 19:21:43.078482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Terminating (SIGTERM) 19:21:43.120875 run iperf3-srv_10.42.42.10(pid=21831): Terminating (SIGTERM) 19:21:43.163341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminating (SIGTERM) 19:21:43.206141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminating (SIGTERM) 19:21:43.248248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Terminating (SIGTERM) 19:21:43.290980 --- ParallelTerminationStrategy: PID 21824 died... 19:21:43.311116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21824): Terminated: ok {rc=0} 19:21:43.358109 --- ParallelTerminationStrategy: PID 21825 died... 19:21:43.377995 run iperf3-srv_10.42.42.10(pid=21825): Terminated {rc=256} 19:21:43.424287 --- ParallelTerminationStrategy: PID 21826 died... 19:21:43.443993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21826): Terminated: ok {rc=0} 19:21:43.490831 --- ParallelTerminationStrategy: PID 21827 died... 19:21:43.510770 run iperf3-srv_10.42.42.10(pid=21827): Terminated {rc=256} 19:21:43.557630 --- ParallelTerminationStrategy: PID 21828 died... 19:21:43.577514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21828): Terminated: ok {rc=0} 19:21:43.624039 --- ParallelTerminationStrategy: PID 21829 died... 19:21:43.644233 run iperf3-srv_10.42.42.10(pid=21829): Terminated {rc=256} 19:21:43.690819 --- ParallelTerminationStrategy: PID 21830 died... 19:21:43.710830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21830): Terminated: ok {rc=0} 19:21:43.757547 --- ParallelTerminationStrategy: PID 21831 died... 19:21:43.777582 run iperf3-srv_10.42.42.10(pid=21831): Terminated {rc=256} 19:21:43.824051 --- ParallelTerminationStrategy: PID 21834 died... 19:21:43.844077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21834): Terminated: ok {rc=0} 19:21:43.890864 --- ParallelTerminationStrategy: PID 21837 died... 19:21:43.911120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21837): Terminated: ok {rc=0} 19:21:43.958012 --- ParallelTerminationStrategy: PID 21840 died... 19:21:43.978223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21840): Terminated: ok {rc=0} 19:21:44.067400 bus /gobi_4: Setting Powered False 19:21:45.167515 bus /gobi_4: Setting Powered False 19:21:46.285338 bus /gobi_1: Setting Powered False 19:21:47.382310 bus /gobi_1: Setting Powered False 19:21:48.499074 bus /gobi_0: Setting Powered False 19:21:49.598092 bus /gobi_0: Setting Powered False 19:21:50.715710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:21:51.818986 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:51.831213 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:21:51.904201 tst ping.py: using LAC 35725 19:21:52.033595 tst ping.py: using RAC 25 19:21:52.157207 tst ping.py: using CellId 35725 19:21:52.279470 tst ping.py: using BVCI 35726 19:21:52.395202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.406727 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.418088 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.429444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.441042 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.452712 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.464548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:52.476189 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:21:52.591906 tst ping.py:19: start network... 19:21:52.790134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:21:53.253543 run create_hlr_db(pid=21842): Launched 19:21:53.376562 bus /gobi_6: Setting Powered False 19:21:54.436653 run create_hlr_db(pid=21842): Terminated: ok {rc=0} 19:21:54.875007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21844): Launched 19:21:55.195244 run osmo-hlr_10.42.42.2(pid=21845): Launched 19:21:55.317030 run osmo-stp_10.42.42.5: Starting osmo-stp 19:21:55.831249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21847): Launched 19:21:56.127848 run osmo-stp_10.42.42.5(pid=21848): Launched 19:21:56.239798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:21:56.749601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21850): Launched 19:21:56.863100 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:21:57.113981 run patchelf(pid=21851): Launched 19:21:57.279049 run osmo-stp_10.42.42.5(pid=21848): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21848)] 19:21:57.405262 run osmo-stp_10.42.42.5(pid=21848): stdout: | (launched: 2022-12-13_19:21:56.073242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:57.532462 run osmo-stp_10.42.42.5(pid=21848): stderr: | 20221213192156239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192156239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192156240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192156240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192156241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192156241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192156241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:57.660391 run osmo-stp_10.42.42.5(pid=21848): stdout: | (launched: 2022-12-13_19:21:56.073242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:21:57.782306 run osmo-stp_10.42.42.5(pid=21848): stderr: | 20221213192156239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192156239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192156240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192156240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192156241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192156241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192156241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:21:57.926927 run patchelf(pid=21851): Terminating (SIGINT) 19:21:58.093635 run patchelf(pid=21851): Terminated: ok {rc=0} 19:21:58.213978 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21848): Process ended prematurely: osmo-stp_10.42.42.5(pid=21848) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21848)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 19:21:58.223009 tst ping.py:22: Test FAILED (6.4 sec) 19:21:58.249922 run osmo-hlr_10.42.42.2(pid=21845): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21845)] 19:21:58.297982 run osmo-hlr_10.42.42.2(pid=21845): stdout: | (launched: 2022-12-13_19:21:55.136524) 19:21:58.347480 run osmo-hlr_10.42.42.2(pid=21845): stderr: | 20221213192155331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192155331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192155331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192155331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192155331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192155331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192155342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192155350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192155351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192155351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:21:58.397398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21844): Terminating (SIGTERM) 19:21:58.437359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21847): Terminating (SIGTERM) 19:21:58.477288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21850): Terminating (SIGTERM) 19:21:58.517723 --- ParallelTerminationStrategy: PID 21844 died... 19:21:58.537060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21844): Terminated: ok {rc=0} 19:21:58.581425 --- ParallelTerminationStrategy: PID 21847 died... 19:21:58.600122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21847): Terminated: ok {rc=0} 19:21:58.644430 --- ParallelTerminationStrategy: PID 21850 died... 19:21:58.663559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21850): Terminated: ok {rc=0} 19:21:58.750416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:21:59.837616 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:21:59.849558 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:21:59.921975 tst ping_idle_ping.py: using LAC 35726 19:22:00.043658 tst ping_idle_ping.py: using RAC 26 19:22:00.160928 tst ping_idle_ping.py: using CellId 35726 19:22:00.275956 tst ping_idle_ping.py: using BVCI 35727 19:22:00.384110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.395308 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.406345 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.417337 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.428187 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.439033 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.450176 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:22:00.461208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:22:00.580313 tst ping_idle_ping.py:24: start network... 19:22:00.795848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:01.314856 run create_hlr_db(pid=21852): Launched 19:22:01.475709 bus /gobi_6: Setting Powered False 19:22:02.534781 run create_hlr_db(pid=21852): Terminated: ok {rc=0} 19:22:02.954441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21854): Launched 19:22:03.253710 run osmo-hlr_10.42.42.2(pid=21855): Launched 19:22:03.367911 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:03.896791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21857): Launched 19:22:04.197612 run osmo-stp_10.42.42.5(pid=21858): Launched 19:22:04.310130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:04.827496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21860): Launched 19:22:04.941602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:05.194521 run patchelf(pid=21861): Launched 19:22:05.360790 run osmo-stp_10.42.42.5(pid=21858): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21858)] 19:22:05.487365 run osmo-stp_10.42.42.5(pid=21858): stdout: | (launched: 2022-12-13_19:22:04.142206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:05.615237 run osmo-stp_10.42.42.5(pid=21858): stderr: | 20221213192204309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192204310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192204310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192204310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192204311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192204311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192204311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:05.742950 run osmo-stp_10.42.42.5(pid=21858): stdout: | (launched: 2022-12-13_19:22:04.142206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:05.865518 run osmo-stp_10.42.42.5(pid=21858): stderr: | 20221213192204309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192204310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192204310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192204310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192204311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192204311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192204311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:06.010641 run patchelf(pid=21861): Terminating (SIGINT) 19:22:06.178235 run patchelf(pid=21861): Terminated: ok {rc=0} 19:22:06.299141 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21858): Process ended prematurely: osmo-stp_10.42.42.5(pid=21858) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21858)] [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:22:06.308111 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:22:06.334721 run osmo-hlr_10.42.42.2(pid=21855): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21855)] 19:22:06.382688 run osmo-hlr_10.42.42.2(pid=21855): stdout: | (launched: 2022-12-13_19:22:03.198073) 19:22:06.431984 run osmo-hlr_10.42.42.2(pid=21855): stderr: | 20221213192203371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192203371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192203371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192203371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192203371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192203371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192203384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192203393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192203393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192203393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:06.481980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21854): Terminating (SIGTERM) 19:22:06.521922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21857): Terminating (SIGTERM) 19:22:06.561740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21860): Terminating (SIGTERM) 19:22:06.601844 --- ParallelTerminationStrategy: PID 21854 died... 19:22:06.621292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21854): Terminated: ok {rc=0} 19:22:06.665518 --- ParallelTerminationStrategy: PID 21857 died... 19:22:06.684429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21857): Terminated: ok {rc=0} 19:22:06.728092 --- ParallelTerminationStrategy: PID 21860 died... 19:22:06.746947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21860): Terminated: ok {rc=0} 19:22:06.830398 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:22:08.139930 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:22:08.147558 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:22:08.182593 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:22:08.222760 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:22:08.313618 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:22:08.347711 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:22:08.388258 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:22:08.996198 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:22:09.050015 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.062164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:22:09.116218 tst cs_paging_gprs_active.py: using LAC 35727 19:22:09.244405 tst cs_paging_gprs_active.py: using RAC 27 19:22:09.373642 tst cs_paging_gprs_active.py: using CellId 35727 19:22:09.501014 tst cs_paging_gprs_active.py: using BVCI 35728 19:22:09.612325 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.623828 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.635086 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.646334 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.657808 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.669301 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.680683 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.691923 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:09.703405 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:09.824397 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:09.944828 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:22:10.165385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:10.493162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21865): Launched 19:22:10.776302 run iperf3-srv_10.42.42.10(pid=21866): Launched 19:22:10.898465 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:22:11.118922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:11.446685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Launched 19:22:11.730119 run iperf3-srv_10.42.42.10(pid=21868): Launched 19:22:11.852084 tst cs_paging_gprs_active.py:38: start network... 19:22:12.072272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:12.578441 run create_hlr_db(pid=21869): Launched 19:22:12.702977 bus /gobi_6: Setting Powered False 19:22:13.766900 run create_hlr_db(pid=21869): Terminated: ok {rc=0} 19:22:14.203360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21871): Launched 19:22:14.508042 run osmo-hlr_10.42.42.2(pid=21872): Launched 19:22:14.625076 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:15.150021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21874): Launched 19:22:15.454059 run osmo-stp_10.42.42.5(pid=21875): Launched 19:22:15.570454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:16.103590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21877): Launched 19:22:16.226441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:16.493304 run patchelf(pid=21878): Launched 19:22:16.680623 run osmo-stp_10.42.42.5(pid=21875): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21875)] 19:22:16.812765 run osmo-stp_10.42.42.5(pid=21875): stdout: | (launched: 2022-12-13_19:22:15.398357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:16.946750 run osmo-stp_10.42.42.5(pid=21875): stderr: | 20221213192215566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192215566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192215566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192215566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192215567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192215567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192215567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:17.080692 run osmo-stp_10.42.42.5(pid=21875): stdout: | (launched: 2022-12-13_19:22:15.398357) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:17.207603 run osmo-stp_10.42.42.5(pid=21875): stderr: | 20221213192215566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192215566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192215566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192215566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192215567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192215567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192215567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:17.355226 run patchelf(pid=21878): Terminating (SIGINT) 19:22:17.526591 run patchelf(pid=21878): Terminated: ok {rc=0} 19:22:17.649284 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21875): Process ended prematurely: osmo-stp_10.42.42.5(pid=21875) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21875)] [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:22:17.658639 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:22:17.685858 run osmo-hlr_10.42.42.2(pid=21872): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21872)] 19:22:17.733772 run osmo-hlr_10.42.42.2(pid=21872): stdout: | (launched: 2022-12-13_19:22:14.452003) 19:22:17.783352 run osmo-hlr_10.42.42.2(pid=21872): stderr: | 20221213192214625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192214625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192214625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192214625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192214625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192214625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192214641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192214650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192214650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192214650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:17.833552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21865): Terminating (SIGTERM) 19:22:17.873613 run iperf3-srv_10.42.42.10(pid=21866): Terminating (SIGTERM) 19:22:17.913662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Terminating (SIGTERM) 19:22:17.953553 run iperf3-srv_10.42.42.10(pid=21868): Terminating (SIGTERM) 19:22:17.993359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21871): Terminating (SIGTERM) 19:22:18.033317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21874): Terminating (SIGTERM) 19:22:18.073172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21877): Terminating (SIGTERM) 19:22:18.113500 --- ParallelTerminationStrategy: PID 21865 died... 19:22:18.132872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21865): Terminated: ok {rc=0} 19:22:18.177580 --- ParallelTerminationStrategy: PID 21866 died... 19:22:18.196235 run iperf3-srv_10.42.42.10(pid=21866): Terminated {rc=256} 19:22:18.240273 --- ParallelTerminationStrategy: PID 21867 died... 19:22:18.258961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21867): Terminated: ok {rc=0} 19:22:18.302836 --- ParallelTerminationStrategy: PID 21868 died... 19:22:18.321325 run iperf3-srv_10.42.42.10(pid=21868): Terminated {rc=256} 19:22:18.365267 --- ParallelTerminationStrategy: PID 21871 died... 19:22:18.383947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21871): Terminated: ok {rc=0} 19:22:18.427842 --- ParallelTerminationStrategy: PID 21874 died... 19:22:18.446600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21874): Terminated: ok {rc=0} 19:22:18.490715 --- ParallelTerminationStrategy: PID 21877 died... 19:22:18.509432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21877): Terminated: ok {rc=0} 19:22:18.595641 bus /gobi_0: Setting Powered False 19:22:19.694745 bus /gobi_0: Setting Powered False 19:22:20.809708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:22:21.956212 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:21.968230 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:22:22.022802 tst iperf3.py: using LAC 35728 19:22:22.143133 tst iperf3.py: using RAC 28 19:22:22.265047 tst iperf3.py: using CellId 35728 19:22:22.385843 tst iperf3.py: using BVCI 35729 19:22:22.498059 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.509571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.520669 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.531802 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.542944 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.554096 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.565393 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.576444 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:22.587863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:22.709509 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:22:22.930844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:23.258452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21879): Launched 19:22:23.543011 run iperf3-srv_10.42.42.10(pid=21880): Launched 19:22:23.665363 tst iperf3.py:8: start network... 19:22:23.884654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:24.389537 run create_hlr_db(pid=21881): Launched 19:22:24.514481 bus /gobi_6: Setting Powered False 19:22:25.578280 run create_hlr_db(pid=21881): Terminated: ok {rc=0} 19:22:26.029631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Launched 19:22:26.353876 run osmo-hlr_10.42.42.2(pid=21884): Launched 19:22:26.478689 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:27.040635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Launched 19:22:27.365692 run osmo-stp_10.42.42.5(pid=21887): Launched 19:22:27.490763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:28.051923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21889): Launched 19:22:28.176014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:28.451649 run patchelf(pid=21890): Launched 19:22:28.631826 run osmo-stp_10.42.42.5(pid=21887): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] 19:22:28.769816 run osmo-stp_10.42.42.5(pid=21887): stdout: | (launched: 2022-12-13_19:22:27.305904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:28.909247 run osmo-stp_10.42.42.5(pid=21887): stderr: | 20221213192227495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192227495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192227495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192227495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192227496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192227496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192227496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:29.048380 run osmo-stp_10.42.42.5(pid=21887): stdout: | (launched: 2022-12-13_19:22:27.305904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:29.182152 run osmo-stp_10.42.42.5(pid=21887): stderr: | 20221213192227495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192227495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192227495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192227495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192227496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192227496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192227496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:29.340595 run patchelf(pid=21890): Terminating (SIGINT) 19:22:29.523543 run patchelf(pid=21890): Terminated: ok {rc=0} 19:22:29.655216 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21887): Process ended prematurely: osmo-stp_10.42.42.5(pid=21887) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:22:29.665349 tst iperf3.py:8: Test FAILED (7.7 sec) 19:22:29.693845 run osmo-hlr_10.42.42.2(pid=21884): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21884)] 19:22:29.744612 run osmo-hlr_10.42.42.2(pid=21884): stdout: | (launched: 2022-12-13_19:22:26.294613) 19:22:29.797128 run osmo-hlr_10.42.42.2(pid=21884): stderr: | 20221213192226489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192226489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192226489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192226489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192226489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192226489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192226502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192226510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192226511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192226511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:29.850334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21879): Terminating (SIGTERM) 19:22:29.892160 run iperf3-srv_10.42.42.10(pid=21880): Terminating (SIGTERM) 19:22:29.934726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Terminating (SIGTERM) 19:22:29.977127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Terminating (SIGTERM) 19:22:30.019901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21889): Terminating (SIGTERM) 19:22:30.062464 --- ParallelTerminationStrategy: PID 21879 died... 19:22:30.083118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21879): Terminated: ok {rc=0} 19:22:30.130118 --- ParallelTerminationStrategy: PID 21880 died... 19:22:30.150164 run iperf3-srv_10.42.42.10(pid=21880): Terminated {rc=256} 19:22:30.196647 --- ParallelTerminationStrategy: PID 21883 died... 19:22:30.216746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21883): Terminated: ok {rc=0} 19:22:30.263337 --- ParallelTerminationStrategy: PID 21886 died... 19:22:30.283431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21886): Terminated: ok {rc=0} 19:22:30.330087 --- ParallelTerminationStrategy: PID 21889 died... 19:22:30.350256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21889): Terminated: ok {rc=0} 19:22:30.439729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:22:31.597495 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:31.611003 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:22:31.669692 tst iperf3m4.py: using LAC 35729 19:22:31.826967 tst iperf3m4.py: using RAC 29 19:22:31.951232 tst iperf3m4.py: using CellId 35729 19:22:32.090762 tst iperf3m4.py: using BVCI 35730 19:22:32.228765 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.240908 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.252841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.264706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.276832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.288871 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.301062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.312522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:32.324272 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:32.440048 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:32.562889 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:32.681999 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:32.801626 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:22:33.021823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:33.348329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21891): Launched 19:22:33.632075 run iperf3-srv_10.42.42.10(pid=21892): Launched 19:22:33.754607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:22:33.974268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:34.300286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21893): Launched 19:22:34.583788 run iperf3-srv_10.42.42.10(pid=21894): Launched 19:22:34.705952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:22:34.924502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:35.250243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21895): Launched 19:22:35.533224 run iperf3-srv_10.42.42.10(pid=21896): Launched 19:22:35.654841 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:22:35.872931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:22:36.197694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21897): Launched 19:22:36.479044 run iperf3-srv_10.42.42.10(pid=21898): Launched 19:22:36.600604 tst iperf3m4.py:8: start network... 19:22:36.819017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:37.323212 run create_hlr_db(pid=21899): Launched 19:22:37.448036 bus /gobi_6: Setting Powered False 19:22:38.508224 run create_hlr_db(pid=21899): Terminated: ok {rc=0} 19:22:38.962735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21901): Launched 19:22:39.288069 run osmo-hlr_10.42.42.2(pid=21902): Launched 19:22:39.412704 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:39.974299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21904): Launched 19:22:40.299429 run osmo-stp_10.42.42.5(pid=21905): Launched 19:22:40.423431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:40.983768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21907): Launched 19:22:41.107630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:41.382455 run patchelf(pid=21908): Launched 19:22:41.563067 run osmo-stp_10.42.42.5(pid=21905): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21905)] 19:22:41.701214 run osmo-stp_10.42.42.5(pid=21905): stdout: | (launched: 2022-12-13_19:22:40.239909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:41.840503 run osmo-stp_10.42.42.5(pid=21905): stderr: | 20221213192240427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192240427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192240427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192240428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192240428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192240428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192240428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:41.979709 run osmo-stp_10.42.42.5(pid=21905): stdout: | (launched: 2022-12-13_19:22:40.239909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:42.113436 run osmo-stp_10.42.42.5(pid=21905): stderr: | 20221213192240427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192240427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192240427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192240428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192240428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192240428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192240428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:42.272155 run patchelf(pid=21908): Terminating (SIGINT) 19:22:42.454448 run patchelf(pid=21908): Terminated: ok {rc=0} 19:22:42.585815 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21905): Process ended prematurely: osmo-stp_10.42.42.5(pid=21905) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21905)] [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:22:42.596009 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:22:42.624851 run osmo-hlr_10.42.42.2(pid=21902): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21902)] 19:22:42.675894 run osmo-hlr_10.42.42.2(pid=21902): stdout: | (launched: 2022-12-13_19:22:39.228155) 19:22:42.728517 run osmo-hlr_10.42.42.2(pid=21902): stderr: | 20221213192239422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192239422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192239422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192239422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192239422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192239422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192239435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192239445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192239446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192239446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:42.781392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21891): Terminating (SIGTERM) 19:22:42.823420 run iperf3-srv_10.42.42.10(pid=21892): Terminating (SIGTERM) 19:22:42.865559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21893): Terminating (SIGTERM) 19:22:42.907736 run iperf3-srv_10.42.42.10(pid=21894): Terminating (SIGTERM) 19:22:42.949749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21895): Terminating (SIGTERM) 19:22:42.991942 run iperf3-srv_10.42.42.10(pid=21896): Terminating (SIGTERM) 19:22:43.033950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21897): Terminating (SIGTERM) 19:22:43.076013 run iperf3-srv_10.42.42.10(pid=21898): Terminating (SIGTERM) 19:22:43.118069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21901): Terminating (SIGTERM) 19:22:43.160069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21904): Terminating (SIGTERM) 19:22:43.202111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21907): Terminating (SIGTERM) 19:22:43.244144 --- ParallelTerminationStrategy: PID 21891 died... 19:22:43.264644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21891): Terminated: ok {rc=0} 19:22:43.311593 --- ParallelTerminationStrategy: PID 21892 died... 19:22:43.331456 run iperf3-srv_10.42.42.10(pid=21892): Terminated {rc=256} 19:22:43.378037 --- ParallelTerminationStrategy: PID 21893 died... 19:22:43.397864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21893): Terminated: ok {rc=0} 19:22:43.444197 --- ParallelTerminationStrategy: PID 21894 died... 19:22:43.463981 run iperf3-srv_10.42.42.10(pid=21894): Terminated {rc=256} 19:22:43.510683 --- ParallelTerminationStrategy: PID 21895 died... 19:22:43.530590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21895): Terminated: ok {rc=0} 19:22:43.576750 --- ParallelTerminationStrategy: PID 21896 died... 19:22:43.596626 run iperf3-srv_10.42.42.10(pid=21896): Terminated {rc=256} 19:22:43.643069 --- ParallelTerminationStrategy: PID 21897 died... 19:22:43.663006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21897): Terminated: ok {rc=0} 19:22:43.709441 --- ParallelTerminationStrategy: PID 21898 died... 19:22:43.729269 run iperf3-srv_10.42.42.10(pid=21898): Terminated {rc=256} 19:22:43.775411 --- ParallelTerminationStrategy: PID 21901 died... 19:22:43.795440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21901): Terminated: ok {rc=0} 19:22:43.841634 --- ParallelTerminationStrategy: PID 21904 died... 19:22:43.861497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21904): Terminated: ok {rc=0} 19:22:43.907724 --- ParallelTerminationStrategy: PID 21907 died... 19:22:43.927751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21907): Terminated: ok {rc=0} 19:22:44.016070 bus /gobi_4: Setting Powered False 19:22:45.113932 bus /gobi_4: Setting Powered False 19:22:46.227800 bus /gobi_1: Setting Powered False 19:22:47.323008 bus /gobi_1: Setting Powered False 19:22:48.439270 bus /gobi_0: Setting Powered False 19:22:49.539253 bus /gobi_0: Setting Powered False 19:22:50.654228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:22:51.757287 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:51.769339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:22:51.821441 tst ping.py: using LAC 35730 19:22:51.962947 tst ping.py: using RAC 30 19:22:52.079573 tst ping.py: using CellId 35730 19:22:52.197528 tst ping.py: using BVCI 35731 19:22:52.306721 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.318263 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.329475 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.340607 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.351830 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.363046 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.374371 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:52.385728 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:22:52.499789 tst ping.py:19: start network... 19:22:52.715029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:22:53.207896 run create_hlr_db(pid=21914): Launched 19:22:53.330018 bus /gobi_6: Setting Powered False 19:22:54.393222 run create_hlr_db(pid=21914): Terminated: ok {rc=0} 19:22:54.818322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21916): Launched 19:22:55.115224 run osmo-hlr_10.42.42.2(pid=21917): Launched 19:22:55.228146 run osmo-stp_10.42.42.5: Starting osmo-stp 19:22:55.742692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21919): Launched 19:22:56.040539 run osmo-stp_10.42.42.5(pid=21920): Launched 19:22:56.152527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:22:56.666133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21922): Launched 19:22:56.779419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:22:57.030484 run patchelf(pid=21923): Launched 19:22:57.194958 run osmo-stp_10.42.42.5(pid=21920): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21920)] 19:22:57.320787 run osmo-stp_10.42.42.5(pid=21920): stdout: | (launched: 2022-12-13_19:22:55.985509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:57.447865 run osmo-stp_10.42.42.5(pid=21920): stderr: | 20221213192256154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192256154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192256154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192256155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192256155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192256155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192256155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:57.575384 run osmo-stp_10.42.42.5(pid=21920): stdout: | (launched: 2022-12-13_19:22:55.985509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:22:57.697506 run osmo-stp_10.42.42.5(pid=21920): stderr: | 20221213192256154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192256154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192256154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192256155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192256155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192256155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192256155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:22:57.842968 run patchelf(pid=21923): Terminating (SIGINT) 19:22:58.009075 run patchelf(pid=21923): Terminated: ok {rc=0} 19:22:58.128858 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21920): Process ended prematurely: osmo-stp_10.42.42.5(pid=21920) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21920)] [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:22:58.137782 tst ping.py:22: Test FAILED (6.4 sec) 19:22:58.164462 run osmo-hlr_10.42.42.2(pid=21917): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21917)] 19:22:58.212176 run osmo-hlr_10.42.42.2(pid=21917): stdout: | (launched: 2022-12-13_19:22:55.060234) 19:22:58.261633 run osmo-hlr_10.42.42.2(pid=21917): stderr: | 20221213192255230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192255230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192255230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192255231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192255231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192255231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192255243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192255252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192255252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192255252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:22:58.311672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21916): Terminating (SIGTERM) 19:22:58.351566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21919): Terminating (SIGTERM) 19:22:58.391546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21922): Terminating (SIGTERM) 19:22:58.431476 --- ParallelTerminationStrategy: PID 21916 died... 19:22:58.450116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21916): Terminated: ok {rc=0} 19:22:58.494052 --- ParallelTerminationStrategy: PID 21919 died... 19:22:58.512570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21919): Terminated: ok {rc=0} 19:22:58.556507 --- ParallelTerminationStrategy: PID 21922 died... 19:22:58.575255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21922): Terminated: ok {rc=0} 19:22:58.661777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:22:59.750469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:22:59.762926 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:22:59.816131 tst ping_idle_ping.py: using LAC 35731 19:22:59.932160 tst ping_idle_ping.py: using RAC 31 19:23:00.048471 tst ping_idle_ping.py: using CellId 35731 19:23:00.164917 tst ping_idle_ping.py: using BVCI 35732 19:23:00.272772 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.284278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.295441 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.306743 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.317902 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.329089 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.340335 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:23:00.351517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:23:00.466279 tst ping_idle_ping.py:24: start network... 19:23:00.665327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:01.183761 run create_hlr_db(pid=21924): Launched 19:23:01.341166 bus /gobi_6: Setting Powered False 19:23:02.405192 run create_hlr_db(pid=21924): Terminated: ok {rc=0} 19:23:02.854278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21926): Launched 19:23:03.173706 run osmo-hlr_10.42.42.2(pid=21927): Launched 19:23:03.295490 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:03.843651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21929): Launched 19:23:04.163520 run osmo-stp_10.42.42.5(pid=21930): Launched 19:23:04.285064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:04.836684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21932): Launched 19:23:04.958728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:05.228602 run patchelf(pid=21933): Launched 19:23:05.406686 run osmo-stp_10.42.42.5(pid=21930): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21930)] 19:23:05.542394 run osmo-stp_10.42.42.5(pid=21930): stdout: | (launched: 2022-12-13_19:23:04.105251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:05.679587 run osmo-stp_10.42.42.5(pid=21930): stderr: | 20221213192304291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192304292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192304292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192304292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192304293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192304293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192304293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:05.817480 run osmo-stp_10.42.42.5(pid=21930): stdout: | (launched: 2022-12-13_19:23:04.105251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:05.949198 run osmo-stp_10.42.42.5(pid=21930): stderr: | 20221213192304291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192304292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192304292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192304292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192304293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192304293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192304293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:06.105453 run patchelf(pid=21933): Terminating (SIGINT) 19:23:06.284197 run patchelf(pid=21933): Terminated: ok {rc=0} 19:23:06.413654 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21930): Process ended prematurely: osmo-stp_10.42.42.5(pid=21930) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21930)] [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:23:06.423463 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:23:06.451581 run osmo-hlr_10.42.42.2(pid=21927): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21927)] 19:23:06.502598 run osmo-hlr_10.42.42.2(pid=21927): stdout: | (launched: 2022-12-13_19:23:03.114965) 19:23:06.555313 run osmo-hlr_10.42.42.2(pid=21927): stderr: | 20221213192303308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192303308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192303308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192303308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192303308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192303308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192303320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192303329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192303329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192303329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:06.608320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21926): Terminating (SIGTERM) 19:23:06.650533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21929): Terminating (SIGTERM) 19:23:06.693660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21932): Terminating (SIGTERM) 19:23:06.736408 --- ParallelTerminationStrategy: PID 21926 died... 19:23:06.757114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21926): Terminated: ok {rc=0} 19:23:06.804031 --- ParallelTerminationStrategy: PID 21929 died... 19:23:06.824052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21929): Terminated: ok {rc=0} 19:23:06.870661 --- ParallelTerminationStrategy: PID 21932 died... 19:23:06.890666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21932): Terminated: ok {rc=0} 19:23:06.979396 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:23:08.293605 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:08.300648 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:23:08.334522 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:23:08.372310 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:23:08.427264 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:23:08.460230 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:23:08.495432 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:23:09.057412 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:23:09.062355 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.073685 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:23:09.147207 tst switch_tch_pdch.py: using LAC 35732 19:23:09.264543 tst switch_tch_pdch.py: using RAC 32 19:23:09.380000 tst switch_tch_pdch.py: using CellId 35732 19:23:09.494659 tst switch_tch_pdch.py: using BVCI 35733 19:23:09.602553 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.613851 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.624853 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.636036 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.647564 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.659065 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.670764 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:23:09.682421 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:23:09.802462 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:23:09.923091 tst switch_tch_pdch.py:51: start network... 19:23:10.138779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:10.636308 run create_hlr_db(pid=21937): Launched 19:23:10.759036 bus /gobi_6: Setting Powered False 19:23:11.822134 run create_hlr_db(pid=21937): Terminated: ok {rc=0} 19:23:12.268069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21939): Launched 19:23:12.587819 run osmo-hlr_10.42.42.2(pid=21940): Launched 19:23:12.709559 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:13.260474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21942): Launched 19:23:13.579381 run osmo-stp_10.42.42.5(pid=21943): Launched 19:23:13.700520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:14.250584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21945): Launched 19:23:14.372935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:14.642904 run patchelf(pid=21946): Launched 19:23:14.819761 run osmo-stp_10.42.42.5(pid=21943): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21943)] 19:23:14.955189 run osmo-stp_10.42.42.5(pid=21943): stdout: | (launched: 2022-12-13_19:23:13.521086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:15.091766 run osmo-stp_10.42.42.5(pid=21943): stderr: | 20221213192313709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192313710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192313710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192313710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192313711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192313711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192313711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:15.228884 run osmo-stp_10.42.42.5(pid=21943): stdout: | (launched: 2022-12-13_19:23:13.521086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:15.360101 run osmo-stp_10.42.42.5(pid=21943): stderr: | 20221213192313709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192313710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192313710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192313710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192313711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192313711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192313711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:15.515815 run patchelf(pid=21946): Terminating (SIGINT) 19:23:15.693774 run patchelf(pid=21946): Terminated: ok {rc=0} 19:23:15.822442 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21943): Process ended prematurely: osmo-stp_10.42.42.5(pid=21943) [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21943)] [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:23:15.832383 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 19:23:15.865875 run osmo-hlr_10.42.42.2(pid=21940): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21940)] 19:23:15.923626 run osmo-hlr_10.42.42.2(pid=21940): stdout: | (launched: 2022-12-13_19:23:12.529527) 19:23:15.977533 run osmo-hlr_10.42.42.2(pid=21940): stderr: | 20221213192312723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192312723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192312723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192312723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192312723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192312723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192312736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192312744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192312745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192312745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:16.032493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21939): Terminating (SIGTERM) 19:23:16.076217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21942): Terminating (SIGTERM) 19:23:16.121964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21945): Terminating (SIGTERM) 19:23:16.166470 --- ParallelTerminationStrategy: PID 21939 died... 19:23:16.188394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21939): Terminated: ok {rc=0} 19:23:16.237085 --- ParallelTerminationStrategy: PID 21942 died... 19:23:16.258802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21942): Terminated: ok {rc=0} 19:23:16.307347 --- ParallelTerminationStrategy: PID 21945 died... 19:23:16.328879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21945): Terminated: ok {rc=0} 19:23:16.420842 bus /gobi_0: Setting Powered False 19:23:17.523020 bus /gobi_0: Setting Powered False 19:23:18.637837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:23:19.892246 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:19.898823 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:23:19.933273 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:23:19.969199 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:23:20.023730 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:23:20.057313 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:23:20.093161 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:23:20.650674 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:23:20.656308 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:20.668100 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:23:20.739756 tst switch_tch_pdch.py: using LAC 35733 19:23:20.855962 tst switch_tch_pdch.py: using RAC 33 19:23:20.972021 tst switch_tch_pdch.py: using CellId 35733 19:23:21.092493 tst switch_tch_pdch.py: using BVCI 35734 19:23:21.201539 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.212654 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.223581 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.234365 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.245121 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.255908 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.266876 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:23:21.277724 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:23:21.397074 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:23:21.516560 tst switch_tch_pdch.py:51: start network... 19:23:21.732287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:22.199511 run create_hlr_db(pid=21950): Launched 19:23:22.322102 bus /gobi_6: Setting Powered False 19:23:23.386056 run create_hlr_db(pid=21950): Terminated: ok {rc=0} 19:23:23.786833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21952): Launched 19:23:24.085910 run osmo-hlr_10.42.42.2(pid=21953): Launched 19:23:24.198362 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:24.684661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21955): Launched 19:23:24.982650 run osmo-stp_10.42.42.5(pid=21956): Launched 19:23:25.095056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:23:25.581800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21958): Launched 19:23:25.695449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:23:25.947890 run patchelf(pid=21959): Launched 19:23:26.112808 run osmo-stp_10.42.42.5(pid=21956): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21956)] 19:23:26.239259 run osmo-stp_10.42.42.5(pid=21956): stdout: | (launched: 2022-12-13_19:23:24.927885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:26.367025 run osmo-stp_10.42.42.5(pid=21956): stderr: | 20221213192325093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192325093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192325093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192325094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192325094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192325094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192325094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:26.495173 run osmo-stp_10.42.42.5(pid=21956): stdout: | (launched: 2022-12-13_19:23:24.927885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:26.617842 run osmo-stp_10.42.42.5(pid=21956): stderr: | 20221213192325093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192325093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192325093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192325094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192325094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192325094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192325094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:26.763471 run patchelf(pid=21959): Terminating (SIGINT) 19:23:26.930195 run patchelf(pid=21959): Terminated: ok {rc=0} 19:23:27.050865 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21956): Process ended prematurely: osmo-stp_10.42.42.5(pid=21956) [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21956)] [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:23:27.059644 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 19:23:27.086025 run osmo-hlr_10.42.42.2(pid=21953): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21953)] 19:23:27.134158 run osmo-hlr_10.42.42.2(pid=21953): stdout: | (launched: 2022-12-13_19:23:24.030956) 19:23:27.183704 run osmo-hlr_10.42.42.2(pid=21953): stderr: | 20221213192324201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192324201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192324201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192324201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192324201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192324201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192324214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192324222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192324223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192324223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:27.233652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21952): Terminating (SIGTERM) 19:23:27.273585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21955): Terminating (SIGTERM) 19:23:27.313335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21958): Terminating (SIGTERM) 19:23:27.353799 --- ParallelTerminationStrategy: PID 21952 died... 19:23:27.372901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21952): Terminated: ok {rc=0} 19:23:27.417144 --- ParallelTerminationStrategy: PID 21955 died... 19:23:27.435664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21955): Terminated: ok {rc=0} 19:23:27.479336 --- ParallelTerminationStrategy: PID 21958 died... 19:23:27.498189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21958): Terminated: ok {rc=0} 19:23:27.583824 bus /gobi_0: Setting Powered False 19:23:28.683388 bus /gobi_0: Setting Powered False 19:23:29.795460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:trx-lms --------------------------------------------------------------------- 19:23:31.083156 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:31.087340 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:23:31.122968 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:23:31.132521 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:23:31.187211 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:23:31.222824 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:23:31.231915 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:23:31.765927 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:23:31.772058 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 19:23:31.787272 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 19:23:31.844531 tst mo_mt_sms.py: using LAC 35734 19:23:32.009270 tst mo_mt_sms.py: using RAC 34 19:23:32.158953 tst mo_mt_sms.py: using CellId 35734 19:23:32.294738 tst mo_mt_sms.py: using BVCI 35735 19:23:32.402839 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:23:32.521686 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 19:23:32.635698 tst mo_mt_sms.py:9: start nitb and bts... 19:23:32.836352 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:23:33.444321 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21963): Launched 19:23:33.742196 run osmo-nitb_10.42.42.2(pid=21964): Launched 19:23:33.907054 run osmo-nitb_10.42.42.2(pid=21964): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21964)] 19:23:34.041983 run osmo-nitb_10.42.42.2(pid=21964): stdout: | (launched: 2022-12-13_19:23:33.687405) 19:23:34.177610 run osmo-nitb_10.42.42.2(pid=21964): stderr: | (launched: 2022-12-13_19:23:33.731627) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:23:34.313130 run osmo-nitb_10.42.42.2(pid=21964): stdout: | (launched: 2022-12-13_19:23:33.687405) 19:23:34.442776 run osmo-nitb_10.42.42.2(pid=21964): stderr: | (launched: 2022-12-13_19:23:33.731627) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21964): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21964) [trial-2393↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21964)] 19:23:34.855149 tst osmo-nitb_10.42.42.2(pid=21964): stdout: | (launched: 2022-12-13_19:23:33.687405) 19:23:34.975870 tst osmo-nitb_10.42.42.2(pid=21964): stderr: | (launched: 2022-12-13_19:23:33.731627) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:23:35.118250 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21964): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21964) [trial-2393↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21964)] [trial-2393↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 19:23:35.126880 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:23:35.133707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21963): Terminating (SIGTERM) 19:23:35.343017 --- ParallelTerminationStrategy: PID 21963 died... 19:23:35.363811 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21963): Terminated: ok {rc=0} 19:23:35.451202 bus /sierra_3: Setting Powered False 19:23:36.552254 bus /sierra_3: Setting Powered False 19:23:37.668598 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:trx-lms --------------------------------------------------------------------- 19:23:38.869645 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:38.874410 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 19:23:38.908406 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:23:38.938003 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 19:23:38.991515 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 19:23:39.025927 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:23:39.054253 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 19:23:39.600856 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 19:23:39.606401 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:39.617653 tst sms:trx-lms: Using 1 x bts (candidates: 1) 19:23:39.669338 tst mo_mt_sms.py: using LAC 35735 19:23:39.792889 tst mo_mt_sms.py: using RAC 35 19:23:39.919005 tst mo_mt_sms.py: using CellId 35735 19:23:40.042974 tst mo_mt_sms.py: using BVCI 35736 19:23:40.159783 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:40.170833 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:40.181826 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:40.192608 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:40.204107 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:40.215555 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:23:40.332109 tst sms:trx-lms: Using 1 x modem (candidates: 2) 19:23:40.454823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:40.949518 run create_hlr_db(pid=21968): Launched 19:23:41.070932 bus /sierra_2: Setting Powered False 19:23:42.133891 run create_hlr_db(pid=21968): Terminated: ok {rc=0} 19:23:42.560536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Launched 19:23:42.859122 run osmo-hlr_10.42.42.2(pid=21971): Launched 19:23:42.972086 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:43.484879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Launched 19:23:43.782546 run osmo-stp_10.42.42.5(pid=21974): Launched 19:23:43.895930 run osmo-msc_10.42.42.6: Starting osmo-msc 19:23:44.437838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21976): Launched 19:23:44.735038 run osmo-msc_10.42.42.6(pid=21977): Launched 19:23:44.901312 run osmo-stp_10.42.42.5(pid=21974): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] 19:23:45.027160 run osmo-stp_10.42.42.5(pid=21974): stdout: | (launched: 2022-12-13_19:23:43.727601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:45.152912 run osmo-stp_10.42.42.5(pid=21974): stderr: | 20221213192343895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192343896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192343896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192343896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192343897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192343897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192343897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:45.276696 run osmo-stp_10.42.42.5(pid=21974): stdout: | (launched: 2022-12-13_19:23:43.727601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:23:45.395599 run osmo-stp_10.42.42.5(pid=21974): stderr: | 20221213192343895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192343896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192343896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192343896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192343897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192343897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192343897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:23:45.537901 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21974): Process ended prematurely: osmo-stp_10.42.42.5(pid=21974) [trial-2393↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] [trial-2393↪sms:trx-lms↪mo_mt_sms.py:16] 19:23:45.546336 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 19:23:45.572421 run osmo-hlr_10.42.42.2(pid=21971): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21971)] 19:23:45.620398 run osmo-hlr_10.42.42.2(pid=21971): stdout: | (launched: 2022-12-13_19:23:42.804072) 19:23:45.669861 run osmo-hlr_10.42.42.2(pid=21971): stderr: | 20221213192342977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192342977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192342977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192342977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192342977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192342977 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192342988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192342997 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192342997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192342998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:23:45.738608 run osmo-msc_10.42.42.6(pid=21977): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21977)] 19:23:45.786168 run osmo-msc_10.42.42.6(pid=21977): stdout: | (launched: 2022-12-13_19:23:44.679896) 19:23:45.835195 run osmo-msc_10.42.42.6(pid=21977): stderr: | 20221213192344946 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192344947 DLGLOBAL DEBUG validating counter group 0x7f404a69ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192344947 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192344947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192344947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192344947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192344949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192344949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192344949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192344950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:23:45.886915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Terminating (SIGTERM) 19:23:45.941784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Terminating (SIGTERM) 19:23:45.982169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21976): Terminating (SIGTERM) 19:23:46.023047 --- ParallelTerminationStrategy: PID 21970 died... 19:23:46.043099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21970): Terminated: ok {rc=0} 19:23:46.089865 --- ParallelTerminationStrategy: PID 21973 died... 19:23:46.109537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21973): Terminated: ok {rc=0} 19:23:46.154117 --- ParallelTerminationStrategy: PID 21976 died... 19:23:46.173207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21976): Terminated: ok {rc=0} 19:23:46.264790 bus /sierra_3: Setting Powered False 19:23:47.378638 bus /sierra_3: Setting Powered False 19:23:48.494357 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-lms --------------------------------------------------------------------- 19:23:49.726547 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:49.731134 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:23:49.764294 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 19:23:49.771306 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:23:49.807407 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:23:49.841929 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 19:23:49.849291 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:23:50.367293 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 19:23:50.372697 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 19:23:50.384080 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 19:23:50.433901 tst assert_extension.py: using LAC 35736 19:23:50.552439 tst assert_extension.py: using RAC 36 19:23:50.673296 tst assert_extension.py: using CellId 35736 19:23:50.790979 tst assert_extension.py: using BVCI 35737 19:23:50.898251 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 19:23:51.017302 tst assert_extension.py:10: start nitb and bts... 19:23:51.232695 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:23:51.886163 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21982): Launched 19:23:52.206122 run osmo-nitb_10.42.42.2(pid=21983): Launched 19:23:52.383031 run osmo-nitb_10.42.42.2(pid=21983): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21983)] 19:23:52.526691 run osmo-nitb_10.42.42.2(pid=21983): stdout: | (launched: 2022-12-13_19:23:52.147334) 19:23:52.671081 run osmo-nitb_10.42.42.2(pid=21983): stderr: | (launched: 2022-12-13_19:23:52.195328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:23:52.815563 run osmo-nitb_10.42.42.2(pid=21983): stdout: | (launched: 2022-12-13_19:23:52.147334) 19:23:52.954554 run osmo-nitb_10.42.42.2(pid=21983): stderr: | (launched: 2022-12-13_19:23:52.195328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21983): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21983) [trial-2393↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21983)] 19:23:53.326615 tst osmo-nitb_10.42.42.2(pid=21983): stdout: | (launched: 2022-12-13_19:23:52.147334) 19:23:53.456366 tst osmo-nitb_10.42.42.2(pid=21983): stderr: | (launched: 2022-12-13_19:23:52.195328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:23:53.609338 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21983): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21983) [trial-2393↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21983)] [trial-2393↪nitb_ussd:trx-lms↪assert_extension.py:12] 19:23:53.618657 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:23:53.625934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21982): Terminating (SIGTERM) 19:23:53.837536 --- ParallelTerminationStrategy: PID 21982 died... 19:23:53.860517 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21982): Terminated: ok {rc=0} 19:23:53.950337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:trx-lms --------------------------------------------------------------------- 19:23:55.132346 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:23:55.136617 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 19:23:55.170650 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:23:55.198654 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 19:23:55.235708 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 19:23:55.270617 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:23:55.298571 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 19:23:55.826890 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:trx-lms assert_extension.py ---------------------------------------------- 19:23:55.832382 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:55.843662 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 19:23:55.893094 tst assert_extension.py: using LAC 35737 19:23:56.017363 tst assert_extension.py: using RAC 37 19:23:56.142181 tst assert_extension.py: using CellId 35737 19:23:56.266479 tst assert_extension.py: using BVCI 35738 19:23:56.381850 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:56.393063 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:56.404354 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:56.415430 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:56.427352 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 19:23:56.439251 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 19:23:56.554756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:23:57.015707 run create_hlr_db(pid=21988): Launched 19:23:57.138273 bus /sierra_2: Setting Powered False 19:23:58.198434 run create_hlr_db(pid=21988): Terminated: ok {rc=0} 19:23:58.635832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Launched 19:23:58.956685 run osmo-hlr_10.42.42.2(pid=21991): Launched 19:23:59.079025 run osmo-stp_10.42.42.5: Starting osmo-stp 19:23:59.633980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Launched 19:23:59.953185 run osmo-stp_10.42.42.5(pid=21994): Launched 19:24:00.074893 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:00.651066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Launched 19:24:01.034304 run osmo-msc_10.42.42.6(pid=22013): Launched 19:24:01.362013 run osmo-stp_10.42.42.5(pid=21994): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] 19:24:01.672728 run osmo-stp_10.42.42.5(pid=21994): stdout: | (launched: 2022-12-13_19:23:59.894650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:01.825657 run osmo-stp_10.42.42.5(pid=21994): stderr: | 20221213192400082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192400083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192400083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192400083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192400084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192400084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192400084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:01.961093 run osmo-stp_10.42.42.5(pid=21994): stdout: | (launched: 2022-12-13_19:23:59.894650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:02.094361 run osmo-stp_10.42.42.5(pid=21994): stderr: | 20221213192400082 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192400083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192400083 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192400083 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192400084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192400084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192400084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:02.257267 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21994): Process ended prematurely: osmo-stp_10.42.42.5(pid=21994) [trial-2393↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] [trial-2393↪ussd:trx-lms↪assert_extension.py:17] 19:24:02.266720 tst assert_extension.py:17: Test FAILED (6.4 sec) 19:24:02.299862 run osmo-hlr_10.42.42.2(pid=21991): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21991)] 19:24:02.350613 run osmo-hlr_10.42.42.2(pid=21991): stdout: | (launched: 2022-12-13_19:23:58.898454) 19:24:02.407683 run osmo-hlr_10.42.42.2(pid=21991): stderr: | 20221213192359092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192359092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192359092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192359092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192359092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192359092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192359105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192359114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192359114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192359114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:02.491403 run osmo-msc_10.42.42.6(pid=22013): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22013)] 19:24:02.547465 run osmo-msc_10.42.42.6(pid=22013): stdout: | (launched: 2022-12-13_19:24:00.953868) 19:24:02.598118 run osmo-msc_10.42.42.6(pid=22013): stderr: | 20221213192401507 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192401508 DLGLOBAL DEBUG validating counter group 0x7fd3a86c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192401508 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192401508 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192401508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192401508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192401510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192401510 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192401510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192401510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:02.658268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Terminating (SIGTERM) 19:24:02.701370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Terminating (SIGTERM) 19:24:02.745849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Terminating (SIGTERM) 19:24:02.795384 --- ParallelTerminationStrategy: PID 21990 died... 19:24:02.815563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21990): Terminated: ok {rc=0} 19:24:02.872249 --- ParallelTerminationStrategy: PID 21993 died... 19:24:02.896449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21993): Terminated: ok {rc=0} 19:24:02.956699 --- ParallelTerminationStrategy: PID 21996 died... 19:24:02.982418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21996): Terminated: ok {rc=0} 19:24:03.090692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:24:04.322030 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:04.329966 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:24:04.368759 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:24:04.398898 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:24:04.457064 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:24:04.492274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:24:04.521973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:24:05.069685 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:24:05.128174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.141023 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:24:05.214304 tst mo_mt_call.py: using LAC 35738 19:24:05.342928 tst mo_mt_call.py: using RAC 38 19:24:05.471824 tst mo_mt_call.py: using CellId 35738 19:24:05.601322 tst mo_mt_call.py: using BVCI 35739 19:24:05.723923 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.736724 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.750078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.762650 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.776613 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:05.790417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:24:05.918437 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:24:06.043523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:06.562282 run create_hlr_db(pid=22275): Launched 19:24:06.719135 bus /sierra_2: Setting Powered False 19:24:07.781696 run create_hlr_db(pid=22275): Terminated: ok {rc=0} 19:24:08.218480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22277): Launched 19:24:08.545261 run osmo-hlr_10.42.42.2(pid=22278): Launched 19:24:08.786834 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:09.491159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22280): Launched 19:24:09.818988 run osmo-stp_10.42.42.5(pid=22281): Launched 19:24:10.052924 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:10.777710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22283): Launched 19:24:11.103335 run osmo-msc_10.42.42.6(pid=22284): Launched 19:24:11.459339 run osmo-stp_10.42.42.5(pid=22281): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22281)] 19:24:11.726874 run osmo-stp_10.42.42.5(pid=22281): stdout: | (launched: 2022-12-13_19:24:09.761408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:12.010866 run osmo-stp_10.42.42.5(pid=22281): stderr: | 20221213192410085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192410086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192410086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192410086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192410087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192410087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192410087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:12.160290 run osmo-stp_10.42.42.5(pid=22281): stdout: | (launched: 2022-12-13_19:24:09.761408) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:12.286157 run osmo-stp_10.42.42.5(pid=22281): stderr: | 20221213192410085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192410086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192410086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192410086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192410087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192410087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192410087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:12.436424 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22281): Process ended prematurely: osmo-stp_10.42.42.5(pid=22281) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22281)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:24:12.446670 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 19:24:12.474870 run osmo-hlr_10.42.42.2(pid=22278): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22278)] 19:24:12.527173 run osmo-hlr_10.42.42.2(pid=22278): stdout: | (launched: 2022-12-13_19:24:08.487596) 19:24:12.579818 run osmo-hlr_10.42.42.2(pid=22278): stderr: | 20221213192408825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192408825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192408826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192408826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192408826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192408826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192408839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192408847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192408847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192408847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:12.651431 run osmo-msc_10.42.42.6(pid=22284): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22284)] 19:24:12.702640 run osmo-msc_10.42.42.6(pid=22284): stdout: | (launched: 2022-12-13_19:24:11.044696) 19:24:12.758049 run osmo-msc_10.42.42.6(pid=22284): stderr: | 20221213192411626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192411626 DLGLOBAL DEBUG validating counter group 0x7f180e385c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192411626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192411626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192411626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192411627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192411628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192411637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192411637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192411637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:12.809457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22277): Terminating (SIGTERM) 19:24:12.851249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22280): Terminating (SIGTERM) 19:24:12.895901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22283): Terminating (SIGTERM) 19:24:12.940048 --- ParallelTerminationStrategy: PID 22277 died... 19:24:12.960230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22277): Terminated: ok {rc=0} 19:24:13.007265 --- ParallelTerminationStrategy: PID 22280 died... 19:24:13.027634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22280): Terminated: ok {rc=0} 19:24:13.073435 --- ParallelTerminationStrategy: PID 22283 died... 19:24:13.094179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22283): Terminated: ok {rc=0} 19:24:13.181816 bus /sierra_3: Setting Powered False 19:24:14.283358 bus /sierra_3: Setting Powered False 19:24:15.405216 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:24:16.592100 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:16.607747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:24:16.699381 tst mo_mt_call_osmux.py: using LAC 35739 19:24:16.869718 tst mo_mt_call_osmux.py: using RAC 39 19:24:17.063573 tst mo_mt_call_osmux.py: using CellId 35739 19:24:17.188460 tst mo_mt_call_osmux.py: using BVCI 35740 19:24:17.338798 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:17.350274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:17.361571 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:17.372694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:17.384212 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:24:17.395447 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:24:17.546544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:24:17.700159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:18.188452 run create_hlr_db(pid=22286): Launched 19:24:18.347701 bus /sierra_2: Setting Powered False 19:24:19.410466 run create_hlr_db(pid=22286): Terminated: ok {rc=0} 19:24:19.854813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22288): Launched 19:24:20.184906 run osmo-hlr_10.42.42.2(pid=22289): Launched 19:24:20.431886 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:21.144783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22291): Launched 19:24:21.474212 run osmo-stp_10.42.42.5(pid=22292): Launched 19:24:21.721847 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:22.440581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22294): Launched 19:24:22.773058 run osmo-msc_10.42.42.6(pid=22295): Launched 19:24:23.128610 run osmo-stp_10.42.42.5(pid=22292): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22292)] 19:24:23.404911 run osmo-stp_10.42.42.5(pid=22292): stdout: | (launched: 2022-12-13_19:24:21.415359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:23.696459 run osmo-stp_10.42.42.5(pid=22292): stderr: | 20221213192421742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192421742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192421743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192421743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192421743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192421743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192421744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:23.845249 run osmo-stp_10.42.42.5(pid=22292): stdout: | (launched: 2022-12-13_19:24:21.415359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:23.973074 run osmo-stp_10.42.42.5(pid=22292): stderr: | 20221213192421742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192421742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192421743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192421743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192421743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192421743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192421744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:24.124600 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22292): Process ended prematurely: osmo-stp_10.42.42.5(pid=22292) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22292)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:24:24.135255 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 19:24:24.163741 run osmo-hlr_10.42.42.2(pid=22289): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22289)] 19:24:24.215012 run osmo-hlr_10.42.42.2(pid=22289): stdout: | (launched: 2022-12-13_19:24:20.126914) 19:24:24.267621 run osmo-hlr_10.42.42.2(pid=22289): stderr: | 20221213192420467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192420467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192420467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192420468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192420468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192420468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192420480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192420498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192420498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192420498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:24.341745 run osmo-msc_10.42.42.6(pid=22295): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22295)] 19:24:24.395181 run osmo-msc_10.42.42.6(pid=22295): stdout: | (launched: 2022-12-13_19:24:22.712210) 19:24:24.447294 run osmo-msc_10.42.42.6(pid=22295): stderr: | 20221213192423303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192423304 DLGLOBAL DEBUG validating counter group 0x7fdfbb76dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192423304 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192423304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192423304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192423304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192423314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192423315 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192423315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192423315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:24.497901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22288): Terminating (SIGTERM) 19:24:24.538300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22291): Terminating (SIGTERM) 19:24:24.579422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22294): Terminating (SIGTERM) 19:24:24.620068 --- ParallelTerminationStrategy: PID 22288 died... 19:24:24.639591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22288): Terminated: ok {rc=0} 19:24:24.684388 --- ParallelTerminationStrategy: PID 22291 died... 19:24:24.703638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22291): Terminated: ok {rc=0} 19:24:24.748010 --- ParallelTerminationStrategy: PID 22294 died... 19:24:24.766914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22294): Terminated: ok {rc=0} 19:24:24.853312 bus /sierra_3: Setting Powered False 19:24:25.954067 bus /sierra_3: Setting Powered False 19:24:27.070042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:24:28.320319 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:28.326953 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:24:28.360187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:24:28.387224 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:24:28.440366 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:24:28.474152 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:24:28.501377 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:24:29.056810 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:24:29.109618 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.121320 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:24:29.191282 tst mo_mt_call.py: using LAC 35740 19:24:29.316574 tst mo_mt_call.py: using RAC 40 19:24:29.442757 tst mo_mt_call.py: using CellId 35740 19:24:29.568605 tst mo_mt_call.py: using BVCI 35741 19:24:29.686416 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.698119 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.709606 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.721033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.732848 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:29.744705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:24:29.861542 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:24:29.982032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:30.489640 run create_hlr_db(pid=22300): Launched 19:24:30.613550 bus /sierra_2: Setting Powered False 19:24:31.677113 run create_hlr_db(pid=22300): Terminated: ok {rc=0} 19:24:32.143284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Launched 19:24:32.471764 run osmo-hlr_10.42.42.2(pid=22303): Launched 19:24:32.590573 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:33.131724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Launched 19:24:33.436911 run osmo-stp_10.42.42.5(pid=22306): Launched 19:24:33.555336 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:34.105123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22308): Launched 19:24:34.410017 run osmo-msc_10.42.42.6(pid=22309): Launched 19:24:34.581581 run osmo-stp_10.42.42.5(pid=22306): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] 19:24:34.709910 run osmo-stp_10.42.42.5(pid=22306): stdout: | (launched: 2022-12-13_19:24:33.380808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:34.838149 run osmo-stp_10.42.42.5(pid=22306): stderr: | 20221213192433550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192433550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192433550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192433551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192433551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192433551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192433551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:34.964352 run osmo-stp_10.42.42.5(pid=22306): stdout: | (launched: 2022-12-13_19:24:33.380808) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:35.085695 run osmo-stp_10.42.42.5(pid=22306): stderr: | 20221213192433550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192433550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192433550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192433551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192433551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192433551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192433551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:35.231239 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22306): Process ended prematurely: osmo-stp_10.42.42.5(pid=22306) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:24:35.240323 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:24:35.266905 run osmo-hlr_10.42.42.2(pid=22303): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22303)] 19:24:35.315166 run osmo-hlr_10.42.42.2(pid=22303): stdout: | (launched: 2022-12-13_19:24:32.415014) 19:24:35.365128 run osmo-hlr_10.42.42.2(pid=22303): stderr: | 20221213192432592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192432592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192432592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192432592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192432592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192432592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192432604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192432615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192432615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192432615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:35.434195 run osmo-msc_10.42.42.6(pid=22309): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22309)] 19:24:35.482201 run osmo-msc_10.42.42.6(pid=22309): stdout: | (launched: 2022-12-13_19:24:34.353865) 19:24:35.531662 run osmo-msc_10.42.42.6(pid=22309): stderr: | 20221213192434622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192434623 DLGLOBAL DEBUG validating counter group 0x7f91d45d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192434623 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192434623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192434623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192434623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192434625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192434625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192434626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192434626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:35.581698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Terminating (SIGTERM) 19:24:35.621719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Terminating (SIGTERM) 19:24:35.661580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22308): Terminating (SIGTERM) 19:24:35.701834 --- ParallelTerminationStrategy: PID 22302 died... 19:24:35.721261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22302): Terminated: ok {rc=0} 19:24:35.765341 --- ParallelTerminationStrategy: PID 22305 died... 19:24:35.783957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22305): Terminated: ok {rc=0} 19:24:35.827749 --- ParallelTerminationStrategy: PID 22308 died... 19:24:35.846649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22308): Terminated: ok {rc=0} 19:24:35.933045 bus /sierra_3: Setting Powered False 19:24:37.033624 bus /sierra_3: Setting Powered False 19:24:38.149631 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:24:39.297527 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.309475 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:24:39.379824 tst mo_mt_call_osmux.py: using LAC 35741 19:24:39.500255 tst mo_mt_call_osmux.py: using RAC 41 19:24:39.620487 tst mo_mt_call_osmux.py: using CellId 35741 19:24:39.741176 tst mo_mt_call_osmux.py: using BVCI 35742 19:24:39.850562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.861778 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.872663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.883780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.894846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:24:39.905794 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:24:40.026334 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:24:40.144671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:40.617132 run create_hlr_db(pid=22311): Launched 19:24:40.741179 bus /sierra_2: Setting Powered False 19:24:41.801938 run create_hlr_db(pid=22311): Terminated: ok {rc=0} 19:24:42.247161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22313): Launched 19:24:42.575571 run osmo-hlr_10.42.42.2(pid=22314): Launched 19:24:42.700621 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:43.261488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22316): Launched 19:24:43.587043 run osmo-stp_10.42.42.5(pid=22317): Launched 19:24:43.712692 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:44.302791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22319): Launched 19:24:44.631808 run osmo-msc_10.42.42.6(pid=22320): Launched 19:24:44.810462 run osmo-stp_10.42.42.5(pid=22317): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22317)] 19:24:44.940730 run osmo-stp_10.42.42.5(pid=22317): stdout: | (launched: 2022-12-13_19:24:43.527749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:45.068899 run osmo-stp_10.42.42.5(pid=22317): stderr: | 20221213192443718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192443718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192443719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192443719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192443720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192443720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192443720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:45.195287 run osmo-stp_10.42.42.5(pid=22317): stdout: | (launched: 2022-12-13_19:24:43.527749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:45.316693 run osmo-stp_10.42.42.5(pid=22317): stderr: | 20221213192443718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192443718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192443719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192443719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192443720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192443720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192443720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:45.461602 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22317): Process ended prematurely: osmo-stp_10.42.42.5(pid=22317) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22317)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:24:45.471021 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:24:45.497668 run osmo-hlr_10.42.42.2(pid=22314): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22314)] 19:24:45.545766 run osmo-hlr_10.42.42.2(pid=22314): stdout: | (launched: 2022-12-13_19:24:42.515772) 19:24:45.595203 run osmo-hlr_10.42.42.2(pid=22314): stderr: | 20221213192442713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192442713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192442713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192442713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192442713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192442713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192442726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192442735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192442735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192442735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:45.665233 run osmo-msc_10.42.42.6(pid=22320): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22320)] 19:24:45.713174 run osmo-msc_10.42.42.6(pid=22320): stdout: | (launched: 2022-12-13_19:24:44.571852) 19:24:45.763010 run osmo-msc_10.42.42.6(pid=22320): stderr: | 20221213192444856 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192444856 DLGLOBAL DEBUG validating counter group 0x7fedc363ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192444856 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192444856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192444857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192444857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192444859 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192444859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192444859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192444859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:45.813256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22313): Terminating (SIGTERM) 19:24:45.868794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22316): Terminating (SIGTERM) 19:24:45.912391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22319): Terminating (SIGTERM) 19:24:45.956151 --- ParallelTerminationStrategy: PID 22313 died... 19:24:45.976413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22313): Terminated: ok {rc=0} 19:24:46.023465 --- ParallelTerminationStrategy: PID 22316 died... 19:24:46.043181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22316): Terminated: ok {rc=0} 19:24:46.088475 --- ParallelTerminationStrategy: PID 22319 died... 19:24:46.108528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22319): Terminated: ok {rc=0} 19:24:46.195585 bus /sierra_3: Setting Powered False 19:24:47.296051 bus /sierra_3: Setting Powered False 19:24:48.412513 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:24:49.666738 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:24:49.673336 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:24:49.706289 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:24:49.734425 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:24:49.788192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:24:49.822084 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:24:49.849950 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:24:50.397721 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:24:50.447168 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:50.458655 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:24:50.528577 tst mo_mt_call.py: using LAC 35742 19:24:50.657386 tst mo_mt_call.py: using RAC 42 19:24:50.787929 tst mo_mt_call.py: using CellId 35742 19:24:50.908341 tst mo_mt_call.py: using BVCI 35743 19:24:51.018686 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:51.030164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:51.041455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:51.052430 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:51.063941 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:24:51.075440 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:24:51.195771 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:24:51.316317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:24:51.791050 run create_hlr_db(pid=22326): Launched 19:24:51.916069 bus /sierra_2: Setting Powered False 19:24:52.977697 run create_hlr_db(pid=22326): Terminated: ok {rc=0} 19:24:53.405171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Launched 19:24:53.712103 run osmo-hlr_10.42.42.2(pid=22329): Launched 19:24:53.828229 run osmo-stp_10.42.42.5: Starting osmo-stp 19:24:54.357281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Launched 19:24:54.662064 run osmo-stp_10.42.42.5(pid=22332): Launched 19:24:54.778361 run osmo-msc_10.42.42.6: Starting osmo-msc 19:24:55.327888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Launched 19:24:55.633010 run osmo-msc_10.42.42.6(pid=22335): Launched 19:24:55.803686 run osmo-stp_10.42.42.5(pid=22332): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] 19:24:55.932567 run osmo-stp_10.42.42.5(pid=22332): stdout: | (launched: 2022-12-13_19:24:54.605501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:56.060590 run osmo-stp_10.42.42.5(pid=22332): stderr: | 20221213192454776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192454776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192454776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192454777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192454777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192454777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192454777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:56.187161 run osmo-stp_10.42.42.5(pid=22332): stdout: | (launched: 2022-12-13_19:24:54.605501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:24:56.308726 run osmo-stp_10.42.42.5(pid=22332): stderr: | 20221213192454776 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192454776 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192454776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192454777 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192454777 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192454777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192454777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:24:56.454235 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22332): Process ended prematurely: osmo-stp_10.42.42.5(pid=22332) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:24:56.463150 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:24:56.490221 run osmo-hlr_10.42.42.2(pid=22329): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22329)] 19:24:56.539086 run osmo-hlr_10.42.42.2(pid=22329): stdout: | (launched: 2022-12-13_19:24:53.654705) 19:24:56.589668 run osmo-hlr_10.42.42.2(pid=22329): stderr: | 20221213192453831 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192453831 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192453831 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192453831 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192453831 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192453831 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192453844 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192453853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192453853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192453853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:24:56.659601 run osmo-msc_10.42.42.6(pid=22335): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22335)] 19:24:56.708049 run osmo-msc_10.42.42.6(pid=22335): stdout: | (launched: 2022-12-13_19:24:55.576667) 19:24:56.758095 run osmo-msc_10.42.42.6(pid=22335): stderr: | 20221213192455850 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192455850 DLGLOBAL DEBUG validating counter group 0x7f8160a78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192455850 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192455850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192455850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192455851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192455852 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192455853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192455853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192455853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:24:56.808166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Terminating (SIGTERM) 19:24:56.848086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Terminating (SIGTERM) 19:24:56.888031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Terminating (SIGTERM) 19:24:56.928269 --- ParallelTerminationStrategy: PID 22328 died... 19:24:56.947652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22328): Terminated: ok {rc=0} 19:24:56.991902 --- ParallelTerminationStrategy: PID 22331 died... 19:24:57.010649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22331): Terminated: ok {rc=0} 19:24:57.054886 --- ParallelTerminationStrategy: PID 22334 died... 19:24:57.073700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22334): Terminated: ok {rc=0} 19:24:57.160599 bus /sierra_3: Setting Powered False 19:24:58.263705 bus /sierra_3: Setting Powered False 19:24:59.383088 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:25:00.535421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:00.547747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:25:00.620800 tst mo_mt_call_osmux.py: using LAC 35743 19:25:00.749400 tst mo_mt_call_osmux.py: using RAC 43 19:25:00.894179 tst mo_mt_call_osmux.py: using CellId 35743 19:25:01.031389 tst mo_mt_call_osmux.py: using BVCI 35744 19:25:01.164920 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:01.176906 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:01.188707 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:01.200756 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:01.212734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:25:01.224671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:25:01.341782 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:25:01.482289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:02.059981 run create_hlr_db(pid=22341): Launched 19:25:02.223871 bus /sierra_2: Setting Powered False 19:25:03.288924 run create_hlr_db(pid=22341): Terminated: ok {rc=0} 19:25:03.743669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22343): Launched 19:25:04.070146 run osmo-hlr_10.42.42.2(pid=22344): Launched 19:25:04.196573 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:04.763346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22346): Launched 19:25:05.090662 run osmo-stp_10.42.42.5(pid=22347): Launched 19:25:05.216580 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:05.807705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22349): Launched 19:25:06.135201 run osmo-msc_10.42.42.6(pid=22350): Launched 19:25:06.318442 run osmo-stp_10.42.42.5(pid=22347): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22347)] 19:25:06.456431 run osmo-stp_10.42.42.5(pid=22347): stdout: | (launched: 2022-12-13_19:25:05.031161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:06.594867 run osmo-stp_10.42.42.5(pid=22347): stderr: | 20221213192505221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192505222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192505222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192505222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192505223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192505223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192505223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:06.731053 run osmo-stp_10.42.42.5(pid=22347): stdout: | (launched: 2022-12-13_19:25:05.031161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:06.861651 run osmo-stp_10.42.42.5(pid=22347): stderr: | 20221213192505221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192505222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192505222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192505222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192505223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192505223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192505223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:07.017633 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22347): Process ended prematurely: osmo-stp_10.42.42.5(pid=22347) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22347)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:25:07.027009 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:25:07.055302 run osmo-hlr_10.42.42.2(pid=22344): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22344)] 19:25:07.106568 run osmo-hlr_10.42.42.2(pid=22344): stdout: | (launched: 2022-12-13_19:25:04.010458) 19:25:07.159102 run osmo-hlr_10.42.42.2(pid=22344): stderr: | 20221213192504207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192504207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192504207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192504207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192504207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192504207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192504219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192504228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192504229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192504229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:07.232383 run osmo-msc_10.42.42.6(pid=22350): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22350)] 19:25:07.282749 run osmo-msc_10.42.42.6(pid=22350): stdout: | (launched: 2022-12-13_19:25:06.075405) 19:25:07.335455 run osmo-msc_10.42.42.6(pid=22350): stderr: | 20221213192506397 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192506397 DLGLOBAL DEBUG validating counter group 0x7fa1bf036c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192506397 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192506397 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192506397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192506398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192506399 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192506400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192506400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192506400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:07.388038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22343): Terminating (SIGTERM) 19:25:07.430498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22346): Terminating (SIGTERM) 19:25:07.473220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22349): Terminating (SIGTERM) 19:25:07.516612 --- ParallelTerminationStrategy: PID 22343 died... 19:25:07.536853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22343): Terminated: ok {rc=0} 19:25:07.583356 --- ParallelTerminationStrategy: PID 22346 died... 19:25:07.603365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22346): Terminated: ok {rc=0} 19:25:07.649684 --- ParallelTerminationStrategy: PID 22349 died... 19:25:07.669705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22349): Terminated: ok {rc=0} 19:25:07.758190 bus /sierra_3: Setting Powered False 19:25:08.857079 bus /sierra_3: Setting Powered False 19:25:09.972353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:25:11.220783 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:11.227597 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:25:11.260611 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:25:11.287432 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:25:11.339140 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:25:11.372278 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:25:11.398879 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:25:11.949862 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:25:11.999552 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.010848 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:25:12.079702 tst mo_mt_call.py: using LAC 35744 19:25:12.203029 tst mo_mt_call.py: using RAC 44 19:25:12.321053 tst mo_mt_call.py: using CellId 35744 19:25:12.438611 tst mo_mt_call.py: using BVCI 35745 19:25:12.550284 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.561521 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.572438 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.583400 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.594463 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:12.605567 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:25:12.725450 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:25:12.842576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:13.315588 run create_hlr_db(pid=22355): Launched 19:25:13.439313 bus /sierra_2: Setting Powered False 19:25:14.501426 run create_hlr_db(pid=22355): Terminated: ok {rc=0} 19:25:14.927680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22357): Launched 19:25:15.232622 run osmo-hlr_10.42.42.2(pid=22358): Launched 19:25:15.349142 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:15.897677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22360): Launched 19:25:16.258607 run osmo-stp_10.42.42.5(pid=22361): Launched 19:25:16.442388 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:17.201268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22363): Launched 19:25:17.540777 run osmo-msc_10.42.42.6(pid=22364): Launched 19:25:17.723039 run osmo-stp_10.42.42.5(pid=22361): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22361)] 19:25:17.860824 run osmo-stp_10.42.42.5(pid=22361): stdout: | (launched: 2022-12-13_19:25:16.197920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:17.999167 run osmo-stp_10.42.42.5(pid=22361): stderr: | 20221213192516510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192516510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192516511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192516511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192516512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192516512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192516512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:18.135966 run osmo-stp_10.42.42.5(pid=22361): stdout: | (launched: 2022-12-13_19:25:16.197920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:18.266883 run osmo-stp_10.42.42.5(pid=22361): stderr: | 20221213192516510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192516510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192516511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192516511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192516512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192516512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192516512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:18.423037 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22361): Process ended prematurely: osmo-stp_10.42.42.5(pid=22361) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22361)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:25:18.432694 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:25:18.461500 run osmo-hlr_10.42.42.2(pid=22358): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22358)] 19:25:18.514145 run osmo-hlr_10.42.42.2(pid=22358): stdout: | (launched: 2022-12-13_19:25:15.176433) 19:25:18.567294 run osmo-hlr_10.42.42.2(pid=22358): stderr: | 20221213192515352 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192515352 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192515352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192515352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192515352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192515352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192515364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192515373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192515373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192515373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:18.641090 run osmo-msc_10.42.42.6(pid=22364): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22364)] 19:25:18.692062 run osmo-msc_10.42.42.6(pid=22364): stdout: | (launched: 2022-12-13_19:25:17.480574) 19:25:18.744915 run osmo-msc_10.42.42.6(pid=22364): stderr: | 20221213192517804 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192517804 DLGLOBAL DEBUG validating counter group 0x7f23854b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192517804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192517804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192517804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192517804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192517806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192517806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192517807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192517807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:18.798212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22357): Terminating (SIGTERM) 19:25:18.840717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22360): Terminating (SIGTERM) 19:25:18.883654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22363): Terminating (SIGTERM) 19:25:18.926751 --- ParallelTerminationStrategy: PID 22357 died... 19:25:18.947344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22357): Terminated: ok {rc=0} 19:25:18.994855 --- ParallelTerminationStrategy: PID 22360 died... 19:25:19.015043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22360): Terminated: ok {rc=0} 19:25:19.062184 --- ParallelTerminationStrategy: PID 22363 died... 19:25:19.082403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22363): Terminated: ok {rc=0} 19:25:19.171690 bus /sierra_3: Setting Powered False 19:25:20.269571 bus /sierra_3: Setting Powered False 19:25:21.383205 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:25:22.533577 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:22.546062 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:25:22.618271 tst mo_mt_call_osmux.py: using LAC 35745 19:25:22.749580 tst mo_mt_call_osmux.py: using RAC 45 19:25:22.875755 tst mo_mt_call_osmux.py: using CellId 35745 19:25:23.005063 tst mo_mt_call_osmux.py: using BVCI 35746 19:25:23.124427 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:23.136219 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:23.147689 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:23.159175 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:23.171137 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:25:23.182935 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:25:23.301033 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:25:23.416547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:23.889781 run create_hlr_db(pid=22366): Launched 19:25:24.015302 bus /sierra_2: Setting Powered False 19:25:25.075872 run create_hlr_db(pid=22366): Terminated: ok {rc=0} 19:25:25.523431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22368): Launched 19:25:25.851904 run osmo-hlr_10.42.42.2(pid=22369): Launched 19:25:25.975967 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:26.542859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22371): Launched 19:25:26.870396 run osmo-stp_10.42.42.5(pid=22372): Launched 19:25:26.996461 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:27.587563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22374): Launched 19:25:27.916552 run osmo-msc_10.42.42.6(pid=22375): Launched 19:25:28.098135 run osmo-stp_10.42.42.5(pid=22372): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22372)] 19:25:28.235706 run osmo-stp_10.42.42.5(pid=22372): stdout: | (launched: 2022-12-13_19:25:26.810613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:28.373991 run osmo-stp_10.42.42.5(pid=22372): stderr: | 20221213192527002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192527002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192527003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192527003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192527003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192527003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192527004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:28.511044 run osmo-stp_10.42.42.5(pid=22372): stdout: | (launched: 2022-12-13_19:25:26.810613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:28.641360 run osmo-stp_10.42.42.5(pid=22372): stderr: | 20221213192527002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192527002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192527003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192527003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192527003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192527003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192527004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:28.797954 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22372): Process ended prematurely: osmo-stp_10.42.42.5(pid=22372) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22372)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:25:28.807589 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:25:28.835687 run osmo-hlr_10.42.42.2(pid=22369): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22369)] 19:25:28.886740 run osmo-hlr_10.42.42.2(pid=22369): stdout: | (launched: 2022-12-13_19:25:25.792101) 19:25:28.939551 run osmo-hlr_10.42.42.2(pid=22369): stderr: | 20221213192525988 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192525988 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192525988 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192525988 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192525988 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192525988 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192526004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192526013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192526014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192526014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:29.012368 run osmo-msc_10.42.42.6(pid=22375): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22375)] 19:25:29.062758 run osmo-msc_10.42.42.6(pid=22375): stdout: | (launched: 2022-12-13_19:25:27.856598) 19:25:29.114858 run osmo-msc_10.42.42.6(pid=22375): stderr: | 20221213192528177 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192528177 DLGLOBAL DEBUG validating counter group 0x7f140a3cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192528177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192528177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192528177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192528177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192528179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192528179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192528180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192528180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:29.167315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22368): Terminating (SIGTERM) 19:25:29.209618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22371): Terminating (SIGTERM) 19:25:29.252569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22374): Terminating (SIGTERM) 19:25:29.295307 --- ParallelTerminationStrategy: PID 22368 died... 19:25:29.315929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22368): Terminated: ok {rc=0} 19:25:29.363243 --- ParallelTerminationStrategy: PID 22371 died... 19:25:29.383379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22371): Terminated: ok {rc=0} 19:25:29.430076 --- ParallelTerminationStrategy: PID 22374 died... 19:25:29.450329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22374): Terminated: ok {rc=0} 19:25:29.540586 bus /sierra_3: Setting Powered False 19:25:30.640556 bus /sierra_3: Setting Powered False 19:25:31.767843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:25:33.034788 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:33.041333 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:25:33.074166 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:25:33.101065 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:25:33.152583 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:25:33.185299 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:25:33.211691 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:25:33.764029 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:25:33.813344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:33.824550 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:25:33.893437 tst mo_mt_call.py: using LAC 35746 19:25:34.015965 tst mo_mt_call.py: using RAC 46 19:25:34.135403 tst mo_mt_call.py: using CellId 35746 19:25:34.254728 tst mo_mt_call.py: using BVCI 35747 19:25:34.366210 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:34.377312 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:34.388141 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:34.398972 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:34.409969 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:34.420870 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:25:34.540179 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:25:34.656583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:35.129061 run create_hlr_db(pid=22380): Launched 19:25:35.253912 bus /sierra_2: Setting Powered False 19:25:36.314334 run create_hlr_db(pid=22380): Terminated: ok {rc=0} 19:25:36.761258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Launched 19:25:37.089056 run osmo-hlr_10.42.42.2(pid=22383): Launched 19:25:37.214158 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:37.780503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Launched 19:25:38.107623 run osmo-stp_10.42.42.5(pid=22386): Launched 19:25:38.231570 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:38.822748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22388): Launched 19:25:39.150488 run osmo-msc_10.42.42.6(pid=22389): Launched 19:25:39.333993 run osmo-stp_10.42.42.5(pid=22386): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] 19:25:39.471989 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-13_19:25:38.047637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:39.610075 run osmo-stp_10.42.42.5(pid=22386): stderr: | 20221213192538237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192538237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192538237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192538238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192538238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192538238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192538238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:39.746058 run osmo-stp_10.42.42.5(pid=22386): stdout: | (launched: 2022-12-13_19:25:38.047637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:39.876797 run osmo-stp_10.42.42.5(pid=22386): stderr: | 20221213192538237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192538237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192538237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192538238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192538238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192538238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192538238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:40.032811 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:25:40.042581 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:25:40.070418 run osmo-hlr_10.42.42.2(pid=22383): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22383)] 19:25:40.121857 run osmo-hlr_10.42.42.2(pid=22383): stdout: | (launched: 2022-12-13_19:25:37.029394) 19:25:40.174443 run osmo-hlr_10.42.42.2(pid=22383): stderr: | 20221213192537225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192537225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192537225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192537225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192537225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192537225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192537239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192537249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192537249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192537249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:40.247924 run osmo-msc_10.42.42.6(pid=22389): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22389)] 19:25:40.298365 run osmo-msc_10.42.42.6(pid=22389): stdout: | (launched: 2022-12-13_19:25:39.090529) 19:25:40.351127 run osmo-msc_10.42.42.6(pid=22389): stderr: | 20221213192539410 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192539410 DLGLOBAL DEBUG validating counter group 0x7f9bcf019c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192539410 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192539411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192539411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192539411 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192539413 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192539413 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192539413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192539413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:40.403692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminating (SIGTERM) 19:25:40.445718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminating (SIGTERM) 19:25:40.488489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22388): Terminating (SIGTERM) 19:25:40.531271 --- ParallelTerminationStrategy: PID 22382 died... 19:25:40.551666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22382): Terminated: ok {rc=0} 19:25:40.598239 --- ParallelTerminationStrategy: PID 22385 died... 19:25:40.618252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22385): Terminated: ok {rc=0} 19:25:40.664776 --- ParallelTerminationStrategy: PID 22388 died... 19:25:40.685147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22388): Terminated: ok {rc=0} 19:25:40.773845 bus /sierra_3: Setting Powered False 19:25:41.873228 bus /sierra_3: Setting Powered False 19:25:42.990347 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:25:44.141452 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.153917 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:25:44.226651 tst mo_mt_call_osmux.py: using LAC 35747 19:25:44.355036 tst mo_mt_call_osmux.py: using RAC 47 19:25:44.482256 tst mo_mt_call_osmux.py: using CellId 35747 19:25:44.609610 tst mo_mt_call_osmux.py: using BVCI 35748 19:25:44.728797 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.740576 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.752053 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.763512 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.775421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:25:44.787238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:25:44.904129 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:25:45.020448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:45.493415 run create_hlr_db(pid=22391): Launched 19:25:45.618886 bus /sierra_2: Setting Powered False 19:25:46.678063 run create_hlr_db(pid=22391): Terminated: ok {rc=0} 19:25:47.109803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22393): Launched 19:25:47.426991 run osmo-hlr_10.42.42.2(pid=22394): Launched 19:25:47.544329 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:48.084535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22396): Launched 19:25:48.387806 run osmo-stp_10.42.42.5(pid=22397): Launched 19:25:48.503002 run osmo-msc_10.42.42.6: Starting osmo-msc 19:25:49.052933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Launched 19:25:49.357743 run osmo-msc_10.42.42.6(pid=22400): Launched 19:25:49.527649 run osmo-stp_10.42.42.5(pid=22397): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22397)] 19:25:49.655839 run osmo-stp_10.42.42.5(pid=22397): stdout: | (launched: 2022-12-13_19:25:48.331849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:49.783817 run osmo-stp_10.42.42.5(pid=22397): stderr: | 20221213192548501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192548502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192548502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192548502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192548503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192548503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192548503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:49.910145 run osmo-stp_10.42.42.5(pid=22397): stdout: | (launched: 2022-12-13_19:25:48.331849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:25:50.031900 run osmo-stp_10.42.42.5(pid=22397): stderr: | 20221213192548501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192548502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192548502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192548502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192548503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192548503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192548503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:25:50.176614 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22397): Process ended prematurely: osmo-stp_10.42.42.5(pid=22397) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22397)] [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:25:50.185663 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:25:50.212036 run osmo-hlr_10.42.42.2(pid=22394): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22394)] 19:25:50.259750 run osmo-hlr_10.42.42.2(pid=22394): stdout: | (launched: 2022-12-13_19:25:47.370928) 19:25:50.309237 run osmo-hlr_10.42.42.2(pid=22394): stderr: | 20221213192547546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192547546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192547546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192547546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192547546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192547546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192547559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192547569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192547569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192547569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:25:50.378302 run osmo-msc_10.42.42.6(pid=22400): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22400)] 19:25:50.426287 run osmo-msc_10.42.42.6(pid=22400): stdout: | (launched: 2022-12-13_19:25:49.301317) 19:25:50.475712 run osmo-msc_10.42.42.6(pid=22400): stderr: | 20221213192549572 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192549572 DLGLOBAL DEBUG validating counter group 0x7fdd8b9dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192549572 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192549572 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192549572 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192549573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192549574 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192549575 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192549575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192549575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:25:50.525530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22393): Terminating (SIGTERM) 19:25:50.565271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22396): Terminating (SIGTERM) 19:25:50.605017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Terminating (SIGTERM) 19:25:50.644900 --- ParallelTerminationStrategy: PID 22393 died... 19:25:50.664107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22393): Terminated: ok {rc=0} 19:25:50.708035 --- ParallelTerminationStrategy: PID 22396 died... 19:25:50.726675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22396): Terminated: ok {rc=0} 19:25:50.770039 --- ParallelTerminationStrategy: PID 22399 died... 19:25:50.788650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22399): Terminated: ok {rc=0} 19:25:50.873754 bus /sierra_3: Setting Powered False 19:25:51.975562 bus /sierra_3: Setting Powered False 19:25:53.092557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:25:54.343751 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:25:54.352697 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:25:54.387936 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:25:54.415966 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:25:54.470455 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:25:54.505171 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:25:54.533507 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:25:55.086251 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:25:55.139902 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.151893 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:25:55.223008 tst mo_mt_call.py: using LAC 35748 19:25:55.351282 tst mo_mt_call.py: using RAC 48 19:25:55.471041 tst mo_mt_call.py: using CellId 35748 19:25:55.590663 tst mo_mt_call.py: using BVCI 35749 19:25:55.702200 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.713626 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.724841 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.736149 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.747249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:25:55.758251 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:25:55.877559 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:25:55.997902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:25:56.502748 run create_hlr_db(pid=22406): Launched 19:25:56.630073 bus /sierra_2: Setting Powered False 19:25:57.694886 run create_hlr_db(pid=22406): Terminated: ok {rc=0} 19:25:58.131902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22408): Launched 19:25:58.438284 run osmo-hlr_10.42.42.2(pid=22409): Launched 19:25:58.553839 run osmo-stp_10.42.42.5: Starting osmo-stp 19:25:59.083409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22411): Launched 19:25:59.388400 run osmo-stp_10.42.42.5(pid=22412): Launched 19:25:59.503890 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:00.056239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22414): Launched 19:26:00.362176 run osmo-msc_10.42.42.6(pid=22415): Launched 19:26:00.531988 run osmo-stp_10.42.42.5(pid=22412): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22412)] 19:26:00.661669 run osmo-stp_10.42.42.5(pid=22412): stdout: | (launched: 2022-12-13_19:25:59.332042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:00.789497 run osmo-stp_10.42.42.5(pid=22412): stderr: | 20221213192559501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192559501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192559501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192559502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192559502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192559502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192559503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:00.934834 run osmo-stp_10.42.42.5(pid=22412): stdout: | (launched: 2022-12-13_19:25:59.332042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:01.065182 run osmo-stp_10.42.42.5(pid=22412): stderr: | 20221213192559501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192559501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192559501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192559502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192559502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192559502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192559503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:01.228455 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22412): Process ended prematurely: osmo-stp_10.42.42.5(pid=22412) [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22412)] [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:26:01.239189 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:26:01.268408 run osmo-hlr_10.42.42.2(pid=22409): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22409)] 19:26:01.325855 run osmo-hlr_10.42.42.2(pid=22409): stdout: | (launched: 2022-12-13_19:25:58.381921) 19:26:01.380896 run osmo-hlr_10.42.42.2(pid=22409): stderr: | 20221213192558557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192558557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192558557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192558557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192558558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192558558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192558570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192558579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192558579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192558579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:01.457159 run osmo-msc_10.42.42.6(pid=22415): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22415)] 19:26:01.511293 run osmo-msc_10.42.42.6(pid=22415): stdout: | (launched: 2022-12-13_19:26:00.305664) 19:26:01.565450 run osmo-msc_10.42.42.6(pid=22415): stderr: | 20221213192600579 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192600579 DLGLOBAL DEBUG validating counter group 0x7f2a9dc7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192600579 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192600579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192600579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192600579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192600581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192600582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192600582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192600582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:01.621978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22408): Terminating (SIGTERM) 19:26:01.666427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22411): Terminating (SIGTERM) 19:26:01.714222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22414): Terminating (SIGTERM) 19:26:01.761144 --- ParallelTerminationStrategy: PID 22408 died... 19:26:01.783513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22408): Terminated: ok {rc=0} 19:26:01.845692 --- ParallelTerminationStrategy: PID 22411 died... 19:26:01.866563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22411): Terminated: ok {rc=0} 19:26:01.916451 --- ParallelTerminationStrategy: PID 22414 died... 19:26:01.938047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22414): Terminated: ok {rc=0} 19:26:02.037213 bus /sierra_3: Setting Powered False 19:26:03.142147 bus /sierra_3: Setting Powered False 19:26:04.257795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:26:05.407919 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:05.420335 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:26:05.493820 tst mo_mt_call_osmux.py: using LAC 35749 19:26:05.620713 tst mo_mt_call_osmux.py: using RAC 49 19:26:05.747820 tst mo_mt_call_osmux.py: using CellId 35749 19:26:05.874742 tst mo_mt_call_osmux.py: using BVCI 35750 19:26:05.994133 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:06.006013 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:06.017759 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:06.029400 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:06.041076 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:26:06.052850 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:26:06.171196 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:26:06.292717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:06.800358 run create_hlr_db(pid=22417): Launched 19:26:06.924839 bus /sierra_2: Setting Powered False 19:26:07.990171 run create_hlr_db(pid=22417): Terminated: ok {rc=0} 19:26:08.428656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Launched 19:26:08.735132 run osmo-hlr_10.42.42.2(pid=22420): Launched 19:26:08.851213 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:09.376218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Launched 19:26:09.681146 run osmo-stp_10.42.42.5(pid=22423): Launched 19:26:09.796701 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:10.352746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Launched 19:26:10.660010 run osmo-msc_10.42.42.6(pid=22426): Launched 19:26:10.830197 run osmo-stp_10.42.42.5(pid=22423): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] 19:26:10.958611 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-13_19:26:09.624687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:11.086550 run osmo-stp_10.42.42.5(pid=22423): stderr: | 20221213192609794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192609794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192609795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192609795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192609795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192609795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192609796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:11.213108 run osmo-stp_10.42.42.5(pid=22423): stdout: | (launched: 2022-12-13_19:26:09.624687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:11.335182 run osmo-stp_10.42.42.5(pid=22423): stderr: | 20221213192609794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192609794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192609795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192609795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192609795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192609795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192609796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:11.480554 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:26:11.489485 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:26:11.515947 run osmo-hlr_10.42.42.2(pid=22420): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22420)] 19:26:11.563611 run osmo-hlr_10.42.42.2(pid=22420): stdout: | (launched: 2022-12-13_19:26:08.678856) 19:26:11.613206 run osmo-hlr_10.42.42.2(pid=22420): stderr: | 20221213192608853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192608853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192608853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192608853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192608853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192608853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192608865 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192608873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192608874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192608874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:11.681992 run osmo-msc_10.42.42.6(pid=22426): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22426)] 19:26:11.729549 run osmo-msc_10.42.42.6(pid=22426): stdout: | (launched: 2022-12-13_19:26:10.603409) 19:26:11.778782 run osmo-msc_10.42.42.6(pid=22426): stderr: | 20221213192610877 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192610877 DLGLOBAL DEBUG validating counter group 0x7f5679721c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192610877 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192610877 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192610878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192610878 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192610879 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192610880 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192610880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192610880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:11.828584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminating (SIGTERM) 19:26:11.868235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminating (SIGTERM) 19:26:11.908371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminating (SIGTERM) 19:26:11.948390 --- ParallelTerminationStrategy: PID 22419 died... 19:26:11.967555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminated: ok {rc=0} 19:26:12.011574 --- ParallelTerminationStrategy: PID 22422 died... 19:26:12.030311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22422): Terminated: ok {rc=0} 19:26:12.074234 --- ParallelTerminationStrategy: PID 22425 died... 19:26:12.092901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22425): Terminated: ok {rc=0} 19:26:12.178829 bus /sierra_3: Setting Powered False 19:26:13.278293 bus /sierra_3: Setting Powered False 19:26:14.391541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:26:15.645253 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:26:15.651744 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:26:15.686976 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:26:15.714752 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:26:15.768217 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:26:15.802662 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:26:15.830758 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:26:16.407386 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:26:16.463742 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:16.476550 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:16.553256 tst mo_mt_call.py: using LAC 35750 19:26:16.689091 tst mo_mt_call.py: using RAC 50 19:26:16.844661 tst mo_mt_call.py: using CellId 35750 19:26:16.970994 tst mo_mt_call.py: using BVCI 35751 19:26:17.085863 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:17.098604 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:17.110194 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:17.121787 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:17.134108 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:17.146443 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:26:17.265389 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:26:17.383202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:17.858539 run create_hlr_db(pid=22431): Launched 19:26:17.986789 bus /sierra_2: Setting Powered False 19:26:19.047351 run create_hlr_db(pid=22431): Terminated: ok {rc=0} 19:26:19.474234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Launched 19:26:19.779464 run osmo-hlr_10.42.42.2(pid=22434): Launched 19:26:19.895277 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:20.433572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Launched 19:26:20.739539 run osmo-stp_10.42.42.5(pid=22437): Launched 19:26:20.854878 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:21.410169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Launched 19:26:21.716883 run osmo-msc_10.42.42.6(pid=22440): Launched 19:26:21.886990 run osmo-stp_10.42.42.5(pid=22437): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] 19:26:22.015803 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-13_19:26:20.682744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:22.144202 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221213192620852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192620852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192620852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192620853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192620853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192620853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192620853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:22.270494 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-13_19:26:20.682744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:22.391857 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221213192620852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192620852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192620852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192620853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192620853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192620853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192620853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:22.537249 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:26:22.546207 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:26:22.572486 run osmo-hlr_10.42.42.2(pid=22434): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22434)] 19:26:22.621217 run osmo-hlr_10.42.42.2(pid=22434): stdout: | (launched: 2022-12-13_19:26:19.723188) 19:26:22.670913 run osmo-hlr_10.42.42.2(pid=22434): stderr: | 20221213192619900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192619900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192619900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192619900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192619900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192619900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192619912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192619921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192619921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192619922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:22.740090 run osmo-msc_10.42.42.6(pid=22440): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22440)] 19:26:22.787734 run osmo-msc_10.42.42.6(pid=22440): stdout: | (launched: 2022-12-13_19:26:21.660447) 19:26:22.837235 run osmo-msc_10.42.42.6(pid=22440): stderr: | 20221213192621933 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192621933 DLGLOBAL DEBUG validating counter group 0x7f9148cdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192621933 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192621933 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192621933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192621934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192621935 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192621936 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192621936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192621936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:22.886909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminating (SIGTERM) 19:26:22.926606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminating (SIGTERM) 19:26:22.966397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Terminating (SIGTERM) 19:26:23.006315 --- ParallelTerminationStrategy: PID 22433 died... 19:26:23.025562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminated: ok {rc=0} 19:26:23.069509 --- ParallelTerminationStrategy: PID 22436 died... 19:26:23.088132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminated: ok {rc=0} 19:26:23.131863 --- ParallelTerminationStrategy: PID 22439 died... 19:26:23.150419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22439): Terminated: ok {rc=0} 19:26:23.235866 bus /sierra_3: Setting Powered False 19:26:24.335870 bus /sierra_3: Setting Powered False 19:26:25.448627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:26:26.598869 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:26.611178 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:26:26.686420 tst mo_mt_call_osmux.py: using LAC 35751 19:26:26.814059 tst mo_mt_call_osmux.py: using RAC 51 19:26:26.940185 tst mo_mt_call_osmux.py: using CellId 35751 19:26:27.067242 tst mo_mt_call_osmux.py: using BVCI 35752 19:26:27.184838 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:27.196309 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:27.207538 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:27.218807 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:27.230487 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:26:27.242081 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:26:27.358595 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:26:27.478753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:27.984232 run create_hlr_db(pid=22442): Launched 19:26:28.108616 bus /sierra_2: Setting Powered False 19:26:29.172919 run create_hlr_db(pid=22442): Terminated: ok {rc=0} 19:26:29.609497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Launched 19:26:29.914947 run osmo-hlr_10.42.42.2(pid=22445): Launched 19:26:30.030961 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:30.569266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Launched 19:26:30.899087 run osmo-stp_10.42.42.5(pid=22448): Launched 19:26:31.232344 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:32.099813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Launched 19:26:32.449801 run osmo-msc_10.42.42.6(pid=22451): Launched 19:26:32.636784 run osmo-stp_10.42.42.5(pid=22448): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] 19:26:32.776554 run osmo-stp_10.42.42.5(pid=22448): stdout: | (launched: 2022-12-13_19:26:30.817996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:32.915994 run osmo-stp_10.42.42.5(pid=22448): stderr: | 20221213192631133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192631134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192631134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192631136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192631137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192631137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192631137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:33.052023 run osmo-stp_10.42.42.5(pid=22448): stdout: | (launched: 2022-12-13_19:26:30.817996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:33.182931 run osmo-stp_10.42.42.5(pid=22448): stderr: | 20221213192631133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192631134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192631134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192631136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192631137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192631137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192631137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:33.339207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22448): Process ended prematurely: osmo-stp_10.42.42.5(pid=22448) [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:26:33.349111 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 19:26:33.377155 run osmo-hlr_10.42.42.2(pid=22445): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22445)] 19:26:33.428654 run osmo-hlr_10.42.42.2(pid=22445): stdout: | (launched: 2022-12-13_19:26:29.858924) 19:26:33.482065 run osmo-hlr_10.42.42.2(pid=22445): stderr: | 20221213192630034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192630034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192630034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192630034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192630034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192630034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192630046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192630056 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192630057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192630057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:33.555541 run osmo-msc_10.42.42.6(pid=22451): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22451)] 19:26:33.606265 run osmo-msc_10.42.42.6(pid=22451): stdout: | (launched: 2022-12-13_19:26:32.390050) 19:26:33.658686 run osmo-msc_10.42.42.6(pid=22451): stderr: | 20221213192632707 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192632707 DLGLOBAL DEBUG validating counter group 0x7f90f8177c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192632707 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192632707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192632707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192632708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192632709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192632710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192632710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192632710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:33.711486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Terminating (SIGTERM) 19:26:33.754391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Terminating (SIGTERM) 19:26:33.797048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Terminating (SIGTERM) 19:26:33.839751 --- ParallelTerminationStrategy: PID 22444 died... 19:26:33.860245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22444): Terminated: ok {rc=0} 19:26:33.907015 --- ParallelTerminationStrategy: PID 22447 died... 19:26:33.926987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22447): Terminated: ok {rc=0} 19:26:33.973649 --- ParallelTerminationStrategy: PID 22450 died... 19:26:33.993930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22450): Terminated: ok {rc=0} 19:26:34.083049 bus /sierra_3: Setting Powered False 19:26:35.187915 bus /sierra_3: Setting Powered False 19:26:36.305086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:trx-lms --------------------------------------------------------------------- 19:26:37.559244 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:26:37.564027 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 19:26:37.598322 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 19:26:37.626328 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 19:26:37.715084 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 19:26:37.749634 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 19:26:37.777963 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 19:26:38.362157 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 19:26:38.367396 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.378694 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:26:38.429442 tst emergency_mo_mt_call.py: using LAC 35752 19:26:38.548605 tst emergency_mo_mt_call.py: using RAC 52 19:26:38.667570 tst emergency_mo_mt_call.py: using CellId 35752 19:26:38.785480 tst emergency_mo_mt_call.py: using BVCI 35753 19:26:38.894121 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.904761 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.915346 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.925938 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.936418 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:38.947469 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:39.069236 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:39.189192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:39.655257 run create_hlr_db(pid=22457): Launched 19:26:39.778619 bus /sierra_2: Setting Powered False 19:26:40.838842 run create_hlr_db(pid=22457): Terminated: ok {rc=0} 19:26:41.277414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Launched 19:26:41.598430 run osmo-hlr_10.42.42.2(pid=22460): Launched 19:26:41.722249 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:42.278575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Launched 19:26:42.601242 run osmo-stp_10.42.42.5(pid=22463): Launched 19:26:42.733076 tst emergency_mo_mt_call.py: using MSISDN 8290 19:26:42.900862 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:43.479378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Launched 19:26:43.801743 run osmo-msc_10.42.42.6(pid=22466): Launched 19:26:43.982561 run osmo-stp_10.42.42.5(pid=22463): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] 19:26:44.118558 run osmo-stp_10.42.42.5(pid=22463): stdout: | (launched: 2022-12-13_19:26:42.541687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:44.254382 run osmo-stp_10.42.42.5(pid=22463): stderr: | 20221213192642735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192642735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192642735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192642736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192642736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192642736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192642736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:44.388682 run osmo-stp_10.42.42.5(pid=22463): stdout: | (launched: 2022-12-13_19:26:42.541687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:44.517780 run osmo-stp_10.42.42.5(pid=22463): stderr: | 20221213192642735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192642735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192642735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192642736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192642736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192642736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192642736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:44.670858 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22463): Process ended prematurely: osmo-stp_10.42.42.5(pid=22463) [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 19:26:44.680074 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 19:26:44.707940 run osmo-hlr_10.42.42.2(pid=22460): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22460)] 19:26:44.758759 run osmo-hlr_10.42.42.2(pid=22460): stdout: | (launched: 2022-12-13_19:26:41.539480) 19:26:44.811193 run osmo-hlr_10.42.42.2(pid=22460): stderr: | 20221213192641738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192641738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192641738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192641738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192641738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192641738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192641750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192641760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192641761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192641761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:44.883706 run osmo-msc_10.42.42.6(pid=22466): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22466)] 19:26:44.934244 run osmo-msc_10.42.42.6(pid=22466): stdout: | (launched: 2022-12-13_19:26:43.742871) 19:26:44.986254 run osmo-msc_10.42.42.6(pid=22466): stderr: | 20221213192644062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192644062 DLGLOBAL DEBUG validating counter group 0x7fa3353fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192644062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192644062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192644063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192644063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192644064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192644065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192644065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192644065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:45.038938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Terminating (SIGTERM) 19:26:45.080662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Terminating (SIGTERM) 19:26:45.122893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Terminating (SIGTERM) 19:26:45.165683 --- ParallelTerminationStrategy: PID 22459 died... 19:26:45.186276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22459): Terminated: ok {rc=0} 19:26:45.233113 --- ParallelTerminationStrategy: PID 22462 died... 19:26:45.253021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22462): Terminated: ok {rc=0} 19:26:45.299276 --- ParallelTerminationStrategy: PID 22465 died... 19:26:45.319356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22465): Terminated: ok {rc=0} 19:26:45.407882 bus /sierra_3: Setting Powered False 19:26:46.511995 bus /sierra_3: Setting Powered False 19:26:47.637422 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 19:26:48.724579 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:48.736155 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 19:26:48.787617 tst emergency_preemptive_call.py: using LAC 35753 19:26:48.907289 tst emergency_preemptive_call.py: using RAC 53 19:26:49.024394 tst emergency_preemptive_call.py: using CellId 35753 19:26:49.142239 tst emergency_preemptive_call.py: using BVCI 35754 19:26:49.251051 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:49.261904 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:49.272452 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:49.283034 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:49.293683 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 19:26:49.305558 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:49.426312 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:49.544483 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:49.663606 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 19:26:49.778202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:26:50.245342 run create_hlr_db(pid=22468): Launched 19:26:50.369116 bus /sierra_2: Setting Powered False 19:26:51.429537 run create_hlr_db(pid=22468): Terminated: ok {rc=0} 19:26:51.871485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Launched 19:26:52.195286 run osmo-hlr_10.42.42.2(pid=22471): Launched 19:26:52.319128 run osmo-stp_10.42.42.5: Starting osmo-stp 19:26:52.877781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Launched 19:26:53.198657 run osmo-stp_10.42.42.5(pid=22474): Launched 19:26:53.330733 tst emergency_preemptive_call.py: using MSISDN 8291 19:26:53.499006 run osmo-msc_10.42.42.6: Starting osmo-msc 19:26:54.075673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Launched 19:26:54.398039 run osmo-msc_10.42.42.6(pid=22477): Launched 19:26:54.577114 run osmo-stp_10.42.42.5(pid=22474): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] 19:26:54.712053 run osmo-stp_10.42.42.5(pid=22474): stdout: | (launched: 2022-12-13_19:26:53.139700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:54.848245 run osmo-stp_10.42.42.5(pid=22474): stderr: | 20221213192653332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192653332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192653332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192653333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192653333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192653333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192653333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:54.983480 run osmo-stp_10.42.42.5(pid=22474): stdout: | (launched: 2022-12-13_19:26:53.139700) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:26:55.111709 run osmo-stp_10.42.42.5(pid=22474): stderr: | 20221213192653332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192653332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192653332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192653333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192653333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192653333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192653333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:26:55.265077 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22474): Process ended prematurely: osmo-stp_10.42.42.5(pid=22474) [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py:32] 19:26:55.274278 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:26:55.302054 run osmo-hlr_10.42.42.2(pid=22471): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22471)] 19:26:55.354264 run osmo-hlr_10.42.42.2(pid=22471): stdout: | (launched: 2022-12-13_19:26:52.136218) 19:26:55.407076 run osmo-hlr_10.42.42.2(pid=22471): stderr: | 20221213192652334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192652334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192652334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192652334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192652334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192652334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192652347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192652355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192652355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192652355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:26:55.480312 run osmo-msc_10.42.42.6(pid=22477): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22477)] 19:26:55.531135 run osmo-msc_10.42.42.6(pid=22477): stdout: | (launched: 2022-12-13_19:26:54.338885) 19:26:55.583343 run osmo-msc_10.42.42.6(pid=22477): stderr: | 20221213192654659 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213192654659 DLGLOBAL DEBUG validating counter group 0x7fc1f093bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213192654659 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213192654659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213192654660 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213192654660 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213192654662 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213192654662 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213192654663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213192654663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:26:55.637407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Terminating (SIGTERM) 19:26:55.679375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Terminating (SIGTERM) 19:26:55.721576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Terminating (SIGTERM) 19:26:55.764492 --- ParallelTerminationStrategy: PID 22470 died... 19:26:55.785023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22470): Terminated: ok {rc=0} 19:26:55.832037 --- ParallelTerminationStrategy: PID 22473 died... 19:26:55.852126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22473): Terminated: ok {rc=0} 19:26:55.899058 --- ParallelTerminationStrategy: PID 22476 died... 19:26:55.919033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22476): Terminated: ok {rc=0} 19:26:56.007633 bus /sierra_9: Setting Powered False 19:26:57.107040 bus /sierra_9: Setting Powered False 19:26:58.223879 bus /sierra_8: Setting Powered False 19:26:59.321955 bus /sierra_8: Setting Powered False 19:27:00.438106 bus /sierra_3: Setting Powered False 19:27:01.546425 bus /sierra_3: Setting Powered False 19:27:02.678510 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms --------------------------------------------------------------------- 19:27:03.952202 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:27:03.957941 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 19:27:03.993186 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 19:27:04.033737 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 19:27:04.123864 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 19:27:04.158045 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 19:27:04.198271 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 19:27:04.790966 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 19:27:04.844531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:04.855759 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:27:04.906232 tst cs_paging_gprs_active.py: using LAC 35754 19:27:05.027568 tst cs_paging_gprs_active.py: using RAC 54 19:27:05.148578 tst cs_paging_gprs_active.py: using CellId 35754 19:27:05.268115 tst cs_paging_gprs_active.py: using BVCI 35755 19:27:05.378553 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.389522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.400194 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.410914 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.421780 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.432417 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.443234 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.453810 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:05.464496 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:05.580618 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:05.700072 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:27:05.922988 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:06.253962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22482): Launched 19:27:06.540273 run iperf3-srv_10.42.42.10(pid=22483): Launched 19:27:06.665519 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:27:06.887263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:07.217753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22484): Launched 19:27:07.503579 run iperf3-srv_10.42.42.10(pid=22485): Launched 19:27:07.629128 tst cs_paging_gprs_active.py:38: start network... 19:27:07.851363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:08.359067 run create_hlr_db(pid=22486): Launched 19:27:08.486397 bus /sierra_2: Setting Powered False 19:27:09.547805 run create_hlr_db(pid=22486): Terminated: ok {rc=0} 19:27:10.001587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22488): Launched 19:27:10.329511 run osmo-hlr_10.42.42.2(pid=22489): Launched 19:27:10.455063 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:11.023073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22491): Launched 19:27:11.352377 run osmo-stp_10.42.42.5(pid=22492): Launched 19:27:11.477909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:12.043292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22494): Launched 19:27:12.169569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:12.445566 run patchelf(pid=22495): Launched 19:27:12.627501 run osmo-stp_10.42.42.5(pid=22492): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22492)] 19:27:12.766216 run osmo-stp_10.42.42.5(pid=22492): stdout: | (launched: 2022-12-13_19:27:11.292363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:12.906038 run osmo-stp_10.42.42.5(pid=22492): stderr: | 20221213192711481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192711481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192711482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192711482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192711482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192711483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192711483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:13.046054 run osmo-stp_10.42.42.5(pid=22492): stdout: | (launched: 2022-12-13_19:27:11.292363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:13.179807 run osmo-stp_10.42.42.5(pid=22492): stderr: | 20221213192711481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192711481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192711482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192711482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192711482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192711483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192711483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:13.338561 run patchelf(pid=22495): Terminating (SIGINT) 19:27:13.522267 run patchelf(pid=22495): Terminated: ok {rc=0} 19:27:13.654368 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22492): Process ended prematurely: osmo-stp_10.42.42.5(pid=22492) [trial-2393↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22492)] [trial-2393↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 19:27:13.664636 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:27:13.693325 run osmo-hlr_10.42.42.2(pid=22489): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22489)] 19:27:13.744329 run osmo-hlr_10.42.42.2(pid=22489): stdout: | (launched: 2022-12-13_19:27:10.269200) 19:27:13.796531 run osmo-hlr_10.42.42.2(pid=22489): stderr: | 20221213192710465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192710465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192710465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192710465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192710465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192710465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192710477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192710486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192710486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192710486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:13.849670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22482): Terminating (SIGTERM) 19:27:13.891597 run iperf3-srv_10.42.42.10(pid=22483): Terminating (SIGTERM) 19:27:13.934312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22484): Terminating (SIGTERM) 19:27:13.977171 run iperf3-srv_10.42.42.10(pid=22485): Terminating (SIGTERM) 19:27:14.019173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22488): Terminating (SIGTERM) 19:27:14.062029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22491): Terminating (SIGTERM) 19:27:14.104398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22494): Terminating (SIGTERM) 19:27:14.146995 --- ParallelTerminationStrategy: PID 22482 died... 19:27:14.167697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22482): Terminated: ok {rc=0} 19:27:14.214713 --- ParallelTerminationStrategy: PID 22483 died... 19:27:14.234849 run iperf3-srv_10.42.42.10(pid=22483): Terminated {rc=256} 19:27:14.281585 --- ParallelTerminationStrategy: PID 22484 died... 19:27:14.301897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22484): Terminated: ok {rc=0} 19:27:14.348528 --- ParallelTerminationStrategy: PID 22485 died... 19:27:14.368736 run iperf3-srv_10.42.42.10(pid=22485): Terminated {rc=256} 19:27:14.415502 --- ParallelTerminationStrategy: PID 22488 died... 19:27:14.435593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22488): Terminated: ok {rc=0} 19:27:14.482289 --- ParallelTerminationStrategy: PID 22491 died... 19:27:14.502688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22491): Terminated: ok {rc=0} 19:27:14.549622 --- ParallelTerminationStrategy: PID 22494 died... 19:27:14.569805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22494): Terminated: ok {rc=0} 19:27:14.658842 bus /gobi_0: Setting Powered False 19:27:15.758189 bus /gobi_0: Setting Powered False 19:27:16.876114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms iperf3.py ---------------------------------------------- 19:27:18.028136 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.040052 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:27:18.093968 tst iperf3.py: using LAC 35755 19:27:18.222331 tst iperf3.py: using RAC 55 19:27:18.349354 tst iperf3.py: using CellId 35755 19:27:18.476737 tst iperf3.py: using BVCI 35756 19:27:18.597380 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.608709 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.619886 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.631054 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.642330 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.653807 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.665334 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.676436 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:18.687797 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:18.805495 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:27:19.010851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:19.317994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22496): Launched 19:27:19.586827 run iperf3-srv_10.42.42.10(pid=22497): Launched 19:27:19.703474 tst iperf3.py:8: start network... 19:27:19.909072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:20.383382 run create_hlr_db(pid=22498): Launched 19:27:20.509448 bus /gobi_6: Setting Powered False 19:27:21.570321 run create_hlr_db(pid=22498): Terminated: ok {rc=0} 19:27:21.998315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22500): Launched 19:27:22.304799 run osmo-hlr_10.42.42.2(pid=22501): Launched 19:27:22.420725 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:22.963833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22503): Launched 19:27:23.269628 run osmo-stp_10.42.42.5(pid=22504): Launched 19:27:23.386194 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:23.913178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22506): Launched 19:27:24.029596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:24.287541 run patchelf(pid=22507): Launched 19:27:24.456811 run osmo-stp_10.42.42.5(pid=22504): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22504)] 19:27:24.585797 run osmo-stp_10.42.42.5(pid=22504): stdout: | (launched: 2022-12-13_19:27:23.213087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:24.716223 run osmo-stp_10.42.42.5(pid=22504): stderr: | 20221213192723384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192723384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192723385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192723385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192723386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192723386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192723386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:24.847008 run osmo-stp_10.42.42.5(pid=22504): stdout: | (launched: 2022-12-13_19:27:23.213087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:24.971896 run osmo-stp_10.42.42.5(pid=22504): stderr: | 20221213192723384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192723384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192723385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192723385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192723386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192723386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192723386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:25.119704 run patchelf(pid=22507): Terminating (SIGINT) 19:27:25.290085 run patchelf(pid=22507): Terminated: ok {rc=0} 19:27:25.413286 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22504): Process ended prematurely: osmo-stp_10.42.42.5(pid=22504) [trial-2393↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22504)] [trial-2393↪gprs:trx-lms↪iperf3.py:8] 19:27:25.422636 tst iperf3.py:8: Test FAILED (7.4 sec) 19:27:25.450028 run osmo-hlr_10.42.42.2(pid=22501): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22501)] 19:27:25.498491 run osmo-hlr_10.42.42.2(pid=22501): stdout: | (launched: 2022-12-13_19:27:22.247977) 19:27:25.548429 run osmo-hlr_10.42.42.2(pid=22501): stderr: | 20221213192722423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192722423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192722423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192722423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192722423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192722423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192722435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192722445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192722445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192722445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:25.598638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22496): Terminating (SIGTERM) 19:27:25.638747 run iperf3-srv_10.42.42.10(pid=22497): Terminating (SIGTERM) 19:27:25.678399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22500): Terminating (SIGTERM) 19:27:25.718253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22503): Terminating (SIGTERM) 19:27:25.758201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22506): Terminating (SIGTERM) 19:27:25.798275 --- ParallelTerminationStrategy: PID 22496 died... 19:27:25.817926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22496): Terminated: ok {rc=0} 19:27:25.862777 --- ParallelTerminationStrategy: PID 22497 died... 19:27:25.881631 run iperf3-srv_10.42.42.10(pid=22497): Terminated {rc=256} 19:27:25.925829 --- ParallelTerminationStrategy: PID 22500 died... 19:27:25.944509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22500): Terminated: ok {rc=0} 19:27:25.988375 --- ParallelTerminationStrategy: PID 22503 died... 19:27:26.007684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22503): Terminated: ok {rc=0} 19:27:26.051821 --- ParallelTerminationStrategy: PID 22506 died... 19:27:26.070814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22506): Terminated: ok {rc=0} 19:27:26.154414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms iperf3m4.py ---------------------------------------------- 19:27:27.305061 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.316843 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:27:27.368481 tst iperf3m4.py: using LAC 35756 19:27:27.488663 tst iperf3m4.py: using RAC 56 19:27:27.608277 tst iperf3m4.py: using CellId 35756 19:27:27.728771 tst iperf3m4.py: using BVCI 35757 19:27:27.840933 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.852174 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.862748 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.873408 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.883707 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.894206 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.905303 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.916153 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:27.926911 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:28.047977 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:28.172573 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:28.293623 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:28.415377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:27:28.637707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:28.966305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Launched 19:27:29.252830 run iperf3-srv_10.42.42.10(pid=22509): Launched 19:27:29.375172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:27:29.596570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:29.925796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Launched 19:27:30.209672 run iperf3-srv_10.42.42.10(pid=22511): Launched 19:27:30.333738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:27:30.553939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:30.908115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22512): Launched 19:27:31.222086 run iperf3-srv_10.42.42.10(pid=22513): Launched 19:27:31.359731 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:27:31.585794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:27:31.920105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22514): Launched 19:27:32.218456 run iperf3-srv_10.42.42.10(pid=22515): Launched 19:27:32.332499 tst iperf3m4.py:8: start network... 19:27:32.537365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:33.010707 run create_hlr_db(pid=22516): Launched 19:27:33.135185 bus /gobi_6: Setting Powered False 19:27:34.196427 run create_hlr_db(pid=22516): Terminated: ok {rc=0} 19:27:34.644104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22518): Launched 19:27:34.971981 run osmo-hlr_10.42.42.2(pid=22519): Launched 19:27:35.097263 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:35.664899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22521): Launched 19:27:35.992293 run osmo-stp_10.42.42.5(pid=22522): Launched 19:27:36.118544 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:36.681465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22524): Launched 19:27:36.807397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:37.082961 run patchelf(pid=22525): Launched 19:27:37.265534 run osmo-stp_10.42.42.5(pid=22522): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22522)] 19:27:37.404155 run osmo-stp_10.42.42.5(pid=22522): stdout: | (launched: 2022-12-13_19:27:35.932141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:37.544482 run osmo-stp_10.42.42.5(pid=22522): stderr: | 20221213192736124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192736124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192736124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192736125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192736125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192736126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192736126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:37.684630 run osmo-stp_10.42.42.5(pid=22522): stdout: | (launched: 2022-12-13_19:27:35.932141) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:37.819036 run osmo-stp_10.42.42.5(pid=22522): stderr: | 20221213192736124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192736124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192736124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192736125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192736125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192736126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192736126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:37.978451 run patchelf(pid=22525): Terminating (SIGINT) 19:27:38.160881 run patchelf(pid=22525): Terminated: ok {rc=0} 19:27:38.292848 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22522): Process ended prematurely: osmo-stp_10.42.42.5(pid=22522) [trial-2393↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22522)] [trial-2393↪gprs:trx-lms↪iperf3m4.py:8] 19:27:38.303187 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:27:38.332087 run osmo-hlr_10.42.42.2(pid=22519): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22519)] 19:27:38.383556 run osmo-hlr_10.42.42.2(pid=22519): stdout: | (launched: 2022-12-13_19:27:34.911648) 19:27:38.436290 run osmo-hlr_10.42.42.2(pid=22519): stderr: | 20221213192735111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192735111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192735111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192735111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192735111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192735111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192735126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192735137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192735137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192735137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:38.488886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Terminating (SIGTERM) 19:27:38.531687 run iperf3-srv_10.42.42.10(pid=22509): Terminating (SIGTERM) 19:27:38.574421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Terminating (SIGTERM) 19:27:38.616858 run iperf3-srv_10.42.42.10(pid=22511): Terminating (SIGTERM) 19:27:38.659262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22512): Terminating (SIGTERM) 19:27:38.701846 run iperf3-srv_10.42.42.10(pid=22513): Terminating (SIGTERM) 19:27:38.744303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22514): Terminating (SIGTERM) 19:27:38.787186 run iperf3-srv_10.42.42.10(pid=22515): Terminating (SIGTERM) 19:27:38.829376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22518): Terminating (SIGTERM) 19:27:38.871923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22521): Terminating (SIGTERM) 19:27:38.914521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22524): Terminating (SIGTERM) 19:27:38.956930 --- ParallelTerminationStrategy: PID 22508 died... 19:27:38.977511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22508): Terminated: ok {rc=0} 19:27:39.024062 --- ParallelTerminationStrategy: PID 22509 died... 19:27:39.043975 run iperf3-srv_10.42.42.10(pid=22509): Terminated {rc=256} 19:27:39.090205 --- ParallelTerminationStrategy: PID 22510 died... 19:27:39.109966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22510): Terminated: ok {rc=0} 19:27:39.156304 --- ParallelTerminationStrategy: PID 22511 died... 19:27:39.176022 run iperf3-srv_10.42.42.10(pid=22511): Terminated {rc=256} 19:27:39.222535 --- ParallelTerminationStrategy: PID 22512 died... 19:27:39.242417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22512): Terminated: ok {rc=0} 19:27:39.288658 --- ParallelTerminationStrategy: PID 22513 died... 19:27:39.308475 run iperf3-srv_10.42.42.10(pid=22513): Terminated {rc=256} 19:27:39.354566 --- ParallelTerminationStrategy: PID 22514 died... 19:27:39.374372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22514): Terminated: ok {rc=0} 19:27:39.420575 --- ParallelTerminationStrategy: PID 22515 died... 19:27:39.440422 run iperf3-srv_10.42.42.10(pid=22515): Terminated {rc=256} 19:27:39.486832 --- ParallelTerminationStrategy: PID 22518 died... 19:27:39.507090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22518): Terminated: ok {rc=0} 19:27:39.553665 --- ParallelTerminationStrategy: PID 22521 died... 19:27:39.573765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22521): Terminated: ok {rc=0} 19:27:39.620359 --- ParallelTerminationStrategy: PID 22524 died... 19:27:39.640344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22524): Terminated: ok {rc=0} 19:27:39.729011 bus /gobi_4: Setting Powered False 19:27:40.828231 bus /gobi_4: Setting Powered False 19:27:41.944459 bus /gobi_1: Setting Powered False 19:27:43.041326 bus /gobi_1: Setting Powered False 19:27:44.154575 bus /gobi_0: Setting Powered False 19:27:45.252082 bus /gobi_0: Setting Powered False 19:27:46.379945 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms ping.py ---------------------------------------------- 19:27:47.491670 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:47.502935 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:27:47.551866 tst ping.py: using LAC 35757 19:27:47.678460 tst ping.py: using RAC 57 19:27:47.804185 tst ping.py: using CellId 35757 19:27:47.933457 tst ping.py: using BVCI 35758 19:27:48.051074 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.062241 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.073179 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.084018 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.095363 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.106569 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.117985 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:48.129169 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:48.244585 tst ping.py:19: start network... 19:27:48.445312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:48.909754 run create_hlr_db(pid=22526): Launched 19:27:49.031924 bus /gobi_6: Setting Powered False 19:27:50.091964 run create_hlr_db(pid=22526): Terminated: ok {rc=0} 19:27:50.530946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22528): Launched 19:27:50.852619 run osmo-hlr_10.42.42.2(pid=22529): Launched 19:27:50.976123 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:51.534102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22531): Launched 19:27:51.858154 run osmo-stp_10.42.42.5(pid=22532): Launched 19:27:51.982853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:27:52.537612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22534): Launched 19:27:52.659988 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:27:52.931233 run patchelf(pid=22535): Launched 19:27:53.110999 run osmo-stp_10.42.42.5(pid=22532): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22532)] 19:27:53.247397 run osmo-stp_10.42.42.5(pid=22532): stdout: | (launched: 2022-12-13_19:27:51.798926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:53.385260 run osmo-stp_10.42.42.5(pid=22532): stderr: | 20221213192751991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192751992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192751992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192751992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192751993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192751993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192751993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:53.523470 run osmo-stp_10.42.42.5(pid=22532): stdout: | (launched: 2022-12-13_19:27:51.798926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:27:53.655874 run osmo-stp_10.42.42.5(pid=22532): stderr: | 20221213192751991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192751992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192751992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192751992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192751993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192751993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192751993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:27:53.812550 run patchelf(pid=22535): Terminating (SIGINT) 19:27:53.992290 run patchelf(pid=22535): Terminated: ok {rc=0} 19:27:54.122132 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22532): Process ended prematurely: osmo-stp_10.42.42.5(pid=22532) [trial-2393↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22532)] [trial-2393↪gprs:trx-lms↪ping.py:22] 19:27:54.131788 tst ping.py:22: Test FAILED (6.6 sec) 19:27:54.159859 run osmo-hlr_10.42.42.2(pid=22529): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22529)] 19:27:54.210827 run osmo-hlr_10.42.42.2(pid=22529): stdout: | (launched: 2022-12-13_19:27:50.793803) 19:27:54.263094 run osmo-hlr_10.42.42.2(pid=22529): stderr: | 20221213192750992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192750992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192750992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192750992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192750993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192750993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192751004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192751013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192751013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192751013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:27:54.315750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22528): Terminating (SIGTERM) 19:27:54.358153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22531): Terminating (SIGTERM) 19:27:54.400398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22534): Terminating (SIGTERM) 19:27:54.442998 --- ParallelTerminationStrategy: PID 22528 died... 19:27:54.463582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22528): Terminated: ok {rc=0} 19:27:54.510088 --- ParallelTerminationStrategy: PID 22531 died... 19:27:54.530416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22531): Terminated: ok {rc=0} 19:27:54.577168 --- ParallelTerminationStrategy: PID 22534 died... 19:27:54.596886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22534): Terminated: ok {rc=0} 19:27:54.684793 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 19:27:55.772863 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:55.784681 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 19:27:55.835046 tst ping_idle_ping.py: using LAC 35758 19:27:55.962099 tst ping_idle_ping.py: using RAC 58 19:27:56.089302 tst ping_idle_ping.py: using CellId 35758 19:27:56.216663 tst ping_idle_ping.py: using BVCI 35759 19:27:56.334828 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.346156 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.357373 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.368270 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.379631 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.390965 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.402482 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 19:27:56.413782 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 19:27:56.531075 tst ping_idle_ping.py:24: start network... 19:27:56.748472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:27:57.250766 run create_hlr_db(pid=22536): Launched 19:27:57.375286 bus /gobi_6: Setting Powered False 19:27:58.439365 run create_hlr_db(pid=22536): Terminated: ok {rc=0} 19:27:58.874032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22538): Launched 19:27:59.178399 run osmo-hlr_10.42.42.2(pid=22539): Launched 19:27:59.293259 run osmo-stp_10.42.42.5: Starting osmo-stp 19:27:59.812573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22541): Launched 19:28:00.114745 run osmo-stp_10.42.42.5(pid=22542): Launched 19:28:00.229551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:00.767455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22544): Launched 19:28:00.901778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:01.165563 run patchelf(pid=22545): Launched 19:28:01.348786 run osmo-stp_10.42.42.5(pid=22542): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22542)] 19:28:01.479036 run osmo-stp_10.42.42.5(pid=22542): stdout: | (launched: 2022-12-13_19:28:00.058557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:01.610745 run osmo-stp_10.42.42.5(pid=22542): stderr: | 20221213192800228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192800228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192800229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192800229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192800230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192800230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192800230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:01.745260 run osmo-stp_10.42.42.5(pid=22542): stdout: | (launched: 2022-12-13_19:28:00.058557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:01.870981 run osmo-stp_10.42.42.5(pid=22542): stderr: | 20221213192800228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192800228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192800229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192800229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192800230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192800230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192800230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:02.020597 run patchelf(pid=22545): Terminating (SIGINT) 19:28:02.192571 run patchelf(pid=22545): Terminated: ok {rc=0} 19:28:02.314992 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22542): Process ended prematurely: osmo-stp_10.42.42.5(pid=22542) [trial-2393↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22542)] [trial-2393↪gprs:trx-lms↪ping_idle_ping.py:27] 19:28:02.323990 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:28:02.350903 run osmo-hlr_10.42.42.2(pid=22539): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22539)] 19:28:02.398735 run osmo-hlr_10.42.42.2(pid=22539): stdout: | (launched: 2022-12-13_19:27:59.121800) 19:28:02.448153 run osmo-hlr_10.42.42.2(pid=22539): stderr: | 20221213192759297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192759297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192759298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192759298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192759298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192759298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192759310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192759319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192759319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192759319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:02.498096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22538): Terminating (SIGTERM) 19:28:02.538288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22541): Terminating (SIGTERM) 19:28:02.578414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22544): Terminating (SIGTERM) 19:28:02.619088 --- ParallelTerminationStrategy: PID 22538 died... 19:28:02.638483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22538): Terminated: ok {rc=0} 19:28:02.683107 --- ParallelTerminationStrategy: PID 22541 died... 19:28:02.701985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22541): Terminated: ok {rc=0} 19:28:02.746206 --- ParallelTerminationStrategy: PID 22544 died... 19:28:02.765033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22544): Terminated: ok {rc=0} 19:28:02.851923 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 19:28:04.148134 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:28:04.153448 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:28:04.186522 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:28:04.225317 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:28:04.311672 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:28:04.345110 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:28:04.383559 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:28:04.977365 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:28:05.026630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.037688 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:28:05.086667 tst cs_paging_gprs_active.py: using LAC 35759 19:28:05.213364 tst cs_paging_gprs_active.py: using RAC 59 19:28:05.340601 tst cs_paging_gprs_active.py: using CellId 35759 19:28:05.466635 tst cs_paging_gprs_active.py: using BVCI 35760 19:28:05.586138 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.597764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.609112 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.620558 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.632044 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.643489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.655167 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.666581 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:05.678428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:05.795348 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:05.915350 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:28:06.138869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:06.470266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22551): Launched 19:28:06.757327 run iperf3-srv_10.42.42.10(pid=22552): Launched 19:28:06.880843 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:28:07.103586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:07.434567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22553): Launched 19:28:07.722539 run iperf3-srv_10.42.42.10(pid=22554): Launched 19:28:07.846743 tst cs_paging_gprs_active.py:38: start network... 19:28:08.069120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:08.578540 run create_hlr_db(pid=22555): Launched 19:28:08.702893 bus /gobi_6: Setting Powered False 19:28:09.767360 run create_hlr_db(pid=22555): Terminated: ok {rc=0} 19:28:10.223100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Launched 19:28:10.552897 run osmo-hlr_10.42.42.2(pid=22558): Launched 19:28:10.679897 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:11.246188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Launched 19:28:11.573818 run osmo-stp_10.42.42.5(pid=22561): Launched 19:28:11.700399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:12.265281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22563): Launched 19:28:12.390061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:12.667234 run patchelf(pid=22564): Launched 19:28:12.851486 run osmo-stp_10.42.42.5(pid=22561): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] 19:28:12.990762 run osmo-stp_10.42.42.5(pid=22561): stdout: | (launched: 2022-12-13_19:28:11.513163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:13.131429 run osmo-stp_10.42.42.5(pid=22561): stderr: | 20221213192811705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192811705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192811705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192811706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192811706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192811706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192811706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:13.271943 run osmo-stp_10.42.42.5(pid=22561): stdout: | (launched: 2022-12-13_19:28:11.513163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:13.406368 run osmo-stp_10.42.42.5(pid=22561): stderr: | 20221213192811705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192811705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192811705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192811706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192811706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192811706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192811706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:13.566399 run patchelf(pid=22564): Terminating (SIGINT) 19:28:13.749762 run patchelf(pid=22564): Terminated: ok {rc=0} 19:28:13.881864 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22561): Process ended prematurely: osmo-stp_10.42.42.5(pid=22561) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:28:13.892147 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:28:13.920741 run osmo-hlr_10.42.42.2(pid=22558): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22558)] 19:28:13.971766 run osmo-hlr_10.42.42.2(pid=22558): stdout: | (launched: 2022-12-13_19:28:10.492185) 19:28:14.024108 run osmo-hlr_10.42.42.2(pid=22558): stderr: | 20221213192810691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192810691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192810691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192810691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192810691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192810691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192810705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192810713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192810713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192810713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:14.076923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22551): Terminating (SIGTERM) 19:28:14.119486 run iperf3-srv_10.42.42.10(pid=22552): Terminating (SIGTERM) 19:28:14.162235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22553): Terminating (SIGTERM) 19:28:14.204560 run iperf3-srv_10.42.42.10(pid=22554): Terminating (SIGTERM) 19:28:14.246869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Terminating (SIGTERM) 19:28:14.289185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Terminating (SIGTERM) 19:28:14.331490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22563): Terminating (SIGTERM) 19:28:14.374528 --- ParallelTerminationStrategy: PID 22551 died... 19:28:14.395135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22551): Terminated: ok {rc=0} 19:28:14.441880 --- ParallelTerminationStrategy: PID 22552 died... 19:28:14.461791 run iperf3-srv_10.42.42.10(pid=22552): Terminated {rc=256} 19:28:14.508128 --- ParallelTerminationStrategy: PID 22553 died... 19:28:14.528511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22553): Terminated: ok {rc=0} 19:28:14.575048 --- ParallelTerminationStrategy: PID 22554 died... 19:28:14.595016 run iperf3-srv_10.42.42.10(pid=22554): Terminated {rc=256} 19:28:14.641273 --- ParallelTerminationStrategy: PID 22557 died... 19:28:14.661224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22557): Terminated: ok {rc=0} 19:28:14.707730 --- ParallelTerminationStrategy: PID 22560 died... 19:28:14.727759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22560): Terminated: ok {rc=0} 19:28:14.774133 --- ParallelTerminationStrategy: PID 22563 died... 19:28:14.794128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22563): Terminated: ok {rc=0} 19:28:14.882421 bus /gobi_0: Setting Powered False 19:28:15.997991 bus /gobi_0: Setting Powered False 19:28:17.113710 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:28:18.259076 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.270986 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:28:18.321759 tst iperf3.py: using LAC 35760 19:28:18.442445 tst iperf3.py: using RAC 60 19:28:18.566385 tst iperf3.py: using CellId 35760 19:28:18.690286 tst iperf3.py: using BVCI 35761 19:28:18.803012 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.814107 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.824795 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.835643 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.846924 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.858276 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.869771 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.880842 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:18.892373 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:19.007816 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:28:19.214525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:19.522873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22565): Launched 19:28:19.791928 run iperf3-srv_10.42.42.10(pid=22566): Launched 19:28:19.906869 tst iperf3.py:8: start network... 19:28:20.112185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:20.588196 run create_hlr_db(pid=22567): Launched 19:28:20.713406 bus /gobi_6: Setting Powered False 19:28:21.774534 run create_hlr_db(pid=22567): Terminated: ok {rc=0} 19:28:22.224344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22569): Launched 19:28:22.554224 run osmo-hlr_10.42.42.2(pid=22570): Launched 19:28:22.682422 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:23.246399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22572): Launched 19:28:23.574598 run osmo-stp_10.42.42.5(pid=22573): Launched 19:28:23.703611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:24.267656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22575): Launched 19:28:24.394307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:24.671636 run patchelf(pid=22576): Launched 19:28:24.855231 run osmo-stp_10.42.42.5(pid=22573): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22573)] 19:28:24.994229 run osmo-stp_10.42.42.5(pid=22573): stdout: | (launched: 2022-12-13_19:28:23.514360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:25.134577 run osmo-stp_10.42.42.5(pid=22573): stderr: | 20221213192823706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192823706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192823707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192823707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192823708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192823708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192823708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:25.275575 run osmo-stp_10.42.42.5(pid=22573): stdout: | (launched: 2022-12-13_19:28:23.514360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:25.410515 run osmo-stp_10.42.42.5(pid=22573): stderr: | 20221213192823706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192823706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192823707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192823707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192823708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192823708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192823708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:25.570485 run patchelf(pid=22576): Terminating (SIGINT) 19:28:25.753743 run patchelf(pid=22576): Terminated: ok {rc=0} 19:28:25.886074 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22573): Process ended prematurely: osmo-stp_10.42.42.5(pid=22573) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22573)] [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 19:28:25.896308 tst iperf3.py:8: Test FAILED (7.7 sec) 19:28:25.924888 run osmo-hlr_10.42.42.2(pid=22570): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22570)] 19:28:25.976086 run osmo-hlr_10.42.42.2(pid=22570): stdout: | (launched: 2022-12-13_19:28:22.493714) 19:28:26.028684 run osmo-hlr_10.42.42.2(pid=22570): stderr: | 20221213192822690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192822690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192822690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192822690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192822690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192822690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192822703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192822712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192822712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192822712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:26.081574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22565): Terminating (SIGTERM) 19:28:26.124138 run iperf3-srv_10.42.42.10(pid=22566): Terminating (SIGTERM) 19:28:26.167328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22569): Terminating (SIGTERM) 19:28:26.209690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22572): Terminating (SIGTERM) 19:28:26.252761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22575): Terminating (SIGTERM) 19:28:26.295981 --- ParallelTerminationStrategy: PID 22565 died... 19:28:26.316806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22565): Terminated: ok {rc=0} 19:28:26.363713 --- ParallelTerminationStrategy: PID 22566 died... 19:28:26.383849 run iperf3-srv_10.42.42.10(pid=22566): Terminated {rc=256} 19:28:26.430341 --- ParallelTerminationStrategy: PID 22569 died... 19:28:26.450473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22569): Terminated: ok {rc=0} 19:28:26.497255 --- ParallelTerminationStrategy: PID 22572 died... 19:28:26.517379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22572): Terminated: ok {rc=0} 19:28:26.564290 --- ParallelTerminationStrategy: PID 22575 died... 19:28:26.584507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22575): Terminated: ok {rc=0} 19:28:26.674056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:28:27.826070 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:27.838074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:28:27.892907 tst iperf3m4.py: using LAC 35761 19:28:28.020555 tst iperf3m4.py: using RAC 61 19:28:28.145928 tst iperf3m4.py: using CellId 35761 19:28:28.272833 tst iperf3m4.py: using BVCI 35762 19:28:28.391981 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.403429 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.414660 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.425828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.437248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.448768 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.460496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.471590 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:28.483389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:28.605421 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:28.724471 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:28.842781 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:28.962796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:28:29.184475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:29.514503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Launched 19:28:29.801804 run iperf3-srv_10.42.42.10(pid=22578): Launched 19:28:29.925917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:28:30.146752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:30.476181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Launched 19:28:30.763229 run iperf3-srv_10.42.42.10(pid=22580): Launched 19:28:30.903097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:28:31.116517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:31.437746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22581): Launched 19:28:31.740080 run iperf3-srv_10.42.42.10(pid=22582): Launched 19:28:31.870513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:28:32.083712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:28:32.396627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22583): Launched 19:28:32.664667 run iperf3-srv_10.42.42.10(pid=22584): Launched 19:28:32.779617 tst iperf3m4.py:8: start network... 19:28:32.984416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:33.459723 run create_hlr_db(pid=22585): Launched 19:28:33.584879 bus /gobi_6: Setting Powered False 19:28:34.646402 run create_hlr_db(pid=22585): Terminated: ok {rc=0} 19:28:35.073940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22587): Launched 19:28:35.381677 run osmo-hlr_10.42.42.2(pid=22588): Launched 19:28:35.497844 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:36.039092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22590): Launched 19:28:36.345835 run osmo-stp_10.42.42.5(pid=22591): Launched 19:28:36.462492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:36.989723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22593): Launched 19:28:37.106274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:37.364073 run patchelf(pid=22594): Launched 19:28:37.533904 run osmo-stp_10.42.42.5(pid=22591): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22591)] 19:28:37.663787 run osmo-stp_10.42.42.5(pid=22591): stdout: | (launched: 2022-12-13_19:28:36.288789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:37.794771 run osmo-stp_10.42.42.5(pid=22591): stderr: | 20221213192836458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192836458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192836459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192836459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192836460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192836460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192836460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:37.925804 run osmo-stp_10.42.42.5(pid=22591): stdout: | (launched: 2022-12-13_19:28:36.288789) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:38.051439 run osmo-stp_10.42.42.5(pid=22591): stderr: | 20221213192836458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192836458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192836459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192836459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192836460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192836460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192836460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:38.200526 run patchelf(pid=22594): Terminating (SIGINT) 19:28:38.371532 run patchelf(pid=22594): Terminated: ok {rc=0} 19:28:38.495736 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22591): Process ended prematurely: osmo-stp_10.42.42.5(pid=22591) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22591)] [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 19:28:38.505264 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:28:38.532825 run osmo-hlr_10.42.42.2(pid=22588): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22588)] 19:28:38.581495 run osmo-hlr_10.42.42.2(pid=22588): stdout: | (launched: 2022-12-13_19:28:35.324799) 19:28:38.631808 run osmo-hlr_10.42.42.2(pid=22588): stderr: | 20221213192835501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192835501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192835502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192835502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192835502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192835502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192835514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192835523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192835523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192835523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:38.682325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Terminating (SIGTERM) 19:28:38.722737 run iperf3-srv_10.42.42.10(pid=22578): Terminating (SIGTERM) 19:28:38.762857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Terminating (SIGTERM) 19:28:38.803364 run iperf3-srv_10.42.42.10(pid=22580): Terminating (SIGTERM) 19:28:38.843501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22581): Terminating (SIGTERM) 19:28:38.883905 run iperf3-srv_10.42.42.10(pid=22582): Terminating (SIGTERM) 19:28:38.924010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22583): Terminating (SIGTERM) 19:28:38.964590 run iperf3-srv_10.42.42.10(pid=22584): Terminating (SIGTERM) 19:28:39.004585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22587): Terminating (SIGTERM) 19:28:39.044853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22590): Terminating (SIGTERM) 19:28:39.085181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22593): Terminating (SIGTERM) 19:28:39.126235 --- ParallelTerminationStrategy: PID 22577 died... 19:28:39.145487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22577): Terminated: ok {rc=0} 19:28:39.190450 --- ParallelTerminationStrategy: PID 22578 died... 19:28:39.209318 run iperf3-srv_10.42.42.10(pid=22578): Terminated {rc=256} 19:28:39.253732 --- ParallelTerminationStrategy: PID 22579 died... 19:28:39.272771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22579): Terminated: ok {rc=0} 19:28:39.317188 --- ParallelTerminationStrategy: PID 22580 died... 19:28:39.335865 run iperf3-srv_10.42.42.10(pid=22580): Terminated {rc=256} 19:28:39.380382 --- ParallelTerminationStrategy: PID 22581 died... 19:28:39.399245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22581): Terminated: ok {rc=0} 19:28:39.443685 --- ParallelTerminationStrategy: PID 22582 died... 19:28:39.462545 run iperf3-srv_10.42.42.10(pid=22582): Terminated {rc=256} 19:28:39.506795 --- ParallelTerminationStrategy: PID 22583 died... 19:28:39.525710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22583): Terminated: ok {rc=0} 19:28:39.570181 --- ParallelTerminationStrategy: PID 22584 died... 19:28:39.589267 run iperf3-srv_10.42.42.10(pid=22584): Terminated {rc=256} 19:28:39.633483 --- ParallelTerminationStrategy: PID 22587 died... 19:28:39.652455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22587): Terminated: ok {rc=0} 19:28:39.696898 --- ParallelTerminationStrategy: PID 22590 died... 19:28:39.715783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22590): Terminated: ok {rc=0} 19:28:39.760999 --- ParallelTerminationStrategy: PID 22593 died... 19:28:39.780009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22593): Terminated: ok {rc=0} 19:28:39.864889 bus /gobi_4: Setting Powered False 19:28:40.964220 bus /gobi_4: Setting Powered False 19:28:42.084524 bus /gobi_1: Setting Powered False 19:28:43.185146 bus /gobi_1: Setting Powered False 19:28:44.301778 bus /gobi_0: Setting Powered False 19:28:45.401290 bus /gobi_0: Setting Powered False 19:28:46.515025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 19:28:47.617884 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:47.629387 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:28:47.679665 tst ping.py: using LAC 35762 19:28:47.798899 tst ping.py: using RAC 62 19:28:47.916367 tst ping.py: using CellId 35762 19:28:48.035570 tst ping.py: using BVCI 35763 19:28:48.145675 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.156546 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.167412 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.178166 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.188864 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.199539 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.211019 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:48.222187 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:48.336563 tst ping.py:19: start network... 19:28:48.538705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:49.005595 run create_hlr_db(pid=22595): Launched 19:28:49.128740 bus /gobi_6: Setting Powered False 19:28:50.188941 run create_hlr_db(pid=22595): Terminated: ok {rc=0} 19:28:50.631627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22597): Launched 19:28:50.955360 run osmo-hlr_10.42.42.2(pid=22598): Launched 19:28:51.079355 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:51.639430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22600): Launched 19:28:51.961709 run osmo-stp_10.42.42.5(pid=22601): Launched 19:28:52.085367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:28:52.641289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22603): Launched 19:28:52.765051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:28:53.037652 run patchelf(pid=22604): Launched 19:28:53.217867 run osmo-stp_10.42.42.5(pid=22601): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22601)] 19:28:53.354613 run osmo-stp_10.42.42.5(pid=22601): stdout: | (launched: 2022-12-13_19:28:51.902557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:53.492708 run osmo-stp_10.42.42.5(pid=22601): stderr: | 20221213192852092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192852093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192852093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192852094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192852095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192852095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192852095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:53.631291 run osmo-stp_10.42.42.5(pid=22601): stdout: | (launched: 2022-12-13_19:28:51.902557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:28:53.763478 run osmo-stp_10.42.42.5(pid=22601): stderr: | 20221213192852092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192852093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192852093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192852094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192852095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192852095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192852095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:28:53.920070 run patchelf(pid=22604): Terminating (SIGINT) 19:28:54.100506 run patchelf(pid=22604): Terminated: ok {rc=0} 19:28:54.230670 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22601): Process ended prematurely: osmo-stp_10.42.42.5(pid=22601) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22601)] [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 19:28:54.240208 tst ping.py:22: Test FAILED (6.6 sec) 19:28:54.268590 run osmo-hlr_10.42.42.2(pid=22598): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22598)] 19:28:54.320101 run osmo-hlr_10.42.42.2(pid=22598): stdout: | (launched: 2022-12-13_19:28:50.896241) 19:28:54.373309 run osmo-hlr_10.42.42.2(pid=22598): stderr: | 20221213192851093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192851093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192851093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192851093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192851093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192851094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192851107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192851117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192851117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192851118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:28:54.426449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22597): Terminating (SIGTERM) 19:28:54.468804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22600): Terminating (SIGTERM) 19:28:54.512058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22603): Terminating (SIGTERM) 19:28:54.555559 --- ParallelTerminationStrategy: PID 22597 died... 19:28:54.576194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22597): Terminated: ok {rc=0} 19:28:54.623785 --- ParallelTerminationStrategy: PID 22600 died... 19:28:54.643928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22600): Terminated: ok {rc=0} 19:28:54.691198 --- ParallelTerminationStrategy: PID 22603 died... 19:28:54.711491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22603): Terminated: ok {rc=0} 19:28:54.800470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:28:55.889653 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:55.901967 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:28:55.958820 tst ping_idle_ping.py: using LAC 35763 19:28:56.087994 tst ping_idle_ping.py: using RAC 63 19:28:56.212599 tst ping_idle_ping.py: using CellId 35763 19:28:56.337118 tst ping_idle_ping.py: using BVCI 35764 19:28:56.454768 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.466497 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.477987 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.489454 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.500933 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.512646 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.524552 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:28:56.536269 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:28:56.657735 tst ping_idle_ping.py:24: start network... 19:28:56.875115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:28:57.378444 run create_hlr_db(pid=22605): Launched 19:28:57.503651 bus /gobi_6: Setting Powered False 19:28:58.568833 run create_hlr_db(pid=22605): Terminated: ok {rc=0} 19:28:59.002849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Launched 19:28:59.306277 run osmo-hlr_10.42.42.2(pid=22608): Launched 19:28:59.422242 run osmo-stp_10.42.42.5: Starting osmo-stp 19:28:59.944251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Launched 19:29:00.247931 run osmo-stp_10.42.42.5(pid=22611): Launched 19:29:00.364111 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:00.889679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Launched 19:29:01.015860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:01.281811 run patchelf(pid=22614): Launched 19:29:01.474037 run osmo-stp_10.42.42.5(pid=22611): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] 19:29:01.617378 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-13_19:29:00.191383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:01.762425 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221213192900362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192900363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192900363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192900363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192900364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192900364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192900364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:01.905993 run osmo-stp_10.42.42.5(pid=22611): stdout: | (launched: 2022-12-13_19:29:00.191383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:02.034342 run osmo-stp_10.42.42.5(pid=22611): stderr: | 20221213192900362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192900363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192900363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192900363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192900364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192900364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192900364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:02.185264 run patchelf(pid=22614): Terminating (SIGINT) 19:29:02.355474 run patchelf(pid=22614): Terminated: ok {rc=0} 19:29:02.477413 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 19:29:02.486564 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:29:02.514010 run osmo-hlr_10.42.42.2(pid=22608): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22608)] 19:29:02.562498 run osmo-hlr_10.42.42.2(pid=22608): stdout: | (launched: 2022-12-13_19:28:59.250134) 19:29:02.612401 run osmo-hlr_10.42.42.2(pid=22608): stderr: | 20221213192859424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192859424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192859424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192859424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192859424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192859424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192859490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192859501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192859501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192859501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:02.662684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminating (SIGTERM) 19:29:02.702806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminating (SIGTERM) 19:29:02.743056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Terminating (SIGTERM) 19:29:02.783745 --- ParallelTerminationStrategy: PID 22607 died... 19:29:02.803563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22607): Terminated: ok {rc=0} 19:29:02.848775 --- ParallelTerminationStrategy: PID 22610 died... 19:29:02.868188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22610): Terminated: ok {rc=0} 19:29:02.913152 --- ParallelTerminationStrategy: PID 22613 died... 19:29:02.932137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22613): Terminated: ok {rc=0} 19:29:03.019464 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:29:04.322065 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:29:04.328016 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:29:04.360931 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:29:04.399891 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:29:04.494790 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:29:04.531075 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:29:04.571655 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:29:05.153925 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:29:05.205622 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.216806 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:29:05.286166 tst cs_paging_gprs_active.py: using LAC 35764 19:29:05.405813 tst cs_paging_gprs_active.py: using RAC 64 19:29:05.529848 tst cs_paging_gprs_active.py: using CellId 35764 19:29:05.658929 tst cs_paging_gprs_active.py: using BVCI 35765 19:29:05.778652 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.790187 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.801562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.812702 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.824218 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.835876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.847596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.859009 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:05.870789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:05.989682 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:06.110672 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:29:06.334843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:06.667303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Launched 19:29:06.956219 run iperf3-srv_10.42.42.10(pid=22621): Launched 19:29:07.079901 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:29:07.303418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:07.635971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Launched 19:29:07.923683 run iperf3-srv_10.42.42.10(pid=22623): Launched 19:29:08.047977 tst cs_paging_gprs_active.py:38: start network... 19:29:08.270736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:08.782330 run create_hlr_db(pid=22624): Launched 19:29:08.908549 bus /gobi_6: Setting Powered False 19:29:09.970178 run create_hlr_db(pid=22624): Terminated: ok {rc=0} 19:29:10.427049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Launched 19:29:10.757925 run osmo-hlr_10.42.42.2(pid=22627): Launched 19:29:10.884801 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:11.452260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Launched 19:29:11.782769 run osmo-stp_10.42.42.5(pid=22630): Launched 19:29:11.910124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:12.502056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Launched 19:29:12.628512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:12.903842 run patchelf(pid=22633): Launched 19:29:13.077246 run osmo-stp_10.42.42.5(pid=22630): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] 19:29:13.207750 run osmo-stp_10.42.42.5(pid=22630): stdout: | (launched: 2022-12-13_19:29:11.722631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:13.339555 run osmo-stp_10.42.42.5(pid=22630): stderr: | 20221213192911960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192911960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192911960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192911961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192911961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192911961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192911961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:13.471244 run osmo-stp_10.42.42.5(pid=22630): stdout: | (launched: 2022-12-13_19:29:11.722631) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:13.597754 run osmo-stp_10.42.42.5(pid=22630): stderr: | 20221213192911960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192911960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192911960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192911961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192911961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192911961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192911961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:13.747135 run patchelf(pid=22633): Terminating (SIGINT) 19:29:13.919673 run patchelf(pid=22633): Terminated: ok {rc=0} 19:29:14.043964 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22630): Process ended prematurely: osmo-stp_10.42.42.5(pid=22630) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:29:14.054021 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 19:29:14.081699 run osmo-hlr_10.42.42.2(pid=22627): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22627)] 19:29:14.129938 run osmo-hlr_10.42.42.2(pid=22627): stdout: | (launched: 2022-12-13_19:29:10.697355) 19:29:14.179569 run osmo-hlr_10.42.42.2(pid=22627): stderr: | 20221213192910895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192910895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192910895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192910895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192910895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192910895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192910908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192910917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192910917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192910917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:14.229629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Terminating (SIGTERM) 19:29:14.269825 run iperf3-srv_10.42.42.10(pid=22621): Terminating (SIGTERM) 19:29:14.309986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Terminating (SIGTERM) 19:29:14.350094 run iperf3-srv_10.42.42.10(pid=22623): Terminating (SIGTERM) 19:29:14.390164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Terminating (SIGTERM) 19:29:14.430108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Terminating (SIGTERM) 19:29:14.469978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Terminating (SIGTERM) 19:29:14.510273 --- ParallelTerminationStrategy: PID 22620 died... 19:29:14.529788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22620): Terminated: ok {rc=0} 19:29:14.574263 --- ParallelTerminationStrategy: PID 22621 died... 19:29:14.592909 run iperf3-srv_10.42.42.10(pid=22621): Terminated {rc=256} 19:29:14.637079 --- ParallelTerminationStrategy: PID 22622 died... 19:29:14.655803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22622): Terminated: ok {rc=0} 19:29:14.700371 --- ParallelTerminationStrategy: PID 22623 died... 19:29:14.719499 run iperf3-srv_10.42.42.10(pid=22623): Terminated {rc=256} 19:29:14.763488 --- ParallelTerminationStrategy: PID 22626 died... 19:29:14.782351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22626): Terminated: ok {rc=0} 19:29:14.826426 --- ParallelTerminationStrategy: PID 22629 died... 19:29:14.845310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22629): Terminated: ok {rc=0} 19:29:14.889249 --- ParallelTerminationStrategy: PID 22632 died... 19:29:14.907922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22632): Terminated: ok {rc=0} 19:29:14.994622 bus /gobi_0: Setting Powered False 19:29:16.094196 bus /gobi_0: Setting Powered False 19:29:17.217107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:29:18.365918 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:18.377739 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:29:18.448354 tst iperf3.py: using LAC 35765 19:29:18.579548 tst iperf3.py: using RAC 65 19:29:18.709173 tst iperf3.py: using CellId 35765 19:29:18.839045 tst iperf3.py: using BVCI 35766 19:29:18.959883 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:18.971398 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:18.982616 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:18.993919 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:19.005564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:19.017117 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:19.028717 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:19.040076 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:19.051901 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:19.169852 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:29:19.375731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:19.684425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22634): Launched 19:29:19.952553 run iperf3-srv_10.42.42.10(pid=22635): Launched 19:29:20.067122 tst iperf3.py:8: start network... 19:29:20.271749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:20.746068 run create_hlr_db(pid=22636): Launched 19:29:20.874121 bus /gobi_6: Setting Powered False 19:29:21.935531 run create_hlr_db(pid=22636): Terminated: ok {rc=0} 19:29:22.382293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Launched 19:29:22.711621 run osmo-hlr_10.42.42.2(pid=22639): Launched 19:29:22.837782 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:23.401883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Launched 19:29:23.730450 run osmo-stp_10.42.42.5(pid=22642): Launched 19:29:23.856304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:24.420245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Launched 19:29:24.547417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:24.825876 run patchelf(pid=22645): Launched 19:29:25.009223 run osmo-stp_10.42.42.5(pid=22642): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] 19:29:25.147472 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-13_19:29:23.670405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:25.287419 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221213192923860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192923860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192923861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192923861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192923862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192923862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192923862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:25.427578 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-13_19:29:23.670405) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:25.562317 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221213192923860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192923860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192923861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192923861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192923862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192923862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192923862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:25.721780 run patchelf(pid=22645): Terminating (SIGINT) 19:29:25.904430 run patchelf(pid=22645): Terminated: ok {rc=0} 19:29:26.037176 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 19:29:26.047492 tst iperf3.py:8: Test FAILED (7.7 sec) 19:29:26.076345 run osmo-hlr_10.42.42.2(pid=22639): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22639)] 19:29:26.127887 run osmo-hlr_10.42.42.2(pid=22639): stdout: | (launched: 2022-12-13_19:29:22.651399) 19:29:26.180692 run osmo-hlr_10.42.42.2(pid=22639): stderr: | 20221213192922849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192922849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192922849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192922849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192922849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192922849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192922889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192922899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192922899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192922899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:26.234008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22634): Terminating (SIGTERM) 19:29:26.276766 run iperf3-srv_10.42.42.10(pid=22635): Terminating (SIGTERM) 19:29:26.319995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminating (SIGTERM) 19:29:26.363488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminating (SIGTERM) 19:29:26.406563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Terminating (SIGTERM) 19:29:26.450171 --- ParallelTerminationStrategy: PID 22634 died... 19:29:26.471132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22634): Terminated: ok {rc=0} 19:29:26.518691 --- ParallelTerminationStrategy: PID 22635 died... 19:29:26.539084 run iperf3-srv_10.42.42.10(pid=22635): Terminated {rc=256} 19:29:26.586662 --- ParallelTerminationStrategy: PID 22638 died... 19:29:26.607052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminated: ok {rc=0} 19:29:26.654345 --- ParallelTerminationStrategy: PID 22641 died... 19:29:26.674751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminated: ok {rc=0} 19:29:26.722015 --- ParallelTerminationStrategy: PID 22644 died... 19:29:26.742575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22644): Terminated: ok {rc=0} 19:29:26.831956 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:29:27.985794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:27.998217 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:29:28.072434 tst iperf3m4.py: using LAC 35766 19:29:28.201842 tst iperf3m4.py: using RAC 66 19:29:28.331754 tst iperf3m4.py: using CellId 35766 19:29:28.459796 tst iperf3m4.py: using BVCI 35767 19:29:28.579527 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.591238 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.602879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.614611 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.626666 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.639010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.651433 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.663606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:28.676120 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:28.796632 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:28.916257 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:29.035715 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:29.154020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:29:29.359518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:29.666653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Launched 19:29:29.934913 run iperf3-srv_10.42.42.10(pid=22647): Launched 19:29:30.049739 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:29:30.255091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:30.562946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Launched 19:29:30.837782 run iperf3-srv_10.42.42.10(pid=22649): Launched 19:29:30.986585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:29:31.221237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:31.534254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22650): Launched 19:29:31.821726 run iperf3-srv_10.42.42.10(pid=22651): Launched 19:29:31.957585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:29:32.186881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:29:32.521439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22652): Launched 19:29:32.809530 run iperf3-srv_10.42.42.10(pid=22653): Launched 19:29:32.933762 tst iperf3m4.py:8: start network... 19:29:33.153839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:33.661708 run create_hlr_db(pid=22654): Launched 19:29:33.786345 bus /gobi_6: Setting Powered False 19:29:34.850940 run create_hlr_db(pid=22654): Terminated: ok {rc=0} 19:29:35.307572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22656): Launched 19:29:35.636795 run osmo-hlr_10.42.42.2(pid=22657): Launched 19:29:35.761561 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:36.326162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22659): Launched 19:29:36.653546 run osmo-stp_10.42.42.5(pid=22660): Launched 19:29:36.778676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:37.341800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22662): Launched 19:29:37.466026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:37.742692 run patchelf(pid=22663): Launched 19:29:37.923721 run osmo-stp_10.42.42.5(pid=22660): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22660)] 19:29:38.062493 run osmo-stp_10.42.42.5(pid=22660): stdout: | (launched: 2022-12-13_19:29:36.593197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:38.202703 run osmo-stp_10.42.42.5(pid=22660): stderr: | 20221213192936785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192936785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192936786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192936786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192936787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192936787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192936787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:38.343161 run osmo-stp_10.42.42.5(pid=22660): stdout: | (launched: 2022-12-13_19:29:36.593197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:38.477562 run osmo-stp_10.42.42.5(pid=22660): stderr: | 20221213192936785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192936785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192936786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192936786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192936787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192936787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192936787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:38.637425 run patchelf(pid=22663): Terminating (SIGINT) 19:29:38.820108 run patchelf(pid=22663): Terminated: ok {rc=0} 19:29:38.952086 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22660): Process ended prematurely: osmo-stp_10.42.42.5(pid=22660) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22660)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:29:38.962413 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:29:38.991454 run osmo-hlr_10.42.42.2(pid=22657): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22657)] 19:29:39.043085 run osmo-hlr_10.42.42.2(pid=22657): stdout: | (launched: 2022-12-13_19:29:35.576364) 19:29:39.095853 run osmo-hlr_10.42.42.2(pid=22657): stderr: | 20221213192935774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192935774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192935774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192935775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192935775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192935775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192935788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192935796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192935796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192935796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:39.149302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Terminating (SIGTERM) 19:29:39.192027 run iperf3-srv_10.42.42.10(pid=22647): Terminating (SIGTERM) 19:29:39.235083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Terminating (SIGTERM) 19:29:39.277828 run iperf3-srv_10.42.42.10(pid=22649): Terminating (SIGTERM) 19:29:39.320631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22650): Terminating (SIGTERM) 19:29:39.363708 run iperf3-srv_10.42.42.10(pid=22651): Terminating (SIGTERM) 19:29:39.406093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22652): Terminating (SIGTERM) 19:29:39.448545 run iperf3-srv_10.42.42.10(pid=22653): Terminating (SIGTERM) 19:29:39.491044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22656): Terminating (SIGTERM) 19:29:39.534201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22659): Terminating (SIGTERM) 19:29:39.577247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22662): Terminating (SIGTERM) 19:29:39.620690 --- ParallelTerminationStrategy: PID 22646 died... 19:29:39.641387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22646): Terminated: ok {rc=0} 19:29:39.688382 --- ParallelTerminationStrategy: PID 22647 died... 19:29:39.708721 run iperf3-srv_10.42.42.10(pid=22647): Terminated {rc=256} 19:29:39.755481 --- ParallelTerminationStrategy: PID 22648 died... 19:29:39.775585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22648): Terminated: ok {rc=0} 19:29:39.822306 --- ParallelTerminationStrategy: PID 22649 died... 19:29:39.842434 run iperf3-srv_10.42.42.10(pid=22649): Terminated {rc=256} 19:29:39.888942 --- ParallelTerminationStrategy: PID 22650 died... 19:29:39.909093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22650): Terminated: ok {rc=0} 19:29:39.956784 --- ParallelTerminationStrategy: PID 22651 died... 19:29:39.977375 run iperf3-srv_10.42.42.10(pid=22651): Terminated {rc=256} 19:29:40.024261 --- ParallelTerminationStrategy: PID 22652 died... 19:29:40.044361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22652): Terminated: ok {rc=0} 19:29:40.091206 --- ParallelTerminationStrategy: PID 22653 died... 19:29:40.111472 run iperf3-srv_10.42.42.10(pid=22653): Terminated {rc=256} 19:29:40.158144 --- ParallelTerminationStrategy: PID 22656 died... 19:29:40.178314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22656): Terminated: ok {rc=0} 19:29:40.225126 --- ParallelTerminationStrategy: PID 22659 died... 19:29:40.245235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22659): Terminated: ok {rc=0} 19:29:40.291948 --- ParallelTerminationStrategy: PID 22662 died... 19:29:40.312229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22662): Terminated: ok {rc=0} 19:29:40.402536 bus /gobi_4: Setting Powered False 19:29:41.502789 bus /gobi_4: Setting Powered False 19:29:42.622325 bus /gobi_1: Setting Powered False 19:29:43.722323 bus /gobi_1: Setting Powered False 19:29:44.838787 bus /gobi_0: Setting Powered False 19:29:45.945259 bus /gobi_0: Setting Powered False 19:29:47.066672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:29:48.176304 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.188521 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:29:48.261416 tst ping.py: using LAC 35767 19:29:48.389755 tst ping.py: using RAC 67 19:29:48.516387 tst ping.py: using CellId 35767 19:29:48.642510 tst ping.py: using BVCI 35768 19:29:48.758763 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.770413 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.781723 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.793043 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.804546 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.816179 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.827860 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:48.839364 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:48.959830 tst ping.py:19: start network... 19:29:49.176220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:49.676802 run create_hlr_db(pid=22664): Launched 19:29:49.798905 bus /gobi_6: Setting Powered False 19:29:50.862954 run create_hlr_db(pid=22664): Terminated: ok {rc=0} 19:29:51.294270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22666): Launched 19:29:51.596938 run osmo-hlr_10.42.42.2(pid=22667): Launched 19:29:51.711818 run osmo-stp_10.42.42.5: Starting osmo-stp 19:29:52.233998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22669): Launched 19:29:52.536517 run osmo-stp_10.42.42.5(pid=22670): Launched 19:29:52.650996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:29:53.170600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22672): Launched 19:29:53.285170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:29:53.539953 run patchelf(pid=22673): Launched 19:29:53.706778 run osmo-stp_10.42.42.5(pid=22670): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22670)] 19:29:53.834029 run osmo-stp_10.42.42.5(pid=22670): stdout: | (launched: 2022-12-13_19:29:52.480081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:53.962816 run osmo-stp_10.42.42.5(pid=22670): stderr: | 20221213192952649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192952649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192952649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192952650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192952650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192952651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192952651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:54.091716 run osmo-stp_10.42.42.5(pid=22670): stdout: | (launched: 2022-12-13_19:29:52.480081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:29:54.215226 run osmo-stp_10.42.42.5(pid=22670): stderr: | 20221213192952649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213192952649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213192952649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213192952650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213192952650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213192952651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213192952651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:29:54.361259 run patchelf(pid=22673): Terminating (SIGINT) 19:29:54.529751 run patchelf(pid=22673): Terminated: ok {rc=0} 19:29:54.650993 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22670): Process ended prematurely: osmo-stp_10.42.42.5(pid=22670) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22670)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 19:29:54.659830 tst ping.py:22: Test FAILED (6.5 sec) 19:29:54.686791 run osmo-hlr_10.42.42.2(pid=22667): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22667)] 19:29:54.735453 run osmo-hlr_10.42.42.2(pid=22667): stdout: | (launched: 2022-12-13_19:29:51.539919) 19:29:54.785286 run osmo-hlr_10.42.42.2(pid=22667): stderr: | 20221213192951715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192951715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192951715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192951715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192951715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192951715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192951727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192951736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192951736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192951736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:29:54.835629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22666): Terminating (SIGTERM) 19:29:54.876135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22669): Terminating (SIGTERM) 19:29:54.916576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22672): Terminating (SIGTERM) 19:29:54.957386 --- ParallelTerminationStrategy: PID 22666 died... 19:29:54.977009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22666): Terminated: ok {rc=0} 19:29:55.022257 --- ParallelTerminationStrategy: PID 22669 died... 19:29:55.041550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22669): Terminated: ok {rc=0} 19:29:55.085987 --- ParallelTerminationStrategy: PID 22672 died... 19:29:55.104698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22672): Terminated: ok {rc=0} 19:29:55.191148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:29:56.280781 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.292543 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:29:56.363806 tst ping_idle_ping.py: using LAC 35768 19:29:56.488654 tst ping_idle_ping.py: using RAC 68 19:29:56.605981 tst ping_idle_ping.py: using CellId 35768 19:29:56.724824 tst ping_idle_ping.py: using BVCI 35769 19:29:56.833617 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.844610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.855432 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.866255 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.877058 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.887836 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.898795 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:29:56.909755 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:29:57.023714 tst ping_idle_ping.py:24: start network... 19:29:57.226632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:29:57.698665 run create_hlr_db(pid=22674): Launched 19:29:57.821473 bus /gobi_6: Setting Powered False 19:29:58.882557 run create_hlr_db(pid=22674): Terminated: ok {rc=0} 19:29:59.326255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Launched 19:29:59.651337 run osmo-hlr_10.42.42.2(pid=22677): Launched 19:29:59.774920 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:00.334341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Launched 19:30:00.658205 run osmo-stp_10.42.42.5(pid=22680): Launched 19:30:00.781532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:30:01.447076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Launched 19:30:01.583871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:30:01.872359 run patchelf(pid=22686): Launched 19:30:02.069914 run osmo-stp_10.42.42.5(pid=22680): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] 19:30:02.209494 run osmo-stp_10.42.42.5(pid=22680): stdout: | (launched: 2022-12-13_19:30:00.598048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:02.349776 run osmo-stp_10.42.42.5(pid=22680): stderr: | 20221213193000790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193000790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193000790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193000791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193000791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193000791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193000791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:02.488906 run osmo-stp_10.42.42.5(pid=22680): stdout: | (launched: 2022-12-13_19:30:00.598048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:02.622607 run osmo-stp_10.42.42.5(pid=22680): stderr: | 20221213193000790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193000790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193000790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193000791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193000791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193000791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193000791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:02.780790 run patchelf(pid=22686): Terminating (SIGINT) 19:30:02.962011 run patchelf(pid=22686): Terminated: ok {rc=0} 19:30:03.093161 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22680): Process ended prematurely: osmo-stp_10.42.42.5(pid=22680) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:30:03.103069 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 19:30:03.131684 run osmo-hlr_10.42.42.2(pid=22677): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22677)] 19:30:03.183383 run osmo-hlr_10.42.42.2(pid=22677): stdout: | (launched: 2022-12-13_19:29:59.591409) 19:30:03.236729 run osmo-hlr_10.42.42.2(pid=22677): stderr: | 20221213192959788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213192959788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213192959788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213192959788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213192959788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213192959788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213192959811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213192959820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213192959820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213192959821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:03.290180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Terminating (SIGTERM) 19:30:03.333001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Terminating (SIGTERM) 19:30:03.376381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Terminating (SIGTERM) 19:30:03.420108 --- ParallelTerminationStrategy: PID 22676 died... 19:30:03.441148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22676): Terminated: ok {rc=0} 19:30:03.488722 --- ParallelTerminationStrategy: PID 22679 died... 19:30:03.509238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22679): Terminated: ok {rc=0} 19:30:03.556700 --- ParallelTerminationStrategy: PID 22682 died... 19:30:03.577463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22682): Terminated: ok {rc=0} 19:30:03.667761 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:30:04.978729 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:30:04.985428 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:30:05.020022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:30:05.061563 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:30:05.155413 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:30:05.190016 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:30:05.228766 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:30:05.823564 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:30:05.878890 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:05.890494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:05.964666 tst cs_paging_gprs_active.py: using LAC 35769 19:30:06.095470 tst cs_paging_gprs_active.py: using RAC 69 19:30:06.226070 tst cs_paging_gprs_active.py: using CellId 35769 19:30:06.357194 tst cs_paging_gprs_active.py: using BVCI 35770 19:30:06.477690 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.489347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.500546 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.511859 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.524000 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.536589 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.549990 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.560855 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:06.571968 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:06.695155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:06.821818 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:30:07.045326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:07.376338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22692): Launched 19:30:07.663236 run iperf3-srv_10.42.42.10(pid=22693): Launched 19:30:07.786557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:30:08.008487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:08.338928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Launched 19:30:08.625964 run iperf3-srv_10.42.42.10(pid=22695): Launched 19:30:08.749347 tst cs_paging_gprs_active.py:38: start network... 19:30:08.971709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:09.483149 run create_hlr_db(pid=22697): Launched 19:30:09.608785 bus /gobi_6: Setting Powered False 19:30:10.674498 run create_hlr_db(pid=22697): Terminated: ok {rc=0} 19:30:11.114666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22699): Launched 19:30:11.423625 run osmo-hlr_10.42.42.2(pid=22700): Launched 19:30:11.540558 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:12.069182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22702): Launched 19:30:12.377962 run osmo-stp_10.42.42.5(pid=22703): Launched 19:30:12.494896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:30:13.024348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22705): Launched 19:30:13.142098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:30:13.402786 run patchelf(pid=22706): Launched 19:30:13.574535 run osmo-stp_10.42.42.5(pid=22703): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22703)] 19:30:13.703993 run osmo-stp_10.42.42.5(pid=22703): stdout: | (launched: 2022-12-13_19:30:12.320272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:13.834937 run osmo-stp_10.42.42.5(pid=22703): stderr: | 20221213193012490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193012490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193012491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193012491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193012491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193012491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193012492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:13.966789 run osmo-stp_10.42.42.5(pid=22703): stdout: | (launched: 2022-12-13_19:30:12.320272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:14.092184 run osmo-stp_10.42.42.5(pid=22703): stderr: | 20221213193012490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193012490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193012491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193012491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193012491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193012491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193012492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:14.240470 run patchelf(pid=22706): Terminating (SIGINT) 19:30:14.412238 run patchelf(pid=22706): Terminated: ok {rc=0} 19:30:14.536054 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22703): Process ended prematurely: osmo-stp_10.42.42.5(pid=22703) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22703)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:30:14.545633 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:30:14.572712 run osmo-hlr_10.42.42.2(pid=22700): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22700)] 19:30:14.621129 run osmo-hlr_10.42.42.2(pid=22700): stdout: | (launched: 2022-12-13_19:30:11.366402) 19:30:14.670762 run osmo-hlr_10.42.42.2(pid=22700): stderr: | 20221213193011543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193011543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193011543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193011543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193011543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193011543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193011556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193011567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193011567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193011567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:14.721272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22692): Terminating (SIGTERM) 19:30:14.761420 run iperf3-srv_10.42.42.10(pid=22693): Terminating (SIGTERM) 19:30:14.802589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Terminating (SIGTERM) 19:30:14.842811 run iperf3-srv_10.42.42.10(pid=22695): Terminating (SIGTERM) 19:30:14.882485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22699): Terminating (SIGTERM) 19:30:14.922109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22702): Terminating (SIGTERM) 19:30:14.961618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22705): Terminating (SIGTERM) 19:30:15.001522 --- ParallelTerminationStrategy: PID 22692 died... 19:30:15.020512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22692): Terminated: ok {rc=0} 19:30:15.064481 --- ParallelTerminationStrategy: PID 22693 died... 19:30:15.082941 run iperf3-srv_10.42.42.10(pid=22693): Terminated {rc=256} 19:30:15.126908 --- ParallelTerminationStrategy: PID 22694 died... 19:30:15.145476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Terminated: ok {rc=0} 19:30:15.189585 --- ParallelTerminationStrategy: PID 22695 died... 19:30:15.208321 run iperf3-srv_10.42.42.10(pid=22695): Terminated {rc=256} 19:30:15.252479 --- ParallelTerminationStrategy: PID 22699 died... 19:30:15.271075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22699): Terminated: ok {rc=0} 19:30:15.314769 --- ParallelTerminationStrategy: PID 22702 died... 19:30:15.333497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22702): Terminated: ok {rc=0} 19:30:15.377278 --- ParallelTerminationStrategy: PID 22705 died... 19:30:15.395754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22705): Terminated: ok {rc=0} 19:30:15.479078 bus /gobi_0: Setting Powered False 19:30:16.586719 bus /gobi_0: Setting Powered False 19:30:17.711579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:30:18.862119 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:18.874324 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:18.947573 tst iperf3.py: using LAC 35770 19:30:19.076032 tst iperf3.py: using RAC 70 19:30:19.204160 tst iperf3.py: using CellId 35770 19:30:19.332010 tst iperf3.py: using BVCI 35771 19:30:19.452779 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.464529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.476062 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.487559 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.499269 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.511319 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.523212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.534961 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:19.546866 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:19.663723 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:30:19.869419 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:20.177208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22707): Launched 19:30:20.444188 run iperf3-srv_10.42.42.10(pid=22708): Launched 19:30:20.559002 tst iperf3.py:8: start network... 19:30:20.764000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:21.239581 run create_hlr_db(pid=22709): Launched 19:30:21.366178 bus /gobi_6: Setting Powered False 19:30:22.427532 run create_hlr_db(pid=22709): Terminated: ok {rc=0} 19:30:22.855386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Launched 19:30:23.165764 run osmo-hlr_10.42.42.2(pid=22712): Launched 19:30:23.293092 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:23.864276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Launched 19:30:24.194070 run osmo-stp_10.42.42.5(pid=22715): Launched 19:30:24.319220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:30:24.886609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22717): Launched 19:30:25.012570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:30:25.290832 run patchelf(pid=22718): Launched 19:30:25.472597 run osmo-stp_10.42.42.5(pid=22715): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] 19:30:25.612016 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-13_19:30:24.133275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:25.752271 run osmo-stp_10.42.42.5(pid=22715): stderr: | 20221213193024326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193024326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193024326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193024326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193024327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193024327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193024327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:25.892332 run osmo-stp_10.42.42.5(pid=22715): stdout: | (launched: 2022-12-13_19:30:24.133275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:26.026943 run osmo-stp_10.42.42.5(pid=22715): stderr: | 20221213193024326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193024326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193024326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193024326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193024327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193024327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193024327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:26.186685 run patchelf(pid=22718): Terminating (SIGINT) 19:30:26.369174 run patchelf(pid=22718): Terminated: ok {rc=0} 19:30:26.501084 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 19:30:26.511533 tst iperf3.py:8: Test FAILED (7.7 sec) 19:30:26.540225 run osmo-hlr_10.42.42.2(pid=22712): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22712)] 19:30:26.591295 run osmo-hlr_10.42.42.2(pid=22712): stdout: | (launched: 2022-12-13_19:30:23.105618) 19:30:26.643527 run osmo-hlr_10.42.42.2(pid=22712): stderr: | 20221213193023304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193023304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193023304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193023304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193023304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193023304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193023320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193023329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193023329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193023329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:26.695791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22707): Terminating (SIGTERM) 19:30:26.738228 run iperf3-srv_10.42.42.10(pid=22708): Terminating (SIGTERM) 19:30:26.780020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminating (SIGTERM) 19:30:26.822680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminating (SIGTERM) 19:30:26.865267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22717): Terminating (SIGTERM) 19:30:26.907539 --- ParallelTerminationStrategy: PID 22707 died... 19:30:26.927939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22707): Terminated: ok {rc=0} 19:30:26.974932 --- ParallelTerminationStrategy: PID 22708 died... 19:30:26.994721 run iperf3-srv_10.42.42.10(pid=22708): Terminated {rc=256} 19:30:27.041256 --- ParallelTerminationStrategy: PID 22711 died... 19:30:27.061544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22711): Terminated: ok {rc=0} 19:30:27.108109 --- ParallelTerminationStrategy: PID 22714 died... 19:30:27.127807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22714): Terminated: ok {rc=0} 19:30:27.174214 --- ParallelTerminationStrategy: PID 22717 died... 19:30:27.194209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22717): Terminated: ok {rc=0} 19:30:27.281647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:30:28.428753 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:28.440674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:28.511301 tst iperf3m4.py: using LAC 35771 19:30:28.632614 tst iperf3m4.py: using RAC 71 19:30:28.751585 tst iperf3m4.py: using CellId 35771 19:30:28.870528 tst iperf3m4.py: using BVCI 35772 19:30:28.982837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:28.994076 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.005002 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.015830 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.026733 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.037944 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.049052 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.059918 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:29.070973 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:29.187018 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:29.304453 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:29.424751 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:29.545781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:30:29.768554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:30.099250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Launched 19:30:30.386895 run iperf3-srv_10.42.42.10(pid=22720): Launched 19:30:30.510644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:30:30.733166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:31.082837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Launched 19:30:31.382148 run iperf3-srv_10.42.42.10(pid=22722): Launched 19:30:31.521582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:30:31.748547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:32.087103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Launched 19:30:32.386561 run iperf3-srv_10.42.42.10(pid=22724): Launched 19:30:32.510867 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:30:32.733146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:30:33.063091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22725): Launched 19:30:33.350094 run iperf3-srv_10.42.42.10(pid=22726): Launched 19:30:33.473129 tst iperf3m4.py:8: start network... 19:30:33.694364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:34.203504 run create_hlr_db(pid=22727): Launched 19:30:34.328348 bus /gobi_6: Setting Powered False 19:30:35.393601 run create_hlr_db(pid=22727): Terminated: ok {rc=0} 19:30:35.833965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22729): Launched 19:30:36.142432 run osmo-hlr_10.42.42.2(pid=22730): Launched 19:30:36.259048 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:36.788454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22732): Launched 19:30:37.095461 run osmo-stp_10.42.42.5(pid=22733): Launched 19:30:37.211285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:30:37.738134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22735): Launched 19:30:37.854234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:30:38.112859 run patchelf(pid=22736): Launched 19:30:38.282075 run osmo-stp_10.42.42.5(pid=22733): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22733)] 19:30:38.411304 run osmo-stp_10.42.42.5(pid=22733): stdout: | (launched: 2022-12-13_19:30:37.037972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:38.542427 run osmo-stp_10.42.42.5(pid=22733): stderr: | 20221213193037208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193037209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193037209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193037209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193037210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193037210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193037210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:38.673143 run osmo-stp_10.42.42.5(pid=22733): stdout: | (launched: 2022-12-13_19:30:37.037972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:38.798072 run osmo-stp_10.42.42.5(pid=22733): stderr: | 20221213193037208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193037209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193037209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193037209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193037210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193037210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193037210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:38.946314 run patchelf(pid=22736): Terminating (SIGINT) 19:30:39.117668 run patchelf(pid=22736): Terminated: ok {rc=0} 19:30:39.240484 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22733): Process ended prematurely: osmo-stp_10.42.42.5(pid=22733) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22733)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:30:39.250116 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:30:39.277679 run osmo-hlr_10.42.42.2(pid=22730): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22730)] 19:30:39.325898 run osmo-hlr_10.42.42.2(pid=22730): stdout: | (launched: 2022-12-13_19:30:36.084740) 19:30:39.375746 run osmo-hlr_10.42.42.2(pid=22730): stderr: | 20221213193036259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193036259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193036259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193036259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193036259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193036259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193036271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193036282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193036282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193036282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:39.425798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Terminating (SIGTERM) 19:30:39.465726 run iperf3-srv_10.42.42.10(pid=22720): Terminating (SIGTERM) 19:30:39.505377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Terminating (SIGTERM) 19:30:39.545414 run iperf3-srv_10.42.42.10(pid=22722): Terminating (SIGTERM) 19:30:39.584931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Terminating (SIGTERM) 19:30:39.625126 run iperf3-srv_10.42.42.10(pid=22724): Terminating (SIGTERM) 19:30:39.664634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22725): Terminating (SIGTERM) 19:30:39.704177 run iperf3-srv_10.42.42.10(pid=22726): Terminating (SIGTERM) 19:30:39.743449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22729): Terminating (SIGTERM) 19:30:39.782890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22732): Terminating (SIGTERM) 19:30:39.822495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22735): Terminating (SIGTERM) 19:30:39.862692 --- ParallelTerminationStrategy: PID 22719 died... 19:30:39.882053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22719): Terminated: ok {rc=0} 19:30:39.926488 --- ParallelTerminationStrategy: PID 22720 died... 19:30:39.945134 run iperf3-srv_10.42.42.10(pid=22720): Terminated {rc=256} 19:30:39.989292 --- ParallelTerminationStrategy: PID 22721 died... 19:30:40.007950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22721): Terminated: ok {rc=0} 19:30:40.052155 --- ParallelTerminationStrategy: PID 22722 died... 19:30:40.070921 run iperf3-srv_10.42.42.10(pid=22722): Terminated {rc=256} 19:30:40.114864 --- ParallelTerminationStrategy: PID 22723 died... 19:30:40.133627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22723): Terminated: ok {rc=0} 19:30:40.177724 --- ParallelTerminationStrategy: PID 22724 died... 19:30:40.196272 run iperf3-srv_10.42.42.10(pid=22724): Terminated {rc=256} 19:30:40.240700 --- ParallelTerminationStrategy: PID 22725 died... 19:30:40.259535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22725): Terminated: ok {rc=0} 19:30:40.303766 --- ParallelTerminationStrategy: PID 22726 died... 19:30:40.322578 run iperf3-srv_10.42.42.10(pid=22726): Terminated {rc=256} 19:30:40.366560 --- ParallelTerminationStrategy: PID 22729 died... 19:30:40.385439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22729): Terminated: ok {rc=0} 19:30:40.429587 --- ParallelTerminationStrategy: PID 22732 died... 19:30:40.448421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22732): Terminated: ok {rc=0} 19:30:40.492692 --- ParallelTerminationStrategy: PID 22735 died... 19:30:40.511624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22735): Terminated: ok {rc=0} 19:30:40.598650 bus /gobi_4: Setting Powered False 19:30:41.699234 bus /gobi_4: Setting Powered False 19:30:42.814346 bus /gobi_1: Setting Powered False 19:30:43.914328 bus /gobi_1: Setting Powered False 19:30:45.029887 bus /gobi_0: Setting Powered False 19:30:46.129114 bus /gobi_0: Setting Powered False 19:30:47.249066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:30:48.354061 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:48.366435 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:48.440420 tst ping.py: using LAC 35772 19:30:48.567494 tst ping.py: using RAC 72 19:30:48.697143 tst ping.py: using CellId 35772 19:30:48.827618 tst ping.py: using BVCI 35773 19:30:48.946430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:48.957998 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:48.969356 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:48.980487 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:48.992080 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:49.003660 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:49.015318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:49.026910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:49.143879 tst ping.py:19: start network... 19:30:49.346308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:49.826140 run create_hlr_db(pid=22737): Launched 19:30:49.949548 bus /gobi_6: Setting Powered False 19:30:51.013421 run create_hlr_db(pid=22737): Terminated: ok {rc=0} 19:30:51.465246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22739): Launched 19:30:51.790124 run osmo-hlr_10.42.42.2(pid=22740): Launched 19:30:51.916087 run osmo-stp_10.42.42.5: Starting osmo-stp 19:30:52.476863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Launched 19:30:52.800201 run osmo-stp_10.42.42.5(pid=22744): Launched 19:30:52.922950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:30:53.482384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Launched 19:30:53.606931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:30:53.881724 run patchelf(pid=22747): Launched 19:30:54.061188 run osmo-stp_10.42.42.5(pid=22744): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] 19:30:54.198136 run osmo-stp_10.42.42.5(pid=22744): stdout: | (launched: 2022-12-13_19:30:52.740177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:54.336232 run osmo-stp_10.42.42.5(pid=22744): stderr: | 20221213193052930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193052930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193052931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193052931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193052932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193052932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193052932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:54.474843 run osmo-stp_10.42.42.5(pid=22744): stdout: | (launched: 2022-12-13_19:30:52.740177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:30:54.607714 run osmo-stp_10.42.42.5(pid=22744): stderr: | 20221213193052930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193052930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193052931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193052931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193052932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193052932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193052932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:30:54.765077 run patchelf(pid=22747): Terminating (SIGINT) 19:30:54.945810 run patchelf(pid=22747): Terminated: ok {rc=0} 19:30:55.075818 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22744): Process ended prematurely: osmo-stp_10.42.42.5(pid=22744) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 19:30:55.085593 tst ping.py:22: Test FAILED (6.7 sec) 19:30:55.113996 run osmo-hlr_10.42.42.2(pid=22740): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22740)] 19:30:55.165247 run osmo-hlr_10.42.42.2(pid=22740): stdout: | (launched: 2022-12-13_19:30:51.729950) 19:30:55.217859 run osmo-hlr_10.42.42.2(pid=22740): stderr: | 20221213193051934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193051934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193051934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193051934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193051934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193051934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193051947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193051959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193051959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193051959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:30:55.271606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22739): Terminating (SIGTERM) 19:30:55.314091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Terminating (SIGTERM) 19:30:55.357084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Terminating (SIGTERM) 19:30:55.400068 --- ParallelTerminationStrategy: PID 22739 died... 19:30:55.420623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22739): Terminated: ok {rc=0} 19:30:55.468109 --- ParallelTerminationStrategy: PID 22743 died... 19:30:55.488376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22743): Terminated: ok {rc=0} 19:30:55.535327 --- ParallelTerminationStrategy: PID 22746 died... 19:30:55.555471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22746): Terminated: ok {rc=0} 19:30:55.644360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:30:56.733529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:56.745690 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:30:56.819304 tst ping_idle_ping.py: using LAC 35773 19:30:56.945376 tst ping_idle_ping.py: using RAC 73 19:30:57.072190 tst ping_idle_ping.py: using CellId 35773 19:30:57.191511 tst ping_idle_ping.py: using BVCI 35774 19:30:57.303326 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.314435 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.325341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.336105 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.346862 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.358166 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.369079 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:30:57.379832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:30:57.499365 tst ping_idle_ping.py:24: start network... 19:30:57.717701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:30:58.224546 run create_hlr_db(pid=22748): Launched 19:30:58.348603 bus /gobi_6: Setting Powered False 19:30:59.413747 run create_hlr_db(pid=22748): Terminated: ok {rc=0} 19:30:59.852043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Launched 19:31:00.156691 run osmo-hlr_10.42.42.2(pid=22751): Launched 19:31:00.271924 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:00.794479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Launched 19:31:01.142387 run osmo-stp_10.42.42.5(pid=22754): Launched 19:31:01.380340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:02.032750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22756): Launched 19:31:02.172804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:02.451670 run patchelf(pid=22757): Launched 19:31:02.631554 run osmo-stp_10.42.42.5(pid=22754): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] 19:31:02.768851 run osmo-stp_10.42.42.5(pid=22754): stdout: | (launched: 2022-12-13_19:31:01.079859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:02.907032 run osmo-stp_10.42.42.5(pid=22754): stderr: | 20221213193101296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193101305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193101305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193101306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193101306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193101306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193101306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:03.045131 run osmo-stp_10.42.42.5(pid=22754): stdout: | (launched: 2022-12-13_19:31:01.079859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:03.177768 run osmo-stp_10.42.42.5(pid=22754): stderr: | 20221213193101296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193101305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193101305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193101306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193101306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193101306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193101306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:03.334797 run patchelf(pid=22757): Terminating (SIGINT) 19:31:03.515134 run patchelf(pid=22757): Terminated: ok {rc=0} 19:31:03.645724 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22754): Process ended prematurely: osmo-stp_10.42.42.5(pid=22754) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:31:03.655402 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 19:31:03.683845 run osmo-hlr_10.42.42.2(pid=22751): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22751)] 19:31:03.735327 run osmo-hlr_10.42.42.2(pid=22751): stdout: | (launched: 2022-12-13_19:31:00.099579) 19:31:03.788028 run osmo-hlr_10.42.42.2(pid=22751): stderr: | 20221213193100273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193100273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193100273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193100274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193100274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193100274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193100286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193100294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193100294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193100294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:03.841610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Terminating (SIGTERM) 19:31:03.884362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Terminating (SIGTERM) 19:31:03.927423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22756): Terminating (SIGTERM) 19:31:03.970731 --- ParallelTerminationStrategy: PID 22750 died... 19:31:03.991424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22750): Terminated: ok {rc=0} 19:31:04.038860 --- ParallelTerminationStrategy: PID 22753 died... 19:31:04.059125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22753): Terminated: ok {rc=0} 19:31:04.106261 --- ParallelTerminationStrategy: PID 22756 died... 19:31:04.126625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22756): Terminated: ok {rc=0} 19:31:04.216263 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:31:05.524460 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:05.531671 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:31:05.566937 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:31:05.603897 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:31:05.659271 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:31:05.693392 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:31:05.729191 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:31:06.285988 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:31:06.292296 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.305266 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:31:06.377165 tst switch_tch_pdch.py: using LAC 35774 19:31:06.498787 tst switch_tch_pdch.py: using RAC 74 19:31:06.617013 tst switch_tch_pdch.py: using CellId 35774 19:31:06.733431 tst switch_tch_pdch.py: using BVCI 35775 19:31:06.844018 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.855498 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.866809 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.877891 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.889013 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.900311 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.911644 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:31:06.922726 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:31:07.038871 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:31:07.165182 tst switch_tch_pdch.py:51: start network... 19:31:07.368496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:07.837865 run create_hlr_db(pid=22762): Launched 19:31:07.960624 bus /gobi_6: Setting Powered False 19:31:09.021354 run create_hlr_db(pid=22762): Terminated: ok {rc=0} 19:31:09.443153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Launched 19:31:09.745615 run osmo-hlr_10.42.42.2(pid=22765): Launched 19:31:09.858947 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:10.374800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Launched 19:31:10.675928 run osmo-stp_10.42.42.5(pid=22768): Launched 19:31:10.790050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:11.309690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22770): Launched 19:31:11.423749 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:11.678634 run patchelf(pid=22771): Launched 19:31:11.845322 run osmo-stp_10.42.42.5(pid=22768): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] 19:31:11.972128 run osmo-stp_10.42.42.5(pid=22768): stdout: | (launched: 2022-12-13_19:31:10.619654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:12.100379 run osmo-stp_10.42.42.5(pid=22768): stderr: | 20221213193110789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193110789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193110789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193110790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193110790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193110790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193110790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:12.228445 run osmo-stp_10.42.42.5(pid=22768): stdout: | (launched: 2022-12-13_19:31:10.619654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:12.351618 run osmo-stp_10.42.42.5(pid=22768): stderr: | 20221213193110789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193110789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193110789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193110790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193110790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193110790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193110790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:12.497568 run patchelf(pid=22771): Terminating (SIGINT) 19:31:12.666925 run patchelf(pid=22771): Terminated: ok {rc=0} 19:31:12.787893 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22768): Process ended prematurely: osmo-stp_10.42.42.5(pid=22768) [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:31:12.796765 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 19:31:12.823606 run osmo-hlr_10.42.42.2(pid=22765): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22765)] 19:31:12.871830 run osmo-hlr_10.42.42.2(pid=22765): stdout: | (launched: 2022-12-13_19:31:09.689210) 19:31:12.921410 run osmo-hlr_10.42.42.2(pid=22765): stderr: | 20221213193109863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193109863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193109863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193109863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193109863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193109863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193109875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193109884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193109884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193109884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:12.971369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Terminating (SIGTERM) 19:31:13.011696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Terminating (SIGTERM) 19:31:13.051880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22770): Terminating (SIGTERM) 19:31:13.092021 --- ParallelTerminationStrategy: PID 22764 died... 19:31:13.111053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22764): Terminated: ok {rc=0} 19:31:13.155343 --- ParallelTerminationStrategy: PID 22767 died... 19:31:13.174208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22767): Terminated: ok {rc=0} 19:31:13.218283 --- ParallelTerminationStrategy: PID 22770 died... 19:31:13.237207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22770): Terminated: ok {rc=0} 19:31:13.321297 bus /gobi_0: Setting Powered False 19:31:14.419850 bus /gobi_0: Setting Powered False 19:31:15.536024 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:31:16.818581 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:16.825219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:31:16.861067 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:31:16.897982 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:31:16.953602 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:31:17.014486 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:31:17.062481 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:31:17.579567 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:31:17.585619 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:17.597307 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:31:17.671924 tst switch_tch_pdch.py: using LAC 35775 19:31:17.792487 tst switch_tch_pdch.py: using RAC 75 19:31:17.908332 tst switch_tch_pdch.py: using CellId 35775 19:31:18.033193 tst switch_tch_pdch.py: using BVCI 35776 19:31:18.150807 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.162569 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.174071 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.185736 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.197554 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.209281 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.221051 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:31:18.232554 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:31:18.350217 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:31:18.470584 tst switch_tch_pdch.py:51: start network... 19:31:18.688795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:19.161600 run create_hlr_db(pid=22775): Launched 19:31:19.283935 bus /gobi_6: Setting Powered False 19:31:20.348871 run create_hlr_db(pid=22775): Terminated: ok {rc=0} 19:31:20.771796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22777): Launched 19:31:21.095051 run osmo-hlr_10.42.42.2(pid=22778): Launched 19:31:21.217960 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:21.715999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22780): Launched 19:31:22.019029 run osmo-stp_10.42.42.5(pid=22781): Launched 19:31:22.133604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:31:22.627225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22783): Launched 19:31:22.741845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:31:22.997212 run patchelf(pid=22784): Launched 19:31:23.164200 run osmo-stp_10.42.42.5(pid=22781): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22781)] 19:31:23.291649 run osmo-stp_10.42.42.5(pid=22781): stdout: | (launched: 2022-12-13_19:31:21.962862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:23.420520 run osmo-stp_10.42.42.5(pid=22781): stderr: | 20221213193122132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193122132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193122133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193122133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193122134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193122134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193122134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:23.549864 run osmo-stp_10.42.42.5(pid=22781): stdout: | (launched: 2022-12-13_19:31:21.962862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:23.673551 run osmo-stp_10.42.42.5(pid=22781): stderr: | 20221213193122132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193122132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193122133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193122133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193122134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193122134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193122134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:23.820250 run patchelf(pid=22784): Terminating (SIGINT) 19:31:23.988386 run patchelf(pid=22784): Terminated: ok {rc=0} 19:31:24.109677 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22781): Process ended prematurely: osmo-stp_10.42.42.5(pid=22781) [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22781)] [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:31:24.118559 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 19:31:24.145262 run osmo-hlr_10.42.42.2(pid=22778): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22778)] 19:31:24.193189 run osmo-hlr_10.42.42.2(pid=22778): stdout: | (launched: 2022-12-13_19:31:21.035013) 19:31:24.242510 run osmo-hlr_10.42.42.2(pid=22778): stderr: | 20221213193121232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193121232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193121232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193121232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193121232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193121232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193121244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193121253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193121253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193121253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:24.292382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22777): Terminating (SIGTERM) 19:31:24.332216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22780): Terminating (SIGTERM) 19:31:24.371978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22783): Terminating (SIGTERM) 19:31:24.412169 --- ParallelTerminationStrategy: PID 22777 died... 19:31:24.431589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22777): Terminated: ok {rc=0} 19:31:24.475857 --- ParallelTerminationStrategy: PID 22780 died... 19:31:24.494641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22780): Terminated: ok {rc=0} 19:31:24.539107 --- ParallelTerminationStrategy: PID 22783 died... 19:31:24.558219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22783): Terminated: ok {rc=0} 19:31:24.642172 bus /gobi_0: Setting Powered False 19:31:25.741638 bus /gobi_0: Setting Powered False 19:31:26.858620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 19:31:28.130468 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:28.135902 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:31:28.167259 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 19:31:28.175821 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:31:28.229078 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:31:28.259393 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 19:31:28.266688 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:31:28.806890 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 19:31:28.812105 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 19:31:28.823301 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:31:28.868417 tst mo_mt_sms.py: using LAC 35776 19:31:28.985845 tst mo_mt_sms.py: using RAC 76 19:31:29.105455 tst mo_mt_sms.py: using CellId 35776 19:31:29.233055 tst mo_mt_sms.py: using BVCI 35777 19:31:29.349817 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:31:29.465582 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:31:29.579564 tst mo_mt_sms.py:9: start nitb and bts... 19:31:29.782547 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:31:30.396936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22788): Launched 19:31:30.698528 run osmo-nitb_10.42.42.2(pid=22789): Launched 19:31:30.873752 run osmo-nitb_10.42.42.2(pid=22789): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22789)] 19:31:31.011775 run osmo-nitb_10.42.42.2(pid=22789): stdout: | (launched: 2022-12-13_19:31:30.641933) 19:31:31.151528 run osmo-nitb_10.42.42.2(pid=22789): stderr: | (launched: 2022-12-13_19:31:30.686677) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:31:31.292178 run osmo-nitb_10.42.42.2(pid=22789): stdout: | (launched: 2022-12-13_19:31:30.641933) 19:31:31.428894 run osmo-nitb_10.42.42.2(pid=22789): stderr: | (launched: 2022-12-13_19:31:30.686677) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22789) [trial-2393↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22789)] 19:31:31.811614 tst osmo-nitb_10.42.42.2(pid=22789): stdout: | (launched: 2022-12-13_19:31:30.641933) 19:31:31.934923 tst osmo-nitb_10.42.42.2(pid=22789): stderr: | (launched: 2022-12-13_19:31:30.686677) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:31:32.082360 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22789) [trial-2393↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22789)] [trial-2393↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 19:31:32.091400 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 19:31:32.098579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22788): Terminating (SIGTERM) 19:31:32.310467 --- ParallelTerminationStrategy: PID 22788 died... 19:31:32.332054 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22788): Terminated: ok {rc=0} 19:31:32.417727 bus /sierra_3: Setting Powered False 19:31:33.519391 bus /sierra_3: Setting Powered False 19:31:34.638553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 19:31:35.837439 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:35.842066 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:31:35.872263 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:31:35.902646 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:31:35.957988 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:31:35.988673 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:31:36.017432 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:31:36.564418 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 19:31:36.570298 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:36.581956 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:31:36.629356 tst mo_mt_sms.py: using LAC 35777 19:31:36.757316 tst mo_mt_sms.py: using RAC 77 19:31:36.876578 tst mo_mt_sms.py: using CellId 35777 19:31:36.996465 tst mo_mt_sms.py: using BVCI 35778 19:31:37.106217 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:37.117097 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:37.127863 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:37.138608 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:37.149341 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:37.160471 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:31:37.280414 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:31:37.396726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:37.864596 run create_hlr_db(pid=22793): Launched 19:31:37.993131 bus /sierra_2: Setting Powered False 19:31:39.053583 run create_hlr_db(pid=22793): Terminated: ok {rc=0} 19:31:39.506268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22795): Launched 19:31:39.830198 run osmo-hlr_10.42.42.2(pid=22796): Launched 19:31:39.954764 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:40.510226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22798): Launched 19:31:40.834329 run osmo-stp_10.42.42.5(pid=22799): Launched 19:31:40.957551 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:41.544233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22801): Launched 19:31:41.868430 run osmo-msc_10.42.42.6(pid=22802): Launched 19:31:42.050720 run osmo-stp_10.42.42.5(pid=22799): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22799)] 19:31:42.187942 run osmo-stp_10.42.42.5(pid=22799): stdout: | (launched: 2022-12-13_19:31:40.774437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:42.325667 run osmo-stp_10.42.42.5(pid=22799): stderr: | 20221213193140966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193140966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193140966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193140967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193140967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193140967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193140967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:42.462051 run osmo-stp_10.42.42.5(pid=22799): stdout: | (launched: 2022-12-13_19:31:40.774437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:42.591402 run osmo-stp_10.42.42.5(pid=22799): stderr: | 20221213193140966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193140966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193140966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193140967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193140967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193140967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193140967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:42.746385 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22799): Process ended prematurely: osmo-stp_10.42.42.5(pid=22799) [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22799)] [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 19:31:42.755240 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 19:31:42.782972 run osmo-hlr_10.42.42.2(pid=22796): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22796)] 19:31:42.834382 run osmo-hlr_10.42.42.2(pid=22796): stdout: | (launched: 2022-12-13_19:31:39.770355) 19:31:42.886915 run osmo-hlr_10.42.42.2(pid=22796): stderr: | 20221213193139968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193139968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193139968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193139968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193139968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193139968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193139981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193139989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193139989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193139989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:42.960647 run osmo-msc_10.42.42.6(pid=22802): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22802)] 19:31:43.011534 run osmo-msc_10.42.42.6(pid=22802): stdout: | (launched: 2022-12-13_19:31:41.808364) 19:31:43.064112 run osmo-msc_10.42.42.6(pid=22802): stderr: | 20221213193142131 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193142131 DLGLOBAL DEBUG validating counter group 0x7f3fb7e17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193142131 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193142131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193142132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193142132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193142134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193142134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193142134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193142134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:43.117550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22795): Terminating (SIGTERM) 19:31:43.159840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22798): Terminating (SIGTERM) 19:31:43.202249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22801): Terminating (SIGTERM) 19:31:43.245683 --- ParallelTerminationStrategy: PID 22795 died... 19:31:43.266232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22795): Terminated: ok {rc=0} 19:31:43.313217 --- ParallelTerminationStrategy: PID 22798 died... 19:31:43.333275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22798): Terminated: ok {rc=0} 19:31:43.380085 --- ParallelTerminationStrategy: PID 22801 died... 19:31:43.400172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22801): Terminated: ok {rc=0} 19:31:43.489907 bus /sierra_3: Setting Powered False 19:31:44.590076 bus /sierra_3: Setting Powered False 19:31:45.707596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 19:31:46.965567 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:46.969857 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:31:47.002087 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 19:31:47.010075 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 19:31:47.048720 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:31:47.087066 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 19:31:47.098125 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 19:31:47.602748 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 19:31:47.608669 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 19:31:47.620483 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:31:47.665556 tst assert_extension.py: using LAC 35778 19:31:47.790756 tst assert_extension.py: using RAC 78 19:31:47.908112 tst assert_extension.py: using CellId 35778 19:31:48.035553 tst assert_extension.py: using BVCI 35779 19:31:48.147556 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 19:31:48.267452 tst assert_extension.py:10: start nitb and bts... 19:31:48.485251 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:31:49.146754 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22807): Launched 19:31:49.471208 run osmo-nitb_10.42.42.2(pid=22808): Launched 19:31:49.651129 run osmo-nitb_10.42.42.2(pid=22808): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22808)] 19:31:49.796196 run osmo-nitb_10.42.42.2(pid=22808): stdout: | (launched: 2022-12-13_19:31:49.411419) 19:31:49.942898 run osmo-nitb_10.42.42.2(pid=22808): stderr: | (launched: 2022-12-13_19:31:49.459387) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:31:50.089733 run osmo-nitb_10.42.42.2(pid=22808): stdout: | (launched: 2022-12-13_19:31:49.411419) 19:31:50.230699 run osmo-nitb_10.42.42.2(pid=22808): stderr: | (launched: 2022-12-13_19:31:49.459387) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22808) [trial-2393↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22808)] 19:31:50.594082 tst osmo-nitb_10.42.42.2(pid=22808): stdout: | (launched: 2022-12-13_19:31:49.411419) 19:31:50.726308 tst osmo-nitb_10.42.42.2(pid=22808): stderr: | (launched: 2022-12-13_19:31:49.459387) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:31:50.880848 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22808) [trial-2393↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22808)] [trial-2393↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 19:31:50.889960 tst assert_extension.py:12: Test FAILED (3.3 sec) 19:31:50.897139 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22807): Terminating (SIGTERM) 19:31:51.109579 --- ParallelTerminationStrategy: PID 22807 died... 19:31:51.131898 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22807): Terminated: ok {rc=0} 19:31:51.222398 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 19:31:52.400883 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:31:52.405342 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:31:52.435294 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:31:52.465936 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 19:31:52.503660 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:31:52.535004 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:31:52.563724 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 19:31:53.091671 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 19:31:53.097351 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.108902 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:31:53.155779 tst assert_extension.py: using LAC 35779 19:31:53.283217 tst assert_extension.py: using RAC 79 19:31:53.412374 tst assert_extension.py: using CellId 35779 19:31:53.536705 tst assert_extension.py: using BVCI 35780 19:31:53.653674 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.665264 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.676673 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.688189 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.699903 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:31:53.711586 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 19:31:53.828454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:31:54.296755 run create_hlr_db(pid=22812): Launched 19:31:54.420436 bus /sierra_2: Setting Powered False 19:31:55.480875 run create_hlr_db(pid=22812): Terminated: ok {rc=0} 19:31:55.901997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Launched 19:31:56.204246 run osmo-hlr_10.42.42.2(pid=22815): Launched 19:31:56.318323 run osmo-stp_10.42.42.5: Starting osmo-stp 19:31:56.839622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Launched 19:31:57.142967 run osmo-stp_10.42.42.5(pid=22818): Launched 19:31:57.258625 run osmo-msc_10.42.42.6: Starting osmo-msc 19:31:57.803525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Launched 19:31:58.106611 run osmo-msc_10.42.42.6(pid=22821): Launched 19:31:58.274443 run osmo-stp_10.42.42.5(pid=22818): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] 19:31:58.401942 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-13_19:31:57.086206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:58.529282 run osmo-stp_10.42.42.5(pid=22818): stderr: | 20221213193157253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193157253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193157253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193157254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193157254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193157254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193157254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:58.654624 run osmo-stp_10.42.42.5(pid=22818): stdout: | (launched: 2022-12-13_19:31:57.086206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:31:58.774473 run osmo-stp_10.42.42.5(pid=22818): stderr: | 20221213193157253 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193157253 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193157253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193157254 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193157254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193157254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193157254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:31:58.917411 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 19:31:58.925465 tst assert_extension.py:17: Test FAILED (5.8 sec) 19:31:58.951729 run osmo-hlr_10.42.42.2(pid=22815): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22815)] 19:31:58.999421 run osmo-hlr_10.42.42.2(pid=22815): stdout: | (launched: 2022-12-13_19:31:56.147694) 19:31:59.048782 run osmo-hlr_10.42.42.2(pid=22815): stderr: | 20221213193156323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193156324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193156324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193156324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193156324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193156324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193156336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193156344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193156345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193156345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:31:59.118032 run osmo-msc_10.42.42.6(pid=22821): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22821)] 19:31:59.165957 run osmo-msc_10.42.42.6(pid=22821): stdout: | (launched: 2022-12-13_19:31:58.049368) 19:31:59.215227 run osmo-msc_10.42.42.6(pid=22821): stderr: | 20221213193158322 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193158322 DLGLOBAL DEBUG validating counter group 0x7f3304716c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193158322 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193158322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193158322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193158323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193158324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193158325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193158325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193158325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:31:59.264866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminating (SIGTERM) 19:31:59.305196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminating (SIGTERM) 19:31:59.345032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Terminating (SIGTERM) 19:31:59.384683 --- ParallelTerminationStrategy: PID 22814 died... 19:31:59.403931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22814): Terminated: ok {rc=0} 19:31:59.448123 --- ParallelTerminationStrategy: PID 22817 died... 19:31:59.466944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22817): Terminated: ok {rc=0} 19:31:59.510846 --- ParallelTerminationStrategy: PID 22820 died... 19:31:59.529574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22820): Terminated: ok {rc=0} 19:31:59.615855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:32:00.826050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:00.836216 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:32:00.867408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:32:00.896029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:32:00.955600 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:32:00.986355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:32:01.015254 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:32:01.589469 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:32:01.663113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:01.675443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:32:01.744813 tst mo_mt_call.py: using LAC 35780 19:32:01.875972 tst mo_mt_call.py: using RAC 80 19:32:02.008726 tst mo_mt_call.py: using CellId 35780 19:32:02.166688 tst mo_mt_call.py: using BVCI 35781 19:32:02.303783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:02.316736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:02.329182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:02.341427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:02.354240 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:02.366453 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:32:02.488022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:32:02.609920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:03.122269 run create_hlr_db(pid=22826): Launched 19:32:03.248459 bus /sierra_2: Setting Powered False 19:32:04.313302 run create_hlr_db(pid=22826): Terminated: ok {rc=0} 19:32:04.754222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22828): Launched 19:32:05.063137 run osmo-hlr_10.42.42.2(pid=22829): Launched 19:32:05.179209 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:05.711232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22831): Launched 19:32:06.018591 run osmo-stp_10.42.42.5(pid=22832): Launched 19:32:06.134978 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:06.687387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22834): Launched 19:32:06.993780 run osmo-msc_10.42.42.6(pid=22835): Launched 19:32:07.164388 run osmo-stp_10.42.42.5(pid=22832): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22832)] 19:32:07.294018 run osmo-stp_10.42.42.5(pid=22832): stdout: | (launched: 2022-12-13_19:32:05.961143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:07.422976 run osmo-stp_10.42.42.5(pid=22832): stderr: | 20221213193206133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193206133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193206134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193206134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193206134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193206135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193206135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:07.550390 run osmo-stp_10.42.42.5(pid=22832): stdout: | (launched: 2022-12-13_19:32:05.961143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:07.672474 run osmo-stp_10.42.42.5(pid=22832): stderr: | 20221213193206133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193206133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193206134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193206134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193206134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193206135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193206135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:07.818847 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22832): Process ended prematurely: osmo-stp_10.42.42.5(pid=22832) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22832)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:32:07.827767 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:32:07.854478 run osmo-hlr_10.42.42.2(pid=22829): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22829)] 19:32:07.902633 run osmo-hlr_10.42.42.2(pid=22829): stdout: | (launched: 2022-12-13_19:32:05.005694) 19:32:07.951971 run osmo-hlr_10.42.42.2(pid=22829): stderr: | 20221213193205184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193205184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193205184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193205184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193205184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193205184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193205196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193205206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193205206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193205206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:08.021097 run osmo-msc_10.42.42.6(pid=22835): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22835)] 19:32:08.068770 run osmo-msc_10.42.42.6(pid=22835): stdout: | (launched: 2022-12-13_19:32:06.936661) 19:32:08.118695 run osmo-msc_10.42.42.6(pid=22835): stderr: | 20221213193207210 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193207210 DLGLOBAL DEBUG validating counter group 0x7f030cc18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193207210 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193207210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193207210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193207211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193207212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193207213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193207213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193207213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:08.168050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22828): Terminating (SIGTERM) 19:32:08.207696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22831): Terminating (SIGTERM) 19:32:08.247279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22834): Terminating (SIGTERM) 19:32:08.287007 --- ParallelTerminationStrategy: PID 22828 died... 19:32:08.306374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22828): Terminated: ok {rc=0} 19:32:08.350340 --- ParallelTerminationStrategy: PID 22831 died... 19:32:08.369412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22831): Terminated: ok {rc=0} 19:32:08.413727 --- ParallelTerminationStrategy: PID 22834 died... 19:32:08.432507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22834): Terminated: ok {rc=0} 19:32:08.517184 bus /sierra_3: Setting Powered False 19:32:09.616255 bus /sierra_3: Setting Powered False 19:32:10.736582 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:32:11.885734 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:11.897919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:32:11.964708 tst mo_mt_call_osmux.py: using LAC 35781 19:32:12.085799 tst mo_mt_call_osmux.py: using RAC 81 19:32:12.209028 tst mo_mt_call_osmux.py: using CellId 35781 19:32:12.328610 tst mo_mt_call_osmux.py: using BVCI 35782 19:32:12.439319 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:12.450815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:12.462054 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:12.473188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:12.484368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:32:12.495595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:32:12.611093 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:32:12.727596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:13.203924 run create_hlr_db(pid=22837): Launched 19:32:13.329267 bus /sierra_2: Setting Powered False 19:32:14.391392 run create_hlr_db(pid=22837): Terminated: ok {rc=0} 19:32:14.842207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22839): Launched 19:32:15.173447 run osmo-hlr_10.42.42.2(pid=22840): Launched 19:32:15.299419 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:15.885140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22842): Launched 19:32:16.251101 run osmo-stp_10.42.42.5(pid=22843): Launched 19:32:16.490796 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:17.209188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22845): Launched 19:32:17.546477 run osmo-msc_10.42.42.6(pid=22846): Launched 19:32:17.731735 run osmo-stp_10.42.42.5(pid=22843): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22843)] 19:32:17.871227 run osmo-stp_10.42.42.5(pid=22843): stdout: | (launched: 2022-12-13_19:32:16.190243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:18.010724 run osmo-stp_10.42.42.5(pid=22843): stderr: | 20221213193216525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193216525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193216526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193216526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193216527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193216527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193216527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:18.149068 run osmo-stp_10.42.42.5(pid=22843): stdout: | (launched: 2022-12-13_19:32:16.190243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:18.281222 run osmo-stp_10.42.42.5(pid=22843): stderr: | 20221213193216525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193216525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193216526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193216526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193216527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193216527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193216527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:18.439257 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22843): Process ended prematurely: osmo-stp_10.42.42.5(pid=22843) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22843)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:32:18.449075 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 19:32:18.477470 run osmo-hlr_10.42.42.2(pid=22840): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22840)] 19:32:18.529151 run osmo-hlr_10.42.42.2(pid=22840): stdout: | (launched: 2022-12-13_19:32:15.112208) 19:32:18.583040 run osmo-hlr_10.42.42.2(pid=22840): stderr: | 20221213193215311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193215311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193215311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193215311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193215311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193215311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193215323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193215331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193215332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193215332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:18.656601 run osmo-msc_10.42.42.6(pid=22846): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22846)] 19:32:18.707349 run osmo-msc_10.42.42.6(pid=22846): stdout: | (launched: 2022-12-13_19:32:17.485273) 19:32:18.759597 run osmo-msc_10.42.42.6(pid=22846): stderr: | 20221213193217808 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193217809 DLGLOBAL DEBUG validating counter group 0x7fb97492ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193217809 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193217809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193217809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193217809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193217811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193217811 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193217811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193217811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:18.812346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22839): Terminating (SIGTERM) 19:32:18.854732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22842): Terminating (SIGTERM) 19:32:18.897155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22845): Terminating (SIGTERM) 19:32:18.940235 --- ParallelTerminationStrategy: PID 22839 died... 19:32:18.961293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22839): Terminated: ok {rc=0} 19:32:19.008423 --- ParallelTerminationStrategy: PID 22842 died... 19:32:19.028808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22842): Terminated: ok {rc=0} 19:32:19.075704 --- ParallelTerminationStrategy: PID 22845 died... 19:32:19.096255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22845): Terminated: ok {rc=0} 19:32:19.186463 bus /sierra_3: Setting Powered False 19:32:20.282277 bus /sierra_3: Setting Powered False 19:32:21.399240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:32:22.646765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:22.653219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:32:22.682166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:32:22.708731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:32:22.762115 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:32:22.792169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:32:22.818985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:32:23.369442 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:32:23.419634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:23.431273 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:32:23.498068 tst mo_mt_call.py: using LAC 35782 19:32:23.618736 tst mo_mt_call.py: using RAC 82 19:32:23.741288 tst mo_mt_call.py: using CellId 35782 19:32:23.861608 tst mo_mt_call.py: using BVCI 35783 19:32:23.973392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:23.984701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:23.995952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:24.007141 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:24.018921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:24.030617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:32:24.147931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:32:24.268245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:24.744362 run create_hlr_db(pid=22851): Launched 19:32:24.869531 bus /sierra_2: Setting Powered False 19:32:25.931027 run create_hlr_db(pid=22851): Terminated: ok {rc=0} 19:32:26.381181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22853): Launched 19:32:26.711288 run osmo-hlr_10.42.42.2(pid=22854): Launched 19:32:26.838632 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:27.402664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22856): Launched 19:32:27.733987 run osmo-stp_10.42.42.5(pid=22857): Launched 19:32:27.859585 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:28.456381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22859): Launched 19:32:28.788117 run osmo-msc_10.42.42.6(pid=22860): Launched 19:32:28.972257 run osmo-stp_10.42.42.5(pid=22857): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22857)] 19:32:29.112025 run osmo-stp_10.42.42.5(pid=22857): stdout: | (launched: 2022-12-13_19:32:27.672772) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:29.251778 run osmo-stp_10.42.42.5(pid=22857): stderr: | 20221213193227865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193227865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193227865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193227866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193227866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193227866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193227866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:29.389919 run osmo-stp_10.42.42.5(pid=22857): stdout: | (launched: 2022-12-13_19:32:27.672772) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:29.521860 run osmo-stp_10.42.42.5(pid=22857): stderr: | 20221213193227865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193227865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193227865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193227866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193227866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193227866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193227866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:29.680385 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22857): Process ended prematurely: osmo-stp_10.42.42.5(pid=22857) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22857)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:32:29.690013 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:32:29.718081 run osmo-hlr_10.42.42.2(pid=22854): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22854)] 19:32:29.769178 run osmo-hlr_10.42.42.2(pid=22854): stdout: | (launched: 2022-12-13_19:32:26.650275) 19:32:29.821374 run osmo-hlr_10.42.42.2(pid=22854): stderr: | 20221213193226848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193226848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193226848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193226848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193226848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193226848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193226864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193226874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193226874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193226874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:29.894591 run osmo-msc_10.42.42.6(pid=22860): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22860)] 19:32:29.944807 run osmo-msc_10.42.42.6(pid=22860): stdout: | (launched: 2022-12-13_19:32:28.727101) 19:32:29.996839 run osmo-msc_10.42.42.6(pid=22860): stderr: | 20221213193229049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193229049 DLGLOBAL DEBUG validating counter group 0x7f8aded59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193229049 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193229049 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193229049 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193229049 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193229051 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193229051 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193229052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193229052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:30.049329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22853): Terminating (SIGTERM) 19:32:30.091545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22856): Terminating (SIGTERM) 19:32:30.134075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22859): Terminating (SIGTERM) 19:32:30.176864 --- ParallelTerminationStrategy: PID 22853 died... 19:32:30.197393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22853): Terminated: ok {rc=0} 19:32:30.244253 --- ParallelTerminationStrategy: PID 22856 died... 19:32:30.264347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22856): Terminated: ok {rc=0} 19:32:30.310912 --- ParallelTerminationStrategy: PID 22859 died... 19:32:30.330933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22859): Terminated: ok {rc=0} 19:32:30.418907 bus /sierra_3: Setting Powered False 19:32:31.516489 bus /sierra_3: Setting Powered False 19:32:32.632020 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:32:33.783241 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:33.796076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:32:33.864942 tst mo_mt_call_osmux.py: using LAC 35783 19:32:33.993369 tst mo_mt_call_osmux.py: using RAC 83 19:32:34.122637 tst mo_mt_call_osmux.py: using CellId 35783 19:32:34.251360 tst mo_mt_call_osmux.py: using BVCI 35784 19:32:34.370931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:34.383088 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:34.395319 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:34.407145 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:34.419354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:32:34.431427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:32:34.553889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:32:34.672726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:35.149969 run create_hlr_db(pid=22863): Launched 19:32:35.274987 bus /sierra_2: Setting Powered False 19:32:36.336549 run create_hlr_db(pid=22863): Terminated: ok {rc=0} 19:32:36.766241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Launched 19:32:37.073104 run osmo-hlr_10.42.42.2(pid=22866): Launched 19:32:37.189295 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:37.721686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Launched 19:32:38.028152 run osmo-stp_10.42.42.5(pid=22869): Launched 19:32:38.144774 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:38.701046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22871): Launched 19:32:39.008043 run osmo-msc_10.42.42.6(pid=22872): Launched 19:32:39.179344 run osmo-stp_10.42.42.5(pid=22869): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] 19:32:39.308687 run osmo-stp_10.42.42.5(pid=22869): stdout: | (launched: 2022-12-13_19:32:37.970898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:39.438413 run osmo-stp_10.42.42.5(pid=22869): stderr: | 20221213193238142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193238142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193238142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193238143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193238143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193238143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193238143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:39.565819 run osmo-stp_10.42.42.5(pid=22869): stdout: | (launched: 2022-12-13_19:32:37.970898) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:39.688545 run osmo-stp_10.42.42.5(pid=22869): stderr: | 20221213193238142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193238142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193238142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193238143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193238143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193238143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193238143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:39.834878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22869): Process ended prematurely: osmo-stp_10.42.42.5(pid=22869) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:32:39.843652 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:32:39.870461 run osmo-hlr_10.42.42.2(pid=22866): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22866)] 19:32:39.918616 run osmo-hlr_10.42.42.2(pid=22866): stdout: | (launched: 2022-12-13_19:32:37.015583) 19:32:39.968264 run osmo-hlr_10.42.42.2(pid=22866): stderr: | 20221213193237195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193237195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193237195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193237195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193237196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193237196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193237208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193237217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193237217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193237217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:40.037854 run osmo-msc_10.42.42.6(pid=22872): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22872)] 19:32:40.085728 run osmo-msc_10.42.42.6(pid=22872): stdout: | (launched: 2022-12-13_19:32:38.950623) 19:32:40.135259 run osmo-msc_10.42.42.6(pid=22872): stderr: | 20221213193239223 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193239223 DLGLOBAL DEBUG validating counter group 0x7f8c4f3e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193239223 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193239223 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193239223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193239224 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193239225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193239226 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193239226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193239226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:40.185111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Terminating (SIGTERM) 19:32:40.225134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Terminating (SIGTERM) 19:32:40.265310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22871): Terminating (SIGTERM) 19:32:40.305806 --- ParallelTerminationStrategy: PID 22865 died... 19:32:40.325355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Terminated: ok {rc=0} 19:32:40.370629 --- ParallelTerminationStrategy: PID 22868 died... 19:32:40.389428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Terminated: ok {rc=0} 19:32:40.433857 --- ParallelTerminationStrategy: PID 22871 died... 19:32:40.452537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22871): Terminated: ok {rc=0} 19:32:40.539098 bus /sierra_3: Setting Powered False 19:32:41.638597 bus /sierra_3: Setting Powered False 19:32:42.754157 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:32:44.001276 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:32:44.007764 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:32:44.036862 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:32:44.063864 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:32:44.115708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:32:44.144654 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:32:44.171368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:32:44.732893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:32:44.787609 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:44.799908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:32:44.866329 tst mo_mt_call.py: using LAC 35784 19:32:44.992724 tst mo_mt_call.py: using RAC 84 19:32:45.119459 tst mo_mt_call.py: using CellId 35784 19:32:45.239748 tst mo_mt_call.py: using BVCI 35785 19:32:45.351212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:45.362818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:45.374157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:45.385531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:45.397185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:45.408758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:32:45.530675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:32:45.648013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:46.160626 run create_hlr_db(pid=22877): Launched 19:32:46.321217 bus /sierra_2: Setting Powered False 19:32:47.382612 run create_hlr_db(pid=22877): Terminated: ok {rc=0} 19:32:47.835135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22879): Launched 19:32:48.166539 run osmo-hlr_10.42.42.2(pid=22880): Launched 19:32:48.292779 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:48.859760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22882): Launched 19:32:49.187951 run osmo-stp_10.42.42.5(pid=22883): Launched 19:32:49.312618 run osmo-msc_10.42.42.6: Starting osmo-msc 19:32:49.911581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22885): Launched 19:32:50.242997 run osmo-msc_10.42.42.6(pid=22886): Launched 19:32:50.427715 run osmo-stp_10.42.42.5(pid=22883): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22883)] 19:32:50.570840 run osmo-stp_10.42.42.5(pid=22883): stdout: | (launched: 2022-12-13_19:32:49.127132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:50.709903 run osmo-stp_10.42.42.5(pid=22883): stderr: | 20221213193249318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193249319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193249319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193249319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193249320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193249320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193249320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:50.847833 run osmo-stp_10.42.42.5(pid=22883): stdout: | (launched: 2022-12-13_19:32:49.127132) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:32:50.980427 run osmo-stp_10.42.42.5(pid=22883): stderr: | 20221213193249318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193249319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193249319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193249319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193249320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193249320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193249320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:32:51.139154 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22883): Process ended prematurely: osmo-stp_10.42.42.5(pid=22883) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22883)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:32:51.149117 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:32:51.177410 run osmo-hlr_10.42.42.2(pid=22880): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22880)] 19:32:51.228732 run osmo-hlr_10.42.42.2(pid=22880): stdout: | (launched: 2022-12-13_19:32:48.104713) 19:32:51.281477 run osmo-hlr_10.42.42.2(pid=22880): stderr: | 20221213193248303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193248303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193248303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193248303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193248303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193248304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193248316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193248325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193248325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193248325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:32:51.355552 run osmo-msc_10.42.42.6(pid=22886): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22886)] 19:32:51.405921 run osmo-msc_10.42.42.6(pid=22886): stdout: | (launched: 2022-12-13_19:32:50.181808) 19:32:51.458361 run osmo-msc_10.42.42.6(pid=22886): stderr: | 20221213193250504 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193250505 DLGLOBAL DEBUG validating counter group 0x7f80237c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193250505 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193250505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193250505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193250505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193250507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193250507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193250507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193250508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:32:51.511118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22879): Terminating (SIGTERM) 19:32:51.553615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22882): Terminating (SIGTERM) 19:32:51.596009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22885): Terminating (SIGTERM) 19:32:51.639319 --- ParallelTerminationStrategy: PID 22879 died... 19:32:51.660239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22879): Terminated: ok {rc=0} 19:32:51.707729 --- ParallelTerminationStrategy: PID 22882 died... 19:32:51.728256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22882): Terminated: ok {rc=0} 19:32:51.775330 --- ParallelTerminationStrategy: PID 22885 died... 19:32:51.795720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22885): Terminated: ok {rc=0} 19:32:51.885351 bus /sierra_3: Setting Powered False 19:32:52.984060 bus /sierra_3: Setting Powered False 19:32:54.100742 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:32:55.251889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.264584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:32:55.332661 tst mo_mt_call_osmux.py: using LAC 35785 19:32:55.460101 tst mo_mt_call_osmux.py: using RAC 85 19:32:55.586299 tst mo_mt_call_osmux.py: using CellId 35785 19:32:55.713331 tst mo_mt_call_osmux.py: using BVCI 35786 19:32:55.834675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.846614 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.858210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.870106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.882253 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:32:55.894259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:32:56.015911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:32:56.134559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:32:56.615285 run create_hlr_db(pid=22888): Launched 19:32:56.741760 bus /sierra_2: Setting Powered False 19:32:57.802378 run create_hlr_db(pid=22888): Terminated: ok {rc=0} 19:32:58.232010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Launched 19:32:58.541390 run osmo-hlr_10.42.42.2(pid=22891): Launched 19:32:58.657421 run osmo-stp_10.42.42.5: Starting osmo-stp 19:32:59.186694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Launched 19:32:59.494802 run osmo-stp_10.42.42.5(pid=22894): Launched 19:32:59.611327 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:00.173296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22896): Launched 19:33:00.476940 run osmo-msc_10.42.42.6(pid=22897): Launched 19:33:00.646753 run osmo-stp_10.42.42.5(pid=22894): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] 19:33:00.774730 run osmo-stp_10.42.42.5(pid=22894): stdout: | (launched: 2022-12-13_19:32:59.437380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:00.942726 run osmo-stp_10.42.42.5(pid=22894): stderr: | 20221213193259609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193259610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193259610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193259610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193259611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193259611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193259611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:01.086615 run osmo-stp_10.42.42.5(pid=22894): stdout: | (launched: 2022-12-13_19:32:59.437380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:01.222385 run osmo-stp_10.42.42.5(pid=22894): stderr: | 20221213193259609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193259610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193259610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193259610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193259611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193259611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193259611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:01.386755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22894): Process ended prematurely: osmo-stp_10.42.42.5(pid=22894) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:33:01.397523 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:33:01.426571 run osmo-hlr_10.42.42.2(pid=22891): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22891)] 19:33:01.480910 run osmo-hlr_10.42.42.2(pid=22891): stdout: | (launched: 2022-12-13_19:32:58.483035) 19:33:01.536843 run osmo-hlr_10.42.42.2(pid=22891): stderr: | 20221213193258661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193258661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193258661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193258661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193258661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193258661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193258678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193258688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193258688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193258688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:01.612397 run osmo-msc_10.42.42.6(pid=22897): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22897)] 19:33:01.665541 run osmo-msc_10.42.42.6(pid=22897): stdout: | (launched: 2022-12-13_19:33:00.420671) 19:33:01.723422 run osmo-msc_10.42.42.6(pid=22897): stderr: | 20221213193300691 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193300691 DLGLOBAL DEBUG validating counter group 0x7fbae38e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193300691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193300691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193300691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193300692 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193300693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193300694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193300694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193300694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:01.778285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Terminating (SIGTERM) 19:33:01.821916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Terminating (SIGTERM) 19:33:01.868125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22896): Terminating (SIGTERM) 19:33:01.915876 --- ParallelTerminationStrategy: PID 22890 died... 19:33:01.937748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22890): Terminated: ok {rc=0} 19:33:01.987800 --- ParallelTerminationStrategy: PID 22893 died... 19:33:02.009557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22893): Terminated: ok {rc=0} 19:33:02.058518 --- ParallelTerminationStrategy: PID 22896 died... 19:33:02.080068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22896): Terminated: ok {rc=0} 19:33:02.173237 bus /sierra_3: Setting Powered False 19:33:03.271731 bus /sierra_3: Setting Powered False 19:33:04.383007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 19:33:05.622707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:05.628808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 19:33:05.657763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 19:33:05.685451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 19:33:05.737937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 19:33:05.767969 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 19:33:05.796604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 19:33:06.345231 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 19:33:06.394773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:06.406638 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:33:06.472277 tst mo_mt_call.py: using LAC 35786 19:33:06.592564 tst mo_mt_call.py: using RAC 86 19:33:06.716692 tst mo_mt_call.py: using CellId 35786 19:33:06.835239 tst mo_mt_call.py: using BVCI 35787 19:33:06.944410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:06.955876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:06.967197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:06.978229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:06.989447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:07.000380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:33:07.120543 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:33:07.240937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:07.746614 run create_hlr_db(pid=22903): Launched 19:33:07.871525 bus /sierra_2: Setting Powered False 19:33:08.935859 run create_hlr_db(pid=22903): Terminated: ok {rc=0} 19:33:09.370618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22905): Launched 19:33:09.674234 run osmo-hlr_10.42.42.2(pid=22906): Launched 19:33:09.789142 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:10.314931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22908): Launched 19:33:10.618781 run osmo-stp_10.42.42.5(pid=22909): Launched 19:33:10.733708 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:11.279244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22911): Launched 19:33:11.582590 run osmo-msc_10.42.42.6(pid=22912): Launched 19:33:11.751288 run osmo-stp_10.42.42.5(pid=22909): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22909)] 19:33:11.879249 run osmo-stp_10.42.42.5(pid=22909): stdout: | (launched: 2022-12-13_19:33:10.561821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:12.006552 run osmo-stp_10.42.42.5(pid=22909): stderr: | 20221213193310731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193310731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193310731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193310732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193310732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193310732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193310733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:12.132682 run osmo-stp_10.42.42.5(pid=22909): stdout: | (launched: 2022-12-13_19:33:10.561821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:12.253432 run osmo-stp_10.42.42.5(pid=22909): stderr: | 20221213193310731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193310731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193310731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193310732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193310732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193310732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193310733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:12.397966 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22909): Process ended prematurely: osmo-stp_10.42.42.5(pid=22909) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22909)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 19:33:12.407015 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:33:12.433473 run osmo-hlr_10.42.42.2(pid=22906): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22906)] 19:33:12.481170 run osmo-hlr_10.42.42.2(pid=22906): stdout: | (launched: 2022-12-13_19:33:09.617706) 19:33:12.530413 run osmo-hlr_10.42.42.2(pid=22906): stderr: | 20221213193309790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193309790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193309790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193309790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193309790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193309790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193309802 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193309813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193309813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193309813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:12.599663 run osmo-msc_10.42.42.6(pid=22912): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22912)] 19:33:12.647124 run osmo-msc_10.42.42.6(pid=22912): stdout: | (launched: 2022-12-13_19:33:11.526008) 19:33:12.696114 run osmo-msc_10.42.42.6(pid=22912): stderr: | 20221213193311794 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193311795 DLGLOBAL DEBUG validating counter group 0x7f982c2e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193311795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193311795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193311795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193311795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193311797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193311797 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193311797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193311798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:12.745326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22905): Terminating (SIGTERM) 19:33:12.784818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22908): Terminating (SIGTERM) 19:33:12.824412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22911): Terminating (SIGTERM) 19:33:12.864108 --- ParallelTerminationStrategy: PID 22905 died... 19:33:12.883372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22905): Terminated: ok {rc=0} 19:33:12.927208 --- ParallelTerminationStrategy: PID 22908 died... 19:33:12.945994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22908): Terminated: ok {rc=0} 19:33:12.989766 --- ParallelTerminationStrategy: PID 22911 died... 19:33:13.008268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22911): Terminated: ok {rc=0} 19:33:13.090766 bus /sierra_3: Setting Powered False 19:33:14.188480 bus /sierra_3: Setting Powered False 19:33:15.304985 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 19:33:16.471296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:16.488179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 19:33:16.567783 tst mo_mt_call_osmux.py: using LAC 35787 19:33:16.690200 tst mo_mt_call_osmux.py: using RAC 87 19:33:16.831914 tst mo_mt_call_osmux.py: using CellId 35787 19:33:16.962074 tst mo_mt_call_osmux.py: using BVCI 35788 19:33:17.108548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:17.124792 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:17.140388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:17.155498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:17.170711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 19:33:17.183717 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:33:17.303091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 19:33:17.423191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:17.896400 run create_hlr_db(pid=22914): Launched 19:33:18.019567 bus /sierra_2: Setting Powered False 19:33:19.080676 run create_hlr_db(pid=22914): Terminated: ok {rc=0} 19:33:19.502850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22916): Launched 19:33:19.805313 run osmo-hlr_10.42.42.2(pid=22917): Launched 19:33:19.919774 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:20.443404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22919): Launched 19:33:20.746837 run osmo-stp_10.42.42.5(pid=22920): Launched 19:33:20.861328 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:21.406572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22922): Launched 19:33:21.710409 run osmo-msc_10.42.42.6(pid=22923): Launched 19:33:21.878275 run osmo-stp_10.42.42.5(pid=22920): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22920)] 19:33:22.005902 run osmo-stp_10.42.42.5(pid=22920): stdout: | (launched: 2022-12-13_19:33:20.690652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:22.132482 run osmo-stp_10.42.42.5(pid=22920): stderr: | 20221213193320858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193320858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193320858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193320858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193320859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193320859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193320859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:22.257811 run osmo-stp_10.42.42.5(pid=22920): stdout: | (launched: 2022-12-13_19:33:20.690652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:22.378908 run osmo-stp_10.42.42.5(pid=22920): stderr: | 20221213193320858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193320858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193320858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193320858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193320859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193320859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193320859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:22.523230 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22920): Process ended prematurely: osmo-stp_10.42.42.5(pid=22920) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22920)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 19:33:22.532082 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:33:22.558556 run osmo-hlr_10.42.42.2(pid=22917): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22917)] 19:33:22.606764 run osmo-hlr_10.42.42.2(pid=22917): stdout: | (launched: 2022-12-13_19:33:19.748896) 19:33:22.656233 run osmo-hlr_10.42.42.2(pid=22917): stderr: | 20221213193319923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193319923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193319923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193319923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193319923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193319923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193319936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193319945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193319945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193319945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:22.725502 run osmo-msc_10.42.42.6(pid=22923): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22923)] 19:33:22.772914 run osmo-msc_10.42.42.6(pid=22923): stdout: | (launched: 2022-12-13_19:33:21.652694) 19:33:22.821899 run osmo-msc_10.42.42.6(pid=22923): stderr: | 20221213193321921 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193321921 DLGLOBAL DEBUG validating counter group 0x7ff5a29a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193321922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193321922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193321922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193321922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193321924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193321924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193321924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193321924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:22.871450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22916): Terminating (SIGTERM) 19:33:22.910754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22919): Terminating (SIGTERM) 19:33:22.950065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22922): Terminating (SIGTERM) 19:33:22.989839 --- ParallelTerminationStrategy: PID 22916 died... 19:33:23.009108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22916): Terminated: ok {rc=0} 19:33:23.053379 --- ParallelTerminationStrategy: PID 22919 died... 19:33:23.072321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22919): Terminated: ok {rc=0} 19:33:23.116255 --- ParallelTerminationStrategy: PID 22922 died... 19:33:23.135278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22922): Terminated: ok {rc=0} 19:33:23.221955 bus /sierra_3: Setting Powered False 19:33:24.319911 bus /sierra_3: Setting Powered False 19:33:25.434982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:33:26.678975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:26.685350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:33:26.714784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:33:26.741661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:33:26.793342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:33:26.822523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:33:26.849433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:33:27.406414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:33:27.456044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:27.467452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:33:27.533938 tst mo_mt_call.py: using LAC 35788 19:33:27.653065 tst mo_mt_call.py: using RAC 88 19:33:27.772913 tst mo_mt_call.py: using CellId 35788 19:33:27.892031 tst mo_mt_call.py: using BVCI 35789 19:33:28.003829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:28.015107 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:28.026271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:28.037286 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:28.049057 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:28.060620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:33:28.175867 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:33:28.295993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:28.804523 run create_hlr_db(pid=22928): Launched 19:33:28.929376 bus /sierra_2: Setting Powered False 19:33:29.993570 run create_hlr_db(pid=22928): Terminated: ok {rc=0} 19:33:30.428103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22930): Launched 19:33:30.756938 run osmo-hlr_10.42.42.2(pid=22931): Launched 19:33:30.948359 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:31.570076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22933): Launched 19:33:31.889983 run osmo-stp_10.42.42.5(pid=22934): Launched 19:33:32.222167 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:32.794692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22936): Launched 19:33:33.098727 run osmo-msc_10.42.42.6(pid=22937): Launched 19:33:33.267794 run osmo-stp_10.42.42.5(pid=22934): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22934)] 19:33:33.394917 run osmo-stp_10.42.42.5(pid=22934): stdout: | (launched: 2022-12-13_19:33:31.831051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:33.522360 run osmo-stp_10.42.42.5(pid=22934): stderr: | 20221213193332072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193332073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193332073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193332073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193332074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193332074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193332074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:33.648802 run osmo-stp_10.42.42.5(pid=22934): stdout: | (launched: 2022-12-13_19:33:31.831051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:33.770405 run osmo-stp_10.42.42.5(pid=22934): stderr: | 20221213193332072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193332073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193332073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193332073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193332074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193332074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193332074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:33.915573 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22934): Process ended prematurely: osmo-stp_10.42.42.5(pid=22934) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22934)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:33:33.924562 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:33:33.950880 run osmo-hlr_10.42.42.2(pid=22931): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22931)] 19:33:33.999537 run osmo-hlr_10.42.42.2(pid=22931): stdout: | (launched: 2022-12-13_19:33:30.697114) 19:33:34.049402 run osmo-hlr_10.42.42.2(pid=22931): stderr: | 20221213193330897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193330897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193330897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193330897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193330897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193330897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193330918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193330940 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193330940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193330940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:34.119252 run osmo-msc_10.42.42.6(pid=22937): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22937)] 19:33:34.166429 run osmo-msc_10.42.42.6(pid=22937): stdout: | (launched: 2022-12-13_19:33:33.042203) 19:33:34.215715 run osmo-msc_10.42.42.6(pid=22937): stderr: | 20221213193333313 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193333314 DLGLOBAL DEBUG validating counter group 0x7fd6c7e5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193333314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193333314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193333314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193333314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193333316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193333316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193333316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193333316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:34.265607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22930): Terminating (SIGTERM) 19:33:34.305664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22933): Terminating (SIGTERM) 19:33:34.345484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22936): Terminating (SIGTERM) 19:33:34.385765 --- ParallelTerminationStrategy: PID 22930 died... 19:33:34.405540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22930): Terminated: ok {rc=0} 19:33:34.449835 --- ParallelTerminationStrategy: PID 22933 died... 19:33:34.469042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22933): Terminated: ok {rc=0} 19:33:34.513338 --- ParallelTerminationStrategy: PID 22936 died... 19:33:34.532363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22936): Terminated: ok {rc=0} 19:33:34.619337 bus /sierra_3: Setting Powered False 19:33:35.718550 bus /sierra_3: Setting Powered False 19:33:36.832488 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:33:37.978513 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:37.990484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:33:38.057064 tst mo_mt_call_osmux.py: using LAC 35789 19:33:38.176090 tst mo_mt_call_osmux.py: using RAC 89 19:33:38.296806 tst mo_mt_call_osmux.py: using CellId 35789 19:33:38.415771 tst mo_mt_call_osmux.py: using BVCI 35790 19:33:38.527369 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:38.538675 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:38.549812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:38.560852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:38.572022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:33:38.583042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:33:38.704110 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:33:38.824015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:39.330011 run create_hlr_db(pid=22939): Launched 19:33:39.454638 bus /sierra_2: Setting Powered False 19:33:40.515676 run create_hlr_db(pid=22939): Terminated: ok {rc=0} 19:33:40.977421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22941): Launched 19:33:41.298587 run osmo-hlr_10.42.42.2(pid=22942): Launched 19:33:41.421370 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:41.979116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22944): Launched 19:33:42.302225 run osmo-stp_10.42.42.5(pid=22945): Launched 19:33:42.426530 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:43.010781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22947): Launched 19:33:43.333193 run osmo-msc_10.42.42.6(pid=22948): Launched 19:33:43.514411 run osmo-stp_10.42.42.5(pid=22945): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22945)] 19:33:43.650989 run osmo-stp_10.42.42.5(pid=22945): stdout: | (launched: 2022-12-13_19:33:42.243325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:43.788633 run osmo-stp_10.42.42.5(pid=22945): stderr: | 20221213193342432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193342432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193342432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193342433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193342433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193342433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193342434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:43.923671 run osmo-stp_10.42.42.5(pid=22945): stdout: | (launched: 2022-12-13_19:33:42.243325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:44.052842 run osmo-stp_10.42.42.5(pid=22945): stderr: | 20221213193342432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193342432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193342432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193342433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193342433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193342433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193342434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:44.207422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22945): Process ended prematurely: osmo-stp_10.42.42.5(pid=22945) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22945)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:33:44.217175 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:33:44.244892 run osmo-hlr_10.42.42.2(pid=22942): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22942)] 19:33:44.295459 run osmo-hlr_10.42.42.2(pid=22942): stdout: | (launched: 2022-12-13_19:33:41.239554) 19:33:44.347172 run osmo-hlr_10.42.42.2(pid=22942): stderr: | 20221213193341433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193341433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193341433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193341433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193341434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193341434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193341447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193341457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193341457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193341457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:44.419506 run osmo-msc_10.42.42.6(pid=22948): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22948)] 19:33:44.469297 run osmo-msc_10.42.42.6(pid=22948): stdout: | (launched: 2022-12-13_19:33:43.274058) 19:33:44.520887 run osmo-msc_10.42.42.6(pid=22948): stderr: | 20221213193343593 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193343593 DLGLOBAL DEBUG validating counter group 0x7f95d9528c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193343593 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193343594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193343594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193343594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193343595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193343596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193343596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193343596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:44.572929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22941): Terminating (SIGTERM) 19:33:44.614675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22944): Terminating (SIGTERM) 19:33:44.656482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22947): Terminating (SIGTERM) 19:33:44.699379 --- ParallelTerminationStrategy: PID 22941 died... 19:33:44.719733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22941): Terminated: ok {rc=0} 19:33:44.765888 --- ParallelTerminationStrategy: PID 22944 died... 19:33:44.785767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22944): Terminated: ok {rc=0} 19:33:44.831530 --- ParallelTerminationStrategy: PID 22947 died... 19:33:44.851414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22947): Terminated: ok {rc=0} 19:33:44.938083 bus /sierra_3: Setting Powered False 19:33:46.032706 bus /sierra_3: Setting Powered False 19:33:47.152732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:33:48.394128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:33:48.400355 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:33:48.429290 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:33:48.455968 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:33:48.507764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:33:48.536707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:33:48.562972 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:33:49.120016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:33:49.172354 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.184481 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:33:49.253124 tst mo_mt_call.py: using LAC 35790 19:33:49.379812 tst mo_mt_call.py: using RAC 90 19:33:49.499568 tst mo_mt_call.py: using CellId 35790 19:33:49.617192 tst mo_mt_call.py: using BVCI 35791 19:33:49.725476 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.736752 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.747907 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.759064 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.770255 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:49.781544 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:33:49.899415 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:33:50.015017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:33:50.482453 run create_hlr_db(pid=22954): Launched 19:33:50.604901 bus /sierra_2: Setting Powered False 19:33:51.665376 run create_hlr_db(pid=22954): Terminated: ok {rc=0} 19:33:52.085216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22956): Launched 19:33:52.386335 run osmo-hlr_10.42.42.2(pid=22957): Launched 19:33:52.499809 run osmo-stp_10.42.42.5: Starting osmo-stp 19:33:53.015245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22959): Launched 19:33:53.315895 run osmo-stp_10.42.42.5(pid=22960): Launched 19:33:53.429133 run osmo-msc_10.42.42.6: Starting osmo-msc 19:33:53.973226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22962): Launched 19:33:54.273984 run osmo-msc_10.42.42.6(pid=22963): Launched 19:33:54.441183 run osmo-stp_10.42.42.5(pid=22960): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22960)] 19:33:54.567483 run osmo-stp_10.42.42.5(pid=22960): stdout: | (launched: 2022-12-13_19:33:53.260429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:54.693849 run osmo-stp_10.42.42.5(pid=22960): stderr: | 20221213193353427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193353427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193353427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193353427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193353428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193353428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193353428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:54.818458 run osmo-stp_10.42.42.5(pid=22960): stdout: | (launched: 2022-12-13_19:33:53.260429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:33:54.938683 run osmo-stp_10.42.42.5(pid=22960): stderr: | 20221213193353427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193353427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193353427 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193353427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193353428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193353428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193353428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:33:55.082284 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22960): Process ended prematurely: osmo-stp_10.42.42.5(pid=22960) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22960)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:33:55.091012 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 19:33:55.117927 run osmo-hlr_10.42.42.2(pid=22957): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22957)] 19:33:55.166132 run osmo-hlr_10.42.42.2(pid=22957): stdout: | (launched: 2022-12-13_19:33:52.330058) 19:33:55.215430 run osmo-hlr_10.42.42.2(pid=22957): stderr: | 20221213193352503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193352503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193352503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193352503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193352504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193352504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193352516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193352525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193352525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193352525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:33:55.284469 run osmo-msc_10.42.42.6(pid=22963): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22963)] 19:33:55.331965 run osmo-msc_10.42.42.6(pid=22963): stdout: | (launched: 2022-12-13_19:33:54.218170) 19:33:55.381130 run osmo-msc_10.42.42.6(pid=22963): stderr: | 20221213193354489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193354489 DLGLOBAL DEBUG validating counter group 0x7f39fe1b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193354489 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193354489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193354489 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193354489 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193354491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193354491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193354492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193354492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:33:55.430578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22956): Terminating (SIGTERM) 19:33:55.470240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22959): Terminating (SIGTERM) 19:33:55.509804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22962): Terminating (SIGTERM) 19:33:55.549694 --- ParallelTerminationStrategy: PID 22956 died... 19:33:55.568857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22956): Terminated: ok {rc=0} 19:33:55.612792 --- ParallelTerminationStrategy: PID 22959 died... 19:33:55.631514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22959): Terminated: ok {rc=0} 19:33:55.675279 --- ParallelTerminationStrategy: PID 22962 died... 19:33:55.694023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22962): Terminated: ok {rc=0} 19:33:55.779433 bus /sierra_3: Setting Powered False 19:33:56.878235 bus /sierra_3: Setting Powered False 19:33:57.992359 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:33:59.137375 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.149306 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:33:59.215930 tst mo_mt_call_osmux.py: using LAC 35791 19:33:59.333745 tst mo_mt_call_osmux.py: using RAC 91 19:33:59.454020 tst mo_mt_call_osmux.py: using CellId 35791 19:33:59.572036 tst mo_mt_call_osmux.py: using BVCI 35792 19:33:59.682582 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.694031 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.705303 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.716472 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.727764 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:33:59.738885 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:33:59.859069 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:33:59.975153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:00.442765 run create_hlr_db(pid=22965): Launched 19:34:00.571651 bus /sierra_2: Setting Powered False 19:34:01.636597 run create_hlr_db(pid=22965): Terminated: ok {rc=0} 19:34:02.101277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Launched 19:34:02.437596 run osmo-hlr_10.42.42.2(pid=22968): Launched 19:34:02.562261 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:03.120203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Launched 19:34:03.443071 run osmo-stp_10.42.42.5(pid=22971): Launched 19:34:03.567025 run osmo-msc_10.42.42.6: Starting osmo-msc 19:34:04.150695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22973): Launched 19:34:04.475035 run osmo-msc_10.42.42.6(pid=22974): Launched 19:34:04.654499 run osmo-stp_10.42.42.5(pid=22971): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] 19:34:04.791168 run osmo-stp_10.42.42.5(pid=22971): stdout: | (launched: 2022-12-13_19:34:03.384052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:04.927899 run osmo-stp_10.42.42.5(pid=22971): stderr: | 20221213193403572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193403572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193403572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193403573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193403573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193403573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193403573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:05.063133 run osmo-stp_10.42.42.5(pid=22971): stdout: | (launched: 2022-12-13_19:34:03.384052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:05.192241 run osmo-stp_10.42.42.5(pid=22971): stderr: | 20221213193403572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193403572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193403572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193403573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193403573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193403573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193403573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:05.347091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22971): Process ended prematurely: osmo-stp_10.42.42.5(pid=22971) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:34:05.356567 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 19:34:05.384428 run osmo-hlr_10.42.42.2(pid=22968): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22968)] 19:34:05.434868 run osmo-hlr_10.42.42.2(pid=22968): stdout: | (launched: 2022-12-13_19:34:02.378435) 19:34:05.486515 run osmo-hlr_10.42.42.2(pid=22968): stderr: | 20221213193402571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193402571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193402571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193402571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193402571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193402571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193402584 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193402592 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193402593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193402593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:05.558775 run osmo-msc_10.42.42.6(pid=22974): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22974)] 19:34:05.608409 run osmo-msc_10.42.42.6(pid=22974): stdout: | (launched: 2022-12-13_19:34:04.415519) 19:34:05.660011 run osmo-msc_10.42.42.6(pid=22974): stderr: | 20221213193404735 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193404735 DLGLOBAL DEBUG validating counter group 0x7f7d48a7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193404736 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193404736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193404736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193404736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193404738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193404738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193404738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193404738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:34:05.712241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Terminating (SIGTERM) 19:34:05.754207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Terminating (SIGTERM) 19:34:05.795648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22973): Terminating (SIGTERM) 19:34:05.837553 --- ParallelTerminationStrategy: PID 22967 died... 19:34:05.857869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Terminated: ok {rc=0} 19:34:05.903669 --- ParallelTerminationStrategy: PID 22970 died... 19:34:05.923503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Terminated: ok {rc=0} 19:34:05.969440 --- ParallelTerminationStrategy: PID 22973 died... 19:34:05.989264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22973): Terminated: ok {rc=0} 19:34:06.076254 bus /sierra_3: Setting Powered False 19:34:07.173544 bus /sierra_3: Setting Powered False 19:34:08.287065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:34:09.536626 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:34:09.542253 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:34:09.571082 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 19:34:09.597705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 19:34:09.649480 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:34:09.678587 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 19:34:09.705189 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 19:34:10.255453 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 19:34:10.304572 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.315935 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:34:10.382562 tst mo_mt_call.py: using LAC 35792 19:34:10.500719 tst mo_mt_call.py: using RAC 92 19:34:10.631760 tst mo_mt_call.py: using CellId 35792 19:34:10.758753 tst mo_mt_call.py: using BVCI 35793 19:34:10.877494 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.889302 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.900793 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.912350 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.924183 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:10.935863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:34:11.052630 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:34:11.173362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:11.676305 run create_hlr_db(pid=22979): Launched 19:34:11.799494 bus /sierra_2: Setting Powered False 19:34:12.863469 run create_hlr_db(pid=22979): Terminated: ok {rc=0} 19:34:13.313659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22981): Launched 19:34:13.635743 run osmo-hlr_10.42.42.2(pid=22982): Launched 19:34:13.758992 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:14.319895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22984): Launched 19:34:14.641744 run osmo-stp_10.42.42.5(pid=22985): Launched 19:34:14.765995 run osmo-msc_10.42.42.6: Starting osmo-msc 19:34:15.347054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22987): Launched 19:34:15.672094 run osmo-msc_10.42.42.6(pid=22988): Launched 19:34:15.854657 run osmo-stp_10.42.42.5(pid=22985): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22985)] 19:34:16.091654 run osmo-stp_10.42.42.5(pid=22985): stdout: | (launched: 2022-12-13_19:34:14.583025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:16.308460 run osmo-stp_10.42.42.5(pid=22985): stderr: | 20221213193414772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193414772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193414772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193414773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193414773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193414773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193414773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:16.468171 run osmo-stp_10.42.42.5(pid=22985): stdout: | (launched: 2022-12-13_19:34:14.583025) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:16.604175 run osmo-stp_10.42.42.5(pid=22985): stderr: | 20221213193414772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193414772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193414772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193414773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193414773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193414773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193414773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:16.765108 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22985): Process ended prematurely: osmo-stp_10.42.42.5(pid=22985) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22985)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 19:34:16.775562 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 19:34:16.804664 run osmo-hlr_10.42.42.2(pid=22982): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22982)] 19:34:16.859853 run osmo-hlr_10.42.42.2(pid=22982): stdout: | (launched: 2022-12-13_19:34:13.576655) 19:34:16.914524 run osmo-hlr_10.42.42.2(pid=22982): stderr: | 20221213193413772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193413772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193413772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193413772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193413773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193413773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193413786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193413794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193413794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193413794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:16.989969 run osmo-msc_10.42.42.6(pid=22988): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22988)] 19:34:17.041596 run osmo-msc_10.42.42.6(pid=22988): stdout: | (launched: 2022-12-13_19:34:15.612624) 19:34:17.096601 run osmo-msc_10.42.42.6(pid=22988): stderr: | 20221213193416041 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193416041 DLGLOBAL DEBUG validating counter group 0x7faf73075c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193416041 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193416041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193416042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193416042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193416043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193416044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193416044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193416044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:34:17.151669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22981): Terminating (SIGTERM) 19:34:17.194966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22984): Terminating (SIGTERM) 19:34:17.239166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22987): Terminating (SIGTERM) 19:34:17.283015 --- ParallelTerminationStrategy: PID 22981 died... 19:34:17.304795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22981): Terminated: ok {rc=0} 19:34:17.353791 --- ParallelTerminationStrategy: PID 22984 died... 19:34:17.374811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22984): Terminated: ok {rc=0} 19:34:17.421678 --- ParallelTerminationStrategy: PID 22987 died... 19:34:17.442140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22987): Terminated: ok {rc=0} 19:34:17.531458 bus /sierra_3: Setting Powered False 19:34:18.629911 bus /sierra_3: Setting Powered False 19:34:19.744816 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 19:34:20.893859 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:20.906140 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:34:20.984146 tst mo_mt_call_osmux.py: using LAC 35793 19:34:21.111483 tst mo_mt_call_osmux.py: using RAC 93 19:34:21.241072 tst mo_mt_call_osmux.py: using CellId 35793 19:34:21.367330 tst mo_mt_call_osmux.py: using BVCI 35794 19:34:21.483810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:21.495580 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:21.507024 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:21.518416 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:21.530232 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 19:34:21.541936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:34:21.658603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 19:34:21.774906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:22.242037 run create_hlr_db(pid=22990): Launched 19:34:22.367639 bus /sierra_2: Setting Powered False 19:34:23.428849 run create_hlr_db(pid=22990): Terminated: ok {rc=0} 19:34:23.849508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22992): Launched 19:34:24.150808 run osmo-hlr_10.42.42.2(pid=22993): Launched 19:34:24.264561 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:24.780586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22995): Launched 19:34:25.080692 run osmo-stp_10.42.42.5(pid=22996): Launched 19:34:25.195641 run osmo-msc_10.42.42.6: Starting osmo-msc 19:34:25.736787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22998): Launched 19:34:26.037569 run osmo-msc_10.42.42.6(pid=22999): Launched 19:34:26.205225 run osmo-stp_10.42.42.5(pid=22996): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22996)] 19:34:26.331692 run osmo-stp_10.42.42.5(pid=22996): stdout: | (launched: 2022-12-13_19:34:25.025250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:26.457865 run osmo-stp_10.42.42.5(pid=22996): stderr: | 20221213193425193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193425193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193425193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193425194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193425194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193425194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193425194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:26.583035 run osmo-stp_10.42.42.5(pid=22996): stdout: | (launched: 2022-12-13_19:34:25.025250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:26.703341 run osmo-stp_10.42.42.5(pid=22996): stderr: | 20221213193425193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193425193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193425193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193425194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193425194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193425194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193425194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:26.847006 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22996): Process ended prematurely: osmo-stp_10.42.42.5(pid=22996) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22996)] [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 19:34:26.856042 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:34:26.882616 run osmo-hlr_10.42.42.2(pid=22993): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22993)] 19:34:26.930319 run osmo-hlr_10.42.42.2(pid=22993): stdout: | (launched: 2022-12-13_19:34:24.094749) 19:34:26.979300 run osmo-hlr_10.42.42.2(pid=22993): stderr: | 20221213193424269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193424269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193424269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193424269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193424269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193424269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193424312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193424323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193424323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193424324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:27.048450 run osmo-msc_10.42.42.6(pid=22999): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22999)] 19:34:27.095784 run osmo-msc_10.42.42.6(pid=22999): stdout: | (launched: 2022-12-13_19:34:25.981929) 19:34:27.145091 run osmo-msc_10.42.42.6(pid=22999): stderr: | 20221213193426252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193426252 DLGLOBAL DEBUG validating counter group 0x7f240aafdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193426252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193426252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193426252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193426252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193426254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193426254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193426255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193426255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:34:27.194760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22992): Terminating (SIGTERM) 19:34:27.234395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22995): Terminating (SIGTERM) 19:34:27.273780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22998): Terminating (SIGTERM) 19:34:27.313930 --- ParallelTerminationStrategy: PID 22992 died... 19:34:27.333364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22992): Terminated: ok {rc=0} 19:34:27.377568 --- ParallelTerminationStrategy: PID 22995 died... 19:34:27.396369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22995): Terminated: ok {rc=0} 19:34:27.440859 --- ParallelTerminationStrategy: PID 22998 died... 19:34:27.460180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22998): Terminated: ok {rc=0} 19:34:27.546179 bus /sierra_3: Setting Powered False 19:34:28.643388 bus /sierra_3: Setting Powered False 19:34:29.754543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 19:34:31.010968 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:34:31.017746 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:34:31.058198 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:34:31.096105 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 19:34:31.206110 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:34:31.237170 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:34:31.267489 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 19:34:31.847642 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 19:34:31.853985 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:31.865903 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:34:31.913436 tst emergency_mo_mt_call.py: using LAC 35794 19:34:32.078181 tst emergency_mo_mt_call.py: using RAC 94 19:34:32.204449 tst emergency_mo_mt_call.py: using CellId 35794 19:34:32.335899 tst emergency_mo_mt_call.py: using BVCI 35795 19:34:32.453685 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:32.465295 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:32.476545 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:32.487817 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:32.499972 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:32.512057 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:32.627730 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:32.746675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:33.206059 run create_hlr_db(pid=23004): Launched 19:34:33.330030 bus /sierra_2: Setting Powered False 19:34:34.389713 run create_hlr_db(pid=23004): Terminated: ok {rc=0} 19:34:34.802721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23006): Launched 19:34:35.099148 run osmo-hlr_10.42.42.2(pid=23007): Launched 19:34:35.209840 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:35.732773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23009): Launched 19:34:36.027020 run osmo-stp_10.42.42.5(pid=23010): Launched 19:34:36.151750 tst emergency_mo_mt_call.py: using MSISDN 8292 19:34:36.300616 run osmo-msc_10.42.42.6: Starting osmo-msc 19:34:36.834016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23012): Launched 19:34:37.133817 run osmo-msc_10.42.42.6(pid=23013): Launched 19:34:37.303489 run osmo-stp_10.42.42.5(pid=23010): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23010)] 19:34:37.437669 run osmo-stp_10.42.42.5(pid=23010): stdout: | (launched: 2022-12-13_19:34:35.972263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:37.575405 run osmo-stp_10.42.42.5(pid=23010): stderr: | 20221213193436139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193436139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193436139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193436140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193436141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193436141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193436141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:37.708393 run osmo-stp_10.42.42.5(pid=23010): stdout: | (launched: 2022-12-13_19:34:35.972263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:37.836043 run osmo-stp_10.42.42.5(pid=23010): stderr: | 20221213193436139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193436139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193436139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193436140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193436141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193436141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193436141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:37.987871 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23010): Process ended prematurely: osmo-stp_10.42.42.5(pid=23010) [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23010)] [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 19:34:37.996882 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 19:34:38.024347 run osmo-hlr_10.42.42.2(pid=23007): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23007)] 19:34:38.074852 run osmo-hlr_10.42.42.2(pid=23007): stdout: | (launched: 2022-12-13_19:34:35.044339) 19:34:38.126779 run osmo-hlr_10.42.42.2(pid=23007): stderr: | 20221213193435218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193435218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193435218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193435218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193435218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193435218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193435230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193435239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193435239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193435239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:38.199536 run osmo-msc_10.42.42.6(pid=23013): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23013)] 19:34:38.249406 run osmo-msc_10.42.42.6(pid=23013): stdout: | (launched: 2022-12-13_19:34:37.075460) 19:34:38.300942 run osmo-msc_10.42.42.6(pid=23013): stderr: | 20221213193437348 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193437348 DLGLOBAL DEBUG validating counter group 0x7f47b7fd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193437348 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193437349 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193437349 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193437349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193437351 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193437351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193437351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193437351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:34:38.353076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23006): Terminating (SIGTERM) 19:34:38.394739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23009): Terminating (SIGTERM) 19:34:38.436433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23012): Terminating (SIGTERM) 19:34:38.479039 --- ParallelTerminationStrategy: PID 23006 died... 19:34:38.500009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23006): Terminated: ok {rc=0} 19:34:38.546806 --- ParallelTerminationStrategy: PID 23009 died... 19:34:38.566787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23009): Terminated: ok {rc=0} 19:34:38.613099 --- ParallelTerminationStrategy: PID 23012 died... 19:34:38.632838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23012): Terminated: ok {rc=0} 19:34:38.720843 bus /sierra_3: Setting Powered False 19:34:39.819381 bus /sierra_3: Setting Powered False 19:34:40.933911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 19:34:42.020465 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.031955 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:34:42.078691 tst emergency_preemptive_call.py: using LAC 35795 19:34:42.204741 tst emergency_preemptive_call.py: using RAC 95 19:34:42.330145 tst emergency_preemptive_call.py: using CellId 35795 19:34:42.454497 tst emergency_preemptive_call.py: using BVCI 35796 19:34:42.569041 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.580638 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.592049 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.603306 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.615066 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:34:42.626673 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:42.747003 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:42.861862 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:42.975878 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:43.093110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:34:43.588635 run create_hlr_db(pid=23016): Launched 19:34:43.709513 bus /sierra_2: Setting Powered False 19:34:44.768246 run create_hlr_db(pid=23016): Terminated: ok {rc=0} 19:34:45.214509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Launched 19:34:45.532560 run osmo-hlr_10.42.42.2(pid=23019): Launched 19:34:45.653773 run osmo-stp_10.42.42.5: Starting osmo-stp 19:34:46.213706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Launched 19:34:46.548400 run osmo-stp_10.42.42.5(pid=23022): Launched 19:34:46.912535 tst emergency_preemptive_call.py: using MSISDN 8293 19:34:47.076280 run osmo-msc_10.42.42.6: Starting osmo-msc 19:34:47.652540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23024): Launched 19:34:47.970998 run osmo-msc_10.42.42.6(pid=23025): Launched 19:34:48.150354 run osmo-stp_10.42.42.5(pid=23022): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] 19:34:48.288483 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-13_19:34:46.487859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:48.422915 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221213193446750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193446750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193446751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193446751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193446751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193446751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193446752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:48.555288 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-13_19:34:46.487859) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:34:48.681926 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221213193446750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193446750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193446751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193446751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193446751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193446751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193446752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:34:48.834058 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 19:34:48.842985 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 19:34:48.870207 run osmo-hlr_10.42.42.2(pid=23019): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23019)] 19:34:48.920525 run osmo-hlr_10.42.42.2(pid=23019): stdout: | (launched: 2022-12-13_19:34:45.473714) 19:34:48.972312 run osmo-hlr_10.42.42.2(pid=23019): stderr: | 20221213193445668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193445668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193445668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193445668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193445668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193445668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193445681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193445689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193445689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193445689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:34:49.045010 run osmo-msc_10.42.42.6(pid=23025): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23025)] 19:34:49.094672 run osmo-msc_10.42.42.6(pid=23025): stdout: | (launched: 2022-12-13_19:34:47.912629) 19:34:49.146148 run osmo-msc_10.42.42.6(pid=23025): stderr: | 20221213193448228 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193448228 DLGLOBAL DEBUG validating counter group 0x7fe298679c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193448229 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193448229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193448229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193448229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193448231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193448231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193448231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193448231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:34:49.198140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminating (SIGTERM) 19:34:49.239944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminating (SIGTERM) 19:34:49.281832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23024): Terminating (SIGTERM) 19:34:49.323899 --- ParallelTerminationStrategy: PID 23018 died... 19:34:49.344006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminated: ok {rc=0} 19:34:49.391007 --- ParallelTerminationStrategy: PID 23021 died... 19:34:49.410835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminated: ok {rc=0} 19:34:49.456782 --- ParallelTerminationStrategy: PID 23024 died... 19:34:49.476884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23024): Terminated: ok {rc=0} 19:34:49.565177 bus /sierra_9: Setting Powered False 19:34:50.663273 bus /sierra_9: Setting Powered False 19:34:51.779116 bus /sierra_8: Setting Powered False 19:34:52.876091 bus /sierra_8: Setting Powered False 19:34:53.992147 bus /sierra_3: Setting Powered False 19:34:55.089417 bus /sierra_3: Setting Powered False 19:34:56.207000 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 19:34:57.478157 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:34:57.482483 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 19:34:57.511393 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 19:34:57.549847 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 19:34:57.639026 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 19:34:57.670491 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 19:34:57.711084 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 19:34:58.296642 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 19:34:58.345800 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.356542 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:34:58.401493 tst cs_paging_gprs_active.py: using LAC 35796 19:34:58.521160 tst cs_paging_gprs_active.py: using RAC 96 19:34:58.638686 tst cs_paging_gprs_active.py: using CellId 35796 19:34:58.757835 tst cs_paging_gprs_active.py: using BVCI 35797 19:34:58.866373 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.877222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.887864 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.898486 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.908878 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.919813 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.930967 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.941914 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:34:58.952917 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:59.067932 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:34:59.187244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:34:59.408310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:34:59.736623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23030): Launched 19:35:00.019018 run iperf3-srv_10.42.42.10(pid=23031): Launched 19:35:00.142251 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:35:00.362493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:00.688774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23032): Launched 19:35:00.993770 run iperf3-srv_10.42.42.10(pid=23033): Launched 19:35:01.121623 tst cs_paging_gprs_active.py:38: start network... 19:35:01.331766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:01.817660 run create_hlr_db(pid=23034): Launched 19:35:01.988606 bus /sierra_2: Setting Powered False 19:35:03.049461 run create_hlr_db(pid=23034): Terminated: ok {rc=0} 19:35:03.469604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23039): Launched 19:35:03.770243 run osmo-hlr_10.42.42.2(pid=23040): Launched 19:35:03.883874 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:04.406313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23042): Launched 19:35:04.708475 run osmo-stp_10.42.42.5(pid=23043): Launched 19:35:04.822330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:05.341169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23045): Launched 19:35:05.456234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:05.711419 run patchelf(pid=23046): Launched 19:35:05.878653 run osmo-stp_10.42.42.5(pid=23043): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23043)] 19:35:06.005953 run osmo-stp_10.42.42.5(pid=23043): stdout: | (launched: 2022-12-13_19:35:04.652791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:06.134763 run osmo-stp_10.42.42.5(pid=23043): stderr: | 20221213193504821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193504821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193504821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193504822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193504822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193504822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193504822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:06.263759 run osmo-stp_10.42.42.5(pid=23043): stdout: | (launched: 2022-12-13_19:35:04.652791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:06.386607 run osmo-stp_10.42.42.5(pid=23043): stderr: | 20221213193504821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193504821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193504821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193504822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193504822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193504822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193504822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:06.532215 run patchelf(pid=23046): Terminating (SIGINT) 19:35:06.701558 run patchelf(pid=23046): Terminated: ok {rc=0} 19:35:06.823210 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23043): Process ended prematurely: osmo-stp_10.42.42.5(pid=23043) [trial-2393↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23043)] [trial-2393↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 19:35:06.832592 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:35:06.859672 run osmo-hlr_10.42.42.2(pid=23040): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23040)] 19:35:06.907375 run osmo-hlr_10.42.42.2(pid=23040): stdout: | (launched: 2022-12-13_19:35:03.714419) 19:35:06.956142 run osmo-hlr_10.42.42.2(pid=23040): stderr: | 20221213193503886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193503886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193503887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193503887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193503887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193503887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193503899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193503908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193503909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193503909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:07.005377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23030): Terminating (SIGTERM) 19:35:07.044541 run iperf3-srv_10.42.42.10(pid=23031): Terminating (SIGTERM) 19:35:07.083714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23032): Terminating (SIGTERM) 19:35:07.123094 run iperf3-srv_10.42.42.10(pid=23033): Terminating (SIGTERM) 19:35:07.162106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23039): Terminating (SIGTERM) 19:35:07.201380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23042): Terminating (SIGTERM) 19:35:07.240576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23045): Terminating (SIGTERM) 19:35:07.280129 --- ParallelTerminationStrategy: PID 23030 died... 19:35:07.299359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23030): Terminated: ok {rc=0} 19:35:07.343200 --- ParallelTerminationStrategy: PID 23031 died... 19:35:07.361660 run iperf3-srv_10.42.42.10(pid=23031): Terminated {rc=256} 19:35:07.405080 --- ParallelTerminationStrategy: PID 23032 died... 19:35:07.423565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23032): Terminated: ok {rc=0} 19:35:07.466945 --- ParallelTerminationStrategy: PID 23033 died... 19:35:07.485433 run iperf3-srv_10.42.42.10(pid=23033): Terminated {rc=256} 19:35:07.529216 --- ParallelTerminationStrategy: PID 23039 died... 19:35:07.547797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23039): Terminated: ok {rc=0} 19:35:07.591130 --- ParallelTerminationStrategy: PID 23042 died... 19:35:07.609793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23042): Terminated: ok {rc=0} 19:35:07.653276 --- ParallelTerminationStrategy: PID 23045 died... 19:35:07.671789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23045): Terminated: ok {rc=0} 19:35:07.754105 bus /gobi_0: Setting Powered False 19:35:08.850983 bus /gobi_0: Setting Powered False 19:35:09.964388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 19:35:11.113248 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.125466 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:35:11.174915 tst iperf3.py: using LAC 35797 19:35:11.301350 tst iperf3.py: using RAC 97 19:35:11.429373 tst iperf3.py: using CellId 35797 19:35:11.556315 tst iperf3.py: using BVCI 35798 19:35:11.674393 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.686046 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.697336 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.708345 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.720311 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.732271 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.744720 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.756913 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:11.769295 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:11.886497 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:12.087432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:12.390245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23047): Launched 19:35:12.654066 run iperf3-srv_10.42.42.10(pid=23048): Launched 19:35:12.766308 tst iperf3.py:8: start network... 19:35:12.967289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:13.433640 run create_hlr_db(pid=23049): Launched 19:35:13.558810 bus /gobi_6: Setting Powered False 19:35:14.622567 run create_hlr_db(pid=23049): Terminated: ok {rc=0} 19:35:15.072310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23051): Launched 19:35:15.395742 run osmo-hlr_10.42.42.2(pid=23052): Launched 19:35:15.519194 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:16.089436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23054): Launched 19:35:16.418839 run osmo-stp_10.42.42.5(pid=23055): Launched 19:35:16.551136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:17.225305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23057): Launched 19:35:17.356084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:17.630500 run patchelf(pid=23058): Launched 19:35:17.811313 run osmo-stp_10.42.42.5(pid=23055): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23055)] 19:35:17.947904 run osmo-stp_10.42.42.5(pid=23055): stdout: | (launched: 2022-12-13_19:35:16.356014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:18.086425 run osmo-stp_10.42.42.5(pid=23055): stderr: | 20221213193516720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193516735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193516735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193516736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193516736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193516736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193516736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:18.225132 run osmo-stp_10.42.42.5(pid=23055): stdout: | (launched: 2022-12-13_19:35:16.356014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:18.358146 run osmo-stp_10.42.42.5(pid=23055): stderr: | 20221213193516720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193516735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193516735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193516736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193516736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193516736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193516736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:18.515924 run patchelf(pid=23058): Terminating (SIGINT) 19:35:18.696801 run patchelf(pid=23058): Terminated: ok {rc=0} 19:35:18.827609 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23055): Process ended prematurely: osmo-stp_10.42.42.5(pid=23055) [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23055)] [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 19:35:18.837836 tst iperf3.py:8: Test FAILED (7.8 sec) 19:35:18.866205 run osmo-hlr_10.42.42.2(pid=23052): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23052)] 19:35:18.916498 run osmo-hlr_10.42.42.2(pid=23052): stdout: | (launched: 2022-12-13_19:35:15.336478) 19:35:18.968340 run osmo-hlr_10.42.42.2(pid=23052): stderr: | 20221213193515531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193515531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193515531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193515531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193515531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193515531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193515544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193515554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193515554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193515554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:19.020253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23047): Terminating (SIGTERM) 19:35:19.062080 run iperf3-srv_10.42.42.10(pid=23048): Terminating (SIGTERM) 19:35:19.103663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23051): Terminating (SIGTERM) 19:35:19.145931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23054): Terminating (SIGTERM) 19:35:19.188040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23057): Terminating (SIGTERM) 19:35:19.230891 --- ParallelTerminationStrategy: PID 23047 died... 19:35:19.251176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23047): Terminated: ok {rc=0} 19:35:19.297984 --- ParallelTerminationStrategy: PID 23048 died... 19:35:19.318040 run iperf3-srv_10.42.42.10(pid=23048): Terminated {rc=256} 19:35:19.364735 --- ParallelTerminationStrategy: PID 23051 died... 19:35:19.384696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23051): Terminated: ok {rc=0} 19:35:19.431159 --- ParallelTerminationStrategy: PID 23054 died... 19:35:19.451122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23054): Terminated: ok {rc=0} 19:35:19.497493 --- ParallelTerminationStrategy: PID 23057 died... 19:35:19.517414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23057): Terminated: ok {rc=0} 19:35:19.605521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 19:35:20.755237 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:20.767168 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:35:20.814096 tst iperf3m4.py: using LAC 35798 19:35:20.941774 tst iperf3m4.py: using RAC 98 19:35:21.070419 tst iperf3m4.py: using CellId 35798 19:35:21.196718 tst iperf3m4.py: using BVCI 35799 19:35:21.315471 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.326999 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.338149 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.349270 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.360664 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.372049 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.383582 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.394899 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:21.406526 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:21.526582 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:21.644204 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:21.765423 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:21.889957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:35:22.108825 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:22.434250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23059): Launched 19:35:22.715430 run iperf3-srv_10.42.42.10(pid=23060): Launched 19:35:22.838478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:35:23.056812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:23.382079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23061): Launched 19:35:23.663807 run iperf3-srv_10.42.42.10(pid=23063): Launched 19:35:23.786972 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:35:24.004377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:24.329533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Launched 19:35:24.611033 run iperf3-srv_10.42.42.10(pid=23065): Launched 19:35:24.733692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:35:24.952612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:25.277731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23066): Launched 19:35:25.559795 run iperf3-srv_10.42.42.10(pid=23067): Launched 19:35:25.681515 tst iperf3m4.py:8: start network... 19:35:25.900314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:26.403314 run create_hlr_db(pid=23068): Launched 19:35:26.527979 bus /gobi_6: Setting Powered False 19:35:27.592342 run create_hlr_db(pid=23068): Terminated: ok {rc=0} 19:35:28.023204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23070): Launched 19:35:28.350555 run osmo-hlr_10.42.42.2(pid=23071): Launched 19:35:28.475769 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:29.133572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23073): Launched 19:35:29.450349 run osmo-stp_10.42.42.5(pid=23074): Launched 19:35:29.570899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:30.117504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23076): Launched 19:35:30.239045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:30.506544 run patchelf(pid=23077): Launched 19:35:30.681597 run osmo-stp_10.42.42.5(pid=23074): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23074)] 19:35:30.816293 run osmo-stp_10.42.42.5(pid=23074): stdout: | (launched: 2022-12-13_19:35:29.392582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:30.955002 run osmo-stp_10.42.42.5(pid=23074): stderr: | 20221213193529579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193529579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193529580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193529580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193529580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193529581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193529581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:31.093788 run osmo-stp_10.42.42.5(pid=23074): stdout: | (launched: 2022-12-13_19:35:29.392582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:31.227050 run osmo-stp_10.42.42.5(pid=23074): stderr: | 20221213193529579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193529579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193529580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193529580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193529580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193529581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193529581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:31.385295 run patchelf(pid=23077): Terminating (SIGINT) 19:35:31.566566 run patchelf(pid=23077): Terminated: ok {rc=0} 19:35:31.697892 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23074): Process ended prematurely: osmo-stp_10.42.42.5(pid=23074) [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23074)] [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 19:35:31.709061 tst iperf3m4.py:8: Test FAILED (11.0 sec) 19:35:31.738948 run osmo-hlr_10.42.42.2(pid=23071): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23071)] 19:35:31.793188 run osmo-hlr_10.42.42.2(pid=23071): stdout: | (launched: 2022-12-13_19:35:28.291116) 19:35:31.847137 run osmo-hlr_10.42.42.2(pid=23071): stderr: | 20221213193528485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193528485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193528485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193528485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193528485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193528485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193528498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193528506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193528506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193528507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:31.900803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23059): Terminating (SIGTERM) 19:35:31.943518 run iperf3-srv_10.42.42.10(pid=23060): Terminating (SIGTERM) 19:35:31.985856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23061): Terminating (SIGTERM) 19:35:32.029108 run iperf3-srv_10.42.42.10(pid=23063): Terminating (SIGTERM) 19:35:32.072871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Terminating (SIGTERM) 19:35:32.115997 run iperf3-srv_10.42.42.10(pid=23065): Terminating (SIGTERM) 19:35:32.158351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23066): Terminating (SIGTERM) 19:35:32.200898 run iperf3-srv_10.42.42.10(pid=23067): Terminating (SIGTERM) 19:35:32.245121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23070): Terminating (SIGTERM) 19:35:32.287304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23073): Terminating (SIGTERM) 19:35:32.329576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23076): Terminating (SIGTERM) 19:35:32.371895 --- ParallelTerminationStrategy: PID 23059 died... 19:35:32.392178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23059): Terminated: ok {rc=0} 19:35:32.438614 --- ParallelTerminationStrategy: PID 23060 died... 19:35:32.458446 run iperf3-srv_10.42.42.10(pid=23060): Terminated {rc=256} 19:35:32.504120 --- ParallelTerminationStrategy: PID 23061 died... 19:35:32.523897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23061): Terminated: ok {rc=0} 19:35:32.569840 --- ParallelTerminationStrategy: PID 23063 died... 19:35:32.589532 run iperf3-srv_10.42.42.10(pid=23063): Terminated {rc=256} 19:35:32.635355 --- ParallelTerminationStrategy: PID 23064 died... 19:35:32.655159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23064): Terminated: ok {rc=0} 19:35:32.701177 --- ParallelTerminationStrategy: PID 23065 died... 19:35:32.720735 run iperf3-srv_10.42.42.10(pid=23065): Terminated {rc=256} 19:35:32.766869 --- ParallelTerminationStrategy: PID 23066 died... 19:35:32.786574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23066): Terminated: ok {rc=0} 19:35:32.832567 --- ParallelTerminationStrategy: PID 23067 died... 19:35:32.852401 run iperf3-srv_10.42.42.10(pid=23067): Terminated {rc=256} 19:35:32.898163 --- ParallelTerminationStrategy: PID 23070 died... 19:35:32.917979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23070): Terminated: ok {rc=0} 19:35:32.963812 --- ParallelTerminationStrategy: PID 23073 died... 19:35:32.983526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23073): Terminated: ok {rc=0} 19:35:33.029455 --- ParallelTerminationStrategy: PID 23076 died... 19:35:33.049173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23076): Terminated: ok {rc=0} 19:35:33.136124 bus /gobi_4: Setting Powered False 19:35:34.231801 bus /gobi_4: Setting Powered False 19:35:35.344619 bus /gobi_1: Setting Powered False 19:35:36.441946 bus /gobi_1: Setting Powered False 19:35:37.557687 bus /gobi_0: Setting Powered False 19:35:38.654385 bus /gobi_0: Setting Powered False 19:35:39.769595 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 19:35:40.870950 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:40.882835 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:35:40.929672 tst ping.py: using LAC 35799 19:35:41.045118 tst ping.py: using RAC 99 19:35:41.159806 tst ping.py: using CellId 35799 19:35:41.274321 tst ping.py: using BVCI 35800 19:35:41.379115 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.389923 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.400649 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.411536 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.422062 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.433138 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.444178 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:41.455085 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:41.571998 tst ping.py:19: start network... 19:35:41.765865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:42.217131 run create_hlr_db(pid=23078): Launched 19:35:42.335436 bus /gobi_6: Setting Powered False 19:35:43.396857 run create_hlr_db(pid=23078): Terminated: ok {rc=0} 19:35:43.815942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23080): Launched 19:35:44.107812 run osmo-hlr_10.42.42.2(pid=23081): Launched 19:35:44.217716 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:44.735643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23083): Launched 19:35:45.025470 run osmo-stp_10.42.42.5(pid=23084): Launched 19:35:45.134839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:45.635564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23086): Launched 19:35:45.746807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:46.021118 run patchelf(pid=23087): Launched 19:35:46.199902 run osmo-stp_10.42.42.5(pid=23084): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23084)] 19:35:46.325872 run osmo-stp_10.42.42.5(pid=23084): stdout: | (launched: 2022-12-13_19:35:44.972018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:46.453607 run osmo-stp_10.42.42.5(pid=23084): stderr: | 20221213193545137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193545137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193545138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193545138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193545138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193545139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193545139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:46.581211 run osmo-stp_10.42.42.5(pid=23084): stdout: | (launched: 2022-12-13_19:35:44.972018) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:46.703236 run osmo-stp_10.42.42.5(pid=23084): stderr: | 20221213193545137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193545137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193545138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193545138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193545138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193545139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193545139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:46.847893 run patchelf(pid=23087): Terminating (SIGINT) 19:35:47.014363 run patchelf(pid=23087): Terminated: ok {rc=0} 19:35:47.134654 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23084): Process ended prematurely: osmo-stp_10.42.42.5(pid=23084) [trial-2393↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23084)] [trial-2393↪gprs:trx-lms-limenet-micro↪ping.py:22] 19:35:47.143979 tst ping.py:22: Test FAILED (6.3 sec) 19:35:47.170923 run osmo-hlr_10.42.42.2(pid=23081): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23081)] 19:35:47.218509 run osmo-hlr_10.42.42.2(pid=23081): stdout: | (launched: 2022-12-13_19:35:44.054491) 19:35:47.267728 run osmo-hlr_10.42.42.2(pid=23081): stderr: | 20221213193544225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193544225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193544225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193544225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193544225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193544225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193544237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193544248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193544249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193544249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:47.317211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23080): Terminating (SIGTERM) 19:35:47.357245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23083): Terminating (SIGTERM) 19:35:47.397047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23086): Terminating (SIGTERM) 19:35:47.436760 --- ParallelTerminationStrategy: PID 23080 died... 19:35:47.455859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23080): Terminated: ok {rc=0} 19:35:47.499779 --- ParallelTerminationStrategy: PID 23083 died... 19:35:47.518385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23083): Terminated: ok {rc=0} 19:35:47.562013 --- ParallelTerminationStrategy: PID 23086 died... 19:35:47.580400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23086): Terminated: ok {rc=0} 19:35:47.665146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 19:35:48.751743 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:48.763197 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 19:35:48.808871 tst ping_idle_ping.py: using LAC 35800 19:35:48.925213 tst ping_idle_ping.py: using RAC 100 19:35:49.041276 tst ping_idle_ping.py: using CellId 35800 19:35:49.156158 tst ping_idle_ping.py: using BVCI 35801 19:35:49.262128 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.272860 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.283490 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.294134 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.304609 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.315650 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.327449 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 19:35:49.338260 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 19:35:49.454560 tst ping_idle_ping.py:24: start network... 19:35:49.666154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:35:50.154837 run create_hlr_db(pid=23088): Launched 19:35:50.273383 bus /gobi_6: Setting Powered False 19:35:51.335468 run create_hlr_db(pid=23088): Terminated: ok {rc=0} 19:35:51.754560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23090): Launched 19:35:52.049555 run osmo-hlr_10.42.42.2(pid=23093): Launched 19:35:52.160307 run osmo-stp_10.42.42.5: Starting osmo-stp 19:35:52.663625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Launched 19:35:52.955137 run osmo-stp_10.42.42.5(pid=23096): Launched 19:35:53.066079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:35:53.570120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23098): Launched 19:35:53.681793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:35:53.929737 run patchelf(pid=23099): Launched 19:35:54.091542 run osmo-stp_10.42.42.5(pid=23096): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] 19:35:54.215493 run osmo-stp_10.42.42.5(pid=23096): stdout: | (launched: 2022-12-13_19:35:52.901339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:54.340831 run osmo-stp_10.42.42.5(pid=23096): stderr: | 20221213193553064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193553064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193553064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193553065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193553065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193553065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193553066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:54.466714 run osmo-stp_10.42.42.5(pid=23096): stdout: | (launched: 2022-12-13_19:35:52.901339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:35:54.586843 run osmo-stp_10.42.42.5(pid=23096): stderr: | 20221213193553064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193553064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193553064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193553065 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193553065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193553065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193553066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:35:54.729351 run patchelf(pid=23099): Terminating (SIGINT) 19:35:54.893330 run patchelf(pid=23099): Terminated: ok {rc=0} 19:35:55.011313 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23096): Process ended prematurely: osmo-stp_10.42.42.5(pid=23096) [trial-2393↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] [trial-2393↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 19:35:55.019981 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:35:55.046310 run osmo-hlr_10.42.42.2(pid=23093): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23093)] 19:35:55.094481 run osmo-hlr_10.42.42.2(pid=23093): stdout: | (launched: 2022-12-13_19:35:51.995492) 19:35:55.143530 run osmo-hlr_10.42.42.2(pid=23093): stderr: | 20221213193552167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193552167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193552167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193552167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193552167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193552167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193552179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193552188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193552188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193552188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:35:55.193106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23090): Terminating (SIGTERM) 19:35:55.232594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Terminating (SIGTERM) 19:35:55.271772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23098): Terminating (SIGTERM) 19:35:55.311265 --- ParallelTerminationStrategy: PID 23090 died... 19:35:55.330082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23090): Terminated: ok {rc=0} 19:35:55.373319 --- ParallelTerminationStrategy: PID 23095 died... 19:35:55.391761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23095): Terminated: ok {rc=0} 19:35:55.435044 --- ParallelTerminationStrategy: PID 23098 died... 19:35:55.453393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23098): Terminated: ok {rc=0} 19:35:55.535735 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 19:35:56.838502 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:35:56.844244 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:35:56.874220 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:35:56.914682 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:35:57.004330 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:35:57.034173 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:35:57.073448 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:35:57.670765 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:35:57.722251 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:57.733726 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:35:57.781748 tst cs_paging_gprs_active.py: using LAC 35801 19:35:57.909800 tst cs_paging_gprs_active.py: using RAC 101 19:35:58.034833 tst cs_paging_gprs_active.py: using CellId 35801 19:35:58.158721 tst cs_paging_gprs_active.py: using BVCI 35802 19:35:58.273681 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.285315 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.296537 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.307783 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.319309 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.330878 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.342637 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.354367 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:35:58.366069 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:35:58.481499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:35:58.600461 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:35:58.816322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:35:59.135302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23103): Launched 19:35:59.412448 run iperf3-srv_10.42.42.10(pid=23104): Launched 19:35:59.531796 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:35:59.747504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:00.068680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23105): Launched 19:36:00.345546 run iperf3-srv_10.42.42.10(pid=23106): Launched 19:36:00.465639 tst cs_paging_gprs_active.py:38: start network... 19:36:00.679845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:01.192444 run create_hlr_db(pid=23107): Launched 19:36:01.354631 bus /gobi_6: Setting Powered False 19:36:02.414264 run create_hlr_db(pid=23107): Terminated: ok {rc=0} 19:36:02.829619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Launched 19:36:03.126286 run osmo-hlr_10.42.42.2(pid=23110): Launched 19:36:03.248889 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:03.797295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Launched 19:36:04.116298 run osmo-stp_10.42.42.5(pid=23113): Launched 19:36:04.237631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:04.790091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Launched 19:36:04.911626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:05.181903 run patchelf(pid=23116): Launched 19:36:05.360385 run osmo-stp_10.42.42.5(pid=23113): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] 19:36:05.495659 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-13_19:36:04.057725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:05.632504 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221213193604245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193604245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193604246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193604246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193604246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193604246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193604247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:05.769655 run osmo-stp_10.42.42.5(pid=23113): stdout: | (launched: 2022-12-13_19:36:04.057725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:05.901033 run osmo-stp_10.42.42.5(pid=23113): stderr: | 20221213193604245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193604245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193604246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193604246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193604246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193604246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193604247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:06.056351 run patchelf(pid=23116): Terminating (SIGINT) 19:36:06.235724 run patchelf(pid=23116): Terminated: ok {rc=0} 19:36:06.365114 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:36:06.375095 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:36:06.403348 run osmo-hlr_10.42.42.2(pid=23110): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23110)] 19:36:06.453764 run osmo-hlr_10.42.42.2(pid=23110): stdout: | (launched: 2022-12-13_19:36:03.071438) 19:36:06.505504 run osmo-hlr_10.42.42.2(pid=23110): stderr: | 20221213193603262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193603262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193603262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193603262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193603262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193603262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193603275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193603283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193603283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193603283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:06.557872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23103): Terminating (SIGTERM) 19:36:06.599664 run iperf3-srv_10.42.42.10(pid=23104): Terminating (SIGTERM) 19:36:06.641286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23105): Terminating (SIGTERM) 19:36:06.682782 run iperf3-srv_10.42.42.10(pid=23106): Terminating (SIGTERM) 19:36:06.724185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminating (SIGTERM) 19:36:06.766219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminating (SIGTERM) 19:36:06.807775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Terminating (SIGTERM) 19:36:06.849731 --- ParallelTerminationStrategy: PID 23103 died... 19:36:06.869778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23103): Terminated: ok {rc=0} 19:36:06.916022 --- ParallelTerminationStrategy: PID 23104 died... 19:36:06.935584 run iperf3-srv_10.42.42.10(pid=23104): Terminated {rc=256} 19:36:06.981434 --- ParallelTerminationStrategy: PID 23105 died... 19:36:07.001230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23105): Terminated: ok {rc=0} 19:36:07.047063 --- ParallelTerminationStrategy: PID 23106 died... 19:36:07.066678 run iperf3-srv_10.42.42.10(pid=23106): Terminated {rc=256} 19:36:07.112379 --- ParallelTerminationStrategy: PID 23109 died... 19:36:07.132058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23109): Terminated: ok {rc=0} 19:36:07.177649 --- ParallelTerminationStrategy: PID 23112 died... 19:36:07.197301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23112): Terminated: ok {rc=0} 19:36:07.242978 --- ParallelTerminationStrategy: PID 23115 died... 19:36:07.262759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23115): Terminated: ok {rc=0} 19:36:07.349510 bus /gobi_0: Setting Powered False 19:36:08.448459 bus /gobi_0: Setting Powered False 19:36:09.563724 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:36:10.712072 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:10.724301 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:36:10.772806 tst iperf3.py: using LAC 35802 19:36:10.898320 tst iperf3.py: using RAC 102 19:36:11.025899 tst iperf3.py: using CellId 35802 19:36:11.150238 tst iperf3.py: using BVCI 35803 19:36:11.265885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.277680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.289216 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.300591 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.312311 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.323904 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.335786 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.347709 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:11.359633 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:11.477986 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:36:11.693050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:12.013083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23117): Launched 19:36:12.288778 run iperf3-srv_10.42.42.10(pid=23118): Launched 19:36:12.410120 tst iperf3.py:8: start network... 19:36:12.625053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:13.118104 run create_hlr_db(pid=23119): Launched 19:36:13.240161 bus /gobi_6: Setting Powered False 19:36:14.302717 run create_hlr_db(pid=23119): Terminated: ok {rc=0} 19:36:14.730885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23121): Launched 19:36:15.027272 run osmo-hlr_10.42.42.2(pid=23122): Launched 19:36:15.141392 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:15.665588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23124): Launched 19:36:15.989666 run osmo-stp_10.42.42.5(pid=23125): Launched 19:36:16.232442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:16.813200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23127): Launched 19:36:16.938846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:17.193457 run patchelf(pid=23128): Launched 19:36:17.386778 run osmo-stp_10.42.42.5(pid=23125): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23125)] 19:36:17.522101 run osmo-stp_10.42.42.5(pid=23125): stdout: | (launched: 2022-12-13_19:36:15.931792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:17.658780 run osmo-stp_10.42.42.5(pid=23125): stderr: | 20221213193616221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193616221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193616221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193616222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193616222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193616222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193616222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:17.795583 run osmo-stp_10.42.42.5(pid=23125): stdout: | (launched: 2022-12-13_19:36:15.931792) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:17.926969 run osmo-stp_10.42.42.5(pid=23125): stderr: | 20221213193616221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193616221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193616221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193616222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193616222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193616222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193616222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:18.082520 run patchelf(pid=23128): Terminating (SIGINT) 19:36:18.260705 run patchelf(pid=23128): Terminated: ok {rc=0} 19:36:18.389640 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23125): Process ended prematurely: osmo-stp_10.42.42.5(pid=23125) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23125)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 19:36:18.399717 tst iperf3.py:8: Test FAILED (7.7 sec) 19:36:18.428245 run osmo-hlr_10.42.42.2(pid=23122): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23122)] 19:36:18.479032 run osmo-hlr_10.42.42.2(pid=23122): stdout: | (launched: 2022-12-13_19:36:14.972232) 19:36:18.531372 run osmo-hlr_10.42.42.2(pid=23122): stderr: | 20221213193615146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193615146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193615146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193615146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193615146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193615146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193615158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193615169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193615169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193615169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:18.583701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23117): Terminating (SIGTERM) 19:36:18.626016 run iperf3-srv_10.42.42.10(pid=23118): Terminating (SIGTERM) 19:36:18.668846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23121): Terminating (SIGTERM) 19:36:18.711066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23124): Terminating (SIGTERM) 19:36:18.753805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23127): Terminating (SIGTERM) 19:36:18.796360 --- ParallelTerminationStrategy: PID 23117 died... 19:36:18.816595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23117): Terminated: ok {rc=0} 19:36:18.863269 --- ParallelTerminationStrategy: PID 23118 died... 19:36:18.882984 run iperf3-srv_10.42.42.10(pid=23118): Terminated {rc=256} 19:36:18.929088 --- ParallelTerminationStrategy: PID 23121 died... 19:36:18.948652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23121): Terminated: ok {rc=0} 19:36:18.994686 --- ParallelTerminationStrategy: PID 23124 died... 19:36:19.014370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23124): Terminated: ok {rc=0} 19:36:19.060446 --- ParallelTerminationStrategy: PID 23127 died... 19:36:19.080243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23127): Terminated: ok {rc=0} 19:36:19.168160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:36:20.316237 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.328380 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:36:20.374797 tst iperf3m4.py: using LAC 35803 19:36:20.498697 tst iperf3m4.py: using RAC 103 19:36:20.621036 tst iperf3m4.py: using CellId 35803 19:36:20.743496 tst iperf3m4.py: using BVCI 35804 19:36:20.852724 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.864313 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.875391 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.886422 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.897656 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.908775 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.920078 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.930935 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:20.942031 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:21.067820 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:21.183210 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:21.301957 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:21.418656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:36:21.618044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:21.915858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23129): Launched 19:36:22.174480 run iperf3-srv_10.42.42.10(pid=23130): Launched 19:36:22.287496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:36:22.486313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:22.784008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23131): Launched 19:36:23.041986 run iperf3-srv_10.42.42.10(pid=23132): Launched 19:36:23.155082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:36:23.353802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:23.651563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23133): Launched 19:36:23.909298 run iperf3-srv_10.42.42.10(pid=23134): Launched 19:36:24.020192 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:36:24.218802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:24.517288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23135): Launched 19:36:24.775743 run iperf3-srv_10.42.42.10(pid=23136): Launched 19:36:24.888779 tst iperf3m4.py:8: start network... 19:36:25.086943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:25.546969 run create_hlr_db(pid=23137): Launched 19:36:25.668047 bus /gobi_6: Setting Powered False 19:36:26.726882 run create_hlr_db(pid=23137): Terminated: ok {rc=0} 19:36:27.163102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Launched 19:36:27.481637 run osmo-hlr_10.42.42.2(pid=23140): Launched 19:36:27.602843 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:28.155276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Launched 19:36:28.474389 run osmo-stp_10.42.42.5(pid=23143): Launched 19:36:28.596942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:29.147280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Launched 19:36:29.268570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:29.538340 run patchelf(pid=23146): Launched 19:36:29.716029 run osmo-stp_10.42.42.5(pid=23143): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] 19:36:29.851628 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-13_19:36:28.415569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:29.987956 run osmo-stp_10.42.42.5(pid=23143): stderr: | 20221213193628603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193628603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193628603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193628604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193628604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193628604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193628604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:30.124167 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-13_19:36:28.415569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:30.255619 run osmo-stp_10.42.42.5(pid=23143): stderr: | 20221213193628603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193628603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193628603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193628604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193628604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193628604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193628604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:30.411185 run patchelf(pid=23146): Terminating (SIGINT) 19:36:30.589520 run patchelf(pid=23146): Terminated: ok {rc=0} 19:36:30.718137 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 19:36:30.728343 tst iperf3m4.py:8: Test FAILED (10.4 sec) 19:36:30.756848 run osmo-hlr_10.42.42.2(pid=23140): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23140)] 19:36:30.807843 run osmo-hlr_10.42.42.2(pid=23140): stdout: | (launched: 2022-12-13_19:36:27.423004) 19:36:30.861595 run osmo-hlr_10.42.42.2(pid=23140): stderr: | 20221213193627616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193627616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193627616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193627616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193627617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193627617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193627628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193627637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193627637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193627637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:30.915598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23129): Terminating (SIGTERM) 19:36:30.959054 run iperf3-srv_10.42.42.10(pid=23130): Terminating (SIGTERM) 19:36:31.004447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23131): Terminating (SIGTERM) 19:36:31.049925 run iperf3-srv_10.42.42.10(pid=23132): Terminating (SIGTERM) 19:36:31.096647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23133): Terminating (SIGTERM) 19:36:31.141262 run iperf3-srv_10.42.42.10(pid=23134): Terminating (SIGTERM) 19:36:31.187927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23135): Terminating (SIGTERM) 19:36:31.232485 run iperf3-srv_10.42.42.10(pid=23136): Terminating (SIGTERM) 19:36:31.279015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminating (SIGTERM) 19:36:31.323688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminating (SIGTERM) 19:36:31.369150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Terminating (SIGTERM) 19:36:31.413169 --- ParallelTerminationStrategy: PID 23129 died... 19:36:31.434854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23129): Terminated: ok {rc=0} 19:36:31.482929 --- ParallelTerminationStrategy: PID 23130 died... 19:36:31.504387 run iperf3-srv_10.42.42.10(pid=23130): Terminated {rc=256} 19:36:31.552399 --- ParallelTerminationStrategy: PID 23131 died... 19:36:31.574033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23131): Terminated: ok {rc=0} 19:36:31.622105 --- ParallelTerminationStrategy: PID 23132 died... 19:36:31.643446 run iperf3-srv_10.42.42.10(pid=23132): Terminated {rc=256} 19:36:31.691610 --- ParallelTerminationStrategy: PID 23133 died... 19:36:31.713031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23133): Terminated: ok {rc=0} 19:36:31.760863 --- ParallelTerminationStrategy: PID 23134 died... 19:36:31.782363 run iperf3-srv_10.42.42.10(pid=23134): Terminated {rc=256} 19:36:31.830528 --- ParallelTerminationStrategy: PID 23135 died... 19:36:31.851946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23135): Terminated: ok {rc=0} 19:36:31.900184 --- ParallelTerminationStrategy: PID 23136 died... 19:36:31.921628 run iperf3-srv_10.42.42.10(pid=23136): Terminated {rc=256} 19:36:31.969745 --- ParallelTerminationStrategy: PID 23139 died... 19:36:31.991363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminated: ok {rc=0} 19:36:32.039356 --- ParallelTerminationStrategy: PID 23142 died... 19:36:32.061116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminated: ok {rc=0} 19:36:32.109311 --- ParallelTerminationStrategy: PID 23145 died... 19:36:32.130945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23145): Terminated: ok {rc=0} 19:36:32.223441 bus /gobi_4: Setting Powered False 19:36:33.322100 bus /gobi_4: Setting Powered False 19:36:34.437593 bus /gobi_1: Setting Powered False 19:36:35.535342 bus /gobi_1: Setting Powered False 19:36:36.651039 bus /gobi_0: Setting Powered False 19:36:37.749217 bus /gobi_0: Setting Powered False 19:36:38.866756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 19:36:39.968863 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:39.981079 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:36:40.029660 tst ping.py: using LAC 35804 19:36:40.151256 tst ping.py: using RAC 104 19:36:40.277225 tst ping.py: using CellId 35804 19:36:40.399530 tst ping.py: using BVCI 35805 19:36:40.512487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.524171 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.535505 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.546928 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.558629 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.570206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.582080 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:40.593745 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:40.711574 tst ping.py:19: start network... 19:36:40.922162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:41.406772 run create_hlr_db(pid=23147): Launched 19:36:41.524525 bus /gobi_6: Setting Powered False 19:36:42.586912 run create_hlr_db(pid=23147): Terminated: ok {rc=0} 19:36:43.004604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Launched 19:36:43.295319 run osmo-hlr_10.42.42.2(pid=23150): Launched 19:36:43.407458 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:43.909994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Launched 19:36:44.200114 run osmo-stp_10.42.42.5(pid=23153): Launched 19:36:44.310158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:44.812655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Launched 19:36:44.923985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:45.170890 run patchelf(pid=23156): Launched 19:36:45.332410 run osmo-stp_10.42.42.5(pid=23153): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] 19:36:45.457611 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-13_19:36:44.146576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:45.582715 run osmo-stp_10.42.42.5(pid=23153): stderr: | 20221213193644310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193644310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193644310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193644311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193644311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193644311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193644311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:45.708174 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-13_19:36:44.146576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:45.827883 run osmo-stp_10.42.42.5(pid=23153): stderr: | 20221213193644310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193644310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193644310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193644311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193644311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193644311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193644311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:45.993733 run patchelf(pid=23156): Terminating (SIGINT) 19:36:46.161483 run patchelf(pid=23156): Terminated: ok {rc=0} 19:36:46.282406 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 19:36:46.291900 tst ping.py:22: Test FAILED (6.3 sec) 19:36:46.319443 run osmo-hlr_10.42.42.2(pid=23150): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23150)] 19:36:46.368324 run osmo-hlr_10.42.42.2(pid=23150): stdout: | (launched: 2022-12-13_19:36:43.241972) 19:36:46.418800 run osmo-hlr_10.42.42.2(pid=23150): stderr: | 20221213193643414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193643414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193643414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193643414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193643414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193643414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193643454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193643464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193643465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193643465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:46.469438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminating (SIGTERM) 19:36:46.510606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminating (SIGTERM) 19:36:46.552779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Terminating (SIGTERM) 19:36:46.593688 --- ParallelTerminationStrategy: PID 23149 died... 19:36:46.613149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminated: ok {rc=0} 19:36:46.658043 --- ParallelTerminationStrategy: PID 23152 died... 19:36:46.677515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminated: ok {rc=0} 19:36:46.722263 --- ParallelTerminationStrategy: PID 23155 died... 19:36:46.741690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23155): Terminated: ok {rc=0} 19:36:46.826846 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:36:47.912136 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:47.924830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:36:47.975991 tst ping_idle_ping.py: using LAC 35805 19:36:48.093369 tst ping_idle_ping.py: using RAC 105 19:36:48.208612 tst ping_idle_ping.py: using CellId 35805 19:36:48.325004 tst ping_idle_ping.py: using BVCI 35806 19:36:48.431018 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.442314 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.453395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.464137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.474898 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.485789 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.496749 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:36:48.507718 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:36:48.624520 tst ping_idle_ping.py:24: start network... 19:36:48.836157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:36:49.325547 run create_hlr_db(pid=23157): Launched 19:36:49.445534 bus /gobi_6: Setting Powered False 19:36:50.508209 run create_hlr_db(pid=23157): Terminated: ok {rc=0} 19:36:50.929397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Launched 19:36:51.221632 run osmo-hlr_10.42.42.2(pid=23160): Launched 19:36:51.332738 run osmo-stp_10.42.42.5: Starting osmo-stp 19:36:51.836630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Launched 19:36:52.130179 run osmo-stp_10.42.42.5(pid=23163): Launched 19:36:52.240372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:36:52.745150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Launched 19:36:52.856670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:36:53.103384 run patchelf(pid=23166): Launched 19:36:53.265266 run osmo-stp_10.42.42.5(pid=23163): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] 19:36:53.389773 run osmo-stp_10.42.42.5(pid=23163): stdout: | (launched: 2022-12-13_19:36:52.075597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:53.515534 run osmo-stp_10.42.42.5(pid=23163): stderr: | 20221213193652238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193652238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193652239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193652239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193652240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193652240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193652240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:53.641570 run osmo-stp_10.42.42.5(pid=23163): stdout: | (launched: 2022-12-13_19:36:52.075597) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:36:53.761802 run osmo-stp_10.42.42.5(pid=23163): stderr: | 20221213193652238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193652238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193652239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193652239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193652240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193652240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193652240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:36:53.904782 run patchelf(pid=23166): Terminating (SIGINT) 19:36:54.069313 run patchelf(pid=23166): Terminated: ok {rc=0} 19:36:54.187760 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23163): Process ended prematurely: osmo-stp_10.42.42.5(pid=23163) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 19:36:54.196643 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:36:54.223113 run osmo-hlr_10.42.42.2(pid=23160): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23160)] 19:36:54.270602 run osmo-hlr_10.42.42.2(pid=23160): stdout: | (launched: 2022-12-13_19:36:51.167974) 19:36:54.319754 run osmo-hlr_10.42.42.2(pid=23160): stderr: | 20221213193651339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193651339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193651339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193651339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193651339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193651339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193651350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193651359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193651359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193651360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:36:54.369889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Terminating (SIGTERM) 19:36:54.409536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Terminating (SIGTERM) 19:36:54.449080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Terminating (SIGTERM) 19:36:54.488874 --- ParallelTerminationStrategy: PID 23159 died... 19:36:54.507983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23159): Terminated: ok {rc=0} 19:36:54.551631 --- ParallelTerminationStrategy: PID 23162 died... 19:36:54.570267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23162): Terminated: ok {rc=0} 19:36:54.614385 --- ParallelTerminationStrategy: PID 23165 died... 19:36:54.632759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23165): Terminated: ok {rc=0} 19:36:54.715604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:36:56.017663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:36:56.024169 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:36:56.054260 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:36:56.095106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:36:56.185470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:36:56.215652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:36:56.255612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:36:56.854864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:36:56.907111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:56.918791 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:36:56.986101 tst cs_paging_gprs_active.py: using LAC 35806 19:36:57.110227 tst cs_paging_gprs_active.py: using RAC 106 19:36:57.234353 tst cs_paging_gprs_active.py: using CellId 35806 19:36:57.358784 tst cs_paging_gprs_active.py: using BVCI 35807 19:36:57.474641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.486382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.497991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.509661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.521383 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.533457 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.545403 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.557284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:36:57.569508 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:36:57.685138 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:36:57.805196 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:36:58.022201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:58.343491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23170): Launched 19:36:58.622264 run iperf3-srv_10.42.42.10(pid=23171): Launched 19:36:58.744069 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:36:58.961181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:36:59.283120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Launched 19:36:59.561720 run iperf3-srv_10.42.42.10(pid=23173): Launched 19:36:59.681441 tst cs_paging_gprs_active.py:38: start network... 19:36:59.897920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:00.393790 run create_hlr_db(pid=23174): Launched 19:37:00.516668 bus /gobi_6: Setting Powered False 19:37:01.604908 run create_hlr_db(pid=23174): Terminated: ok {rc=0} 19:37:02.085337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23176): Launched 19:37:02.444522 run osmo-hlr_10.42.42.2(pid=23177): Launched 19:37:02.568249 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:03.123045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23179): Launched 19:37:03.445128 run osmo-stp_10.42.42.5(pid=23180): Launched 19:37:03.567747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:04.122710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23182): Launched 19:37:04.245208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:04.516841 run patchelf(pid=23183): Launched 19:37:04.696709 run osmo-stp_10.42.42.5(pid=23180): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23180)] 19:37:04.833286 run osmo-stp_10.42.42.5(pid=23180): stdout: | (launched: 2022-12-13_19:37:03.386593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:04.971123 run osmo-stp_10.42.42.5(pid=23180): stderr: | 20221213193703575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193703575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193703575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193703576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193703576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193703576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193703576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:05.109186 run osmo-stp_10.42.42.5(pid=23180): stdout: | (launched: 2022-12-13_19:37:03.386593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:05.241537 run osmo-stp_10.42.42.5(pid=23180): stderr: | 20221213193703575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193703575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193703575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193703576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193703576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193703576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193703576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:05.398400 run patchelf(pid=23183): Terminating (SIGINT) 19:37:05.578183 run patchelf(pid=23183): Terminated: ok {rc=0} 19:37:05.707638 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23180): Process ended prematurely: osmo-stp_10.42.42.5(pid=23180) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23180)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:37:05.717867 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:37:05.746334 run osmo-hlr_10.42.42.2(pid=23177): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23177)] 19:37:05.798094 run osmo-hlr_10.42.42.2(pid=23177): stdout: | (launched: 2022-12-13_19:37:02.385248) 19:37:05.850123 run osmo-hlr_10.42.42.2(pid=23177): stderr: | 20221213193702580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193702580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193702580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193702580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193702580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193702580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193702593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193702601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193702602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193702602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:05.902551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23170): Terminating (SIGTERM) 19:37:05.944139 run iperf3-srv_10.42.42.10(pid=23171): Terminating (SIGTERM) 19:37:05.986194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Terminating (SIGTERM) 19:37:06.028232 run iperf3-srv_10.42.42.10(pid=23173): Terminating (SIGTERM) 19:37:06.070096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23176): Terminating (SIGTERM) 19:37:06.112219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23179): Terminating (SIGTERM) 19:37:06.154151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23182): Terminating (SIGTERM) 19:37:06.196131 --- ParallelTerminationStrategy: PID 23170 died... 19:37:06.216539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23170): Terminated: ok {rc=0} 19:37:06.262701 --- ParallelTerminationStrategy: PID 23171 died... 19:37:06.282456 run iperf3-srv_10.42.42.10(pid=23171): Terminated {rc=256} 19:37:06.328434 --- ParallelTerminationStrategy: PID 23172 died... 19:37:06.348141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23172): Terminated: ok {rc=0} 19:37:06.394076 --- ParallelTerminationStrategy: PID 23173 died... 19:37:06.413796 run iperf3-srv_10.42.42.10(pid=23173): Terminated {rc=256} 19:37:06.459776 --- ParallelTerminationStrategy: PID 23176 died... 19:37:06.479554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23176): Terminated: ok {rc=0} 19:37:06.525412 --- ParallelTerminationStrategy: PID 23179 died... 19:37:06.545314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23179): Terminated: ok {rc=0} 19:37:06.591307 --- ParallelTerminationStrategy: PID 23182 died... 19:37:06.610959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23182): Terminated: ok {rc=0} 19:37:06.698643 bus /gobi_0: Setting Powered False 19:37:07.797391 bus /gobi_0: Setting Powered False 19:37:08.913066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:37:10.061783 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.074022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:37:10.145370 tst iperf3.py: using LAC 35807 19:37:10.271913 tst iperf3.py: using RAC 107 19:37:10.396833 tst iperf3.py: using CellId 35807 19:37:10.522457 tst iperf3.py: using BVCI 35808 19:37:10.639122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.650762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.662249 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.673645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.685876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.698161 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.710550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.722728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:10.735110 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:10.855522 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:37:11.072151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:11.393600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23184): Launched 19:37:11.672417 run iperf3-srv_10.42.42.10(pid=23185): Launched 19:37:11.794211 tst iperf3.py:8: start network... 19:37:12.010549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:12.505869 run create_hlr_db(pid=23186): Launched 19:37:12.630450 bus /gobi_6: Setting Powered False 19:37:13.693820 run create_hlr_db(pid=23186): Terminated: ok {rc=0} 19:37:14.119943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23188): Launched 19:37:14.417998 run osmo-hlr_10.42.42.2(pid=23189): Launched 19:37:14.531548 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:15.048078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23191): Launched 19:37:15.345953 run osmo-stp_10.42.42.5(pid=23192): Launched 19:37:15.458117 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:15.999105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23194): Launched 19:37:16.128925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:16.387543 run patchelf(pid=23195): Launched 19:37:16.585187 run osmo-stp_10.42.42.5(pid=23192): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23192)] 19:37:16.725908 run osmo-stp_10.42.42.5(pid=23192): stdout: | (launched: 2022-12-13_19:37:15.290398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:16.867690 run osmo-stp_10.42.42.5(pid=23192): stderr: | 20221213193715458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193715458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193715459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193715459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193715460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193715460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193715460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:17.010538 run osmo-stp_10.42.42.5(pid=23192): stdout: | (launched: 2022-12-13_19:37:15.290398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:17.147413 run osmo-stp_10.42.42.5(pid=23192): stderr: | 20221213193715458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193715458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193715459 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193715459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193715460 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193715460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193715460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:17.304057 run patchelf(pid=23195): Terminating (SIGINT) 19:37:17.484139 run patchelf(pid=23195): Terminated: ok {rc=0} 19:37:17.614121 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23192): Process ended prematurely: osmo-stp_10.42.42.5(pid=23192) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23192)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 19:37:17.624393 tst iperf3.py:8: Test FAILED (7.6 sec) 19:37:17.653099 run osmo-hlr_10.42.42.2(pid=23189): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23189)] 19:37:17.704457 run osmo-hlr_10.42.42.2(pid=23189): stdout: | (launched: 2022-12-13_19:37:14.362596) 19:37:17.756644 run osmo-hlr_10.42.42.2(pid=23189): stderr: | 20221213193714535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193714535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193714535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193714535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193714535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193714535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193714547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193714556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193714556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193714556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:17.809747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23184): Terminating (SIGTERM) 19:37:17.851735 run iperf3-srv_10.42.42.10(pid=23185): Terminating (SIGTERM) 19:37:17.893673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23188): Terminating (SIGTERM) 19:37:17.936015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23191): Terminating (SIGTERM) 19:37:17.978081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23194): Terminating (SIGTERM) 19:37:18.020471 --- ParallelTerminationStrategy: PID 23184 died... 19:37:18.041054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23184): Terminated: ok {rc=0} 19:37:18.087564 --- ParallelTerminationStrategy: PID 23185 died... 19:37:18.107467 run iperf3-srv_10.42.42.10(pid=23185): Terminated {rc=256} 19:37:18.153773 --- ParallelTerminationStrategy: PID 23188 died... 19:37:18.173980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23188): Terminated: ok {rc=0} 19:37:18.220188 --- ParallelTerminationStrategy: PID 23191 died... 19:37:18.240132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23191): Terminated: ok {rc=0} 19:37:18.286516 --- ParallelTerminationStrategy: PID 23194 died... 19:37:18.306332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23194): Terminated: ok {rc=0} 19:37:18.394481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:37:19.545041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:19.557263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:37:19.624374 tst iperf3m4.py: using LAC 35808 19:37:19.748704 tst iperf3m4.py: using RAC 108 19:37:19.873480 tst iperf3m4.py: using CellId 35808 19:37:19.999328 tst iperf3m4.py: using BVCI 35809 19:37:20.114492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.126238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.137742 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.149090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.160729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.172419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.184183 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.195842 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:20.207615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:20.324603 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:20.444569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:20.564022 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:20.679853 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:37:20.897932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:21.220391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23196): Launched 19:37:21.498377 run iperf3-srv_10.42.42.10(pid=23197): Launched 19:37:21.618527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:37:21.835110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:22.156646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23198): Launched 19:37:22.436350 run iperf3-srv_10.42.42.10(pid=23199): Launched 19:37:22.556743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:37:22.772660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:23.094506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23200): Launched 19:37:23.374504 run iperf3-srv_10.42.42.10(pid=23201): Launched 19:37:23.495665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:37:23.711441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:24.033332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23202): Launched 19:37:24.311120 run iperf3-srv_10.42.42.10(pid=23203): Launched 19:37:24.431093 tst iperf3m4.py:8: start network... 19:37:24.647446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:25.144291 run create_hlr_db(pid=23204): Launched 19:37:25.266257 bus /gobi_6: Setting Powered False 19:37:26.329537 run create_hlr_db(pid=23204): Terminated: ok {rc=0} 19:37:26.758387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23206): Launched 19:37:27.055976 run osmo-hlr_10.42.42.2(pid=23207): Launched 19:37:27.169009 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:27.681577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23209): Launched 19:37:27.978979 run osmo-stp_10.42.42.5(pid=23210): Launched 19:37:28.091575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:28.604006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23212): Launched 19:37:28.718256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:28.970039 run patchelf(pid=23213): Launched 19:37:29.134823 run osmo-stp_10.42.42.5(pid=23210): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23210)] 19:37:29.260867 run osmo-stp_10.42.42.5(pid=23210): stdout: | (launched: 2022-12-13_19:37:27.924128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:29.388383 run osmo-stp_10.42.42.5(pid=23210): stderr: | 20221213193728090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193728091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193728091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193728091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193728092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193728092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193728092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:29.516012 run osmo-stp_10.42.42.5(pid=23210): stdout: | (launched: 2022-12-13_19:37:27.924128) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:29.638266 run osmo-stp_10.42.42.5(pid=23210): stderr: | 20221213193728090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193728091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193728091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193728091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193728092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193728092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193728092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:29.783440 run patchelf(pid=23213): Terminating (SIGINT) 19:37:29.951145 run patchelf(pid=23213): Terminated: ok {rc=0} 19:37:30.072048 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23210): Process ended prematurely: osmo-stp_10.42.42.5(pid=23210) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23210)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:37:30.081563 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:37:30.108504 run osmo-hlr_10.42.42.2(pid=23207): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23207)] 19:37:30.155991 run osmo-hlr_10.42.42.2(pid=23207): stdout: | (launched: 2022-12-13_19:37:27.000725) 19:37:30.205109 run osmo-hlr_10.42.42.2(pid=23207): stderr: | 20221213193727174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193727174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193727174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193727174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193727175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193727175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193727190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193727200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193727200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193727200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:30.254731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23196): Terminating (SIGTERM) 19:37:30.293928 run iperf3-srv_10.42.42.10(pid=23197): Terminating (SIGTERM) 19:37:30.333137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23198): Terminating (SIGTERM) 19:37:30.372387 run iperf3-srv_10.42.42.10(pid=23199): Terminating (SIGTERM) 19:37:30.411472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23200): Terminating (SIGTERM) 19:37:30.450745 run iperf3-srv_10.42.42.10(pid=23201): Terminating (SIGTERM) 19:37:30.489846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23202): Terminating (SIGTERM) 19:37:30.529675 run iperf3-srv_10.42.42.10(pid=23203): Terminating (SIGTERM) 19:37:30.570632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23206): Terminating (SIGTERM) 19:37:30.610388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23209): Terminating (SIGTERM) 19:37:30.650088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23212): Terminating (SIGTERM) 19:37:30.689460 --- ParallelTerminationStrategy: PID 23196 died... 19:37:30.708091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23196): Terminated: ok {rc=0} 19:37:30.751816 --- ParallelTerminationStrategy: PID 23197 died... 19:37:30.770177 run iperf3-srv_10.42.42.10(pid=23197): Terminated {rc=256} 19:37:30.813198 --- ParallelTerminationStrategy: PID 23198 died... 19:37:30.831979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23198): Terminated: ok {rc=0} 19:37:30.890988 --- ParallelTerminationStrategy: PID 23199 died... 19:37:30.913081 run iperf3-srv_10.42.42.10(pid=23199): Terminated {rc=256} 19:37:30.969508 --- ParallelTerminationStrategy: PID 23200 died... 19:37:30.990233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23200): Terminated: ok {rc=0} 19:37:31.039163 --- ParallelTerminationStrategy: PID 23201 died... 19:37:31.060336 run iperf3-srv_10.42.42.10(pid=23201): Terminated {rc=256} 19:37:31.109249 --- ParallelTerminationStrategy: PID 23202 died... 19:37:31.131495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23202): Terminated: ok {rc=0} 19:37:31.180353 --- ParallelTerminationStrategy: PID 23203 died... 19:37:31.201858 run iperf3-srv_10.42.42.10(pid=23203): Terminated {rc=256} 19:37:31.250178 --- ParallelTerminationStrategy: PID 23206 died... 19:37:31.271657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23206): Terminated: ok {rc=0} 19:37:31.321159 --- ParallelTerminationStrategy: PID 23209 died... 19:37:31.342488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23209): Terminated: ok {rc=0} 19:37:31.391918 --- ParallelTerminationStrategy: PID 23212 died... 19:37:31.413209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23212): Terminated: ok {rc=0} 19:37:31.505642 bus /gobi_4: Setting Powered False 19:37:32.607253 bus /gobi_4: Setting Powered False 19:37:33.725565 bus /gobi_1: Setting Powered False 19:37:34.824414 bus /gobi_1: Setting Powered False 19:37:35.940199 bus /gobi_0: Setting Powered False 19:37:37.038655 bus /gobi_0: Setting Powered False 19:37:38.153916 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:37:39.256542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.268936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:37:39.337948 tst ping.py: using LAC 35809 19:37:39.461334 tst ping.py: using RAC 109 19:37:39.586806 tst ping.py: using CellId 35809 19:37:39.703576 tst ping.py: using BVCI 35810 19:37:39.811990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.823393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.834460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.845587 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.857252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.868541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.879965 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:39.891327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:40.010021 tst ping.py:19: start network... 19:37:40.222792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:40.710514 run create_hlr_db(pid=23214): Launched 19:37:40.831982 bus /gobi_6: Setting Powered False 19:37:41.894048 run create_hlr_db(pid=23214): Terminated: ok {rc=0} 19:37:42.332811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Launched 19:37:42.647798 run osmo-hlr_10.42.42.2(pid=23217): Launched 19:37:42.767489 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:43.314553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23219): Launched 19:37:43.629291 run osmo-stp_10.42.42.5(pid=23220): Launched 19:37:43.748423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:44.292088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23222): Launched 19:37:44.412683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:44.678907 run patchelf(pid=23223): Launched 19:37:44.853534 run osmo-stp_10.42.42.5(pid=23220): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23220)] 19:37:44.986712 run osmo-stp_10.42.42.5(pid=23220): stdout: | (launched: 2022-12-13_19:37:43.571828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:45.121410 run osmo-stp_10.42.42.5(pid=23220): stderr: | 20221213193743758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193743759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193743759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193743759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193743760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193743760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193743760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:45.256331 run osmo-stp_10.42.42.5(pid=23220): stdout: | (launched: 2022-12-13_19:37:43.571828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:45.386063 run osmo-stp_10.42.42.5(pid=23220): stderr: | 20221213193743758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193743759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193743759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193743759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193743760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193743760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193743760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:45.539157 run patchelf(pid=23223): Terminating (SIGINT) 19:37:45.714849 run patchelf(pid=23223): Terminated: ok {rc=0} 19:37:45.858210 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23220): Process ended prematurely: osmo-stp_10.42.42.5(pid=23220) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23220)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 19:37:45.868620 tst ping.py:22: Test FAILED (6.6 sec) 19:37:45.911271 run osmo-hlr_10.42.42.2(pid=23217): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23217)] 19:37:45.978289 run osmo-hlr_10.42.42.2(pid=23217): stdout: | (launched: 2022-12-13_19:37:42.590439) 19:37:46.032091 run osmo-hlr_10.42.42.2(pid=23217): stderr: | 20221213193742783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193742783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193742783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193742783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193742783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193742783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193742796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193742804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193742804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193742804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:46.086863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Terminating (SIGTERM) 19:37:46.130244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23219): Terminating (SIGTERM) 19:37:46.175711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23222): Terminating (SIGTERM) 19:37:46.219946 --- ParallelTerminationStrategy: PID 23216 died... 19:37:46.241920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23216): Terminated: ok {rc=0} 19:37:46.289843 --- ParallelTerminationStrategy: PID 23219 died... 19:37:46.311220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23219): Terminated: ok {rc=0} 19:37:46.359312 --- ParallelTerminationStrategy: PID 23222 died... 19:37:46.380867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23222): Terminated: ok {rc=0} 19:37:46.471753 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:37:47.560168 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:47.572492 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:37:47.642362 tst ping_idle_ping.py: using LAC 35810 19:37:47.766859 tst ping_idle_ping.py: using RAC 110 19:37:47.890580 tst ping_idle_ping.py: using CellId 35810 19:37:48.013340 tst ping_idle_ping.py: using BVCI 35811 19:37:48.129572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.141383 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.152901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.164500 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.176258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.188165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.199922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:37:48.211608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:37:48.327283 tst ping_idle_ping.py:24: start network... 19:37:48.523663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:37:48.981299 run create_hlr_db(pid=23224): Launched 19:37:49.100617 bus /gobi_6: Setting Powered False 19:37:50.160552 run create_hlr_db(pid=23224): Terminated: ok {rc=0} 19:37:50.591901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23226): Launched 19:37:50.908501 run osmo-hlr_10.42.42.2(pid=23227): Launched 19:37:51.028719 run osmo-stp_10.42.42.5: Starting osmo-stp 19:37:51.574719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23229): Launched 19:37:51.892376 run osmo-stp_10.42.42.5(pid=23230): Launched 19:37:52.059536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:37:52.565996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23232): Launched 19:37:52.677767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:37:52.926695 run patchelf(pid=23233): Launched 19:37:53.091483 run osmo-stp_10.42.42.5(pid=23230): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23230)] 19:37:53.215818 run osmo-stp_10.42.42.5(pid=23230): stdout: | (launched: 2022-12-13_19:37:51.832371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:53.341471 run osmo-stp_10.42.42.5(pid=23230): stderr: | 20221213193752016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193752016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193752017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193752017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193752017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193752018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193752018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:53.467418 run osmo-stp_10.42.42.5(pid=23230): stdout: | (launched: 2022-12-13_19:37:51.832371) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:37:53.587746 run osmo-stp_10.42.42.5(pid=23230): stderr: | 20221213193752016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193752016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193752017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193752017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193752017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193752018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193752018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:37:53.730360 run patchelf(pid=23233): Terminating (SIGINT) 19:37:53.895031 run patchelf(pid=23233): Terminated: ok {rc=0} 19:37:54.013781 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23230): Process ended prematurely: osmo-stp_10.42.42.5(pid=23230) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23230)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:37:54.022579 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:37:54.048827 run osmo-hlr_10.42.42.2(pid=23227): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23227)] 19:37:54.096545 run osmo-hlr_10.42.42.2(pid=23227): stdout: | (launched: 2022-12-13_19:37:50.850531) 19:37:54.145530 run osmo-hlr_10.42.42.2(pid=23227): stderr: | 20221213193751044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193751044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193751044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193751044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193751044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193751044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193751056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193751064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193751065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193751065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:37:54.195176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23226): Terminating (SIGTERM) 19:37:54.235076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23229): Terminating (SIGTERM) 19:37:54.274695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23232): Terminating (SIGTERM) 19:37:54.314473 --- ParallelTerminationStrategy: PID 23226 died... 19:37:54.333734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23226): Terminated: ok {rc=0} 19:37:54.377307 --- ParallelTerminationStrategy: PID 23229 died... 19:37:54.395833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23229): Terminated: ok {rc=0} 19:37:54.439529 --- ParallelTerminationStrategy: PID 23232 died... 19:37:54.458412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23232): Terminated: ok {rc=0} 19:37:54.543858 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 19:37:55.845939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:37:55.852296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 19:37:55.881713 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 19:37:55.920647 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 19:37:56.006908 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 19:37:56.036033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 19:37:56.074361 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 19:37:56.671738 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 19:37:56.719659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:56.730849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:37:56.801211 tst cs_paging_gprs_active.py: using LAC 35811 19:37:56.918222 tst cs_paging_gprs_active.py: using RAC 111 19:37:57.036026 tst cs_paging_gprs_active.py: using CellId 35811 19:37:57.161471 tst cs_paging_gprs_active.py: using BVCI 35812 19:37:57.269779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.280925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.291855 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.302721 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.313625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.324511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.335913 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.346737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:37:57.357745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:37:57.478204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:37:57.594785 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:37:57.796437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:58.097998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23238): Launched 19:37:58.358931 run iperf3-srv_10.42.42.10(pid=23239): Launched 19:37:58.470697 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:37:58.670822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:37:58.972037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23240): Launched 19:37:59.232328 run iperf3-srv_10.42.42.10(pid=23241): Launched 19:37:59.344307 tst cs_paging_gprs_active.py:38: start network... 19:37:59.545409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:00.008347 run create_hlr_db(pid=23242): Launched 19:38:00.133224 bus /gobi_6: Setting Powered False 19:38:01.214934 run create_hlr_db(pid=23242): Terminated: ok {rc=0} 19:38:01.659953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Launched 19:38:01.973750 run osmo-hlr_10.42.42.2(pid=23245): Launched 19:38:02.200782 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:02.752393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Launched 19:38:03.074848 run osmo-stp_10.42.42.5(pid=23248): Launched 19:38:03.196453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:38:03.748931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23250): Launched 19:38:03.873455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:38:04.151613 run patchelf(pid=23251): Launched 19:38:04.330601 run osmo-stp_10.42.42.5(pid=23248): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] 19:38:04.466841 run osmo-stp_10.42.42.5(pid=23248): stdout: | (launched: 2022-12-13_19:38:03.014578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:04.604805 run osmo-stp_10.42.42.5(pid=23248): stderr: | 20221213193803199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193803200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193803200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193803200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193803201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193803201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193803201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:04.742898 run osmo-stp_10.42.42.5(pid=23248): stdout: | (launched: 2022-12-13_19:38:03.014578) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:04.875328 run osmo-stp_10.42.42.5(pid=23248): stderr: | 20221213193803199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193803200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193803200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193803200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193803201 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193803201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193803201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:05.032041 run patchelf(pid=23251): Terminating (SIGINT) 19:38:05.212289 run patchelf(pid=23251): Terminated: ok {rc=0} 19:38:05.342139 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23248): Process ended prematurely: osmo-stp_10.42.42.5(pid=23248) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 19:38:05.352749 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:38:05.381529 run osmo-hlr_10.42.42.2(pid=23245): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23245)] 19:38:05.432622 run osmo-hlr_10.42.42.2(pid=23245): stdout: | (launched: 2022-12-13_19:38:01.913546) 19:38:05.484888 run osmo-hlr_10.42.42.2(pid=23245): stderr: | 20221213193802184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193802184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193802184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193802184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193802184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193802184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193802196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193802204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193802204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193802204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:05.537327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23238): Terminating (SIGTERM) 19:38:05.579533 run iperf3-srv_10.42.42.10(pid=23239): Terminating (SIGTERM) 19:38:05.621793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23240): Terminating (SIGTERM) 19:38:05.663928 run iperf3-srv_10.42.42.10(pid=23241): Terminating (SIGTERM) 19:38:05.706031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Terminating (SIGTERM) 19:38:05.748004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Terminating (SIGTERM) 19:38:05.789959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23250): Terminating (SIGTERM) 19:38:05.832383 --- ParallelTerminationStrategy: PID 23238 died... 19:38:05.852885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23238): Terminated: ok {rc=0} 19:38:05.899443 --- ParallelTerminationStrategy: PID 23239 died... 19:38:05.919337 run iperf3-srv_10.42.42.10(pid=23239): Terminated {rc=256} 19:38:05.965543 --- ParallelTerminationStrategy: PID 23240 died... 19:38:05.985496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23240): Terminated: ok {rc=0} 19:38:06.031835 --- ParallelTerminationStrategy: PID 23241 died... 19:38:06.051804 run iperf3-srv_10.42.42.10(pid=23241): Terminated {rc=256} 19:38:06.098162 --- ParallelTerminationStrategy: PID 23244 died... 19:38:06.118264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Terminated: ok {rc=0} 19:38:06.164489 --- ParallelTerminationStrategy: PID 23247 died... 19:38:06.184435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Terminated: ok {rc=0} 19:38:06.230578 --- ParallelTerminationStrategy: PID 23250 died... 19:38:06.250538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23250): Terminated: ok {rc=0} 19:38:06.338644 bus /gobi_0: Setting Powered False 19:38:07.437613 bus /gobi_0: Setting Powered False 19:38:08.556465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 19:38:09.700751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:09.712513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:38:09.778808 tst iperf3.py: using LAC 35812 19:38:09.899075 tst iperf3.py: using RAC 112 19:38:10.017149 tst iperf3.py: using CellId 35812 19:38:10.132747 tst iperf3.py: using BVCI 35813 19:38:10.240198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.251366 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.262309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.273288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.284202 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.295058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.306078 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.316872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:10.327926 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:10.446572 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:38:10.648118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:38:10.947570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23252): Launched 19:38:11.208552 run iperf3-srv_10.42.42.10(pid=23253): Launched 19:38:11.320542 tst iperf3.py:8: start network... 19:38:11.520744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:11.983775 run create_hlr_db(pid=23254): Launched 19:38:12.105555 bus /gobi_6: Setting Powered False 19:38:13.165913 run create_hlr_db(pid=23254): Terminated: ok {rc=0} 19:38:13.604648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Launched 19:38:13.925654 run osmo-hlr_10.42.42.2(pid=23257): Launched 19:38:14.048595 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:14.604791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Launched 19:38:14.926223 run osmo-stp_10.42.42.5(pid=23260): Launched 19:38:15.050282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:38:15.603084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23262): Launched 19:38:15.725705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:38:16.015130 run patchelf(pid=23263): Launched 19:38:16.193933 run osmo-stp_10.42.42.5(pid=23260): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] 19:38:16.324682 run osmo-stp_10.42.42.5(pid=23260): stdout: | (launched: 2022-12-13_19:38:14.867526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:16.458355 run osmo-stp_10.42.42.5(pid=23260): stderr: | 20221213193815056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193815056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193815056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193815057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193815057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193815058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193815058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:16.592394 run osmo-stp_10.42.42.5(pid=23260): stdout: | (launched: 2022-12-13_19:38:14.867526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:16.718966 run osmo-stp_10.42.42.5(pid=23260): stderr: | 20221213193815056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193815056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193815056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193815057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193815057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193815058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193815058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:16.869813 run patchelf(pid=23263): Terminating (SIGINT) 19:38:17.043600 run patchelf(pid=23263): Terminated: ok {rc=0} 19:38:17.169202 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23260): Process ended prematurely: osmo-stp_10.42.42.5(pid=23260) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 19:38:17.179337 tst iperf3.py:8: Test FAILED (7.5 sec) 19:38:17.207125 run osmo-hlr_10.42.42.2(pid=23257): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23257)] 19:38:17.255759 run osmo-hlr_10.42.42.2(pid=23257): stdout: | (launched: 2022-12-13_19:38:13.867107) 19:38:17.305532 run osmo-hlr_10.42.42.2(pid=23257): stderr: | 20221213193814060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193814060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193814061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193814061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193814061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193814061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193814073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193814081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193814082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193814082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:17.355613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23252): Terminating (SIGTERM) 19:38:17.395925 run iperf3-srv_10.42.42.10(pid=23253): Terminating (SIGTERM) 19:38:17.436245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Terminating (SIGTERM) 19:38:17.476887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Terminating (SIGTERM) 19:38:17.517421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23262): Terminating (SIGTERM) 19:38:17.558833 --- ParallelTerminationStrategy: PID 23252 died... 19:38:17.578124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23252): Terminated: ok {rc=0} 19:38:17.622617 --- ParallelTerminationStrategy: PID 23253 died... 19:38:17.641634 run iperf3-srv_10.42.42.10(pid=23253): Terminated {rc=256} 19:38:17.686027 --- ParallelTerminationStrategy: PID 23256 died... 19:38:17.705078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23256): Terminated: ok {rc=0} 19:38:17.749338 --- ParallelTerminationStrategy: PID 23259 died... 19:38:17.768370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23259): Terminated: ok {rc=0} 19:38:17.812643 --- ParallelTerminationStrategy: PID 23262 died... 19:38:17.831652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23262): Terminated: ok {rc=0} 19:38:17.915952 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 19:38:19.064923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.080346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:38:19.147061 tst iperf3m4.py: using LAC 35813 19:38:19.271941 tst iperf3m4.py: using RAC 113 19:38:19.396770 tst iperf3m4.py: using CellId 35813 19:38:19.525989 tst iperf3m4.py: using BVCI 35814 19:38:19.642717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.654412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.665873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.677276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.689109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.700745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.712556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.724188 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:19.736071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:19.852318 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:19.972424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:20.088235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:20.202993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:38:20.403067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:38:20.703344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23264): Launched 19:38:20.963143 run iperf3-srv_10.42.42.10(pid=23265): Launched 19:38:21.075441 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:38:21.274373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:38:21.574012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23266): Launched 19:38:21.835535 run iperf3-srv_10.42.42.10(pid=23267): Launched 19:38:21.947164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:38:22.146233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:38:22.446354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23268): Launched 19:38:22.706660 run iperf3-srv_10.42.42.10(pid=23269): Launched 19:38:22.820649 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:38:23.020263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:38:23.320723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23270): Launched 19:38:23.581421 run iperf3-srv_10.42.42.10(pid=23271): Launched 19:38:23.693095 tst iperf3m4.py:8: start network... 19:38:23.892041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:24.355842 run create_hlr_db(pid=23272): Launched 19:38:24.479984 bus /gobi_6: Setting Powered False 19:38:25.539250 run create_hlr_db(pid=23272): Terminated: ok {rc=0} 19:38:25.977672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Launched 19:38:26.300085 run osmo-hlr_10.42.42.2(pid=23275): Launched 19:38:26.422877 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:26.981294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Launched 19:38:27.302000 run osmo-stp_10.42.42.5(pid=23278): Launched 19:38:27.424422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:38:27.979417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Launched 19:38:28.103211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:38:28.375366 run patchelf(pid=23281): Launched 19:38:28.553612 run osmo-stp_10.42.42.5(pid=23278): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] 19:38:28.689568 run osmo-stp_10.42.42.5(pid=23278): stdout: | (launched: 2022-12-13_19:38:27.243246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:28.826683 run osmo-stp_10.42.42.5(pid=23278): stderr: | 20221213193827432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193827432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193827432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193827432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193827433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193827433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193827433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:28.964364 run osmo-stp_10.42.42.5(pid=23278): stdout: | (launched: 2022-12-13_19:38:27.243246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:29.095786 run osmo-stp_10.42.42.5(pid=23278): stderr: | 20221213193827432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193827432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193827432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193827432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193827433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193827433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193827433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:29.251743 run patchelf(pid=23281): Terminating (SIGINT) 19:38:29.431087 run patchelf(pid=23281): Terminated: ok {rc=0} 19:38:29.560495 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23278): Process ended prematurely: osmo-stp_10.42.42.5(pid=23278) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 19:38:29.570768 tst iperf3m4.py:8: Test FAILED (10.5 sec) 19:38:29.599210 run osmo-hlr_10.42.42.2(pid=23275): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23275)] 19:38:29.649763 run osmo-hlr_10.42.42.2(pid=23275): stdout: | (launched: 2022-12-13_19:38:26.241224) 19:38:29.701786 run osmo-hlr_10.42.42.2(pid=23275): stderr: | 20221213193826437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193826437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193826437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193826437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193826437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193826437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193826449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193826458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193826458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193826458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:29.754213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23264): Terminating (SIGTERM) 19:38:29.796021 run iperf3-srv_10.42.42.10(pid=23265): Terminating (SIGTERM) 19:38:29.838342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23266): Terminating (SIGTERM) 19:38:29.880469 run iperf3-srv_10.42.42.10(pid=23267): Terminating (SIGTERM) 19:38:29.922570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23268): Terminating (SIGTERM) 19:38:29.964690 run iperf3-srv_10.42.42.10(pid=23269): Terminating (SIGTERM) 19:38:30.006783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23270): Terminating (SIGTERM) 19:38:30.048728 run iperf3-srv_10.42.42.10(pid=23271): Terminating (SIGTERM) 19:38:30.090812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Terminating (SIGTERM) 19:38:30.132725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Terminating (SIGTERM) 19:38:30.174780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Terminating (SIGTERM) 19:38:30.217151 --- ParallelTerminationStrategy: PID 23264 died... 19:38:30.237665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23264): Terminated: ok {rc=0} 19:38:30.284247 --- ParallelTerminationStrategy: PID 23265 died... 19:38:30.304026 run iperf3-srv_10.42.42.10(pid=23265): Terminated {rc=256} 19:38:30.350599 --- ParallelTerminationStrategy: PID 23266 died... 19:38:30.370549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23266): Terminated: ok {rc=0} 19:38:30.416585 --- ParallelTerminationStrategy: PID 23267 died... 19:38:30.436507 run iperf3-srv_10.42.42.10(pid=23267): Terminated {rc=256} 19:38:30.482668 --- ParallelTerminationStrategy: PID 23268 died... 19:38:30.502581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23268): Terminated: ok {rc=0} 19:38:30.548752 --- ParallelTerminationStrategy: PID 23269 died... 19:38:30.568764 run iperf3-srv_10.42.42.10(pid=23269): Terminated {rc=256} 19:38:30.614915 --- ParallelTerminationStrategy: PID 23270 died... 19:38:30.634944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23270): Terminated: ok {rc=0} 19:38:30.681141 --- ParallelTerminationStrategy: PID 23271 died... 19:38:30.700918 run iperf3-srv_10.42.42.10(pid=23271): Terminated {rc=256} 19:38:30.747081 --- ParallelTerminationStrategy: PID 23274 died... 19:38:30.767049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23274): Terminated: ok {rc=0} 19:38:30.813029 --- ParallelTerminationStrategy: PID 23277 died... 19:38:30.837296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23277): Terminated: ok {rc=0} 19:38:30.888632 --- ParallelTerminationStrategy: PID 23280 died... 19:38:30.910860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23280): Terminated: ok {rc=0} 19:38:31.003867 bus /gobi_4: Setting Powered False 19:38:32.104550 bus /gobi_4: Setting Powered False 19:38:33.221591 bus /gobi_1: Setting Powered False 19:38:34.319795 bus /gobi_1: Setting Powered False 19:38:35.434343 bus /gobi_0: Setting Powered False 19:38:36.532298 bus /gobi_0: Setting Powered False 19:38:37.647960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 19:38:38.750000 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:38.762420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:38:38.830617 tst ping.py: using LAC 35814 19:38:38.954257 tst ping.py: using RAC 114 19:38:39.075537 tst ping.py: using CellId 35814 19:38:39.196786 tst ping.py: using BVCI 35815 19:38:39.311060 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.322699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.334172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.345598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.357503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.369425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.381467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:39.393468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:39.512549 tst ping.py:19: start network... 19:38:39.724529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:40.213417 run create_hlr_db(pid=23282): Launched 19:38:40.332852 bus /gobi_6: Setting Powered False 19:38:41.395511 run create_hlr_db(pid=23282): Terminated: ok {rc=0} 19:38:41.816581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Launched 19:38:42.110082 run osmo-hlr_10.42.42.2(pid=23285): Launched 19:38:42.221222 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:42.733590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23287): Launched 19:38:43.025613 run osmo-stp_10.42.42.5(pid=23288): Launched 19:38:43.137708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:38:43.645197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23290): Launched 19:38:43.756462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:38:44.004350 run patchelf(pid=23291): Launched 19:38:44.166932 run osmo-stp_10.42.42.5(pid=23288): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23288)] 19:38:44.290798 run osmo-stp_10.42.42.5(pid=23288): stdout: | (launched: 2022-12-13_19:38:42.971650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:44.416168 run osmo-stp_10.42.42.5(pid=23288): stderr: | 20221213193843137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193843137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193843138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193843138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193843139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193843139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193843139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:44.541956 run osmo-stp_10.42.42.5(pid=23288): stdout: | (launched: 2022-12-13_19:38:42.971650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:44.662207 run osmo-stp_10.42.42.5(pid=23288): stderr: | 20221213193843137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193843137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193843138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193843138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193843139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193843139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193843139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:44.804644 run patchelf(pid=23291): Terminating (SIGINT) 19:38:44.968809 run patchelf(pid=23291): Terminated: ok {rc=0} 19:38:45.086936 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23288): Process ended prematurely: osmo-stp_10.42.42.5(pid=23288) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23288)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 19:38:45.095692 tst ping.py:22: Test FAILED (6.3 sec) 19:38:45.122215 run osmo-hlr_10.42.42.2(pid=23285): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23285)] 19:38:45.169660 run osmo-hlr_10.42.42.2(pid=23285): stdout: | (launched: 2022-12-13_19:38:42.055818) 19:38:45.218702 run osmo-hlr_10.42.42.2(pid=23285): stderr: | 20221213193842227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193842227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193842227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193842227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193842227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193842227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193842239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193842250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193842250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193842250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:45.268583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Terminating (SIGTERM) 19:38:45.308180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23287): Terminating (SIGTERM) 19:38:45.347642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23290): Terminating (SIGTERM) 19:38:45.387381 --- ParallelTerminationStrategy: PID 23284 died... 19:38:45.406465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Terminated: ok {rc=0} 19:38:45.450012 --- ParallelTerminationStrategy: PID 23287 died... 19:38:45.468579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23287): Terminated: ok {rc=0} 19:38:45.512422 --- ParallelTerminationStrategy: PID 23290 died... 19:38:45.531001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23290): Terminated: ok {rc=0} 19:38:45.613590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 19:38:46.699327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:46.711852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 19:38:46.781192 tst ping_idle_ping.py: using LAC 35815 19:38:46.930769 tst ping_idle_ping.py: using RAC 115 19:38:47.069326 tst ping_idle_ping.py: using CellId 35815 19:38:47.222994 tst ping_idle_ping.py: using BVCI 35816 19:38:47.340798 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.352616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.364083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.375536 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.387806 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.400130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.412568 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 19:38:47.424922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 19:38:47.546883 tst ping_idle_ping.py:24: start network... 19:38:47.760097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:48.254193 run create_hlr_db(pid=23292): Launched 19:38:48.373856 bus /gobi_6: Setting Powered False 19:38:49.436565 run create_hlr_db(pid=23292): Terminated: ok {rc=0} 19:38:49.859773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Launched 19:38:50.153465 run osmo-hlr_10.42.42.2(pid=23295): Launched 19:38:50.265207 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:50.774965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Launched 19:38:51.068268 run osmo-stp_10.42.42.5(pid=23298): Launched 19:38:51.179156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:38:51.685302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23300): Launched 19:38:51.797488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:38:52.046596 run patchelf(pid=23301): Launched 19:38:52.209750 run osmo-stp_10.42.42.5(pid=23298): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] 19:38:52.333932 run osmo-stp_10.42.42.5(pid=23298): stdout: | (launched: 2022-12-13_19:38:51.013856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:52.459734 run osmo-stp_10.42.42.5(pid=23298): stderr: | 20221213193851179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193851179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193851179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193851179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193851180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193851180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193851180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:52.585701 run osmo-stp_10.42.42.5(pid=23298): stdout: | (launched: 2022-12-13_19:38:51.013856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:38:52.706611 run osmo-stp_10.42.42.5(pid=23298): stderr: | 20221213193851179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193851179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193851179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193851179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193851180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193851180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193851180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:38:52.849764 run patchelf(pid=23301): Terminating (SIGINT) 19:38:53.014744 run patchelf(pid=23301): Terminated: ok {rc=0} 19:38:53.133791 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23298): Process ended prematurely: osmo-stp_10.42.42.5(pid=23298) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 19:38:53.142597 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:38:53.169242 run osmo-hlr_10.42.42.2(pid=23295): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23295)] 19:38:53.216841 run osmo-hlr_10.42.42.2(pid=23295): stdout: | (launched: 2022-12-13_19:38:50.099274) 19:38:53.266021 run osmo-hlr_10.42.42.2(pid=23295): stderr: | 20221213193850271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193850271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193850271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193850271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193850271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193850271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193850283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193850292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193850292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193850292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:38:53.316031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Terminating (SIGTERM) 19:38:53.355793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Terminating (SIGTERM) 19:38:53.395742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23300): Terminating (SIGTERM) 19:38:53.435632 --- ParallelTerminationStrategy: PID 23294 died... 19:38:53.454750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Terminated: ok {rc=0} 19:38:53.498369 --- ParallelTerminationStrategy: PID 23297 died... 19:38:53.516785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Terminated: ok {rc=0} 19:38:53.560421 --- ParallelTerminationStrategy: PID 23300 died... 19:38:53.578954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23300): Terminated: ok {rc=0} 19:38:53.661700 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:38:54.958683 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:38:54.965176 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:38:54.994031 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:38:55.028192 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:38:55.082298 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:38:55.111698 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:38:55.146129 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:38:55.704138 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:38:55.709127 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:55.720379 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:38:55.785412 tst switch_tch_pdch.py: using LAC 35816 19:38:55.906672 tst switch_tch_pdch.py: using RAC 116 19:38:56.021234 tst switch_tch_pdch.py: using CellId 35816 19:38:56.134639 tst switch_tch_pdch.py: using BVCI 35817 19:38:56.239791 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.251160 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.262466 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.273671 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.284811 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.296056 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.307526 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:38:56.318709 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:38:56.437296 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:38:56.556026 tst switch_tch_pdch.py:51: start network... 19:38:56.767926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:38:57.257325 run create_hlr_db(pid=23306): Launched 19:38:57.377526 bus /gobi_6: Setting Powered False 19:38:58.440798 run create_hlr_db(pid=23306): Terminated: ok {rc=0} 19:38:58.881432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23308): Launched 19:38:59.196179 run osmo-hlr_10.42.42.2(pid=23309): Launched 19:38:59.316085 run osmo-stp_10.42.42.5: Starting osmo-stp 19:38:59.857047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23311): Launched 19:39:00.173607 run osmo-stp_10.42.42.5(pid=23312): Launched 19:39:00.293571 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:39:00.843556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23314): Launched 19:39:00.993261 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:39:01.299365 run patchelf(pid=23343): Launched 19:39:01.506015 run osmo-stp_10.42.42.5(pid=23312): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23312)] 19:39:01.645537 run osmo-stp_10.42.42.5(pid=23312): stdout: | (launched: 2022-12-13_19:39:00.115115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:01.779599 run osmo-stp_10.42.42.5(pid=23312): stderr: | 20221213193900302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193900302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193900302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193900303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193900303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193900303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193900303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:01.916678 run osmo-stp_10.42.42.5(pid=23312): stdout: | (launched: 2022-12-13_19:39:00.115115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:02.065927 run osmo-stp_10.42.42.5(pid=23312): stderr: | 20221213193900302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193900302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193900302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193900303 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193900303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193900303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193900303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:02.222362 run patchelf(pid=23343): Terminating (SIGINT) 19:39:02.402069 run patchelf(pid=23343): Terminated: ok {rc=0} 19:39:02.538736 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23312): Process ended prematurely: osmo-stp_10.42.42.5(pid=23312) [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23312)] [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:39:02.548344 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 19:39:02.581422 run osmo-hlr_10.42.42.2(pid=23309): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23309)] 19:39:02.636117 run osmo-hlr_10.42.42.2(pid=23309): stdout: | (launched: 2022-12-13_19:38:59.138632) 19:39:02.694690 run osmo-hlr_10.42.42.2(pid=23309): stderr: | 20221213193859331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193859331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193859331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193859331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193859331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193859332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193859344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193859353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193859353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193859353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:02.749742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23308): Terminating (SIGTERM) 19:39:02.791603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23311): Terminating (SIGTERM) 19:39:02.841922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23314): Terminating (SIGTERM) 19:39:02.883656 --- ParallelTerminationStrategy: PID 23308 died... 19:39:02.912251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23308): Terminated: ok {rc=0} 19:39:02.962599 --- ParallelTerminationStrategy: PID 23311 died... 19:39:02.982101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23311): Terminated: ok {rc=0} 19:39:03.027654 --- ParallelTerminationStrategy: PID 23314 died... 19:39:03.053890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23314): Terminated: ok {rc=0} 19:39:03.152309 bus /gobi_0: Setting Powered False 19:39:04.261696 bus /gobi_0: Setting Powered False 19:39:05.382915 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 19:39:06.650726 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:06.657889 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 19:39:06.692527 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 19:39:06.731602 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 19:39:06.788619 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 19:39:06.819439 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 19:39:06.858319 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 19:39:07.414722 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 19:39:07.421577 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:07.434239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 19:39:07.506610 tst switch_tch_pdch.py: using LAC 35817 19:39:07.634740 tst switch_tch_pdch.py: using RAC 117 19:39:07.760927 tst switch_tch_pdch.py: using CellId 35817 19:39:07.887787 tst switch_tch_pdch.py: using BVCI 35818 19:39:08.007594 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.020751 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.033338 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.047208 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.060657 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.074219 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.087905 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 19:39:08.101731 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:39:08.226642 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 19:39:08.350345 tst switch_tch_pdch.py:51: start network... 19:39:08.569946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:09.041850 run create_hlr_db(pid=23592): Launched 19:39:09.203947 bus /gobi_6: Setting Powered False 19:39:10.268225 run create_hlr_db(pid=23592): Terminated: ok {rc=0} 19:39:10.673946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23594): Launched 19:39:10.984412 run osmo-hlr_10.42.42.2(pid=23595): Launched 19:39:11.214401 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:11.873543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23597): Launched 19:39:12.209501 run osmo-stp_10.42.42.5(pid=23598): Launched 19:39:12.455775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:39:13.064817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23600): Launched 19:39:13.199657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:39:13.474532 run patchelf(pid=23601): Launched 19:39:13.669380 run osmo-stp_10.42.42.5(pid=23598): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23598)] 19:39:13.808154 run osmo-stp_10.42.42.5(pid=23598): stdout: | (launched: 2022-12-13_19:39:12.151232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:13.950050 run osmo-stp_10.42.42.5(pid=23598): stderr: | 20221213193912448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193912448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193912448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193912449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193912449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193912449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193912449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:14.089700 run osmo-stp_10.42.42.5(pid=23598): stdout: | (launched: 2022-12-13_19:39:12.151232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:14.225737 run osmo-stp_10.42.42.5(pid=23598): stderr: | 20221213193912448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193912448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193912448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193912449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193912449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193912449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193912449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:14.385545 run patchelf(pid=23601): Terminating (SIGINT) 19:39:14.571316 run patchelf(pid=23601): Terminated: ok {rc=0} 19:39:14.704742 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23598): Process ended prematurely: osmo-stp_10.42.42.5(pid=23598) [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23598)] [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 19:39:14.715378 tst switch_tch_pdch.py:54: Test FAILED (7.3 sec) 19:39:14.747077 run osmo-hlr_10.42.42.2(pid=23595): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23595)] 19:39:14.801721 run osmo-hlr_10.42.42.2(pid=23595): stdout: | (launched: 2022-12-13_19:39:10.929409) 19:39:14.856675 run osmo-hlr_10.42.42.2(pid=23595): stderr: | 20221213193911253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193911253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193911254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193911254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193911254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193911254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193911277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193911290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193911290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193911290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:14.912553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23594): Terminating (SIGTERM) 19:39:14.957361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23597): Terminating (SIGTERM) 19:39:15.005236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23600): Terminating (SIGTERM) 19:39:15.052521 --- ParallelTerminationStrategy: PID 23594 died... 19:39:15.073702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23594): Terminated: ok {rc=0} 19:39:15.125971 --- ParallelTerminationStrategy: PID 23597 died... 19:39:15.147651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23597): Terminated: ok {rc=0} 19:39:15.197855 --- ParallelTerminationStrategy: PID 23600 died... 19:39:15.218853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23600): Terminated: ok {rc=0} 19:39:15.311496 bus /gobi_0: Setting Powered False 19:39:16.424057 bus /gobi_0: Setting Powered False 19:39:17.558314 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_sms:nanobts --------------------------------------------------------------------- 19:39:18.818449 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:18.823397 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 19:39:18.849653 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 19:39:18.860340 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 19:39:18.916770 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 19:39:18.943921 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 19:39:18.952665 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 19:39:19.488731 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 19:39:19.495747 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 19:39:19.509719 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 19:39:19.552530 tst mo_mt_sms.py: using LAC 35818 19:39:19.679516 tst mo_mt_sms.py: using RAC 118 19:39:19.811474 tst mo_mt_sms.py: using CellId 35818 19:39:19.938795 tst mo_mt_sms.py: using BVCI 35819 19:39:20.057914 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 19:39:20.180723 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 19:39:20.303814 tst mo_mt_sms.py:9: start nitb and bts... 19:39:20.527070 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:39:21.194090 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23605): Launched 19:39:21.531983 run osmo-nitb_10.42.42.2(pid=23606): Launched 19:39:21.734063 run osmo-nitb_10.42.42.2(pid=23606): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23606)] 19:39:21.882265 run osmo-nitb_10.42.42.2(pid=23606): stdout: | (launched: 2022-12-13_19:39:21.471349) 19:39:22.032070 run osmo-nitb_10.42.42.2(pid=23606): stderr: | (launched: 2022-12-13_19:39:21.521711) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:39:22.180660 run osmo-nitb_10.42.42.2(pid=23606): stdout: | (launched: 2022-12-13_19:39:21.471349) 19:39:22.323805 run osmo-nitb_10.42.42.2(pid=23606): stderr: | (launched: 2022-12-13_19:39:21.521711) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23606): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23606) [trial-2393↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23606)] 19:39:22.673972 tst osmo-nitb_10.42.42.2(pid=23606): stdout: | (launched: 2022-12-13_19:39:21.471349) 19:39:22.807466 tst osmo-nitb_10.42.42.2(pid=23606): stderr: | (launched: 2022-12-13_19:39:21.521711) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:39:22.965850 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23606): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23606) [trial-2393↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23606)] [trial-2393↪nitb_sms:nanobts↪mo_mt_sms.py:11] 19:39:22.975816 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 19:39:22.984275 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23605): Terminating (SIGTERM) 19:39:23.200286 --- ParallelTerminationStrategy: PID 23605 died... 19:39:23.223079 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23605): Terminated: ok {rc=0} 19:39:23.315138 bus /sierra_3: Setting Powered False 19:39:24.414557 bus /sierra_3: Setting Powered False 19:39:25.527492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:nanobts+band-1900 --------------------------------------------------------------------- 19:39:26.711342 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:26.716500 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:39:26.741210 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:39:26.769933 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 19:39:26.825574 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:39:26.850707 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:39:26.878588 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 19:39:27.425031 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 19:39:27.430138 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:27.441489 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:39:27.480138 tst mo_mt_sms.py: using LAC 35819 19:39:27.605454 tst mo_mt_sms.py: using RAC 119 19:39:27.731531 tst mo_mt_sms.py: using CellId 35819 19:39:27.855345 tst mo_mt_sms.py: using BVCI 35820 19:39:27.970022 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:27.981247 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:27.992370 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:28.003453 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:28.014797 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:28.026136 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 19:39:28.142709 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 19:39:28.257466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:28.713074 run create_hlr_db(pid=23612): Launched 19:39:28.833631 bus /sierra_2: Setting Powered False 19:39:29.892618 run create_hlr_db(pid=23612): Terminated: ok {rc=0} 19:39:30.301487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Launched 19:39:30.593149 run osmo-hlr_10.42.42.2(pid=23615): Launched 19:39:30.704199 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:31.227339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Launched 19:39:31.581224 run osmo-stp_10.42.42.5(pid=23618): Launched 19:39:31.812715 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:32.457725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Launched 19:39:32.771963 run osmo-msc_10.42.42.6(pid=23621): Launched 19:39:32.947981 run osmo-stp_10.42.42.5(pid=23618): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] 19:39:33.081851 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-13_19:39:31.521464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:33.216088 run osmo-stp_10.42.42.5(pid=23618): stderr: | 20221213193931816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193931817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193931817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193931817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193931818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193931818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193931818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:33.348529 run osmo-stp_10.42.42.5(pid=23618): stdout: | (launched: 2022-12-13_19:39:31.521464) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:33.475226 run osmo-stp_10.42.42.5(pid=23618): stderr: | 20221213193931816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193931817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193931817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193931817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193931818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193931818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193931818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:33.626705 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 19:39:33.635549 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 19:39:33.662780 run osmo-hlr_10.42.42.2(pid=23615): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23615)] 19:39:33.713393 run osmo-hlr_10.42.42.2(pid=23615): stdout: | (launched: 2022-12-13_19:39:30.539185) 19:39:33.765393 run osmo-hlr_10.42.42.2(pid=23615): stderr: | 20221213193930708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193930708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193930709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193930709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193930709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193930709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193930722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193930731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193930731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193930731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:33.837562 run osmo-msc_10.42.42.6(pid=23621): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23621)] 19:39:33.887931 run osmo-msc_10.42.42.6(pid=23621): stdout: | (launched: 2022-12-13_19:39:32.714562) 19:39:33.939475 run osmo-msc_10.42.42.6(pid=23621): stderr: | 20221213193933031 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193933031 DLGLOBAL DEBUG validating counter group 0x7fbba5eb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193933031 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193933031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193933032 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193933032 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193933034 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193933034 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193933034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193933034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:33.991447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminating (SIGTERM) 19:39:34.033085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminating (SIGTERM) 19:39:34.074753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminating (SIGTERM) 19:39:34.116576 --- ParallelTerminationStrategy: PID 23614 died... 19:39:34.137053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23614): Terminated: ok {rc=0} 19:39:34.183042 --- ParallelTerminationStrategy: PID 23617 died... 19:39:34.202949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23617): Terminated: ok {rc=0} 19:39:34.248888 --- ParallelTerminationStrategy: PID 23620 died... 19:39:34.269155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23620): Terminated: ok {rc=0} 19:39:34.357100 bus /sierra_3: Setting Powered False 19:39:35.453510 bus /sierra_3: Setting Powered False 19:39:36.569424 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 19:39:37.796345 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:37.801899 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:39:37.827644 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 19:39:37.834359 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 19:39:37.869445 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:39:37.893078 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 19:39:37.899605 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 19:39:38.419461 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 19:39:38.424522 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 19:39:38.435399 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:39:38.472641 tst assert_extension.py: using LAC 35820 19:39:38.587821 tst assert_extension.py: using RAC 120 19:39:38.704554 tst assert_extension.py: using CellId 35820 19:39:38.819643 tst assert_extension.py: using BVCI 35821 19:39:38.925429 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 19:39:39.041853 tst assert_extension.py:10: start nitb and bts... 19:39:39.253434 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:39:39.897384 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23626): Launched 19:39:40.213193 run osmo-nitb_10.42.42.2(pid=23627): Launched 19:39:40.387827 run osmo-nitb_10.42.42.2(pid=23627): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23627)] 19:39:40.529152 run osmo-nitb_10.42.42.2(pid=23627): stdout: | (launched: 2022-12-13_19:39:40.155844) 19:39:40.672250 run osmo-nitb_10.42.42.2(pid=23627): stderr: | (launched: 2022-12-13_19:39:40.202693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:39:40.815013 run osmo-nitb_10.42.42.2(pid=23627): stdout: | (launched: 2022-12-13_19:39:40.155844) 19:39:40.953086 run osmo-nitb_10.42.42.2(pid=23627): stderr: | (launched: 2022-12-13_19:39:40.202693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23627): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23627) [trial-2393↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23627)] 19:39:41.332247 tst osmo-nitb_10.42.42.2(pid=23627): stdout: | (launched: 2022-12-13_19:39:40.155844) 19:39:41.460083 tst osmo-nitb_10.42.42.2(pid=23627): stderr: | (launched: 2022-12-13_19:39:40.202693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:39:41.611253 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23627): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23627) [trial-2393↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23627)] [trial-2393↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 19:39:41.620151 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:39:41.627028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23626): Terminating (SIGTERM) 19:39:41.837672 --- ParallelTerminationStrategy: PID 23626 died... 19:39:41.859288 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23626): Terminated: ok {rc=0} 19:39:41.946989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:nanobts+band-1900 --------------------------------------------------------------------- 19:39:43.111001 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:43.116503 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:39:43.141114 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:39:43.167714 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 19:39:43.201115 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:39:43.224826 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:39:43.251130 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 19:39:43.785481 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 19:39:43.790582 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:43.801468 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:39:43.840103 tst assert_extension.py: using LAC 35821 19:39:43.954279 tst assert_extension.py: using RAC 121 19:39:44.068215 tst assert_extension.py: using CellId 35821 19:39:44.181493 tst assert_extension.py: using BVCI 35822 19:39:44.297496 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:44.308628 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:44.319703 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:44.330737 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:44.342186 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:39:44.353648 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 19:39:44.466366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:44.922878 run create_hlr_db(pid=23631): Launched 19:39:45.042769 bus /sierra_2: Setting Powered False 19:39:46.120317 run create_hlr_db(pid=23631): Terminated: ok {rc=0} 19:39:46.628667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Launched 19:39:46.939429 run osmo-hlr_10.42.42.2(pid=23634): Launched 19:39:47.117216 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:47.716199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Launched 19:39:48.014322 run osmo-stp_10.42.42.5(pid=23637): Launched 19:39:48.124994 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:48.654439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23639): Launched 19:39:48.948376 run osmo-msc_10.42.42.6(pid=23640): Launched 19:39:49.111532 run osmo-stp_10.42.42.5(pid=23637): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] 19:39:49.235271 run osmo-stp_10.42.42.5(pid=23637): stdout: | (launched: 2022-12-13_19:39:47.960444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:49.359272 run osmo-stp_10.42.42.5(pid=23637): stderr: | 20221213193948127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193948127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193948127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193948127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193948128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193948128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193948128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:49.481960 run osmo-stp_10.42.42.5(pid=23637): stdout: | (launched: 2022-12-13_19:39:47.960444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:49.598965 run osmo-stp_10.42.42.5(pid=23637): stderr: | 20221213193948127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193948127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193948127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193948127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193948128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193948128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193948128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:49.739650 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23637): Process ended prematurely: osmo-stp_10.42.42.5(pid=23637) [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py:17] 19:39:49.748283 tst assert_extension.py:17: Test FAILED (6.0 sec) 19:39:49.774329 run osmo-hlr_10.42.42.2(pid=23634): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23634)] 19:39:49.822105 run osmo-hlr_10.42.42.2(pid=23634): stdout: | (launched: 2022-12-13_19:39:46.883924) 19:39:49.871662 run osmo-hlr_10.42.42.2(pid=23634): stderr: | 20221213193947198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193947198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193947198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193947198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193947198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193947198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193947216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193947242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193947242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193947242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:49.940275 run osmo-msc_10.42.42.6(pid=23640): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23640)] 19:39:49.987655 run osmo-msc_10.42.42.6(pid=23640): stdout: | (launched: 2022-12-13_19:39:48.893488) 19:39:50.036902 run osmo-msc_10.42.42.6(pid=23640): stderr: | 20221213193949162 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193949162 DLGLOBAL DEBUG validating counter group 0x7fb54f173c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193949162 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193949162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193949162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193949163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193949164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193949165 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193949165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193949165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:50.086341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Terminating (SIGTERM) 19:39:50.126149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Terminating (SIGTERM) 19:39:50.165781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23639): Terminating (SIGTERM) 19:39:50.205566 --- ParallelTerminationStrategy: PID 23633 died... 19:39:50.224846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23633): Terminated: ok {rc=0} 19:39:50.268617 --- ParallelTerminationStrategy: PID 23636 died... 19:39:50.286885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23636): Terminated: ok {rc=0} 19:39:50.330611 --- ParallelTerminationStrategy: PID 23639 died... 19:39:50.349347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23639): Terminated: ok {rc=0} 19:39:50.432638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:39:51.629519 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:39:51.636670 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:39:51.660548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:39:51.687260 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:39:51.739702 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:39:51.763510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:39:51.790052 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:39:52.341077 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:39:52.389688 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.401347 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:39:52.463865 tst mo_mt_call.py: using LAC 35822 19:39:52.579961 tst mo_mt_call.py: using RAC 122 19:39:52.695147 tst mo_mt_call.py: using CellId 35822 19:39:52.809745 tst mo_mt_call.py: using BVCI 35823 19:39:52.917280 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.928510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.939586 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.950589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.962322 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:39:52.973631 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:39:53.087575 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:39:53.206733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:39:53.703935 run create_hlr_db(pid=23645): Launched 19:39:53.826998 bus /sierra_2: Setting Powered False 19:39:54.891250 run create_hlr_db(pid=23645): Terminated: ok {rc=0} 19:39:55.318745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Launched 19:39:55.617315 run osmo-hlr_10.42.42.2(pid=23648): Launched 19:39:55.730633 run osmo-stp_10.42.42.5: Starting osmo-stp 19:39:56.244781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Launched 19:39:56.544261 run osmo-stp_10.42.42.5(pid=23651): Launched 19:39:56.667834 run osmo-msc_10.42.42.6: Starting osmo-msc 19:39:57.249319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23653): Launched 19:39:57.570409 run osmo-msc_10.42.42.6(pid=23654): Launched 19:39:57.749246 run osmo-stp_10.42.42.5(pid=23651): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] 19:39:57.884031 run osmo-stp_10.42.42.5(pid=23651): stdout: | (launched: 2022-12-13_19:39:56.487375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:58.019665 run osmo-stp_10.42.42.5(pid=23651): stderr: | 20221213193956670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193956670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193956670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193956670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193956671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193956671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193956671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:58.154372 run osmo-stp_10.42.42.5(pid=23651): stdout: | (launched: 2022-12-13_19:39:56.487375) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:39:58.283090 run osmo-stp_10.42.42.5(pid=23651): stderr: | 20221213193956670 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213193956670 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213193956670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213193956670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213193956671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213193956671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213193956671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:39:58.436940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23651): Process ended prematurely: osmo-stp_10.42.42.5(pid=23651) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:39:58.446440 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:39:58.473898 run osmo-hlr_10.42.42.2(pid=23648): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23648)] 19:39:58.526324 run osmo-hlr_10.42.42.2(pid=23648): stdout: | (launched: 2022-12-13_19:39:55.562450) 19:39:58.578757 run osmo-hlr_10.42.42.2(pid=23648): stderr: | 20221213193955736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213193955736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213193955736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213193955736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213193955736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213193955736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213193955748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213193955757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213193955757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213193955757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:39:58.651417 run osmo-msc_10.42.42.6(pid=23654): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23654)] 19:39:58.702090 run osmo-msc_10.42.42.6(pid=23654): stdout: | (launched: 2022-12-13_19:39:57.511371) 19:39:58.754214 run osmo-msc_10.42.42.6(pid=23654): stderr: | 20221213193957829 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213193957829 DLGLOBAL DEBUG validating counter group 0x7f277aab9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213193957829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213193957829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213193957830 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213193957830 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213193957831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213193957832 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213193957832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213193957832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:39:58.806599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Terminating (SIGTERM) 19:39:58.847755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Terminating (SIGTERM) 19:39:58.890287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23653): Terminating (SIGTERM) 19:39:58.932746 --- ParallelTerminationStrategy: PID 23647 died... 19:39:58.953357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23647): Terminated: ok {rc=0} 19:39:58.999522 --- ParallelTerminationStrategy: PID 23650 died... 19:39:59.019562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23650): Terminated: ok {rc=0} 19:39:59.065527 --- ParallelTerminationStrategy: PID 23653 died... 19:39:59.085889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23653): Terminated: ok {rc=0} 19:39:59.174402 bus /sierra_3: Setting Powered False 19:40:00.271984 bus /sierra_3: Setting Powered False 19:40:01.394980 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:40:02.557656 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:02.570166 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:40:02.633788 tst mo_mt_call_osmux.py: using LAC 35823 19:40:02.760024 tst mo_mt_call_osmux.py: using RAC 123 19:40:02.885152 tst mo_mt_call_osmux.py: using CellId 35823 19:40:03.012654 tst mo_mt_call_osmux.py: using BVCI 35824 19:40:03.122238 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:03.133673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:03.144863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:03.156001 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:03.167374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:40:03.178555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:40:03.295649 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:40:03.410519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:03.874853 run create_hlr_db(pid=23659): Launched 19:40:03.997406 bus /sierra_2: Setting Powered False 19:40:05.057986 run create_hlr_db(pid=23659): Terminated: ok {rc=0} 19:40:05.473975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Launched 19:40:05.771520 run osmo-hlr_10.42.42.2(pid=23662): Launched 19:40:05.885229 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:06.403134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Launched 19:40:06.702691 run osmo-stp_10.42.42.5(pid=23665): Launched 19:40:06.816291 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:07.357281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23667): Launched 19:40:07.655857 run osmo-msc_10.42.42.6(pid=23668): Launched 19:40:07.823024 run osmo-stp_10.42.42.5(pid=23665): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] 19:40:07.950631 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-13_19:40:06.647079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:08.076875 run osmo-stp_10.42.42.5(pid=23665): stderr: | 20221213194006813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194006813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194006814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194006814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194006814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194006815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194006815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:08.201365 run osmo-stp_10.42.42.5(pid=23665): stdout: | (launched: 2022-12-13_19:40:06.647079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:08.320625 run osmo-stp_10.42.42.5(pid=23665): stderr: | 20221213194006813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194006813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194006814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194006814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194006814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194006815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194006815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:08.462980 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:40:08.472023 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:40:08.498138 run osmo-hlr_10.42.42.2(pid=23662): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23662)] 19:40:08.545522 run osmo-hlr_10.42.42.2(pid=23662): stdout: | (launched: 2022-12-13_19:40:05.716649) 19:40:08.594509 run osmo-hlr_10.42.42.2(pid=23662): stderr: | 20221213194005889 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194005889 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194005889 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194005889 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194005889 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194005889 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194005900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194005909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194005910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194005910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:08.663273 run osmo-msc_10.42.42.6(pid=23668): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23668)] 19:40:08.710430 run osmo-msc_10.42.42.6(pid=23668): stdout: | (launched: 2022-12-13_19:40:07.600795) 19:40:08.759273 run osmo-msc_10.42.42.6(pid=23668): stderr: | 20221213194007869 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194007870 DLGLOBAL DEBUG validating counter group 0x7f8fd5b4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194007870 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194007870 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194007870 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194007870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194007872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194007872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194007872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194007873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:08.808475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminating (SIGTERM) 19:40:08.847946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminating (SIGTERM) 19:40:08.887199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23667): Terminating (SIGTERM) 19:40:08.926593 --- ParallelTerminationStrategy: PID 23661 died... 19:40:08.945770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23661): Terminated: ok {rc=0} 19:40:08.989644 --- ParallelTerminationStrategy: PID 23664 died... 19:40:09.008276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23664): Terminated: ok {rc=0} 19:40:09.051899 --- ParallelTerminationStrategy: PID 23667 died... 19:40:09.070472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23667): Terminated: ok {rc=0} 19:40:09.153170 bus /sierra_3: Setting Powered False 19:40:10.251273 bus /sierra_3: Setting Powered False 19:40:11.365647 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:40:12.611512 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:12.619475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:40:12.644031 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:40:12.672476 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:40:12.728537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:40:12.753789 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:40:12.781366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:40:13.330807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:40:13.382651 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:13.394555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:40:13.455524 tst mo_mt_call.py: using LAC 35824 19:40:13.580168 tst mo_mt_call.py: using RAC 124 19:40:13.704742 tst mo_mt_call.py: using CellId 35824 19:40:13.833419 tst mo_mt_call.py: using BVCI 35825 19:40:13.951464 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:13.963263 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:13.975095 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:13.986779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:13.998855 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:14.010884 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:40:14.123614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:40:14.237787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:14.699352 run create_hlr_db(pid=23673): Launched 19:40:14.821845 bus /sierra_2: Setting Powered False 19:40:15.917432 run create_hlr_db(pid=23673): Terminated: ok {rc=0} 19:40:16.375573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23675): Launched 19:40:16.721145 run osmo-hlr_10.42.42.2(pid=23676): Launched 19:40:16.926607 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:17.553630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23678): Launched 19:40:17.874677 run osmo-stp_10.42.42.5(pid=23679): Launched 19:40:17.997122 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:18.575578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23681): Launched 19:40:18.897748 run osmo-msc_10.42.42.6(pid=23682): Launched 19:40:19.077890 run osmo-stp_10.42.42.5(pid=23679): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23679)] 19:40:19.213484 run osmo-stp_10.42.42.5(pid=23679): stdout: | (launched: 2022-12-13_19:40:17.816203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:19.349590 run osmo-stp_10.42.42.5(pid=23679): stderr: | 20221213194018004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194018004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194018005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194018005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194018005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:19.483687 run osmo-stp_10.42.42.5(pid=23679): stdout: | (launched: 2022-12-13_19:40:17.816203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:19.611849 run osmo-stp_10.42.42.5(pid=23679): stderr: | 20221213194018004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194018004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194018004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194018005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194018005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194018005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194018005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:19.765099 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23679): Process ended prematurely: osmo-stp_10.42.42.5(pid=23679) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23679)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:40:19.774785 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 19:40:19.802274 run osmo-hlr_10.42.42.2(pid=23676): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23676)] 19:40:19.853203 run osmo-hlr_10.42.42.2(pid=23676): stdout: | (launched: 2022-12-13_19:40:16.658992) 19:40:19.905235 run osmo-hlr_10.42.42.2(pid=23676): stderr: | 20221213194017006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194017006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194017007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194017007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194017007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194017007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194017033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194017049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194017049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194017050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:19.977259 run osmo-msc_10.42.42.6(pid=23682): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23682)] 19:40:20.027275 run osmo-msc_10.42.42.6(pid=23682): stdout: | (launched: 2022-12-13_19:40:18.838896) 19:40:20.078869 run osmo-msc_10.42.42.6(pid=23682): stderr: | 20221213194019155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194019155 DLGLOBAL DEBUG validating counter group 0x7f50d1f6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194019156 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194019156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194019156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194019156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194019158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194019158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194019158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194019158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:20.130785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23675): Terminating (SIGTERM) 19:40:20.172350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23678): Terminating (SIGTERM) 19:40:20.214054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23681): Terminating (SIGTERM) 19:40:20.256245 --- ParallelTerminationStrategy: PID 23675 died... 19:40:20.276600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23675): Terminated: ok {rc=0} 19:40:20.323364 --- ParallelTerminationStrategy: PID 23678 died... 19:40:20.343168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23678): Terminated: ok {rc=0} 19:40:20.388911 --- ParallelTerminationStrategy: PID 23681 died... 19:40:20.408404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23681): Terminated: ok {rc=0} 19:40:20.495550 bus /sierra_3: Setting Powered False 19:40:21.594326 bus /sierra_3: Setting Powered False 19:40:22.709512 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:40:23.858645 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:23.870967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:40:23.933336 tst mo_mt_call_osmux.py: using LAC 35825 19:40:24.060158 tst mo_mt_call_osmux.py: using RAC 125 19:40:24.184632 tst mo_mt_call_osmux.py: using CellId 35825 19:40:24.308918 tst mo_mt_call_osmux.py: using BVCI 35826 19:40:24.424666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:24.436383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:24.447997 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:24.459548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:24.471338 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:40:24.483134 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:40:24.602707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:40:24.723612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:25.220153 run create_hlr_db(pid=23684): Launched 19:40:25.342269 bus /sierra_2: Setting Powered False 19:40:26.401468 run create_hlr_db(pid=23684): Terminated: ok {rc=0} 19:40:26.826897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23686): Launched 19:40:27.125303 run osmo-hlr_10.42.42.2(pid=23687): Launched 19:40:27.238047 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:27.766796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23689): Launched 19:40:28.065276 run osmo-stp_10.42.42.5(pid=23690): Launched 19:40:28.178025 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:28.718609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23692): Launched 19:40:29.017687 run osmo-msc_10.42.42.6(pid=23693): Launched 19:40:29.184204 run osmo-stp_10.42.42.5(pid=23690): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23690)] 19:40:29.310350 run osmo-stp_10.42.42.5(pid=23690): stdout: | (launched: 2022-12-13_19:40:28.009764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:29.436370 run osmo-stp_10.42.42.5(pid=23690): stderr: | 20221213194028178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194028179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194028179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194028179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194028180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194028180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194028180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:29.560225 run osmo-stp_10.42.42.5(pid=23690): stdout: | (launched: 2022-12-13_19:40:28.009764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:29.679248 run osmo-stp_10.42.42.5(pid=23690): stderr: | 20221213194028178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194028179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194028179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194028179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194028180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194028180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194028180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:29.821531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23690): Process ended prematurely: osmo-stp_10.42.42.5(pid=23690) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23690)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:40:29.830327 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:40:29.856269 run osmo-hlr_10.42.42.2(pid=23687): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23687)] 19:40:29.903884 run osmo-hlr_10.42.42.2(pid=23687): stdout: | (launched: 2022-12-13_19:40:27.070289) 19:40:29.952925 run osmo-hlr_10.42.42.2(pid=23687): stderr: | 20221213194027242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194027242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194027242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194027242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194027242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194027242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194027254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194027264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194027264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194027264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:30.021459 run osmo-msc_10.42.42.6(pid=23693): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23693)] 19:40:30.069240 run osmo-msc_10.42.42.6(pid=23693): stdout: | (launched: 2022-12-13_19:40:28.961884) 19:40:30.118382 run osmo-msc_10.42.42.6(pid=23693): stderr: | 20221213194029231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194029231 DLGLOBAL DEBUG validating counter group 0x7f4ab0493c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194029231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194029231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194029231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194029231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194029233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194029233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194029234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194029234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:30.167706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23686): Terminating (SIGTERM) 19:40:30.206936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23689): Terminating (SIGTERM) 19:40:30.246425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23692): Terminating (SIGTERM) 19:40:30.285874 --- ParallelTerminationStrategy: PID 23686 died... 19:40:30.304609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23686): Terminated: ok {rc=0} 19:40:30.348211 --- ParallelTerminationStrategy: PID 23689 died... 19:40:30.366681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23689): Terminated: ok {rc=0} 19:40:30.410106 --- ParallelTerminationStrategy: PID 23692 died... 19:40:30.428526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23692): Terminated: ok {rc=0} 19:40:30.510576 bus /sierra_3: Setting Powered False 19:40:31.611060 bus /sierra_3: Setting Powered False 19:40:32.740711 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:40:33.983569 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:33.991493 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:40:34.015996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:40:34.044685 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:40:34.099265 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:40:34.124203 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:40:34.151887 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:40:34.702876 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:40:34.754738 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:34.766518 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:40:34.827434 tst mo_mt_call.py: using LAC 35826 19:40:34.952694 tst mo_mt_call.py: using RAC 126 19:40:35.078468 tst mo_mt_call.py: using CellId 35826 19:40:35.208844 tst mo_mt_call.py: using BVCI 35827 19:40:35.319295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:35.330827 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:35.342068 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:35.353429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:35.364718 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:35.375963 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:40:35.495051 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:40:35.611300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:36.074532 run create_hlr_db(pid=23700): Launched 19:40:36.196032 bus /sierra_2: Setting Powered False 19:40:37.259595 run create_hlr_db(pid=23700): Terminated: ok {rc=0} 19:40:37.706279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23702): Launched 19:40:38.026967 run osmo-hlr_10.42.42.2(pid=23703): Launched 19:40:38.150362 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:38.702802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23705): Launched 19:40:39.025301 run osmo-stp_10.42.42.5(pid=23706): Launched 19:40:39.147115 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:39.726896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23708): Launched 19:40:40.049869 run osmo-msc_10.42.42.6(pid=23709): Launched 19:40:40.229200 run osmo-stp_10.42.42.5(pid=23706): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23706)] 19:40:40.365128 run osmo-stp_10.42.42.5(pid=23706): stdout: | (launched: 2022-12-13_19:40:38.966129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:40.501233 run osmo-stp_10.42.42.5(pid=23706): stderr: | 20221213194039154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194039154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194039154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194039155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194039155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194039155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194039155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:40.635745 run osmo-stp_10.42.42.5(pid=23706): stdout: | (launched: 2022-12-13_19:40:38.966129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:40.764478 run osmo-stp_10.42.42.5(pid=23706): stderr: | 20221213194039154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194039154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194039154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194039155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194039155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194039155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194039155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:40.919146 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23706): Process ended prematurely: osmo-stp_10.42.42.5(pid=23706) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23706)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:40:40.928494 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:40:40.956185 run osmo-hlr_10.42.42.2(pid=23703): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23703)] 19:40:41.006847 run osmo-hlr_10.42.42.2(pid=23703): stdout: | (launched: 2022-12-13_19:40:37.968344) 19:40:41.058942 run osmo-hlr_10.42.42.2(pid=23703): stderr: | 20221213194038162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194038162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194038162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194038162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194038163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194038163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194038175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194038183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194038184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194038184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:41.131378 run osmo-msc_10.42.42.6(pid=23709): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23709)] 19:40:41.181338 run osmo-msc_10.42.42.6(pid=23709): stdout: | (launched: 2022-12-13_19:40:39.990976) 19:40:41.232660 run osmo-msc_10.42.42.6(pid=23709): stderr: | 20221213194040308 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194040309 DLGLOBAL DEBUG validating counter group 0x7ff46b9a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194040309 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194040309 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194040309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194040309 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194040311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194040311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194040312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194040312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:41.284525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23702): Terminating (SIGTERM) 19:40:41.325822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23705): Terminating (SIGTERM) 19:40:41.367324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23708): Terminating (SIGTERM) 19:40:41.409159 --- ParallelTerminationStrategy: PID 23702 died... 19:40:41.429257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23702): Terminated: ok {rc=0} 19:40:41.475139 --- ParallelTerminationStrategy: PID 23705 died... 19:40:41.494608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23705): Terminated: ok {rc=0} 19:40:41.540734 --- ParallelTerminationStrategy: PID 23708 died... 19:40:41.560448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23708): Terminated: ok {rc=0} 19:40:41.647560 bus /sierra_3: Setting Powered False 19:40:42.746907 bus /sierra_3: Setting Powered False 19:40:43.865377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:40:45.008714 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.022791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:40:45.087680 tst mo_mt_call_osmux.py: using LAC 35827 19:40:45.231490 tst mo_mt_call_osmux.py: using RAC 127 19:40:45.356727 tst mo_mt_call_osmux.py: using CellId 35827 19:40:45.482073 tst mo_mt_call_osmux.py: using BVCI 35828 19:40:45.600250 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.612095 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.623860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.635636 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.647758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:40:45.659807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:40:45.780821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:40:45.922127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:46.470939 run create_hlr_db(pid=23711): Launched 19:40:46.639724 bus /sierra_2: Setting Powered False 19:40:47.699385 run create_hlr_db(pid=23711): Terminated: ok {rc=0} 19:40:48.136476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23713): Launched 19:40:48.457215 run osmo-hlr_10.42.42.2(pid=23714): Launched 19:40:48.580706 run osmo-stp_10.42.42.5: Starting osmo-stp 19:40:49.135157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23716): Launched 19:40:49.455515 run osmo-stp_10.42.42.5(pid=23717): Launched 19:40:49.580874 run osmo-msc_10.42.42.6: Starting osmo-msc 19:40:50.167560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23719): Launched 19:40:50.490170 run osmo-msc_10.42.42.6(pid=23720): Launched 19:40:50.668795 run osmo-stp_10.42.42.5(pid=23717): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23717)] 19:40:50.803753 run osmo-stp_10.42.42.5(pid=23717): stdout: | (launched: 2022-12-13_19:40:49.397046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:50.940322 run osmo-stp_10.42.42.5(pid=23717): stderr: | 20221213194049584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194049585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194049585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194049585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194049586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194049586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194049586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:51.074911 run osmo-stp_10.42.42.5(pid=23717): stdout: | (launched: 2022-12-13_19:40:49.397046) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:40:51.203549 run osmo-stp_10.42.42.5(pid=23717): stderr: | 20221213194049584 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194049585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194049585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194049585 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194049586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194049586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194049586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:40:51.357206 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23717): Process ended prematurely: osmo-stp_10.42.42.5(pid=23717) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23717)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:40:51.366709 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 19:40:51.394206 run osmo-hlr_10.42.42.2(pid=23714): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23714)] 19:40:51.444496 run osmo-hlr_10.42.42.2(pid=23714): stdout: | (launched: 2022-12-13_19:40:48.398649) 19:40:51.496121 run osmo-hlr_10.42.42.2(pid=23714): stderr: | 20221213194048591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194048591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194048591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194048591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194048591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194048592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194048603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194048612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194048613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194048613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:40:51.567944 run osmo-msc_10.42.42.6(pid=23720): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23720)] 19:40:51.617755 run osmo-msc_10.42.42.6(pid=23720): stdout: | (launched: 2022-12-13_19:40:50.430836) 19:40:51.669360 run osmo-msc_10.42.42.6(pid=23720): stderr: | 20221213194050751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194050751 DLGLOBAL DEBUG validating counter group 0x7fb9a09bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194050751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194050751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194050752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194050752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194050754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194050754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194050754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194050754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:40:51.721267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23713): Terminating (SIGTERM) 19:40:51.762704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23716): Terminating (SIGTERM) 19:40:51.804200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23719): Terminating (SIGTERM) 19:40:51.846172 --- ParallelTerminationStrategy: PID 23713 died... 19:40:51.866424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23713): Terminated: ok {rc=0} 19:40:51.915899 --- ParallelTerminationStrategy: PID 23716 died... 19:40:51.935292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23716): Terminated: ok {rc=0} 19:40:51.981739 --- ParallelTerminationStrategy: PID 23719 died... 19:40:52.001422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23719): Terminated: ok {rc=0} 19:40:52.089232 bus /sierra_3: Setting Powered False 19:40:53.186965 bus /sierra_3: Setting Powered False 19:40:54.302251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:40:55.544072 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:40:55.552485 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:40:55.577285 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:40:55.606073 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:40:55.660125 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:40:55.684599 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:40:55.712128 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:40:56.265812 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:40:56.317774 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.329572 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:40:56.391126 tst mo_mt_call.py: using LAC 35828 19:40:56.516002 tst mo_mt_call.py: using RAC 128 19:40:56.641617 tst mo_mt_call.py: using CellId 35828 19:40:56.767348 tst mo_mt_call.py: using BVCI 35829 19:40:56.884835 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.896617 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.908499 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.920118 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.931998 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:40:56.943795 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:40:57.062102 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:40:57.178341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:40:57.642555 run create_hlr_db(pid=23727): Launched 19:40:57.764588 bus /sierra_2: Setting Powered False 19:40:58.825190 run create_hlr_db(pid=23727): Terminated: ok {rc=0} 19:40:59.263062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23729): Launched 19:40:59.585871 run osmo-hlr_10.42.42.2(pid=23730): Launched 19:40:59.707207 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:00.263665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23732): Launched 19:41:00.586727 run osmo-stp_10.42.42.5(pid=23733): Launched 19:41:00.709493 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:01.311942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23735): Launched 19:41:01.659585 run osmo-msc_10.42.42.6(pid=23736): Launched 19:41:02.124905 run osmo-stp_10.42.42.5(pid=23733): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23733)] 19:41:02.402055 run osmo-stp_10.42.42.5(pid=23733): stdout: | (launched: 2022-12-13_19:41:00.527098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:02.542600 run osmo-stp_10.42.42.5(pid=23733): stderr: | 20221213194100714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194100715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194100715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194100715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194100716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194100716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194100716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:02.676572 run osmo-stp_10.42.42.5(pid=23733): stdout: | (launched: 2022-12-13_19:41:00.527098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:02.805305 run osmo-stp_10.42.42.5(pid=23733): stderr: | 20221213194100714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194100715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194100715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194100715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194100716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194100716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194100716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:02.959646 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23733): Process ended prematurely: osmo-stp_10.42.42.5(pid=23733) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23733)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:41:02.969270 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 19:41:02.997288 run osmo-hlr_10.42.42.2(pid=23730): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23730)] 19:41:03.048749 run osmo-hlr_10.42.42.2(pid=23730): stdout: | (launched: 2022-12-13_19:40:59.526936) 19:41:03.101439 run osmo-hlr_10.42.42.2(pid=23730): stderr: | 20221213194059721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194059721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194059721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194059721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194059721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194059721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194059735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194059743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194059744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194059744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:03.174417 run osmo-msc_10.42.42.6(pid=23736): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23736)] 19:41:03.225112 run osmo-msc_10.42.42.6(pid=23736): stdout: | (launched: 2022-12-13_19:41:01.587638) 19:41:03.277255 run osmo-msc_10.42.42.6(pid=23736): stderr: | 20221213194102200 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194102200 DLGLOBAL DEBUG validating counter group 0x7f28d5b94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194102200 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194102200 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194102200 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194102207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194102210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194102210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194102211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194102211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:03.329652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23729): Terminating (SIGTERM) 19:41:03.371294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23732): Terminating (SIGTERM) 19:41:03.413444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23735): Terminating (SIGTERM) 19:41:03.455857 --- ParallelTerminationStrategy: PID 23729 died... 19:41:03.476209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23729): Terminated: ok {rc=0} 19:41:03.522867 --- ParallelTerminationStrategy: PID 23732 died... 19:41:03.542816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23732): Terminated: ok {rc=0} 19:41:03.589183 --- ParallelTerminationStrategy: PID 23735 died... 19:41:03.608943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23735): Terminated: ok {rc=0} 19:41:03.697474 bus /sierra_3: Setting Powered False 19:41:04.795039 bus /sierra_3: Setting Powered False 19:41:05.910361 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:41:07.060843 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.073212 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:41:07.136357 tst mo_mt_call_osmux.py: using LAC 35829 19:41:07.255463 tst mo_mt_call_osmux.py: using RAC 129 19:41:07.372222 tst mo_mt_call_osmux.py: using CellId 35829 19:41:07.489834 tst mo_mt_call_osmux.py: using BVCI 35830 19:41:07.597697 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.609130 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.620336 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.631324 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.642454 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:41:07.653475 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:41:07.770012 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:41:07.886978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:08.350858 run create_hlr_db(pid=23738): Launched 19:41:08.474695 bus /sierra_2: Setting Powered False 19:41:09.534967 run create_hlr_db(pid=23738): Terminated: ok {rc=0} 19:41:09.972590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Launched 19:41:10.292415 run osmo-hlr_10.42.42.2(pid=23741): Launched 19:41:10.415729 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:10.966758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Launched 19:41:11.287667 run osmo-stp_10.42.42.5(pid=23744): Launched 19:41:11.409872 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:11.991603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Launched 19:41:12.313581 run osmo-msc_10.42.42.6(pid=23747): Launched 19:41:12.492255 run osmo-stp_10.42.42.5(pid=23744): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] 19:41:12.627737 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-13_19:41:11.228545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:12.763041 run osmo-stp_10.42.42.5(pid=23744): stderr: | 20221213194111416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194111416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194111417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194111417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194111417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194111418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194111418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:12.897264 run osmo-stp_10.42.42.5(pid=23744): stdout: | (launched: 2022-12-13_19:41:11.228545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:13.025821 run osmo-stp_10.42.42.5(pid=23744): stderr: | 20221213194111416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194111416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194111417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194111417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194111417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194111418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194111418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:13.178949 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:41:13.188348 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:41:13.216110 run osmo-hlr_10.42.42.2(pid=23741): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23741)] 19:41:13.267949 run osmo-hlr_10.42.42.2(pid=23741): stdout: | (launched: 2022-12-13_19:41:10.234217) 19:41:13.320108 run osmo-hlr_10.42.42.2(pid=23741): stderr: | 20221213194110428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194110428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194110428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194110428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194110428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194110428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194110440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194110449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194110449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194110449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:13.392788 run osmo-msc_10.42.42.6(pid=23747): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23747)] 19:41:13.443171 run osmo-msc_10.42.42.6(pid=23747): stdout: | (launched: 2022-12-13_19:41:12.254749) 19:41:13.495097 run osmo-msc_10.42.42.6(pid=23747): stderr: | 20221213194112574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194112574 DLGLOBAL DEBUG validating counter group 0x7f3ea32d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194112575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194112575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194112575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194112575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194112577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194112577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194112577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194112577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:13.547282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminating (SIGTERM) 19:41:13.588773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminating (SIGTERM) 19:41:13.630635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Terminating (SIGTERM) 19:41:13.672550 --- ParallelTerminationStrategy: PID 23740 died... 19:41:13.692867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23740): Terminated: ok {rc=0} 19:41:13.739348 --- ParallelTerminationStrategy: PID 23743 died... 19:41:13.759236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23743): Terminated: ok {rc=0} 19:41:13.805286 --- ParallelTerminationStrategy: PID 23746 died... 19:41:13.824793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23746): Terminated: ok {rc=0} 19:41:13.913247 bus /sierra_3: Setting Powered False 19:41:15.010140 bus /sierra_3: Setting Powered False 19:41:16.133981 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:41:17.398471 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:41:17.406454 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:41:17.431029 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:41:17.459704 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:41:17.513736 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:41:17.538496 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:41:17.566295 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:41:18.119217 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:41:18.170556 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.182415 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:41:18.243910 tst mo_mt_call.py: using LAC 35830 19:41:18.369208 tst mo_mt_call.py: using RAC 130 19:41:18.488528 tst mo_mt_call.py: using CellId 35830 19:41:18.610158 tst mo_mt_call.py: using BVCI 35831 19:41:18.718017 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.729365 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.740412 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.751456 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.762678 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:18.773741 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:41:18.891923 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:41:19.006703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:19.468726 run create_hlr_db(pid=23752): Launched 19:41:19.590651 bus /sierra_2: Setting Powered False 19:41:20.651109 run create_hlr_db(pid=23752): Terminated: ok {rc=0} 19:41:21.088597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Launched 19:41:21.409077 run osmo-hlr_10.42.42.2(pid=23755): Launched 19:41:21.532553 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:22.087135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Launched 19:41:22.408185 run osmo-stp_10.42.42.5(pid=23758): Launched 19:41:22.530691 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:23.112481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Launched 19:41:23.433259 run osmo-msc_10.42.42.6(pid=23761): Launched 19:41:23.611646 run osmo-stp_10.42.42.5(pid=23758): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] 19:41:23.747467 run osmo-stp_10.42.42.5(pid=23758): stdout: | (launched: 2022-12-13_19:41:22.349070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:23.883361 run osmo-stp_10.42.42.5(pid=23758): stderr: | 20221213194122537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194122537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194122537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194122537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194122538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194122538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194122538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:24.018704 run osmo-stp_10.42.42.5(pid=23758): stdout: | (launched: 2022-12-13_19:41:22.349070) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:24.147187 run osmo-stp_10.42.42.5(pid=23758): stderr: | 20221213194122537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194122537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194122537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194122537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194122538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194122538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194122538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:24.300537 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23758): Process ended prematurely: osmo-stp_10.42.42.5(pid=23758) [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:41:24.310120 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:41:24.337995 run osmo-hlr_10.42.42.2(pid=23755): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23755)] 19:41:24.389176 run osmo-hlr_10.42.42.2(pid=23755): stdout: | (launched: 2022-12-13_19:41:21.350280) 19:41:24.441179 run osmo-hlr_10.42.42.2(pid=23755): stderr: | 20221213194121544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194121544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194121544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194121544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194121544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194121544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194121557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194121565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194121566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194121566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:24.513420 run osmo-msc_10.42.42.6(pid=23761): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23761)] 19:41:24.563684 run osmo-msc_10.42.42.6(pid=23761): stdout: | (launched: 2022-12-13_19:41:23.374509) 19:41:24.615462 run osmo-msc_10.42.42.6(pid=23761): stderr: | 20221213194123694 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194123694 DLGLOBAL DEBUG validating counter group 0x7ff220ee0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194123695 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194123695 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194123695 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194123695 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194123697 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194123697 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194123697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194123697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:24.667613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Terminating (SIGTERM) 19:41:24.709283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Terminating (SIGTERM) 19:41:24.751063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Terminating (SIGTERM) 19:41:24.793074 --- ParallelTerminationStrategy: PID 23754 died... 19:41:24.813192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23754): Terminated: ok {rc=0} 19:41:24.859501 --- ParallelTerminationStrategy: PID 23757 died... 19:41:24.879359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23757): Terminated: ok {rc=0} 19:41:24.925573 --- ParallelTerminationStrategy: PID 23760 died... 19:41:24.945187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23760): Terminated: ok {rc=0} 19:41:25.032469 bus /sierra_3: Setting Powered False 19:41:26.130976 bus /sierra_3: Setting Powered False 19:41:27.246170 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:41:28.389314 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.401333 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:41:28.471716 tst mo_mt_call_osmux.py: using LAC 35831 19:41:28.600516 tst mo_mt_call_osmux.py: using RAC 131 19:41:28.717405 tst mo_mt_call_osmux.py: using CellId 35831 19:41:28.833426 tst mo_mt_call_osmux.py: using BVCI 35832 19:41:28.943747 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.955113 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.966695 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.977782 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.988887 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:41:28.999941 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:41:29.117814 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:41:29.234228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:29.696562 run create_hlr_db(pid=23763): Launched 19:41:29.818991 bus /sierra_2: Setting Powered False 19:41:30.902907 run create_hlr_db(pid=23763): Terminated: ok {rc=0} 19:41:31.347057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Launched 19:41:31.691503 run osmo-hlr_10.42.42.2(pid=23766): Launched 19:41:31.871475 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:32.619869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Launched 19:41:32.943029 run osmo-stp_10.42.42.5(pid=23769): Launched 19:41:33.067494 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:33.648764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23771): Launched 19:41:33.970590 run osmo-msc_10.42.42.6(pid=23772): Launched 19:41:34.150646 run osmo-stp_10.42.42.5(pid=23769): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] 19:41:34.286028 run osmo-stp_10.42.42.5(pid=23769): stdout: | (launched: 2022-12-13_19:41:32.883820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:34.422430 run osmo-stp_10.42.42.5(pid=23769): stderr: | 20221213194133072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194133072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194133072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194133072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194133073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194133073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194133073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:34.556464 run osmo-stp_10.42.42.5(pid=23769): stdout: | (launched: 2022-12-13_19:41:32.883820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:34.685408 run osmo-stp_10.42.42.5(pid=23769): stderr: | 20221213194133072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194133072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194133072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194133072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194133073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194133073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194133073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:34.839026 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23769): Process ended prematurely: osmo-stp_10.42.42.5(pid=23769) [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:41:34.848213 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:41:34.876127 run osmo-hlr_10.42.42.2(pid=23766): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23766)] 19:41:34.926899 run osmo-hlr_10.42.42.2(pid=23766): stdout: | (launched: 2022-12-13_19:41:31.631253) 19:41:34.978642 run osmo-hlr_10.42.42.2(pid=23766): stderr: | 20221213194131944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194131944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194131944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194131944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194131944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194131944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194131958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194131979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194131979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194131979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:35.050885 run osmo-msc_10.42.42.6(pid=23772): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23772)] 19:41:35.100792 run osmo-msc_10.42.42.6(pid=23772): stdout: | (launched: 2022-12-13_19:41:33.911400) 19:41:35.152709 run osmo-msc_10.42.42.6(pid=23772): stderr: | 20221213194134230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194134230 DLGLOBAL DEBUG validating counter group 0x7fcaa990cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194134230 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194134230 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194134230 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194134230 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194134232 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194134232 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194134233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194134233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:35.204857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Terminating (SIGTERM) 19:41:35.246224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Terminating (SIGTERM) 19:41:35.287937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23771): Terminating (SIGTERM) 19:41:35.330007 --- ParallelTerminationStrategy: PID 23765 died... 19:41:35.350221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23765): Terminated: ok {rc=0} 19:41:35.396798 --- ParallelTerminationStrategy: PID 23768 died... 19:41:35.416627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23768): Terminated: ok {rc=0} 19:41:35.462719 --- ParallelTerminationStrategy: PID 23771 died... 19:41:35.482473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23771): Terminated: ok {rc=0} 19:41:35.570466 bus /sierra_3: Setting Powered False 19:41:36.669458 bus /sierra_3: Setting Powered False 19:41:37.784579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:nanobts+band-1900 --------------------------------------------------------------------- 19:41:39.027214 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:41:39.033025 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:41:39.057611 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 19:41:39.086203 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 19:41:39.173445 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:41:39.198441 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 19:41:39.226299 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 19:41:39.813036 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 19:41:39.818229 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:39.829599 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:41:39.870568 tst emergency_mo_mt_call.py: using LAC 35832 19:41:39.995554 tst emergency_mo_mt_call.py: using RAC 132 19:41:40.112409 tst emergency_mo_mt_call.py: using CellId 35832 19:41:40.231850 tst emergency_mo_mt_call.py: using BVCI 35833 19:41:40.339778 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:40.350680 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:40.361510 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:40.372019 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:40.383150 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:40.394369 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:40.510344 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:40.623749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:41.079467 run create_hlr_db(pid=23777): Launched 19:41:41.199983 bus /sierra_2: Setting Powered False 19:41:42.259053 run create_hlr_db(pid=23777): Terminated: ok {rc=0} 19:41:42.691473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Launched 19:41:43.007904 run osmo-hlr_10.42.42.2(pid=23780): Launched 19:41:43.127710 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:43.673295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Launched 19:41:43.991679 run osmo-stp_10.42.42.5(pid=23783): Launched 19:41:44.119740 tst emergency_mo_mt_call.py: using MSISDN 8294 19:41:44.284733 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:44.853102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23785): Launched 19:41:45.169996 run osmo-msc_10.42.42.6(pid=23786): Launched 19:41:45.347749 run osmo-stp_10.42.42.5(pid=23783): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] 19:41:45.481519 run osmo-stp_10.42.42.5(pid=23783): stdout: | (launched: 2022-12-13_19:41:43.932564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:45.615533 run osmo-stp_10.42.42.5(pid=23783): stderr: | 20221213194144120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194144120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194144120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194144121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194144121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194144121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194144121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:45.749131 run osmo-stp_10.42.42.5(pid=23783): stdout: | (launched: 2022-12-13_19:41:43.932564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:45.878231 run osmo-stp_10.42.42.5(pid=23783): stderr: | 20221213194144120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194144120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194144120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194144121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194144121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194144121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194144121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:46.043283 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23783): Process ended prematurely: osmo-stp_10.42.42.5(pid=23783) [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 19:41:46.051925 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 19:41:46.079163 run osmo-hlr_10.42.42.2(pid=23780): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23780)] 19:41:46.128610 run osmo-hlr_10.42.42.2(pid=23780): stdout: | (launched: 2022-12-13_19:41:42.949847) 19:41:46.179401 run osmo-hlr_10.42.42.2(pid=23780): stderr: | 20221213194143141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194143141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194143141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194143141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194143142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194143142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194143157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194143166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194143166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194143166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:46.251776 run osmo-msc_10.42.42.6(pid=23786): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23786)] 19:41:46.301593 run osmo-msc_10.42.42.6(pid=23786): stdout: | (launched: 2022-12-13_19:41:45.112036) 19:41:46.352178 run osmo-msc_10.42.42.6(pid=23786): stderr: | 20221213194145429 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194145430 DLGLOBAL DEBUG validating counter group 0x7f93a9614c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194145430 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194145430 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194145430 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194145430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194145432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194145432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194145432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194145432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:46.403892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Terminating (SIGTERM) 19:41:46.445887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Terminating (SIGTERM) 19:41:46.489360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23785): Terminating (SIGTERM) 19:41:46.532559 --- ParallelTerminationStrategy: PID 23779 died... 19:41:46.553931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23779): Terminated: ok {rc=0} 19:41:46.603294 --- ParallelTerminationStrategy: PID 23782 died... 19:41:46.623055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23782): Terminated: ok {rc=0} 19:41:46.669210 --- ParallelTerminationStrategy: PID 23785 died... 19:41:46.688940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23785): Terminated: ok {rc=0} 19:41:46.774875 bus /sierra_3: Setting Powered False 19:41:47.871466 bus /sierra_3: Setting Powered False 19:41:48.984826 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 19:41:50.073194 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.085194 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:41:50.126428 tst emergency_preemptive_call.py: using LAC 35833 19:41:50.242811 tst emergency_preemptive_call.py: using RAC 133 19:41:50.356870 tst emergency_preemptive_call.py: using CellId 35833 19:41:50.470464 tst emergency_preemptive_call.py: using BVCI 35834 19:41:50.578071 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.589187 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.600120 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.610933 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.621809 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 19:41:50.632599 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:50.749988 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:50.865732 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:50.983951 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:41:51.101173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:41:51.593694 run create_hlr_db(pid=23788): Launched 19:41:51.715221 bus /sierra_2: Setting Powered False 19:41:52.778083 run create_hlr_db(pid=23788): Terminated: ok {rc=0} 19:41:53.219489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Launched 19:41:53.535593 run osmo-hlr_10.42.42.2(pid=23791): Launched 19:41:53.655980 run osmo-stp_10.42.42.5: Starting osmo-stp 19:41:54.199216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Launched 19:41:54.515490 run osmo-stp_10.42.42.5(pid=23794): Launched 19:41:54.646976 tst emergency_preemptive_call.py: using MSISDN 8295 19:41:54.805414 run osmo-msc_10.42.42.6: Starting osmo-msc 19:41:55.373793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Launched 19:41:55.690180 run osmo-msc_10.42.42.6(pid=23797): Launched 19:41:55.866615 run osmo-stp_10.42.42.5(pid=23794): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] 19:41:56.000885 run osmo-stp_10.42.42.5(pid=23794): stdout: | (launched: 2022-12-13_19:41:54.457633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:56.135269 run osmo-stp_10.42.42.5(pid=23794): stderr: | 20221213194154648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194154648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194154648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194154649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194154649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194154649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194154649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:56.268581 run osmo-stp_10.42.42.5(pid=23794): stdout: | (launched: 2022-12-13_19:41:54.457633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:41:56.395211 run osmo-stp_10.42.42.5(pid=23794): stderr: | 20221213194154648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194154648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194154648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194154649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194154649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194154649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194154649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:41:56.546261 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23794): Process ended prematurely: osmo-stp_10.42.42.5(pid=23794) [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 19:41:56.555058 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:41:56.582576 run osmo-hlr_10.42.42.2(pid=23791): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23791)] 19:41:56.633395 run osmo-hlr_10.42.42.2(pid=23791): stdout: | (launched: 2022-12-13_19:41:53.477838) 19:41:56.685396 run osmo-hlr_10.42.42.2(pid=23791): stderr: | 20221213194153673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194153673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194153673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194153673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194153673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194153673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194153685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194153694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194153694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194153694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:41:56.757872 run osmo-msc_10.42.42.6(pid=23797): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23797)] 19:41:56.808006 run osmo-msc_10.42.42.6(pid=23797): stdout: | (launched: 2022-12-13_19:41:55.632292) 19:41:56.859582 run osmo-msc_10.42.42.6(pid=23797): stderr: | 20221213194155948 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194155948 DLGLOBAL DEBUG validating counter group 0x7f9ea82dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194155948 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194155948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194155949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194155949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194155951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194155951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194155951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194155951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:41:56.911661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Terminating (SIGTERM) 19:41:56.953443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Terminating (SIGTERM) 19:41:56.995390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Terminating (SIGTERM) 19:41:57.037448 --- ParallelTerminationStrategy: PID 23790 died... 19:41:57.057697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23790): Terminated: ok {rc=0} 19:41:57.103860 --- ParallelTerminationStrategy: PID 23793 died... 19:41:57.123328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23793): Terminated: ok {rc=0} 19:41:57.169367 --- ParallelTerminationStrategy: PID 23796 died... 19:41:57.189016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23796): Terminated: ok {rc=0} 19:41:57.276356 bus /sierra_9: Setting Powered False 19:41:58.371965 bus /sierra_9: Setting Powered False 19:41:59.486449 bus /sierra_8: Setting Powered False 19:42:00.582964 bus /sierra_8: Setting Powered False 19:42:01.702968 bus /sierra_3: Setting Powered False 19:42:02.831789 bus /sierra_3: Setting Powered False 19:42:03.943256 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900 --------------------------------------------------------------------- 19:42:05.211021 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:42:05.216152 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 19:42:05.239880 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 19:42:05.278381 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 19:42:05.364686 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 19:42:05.388411 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 19:42:05.426412 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 19:42:06.018749 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 19:42:06.067285 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.078153 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:42:06.116831 tst cs_paging_gprs_active.py: using LAC 35834 19:42:06.248361 tst cs_paging_gprs_active.py: using RAC 134 19:42:06.373992 tst cs_paging_gprs_active.py: using CellId 35834 19:42:06.499860 tst cs_paging_gprs_active.py: using BVCI 35835 19:42:06.616354 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.627652 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.638666 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.649653 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.660910 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.672220 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.683669 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.694846 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:06.706301 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:06.820117 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:06.942077 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:42:07.145088 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:07.446603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Launched 19:42:07.709642 run iperf3-srv_10.42.42.10(pid=23806): Launched 19:42:07.821338 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:42:08.021927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:08.322465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23807): Launched 19:42:08.585779 run iperf3-srv_10.42.42.10(pid=23808): Launched 19:42:08.704454 tst cs_paging_gprs_active.py:38: start network... 19:42:08.906290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:09.371442 run create_hlr_db(pid=23809): Launched 19:42:09.494032 bus /sierra_2: Setting Powered False 19:42:10.555301 run create_hlr_db(pid=23809): Terminated: ok {rc=0} 19:42:10.993403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Launched 19:42:11.317077 run osmo-hlr_10.42.42.2(pid=23812): Launched 19:42:11.439696 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:11.998194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Launched 19:42:12.320589 run osmo-stp_10.42.42.5(pid=23815): Launched 19:42:12.443522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:13.001461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23817): Launched 19:42:13.124806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:13.397353 run patchelf(pid=23818): Launched 19:42:13.576705 run osmo-stp_10.42.42.5(pid=23815): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] 19:42:13.713800 run osmo-stp_10.42.42.5(pid=23815): stdout: | (launched: 2022-12-13_19:42:12.261414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:13.851742 run osmo-stp_10.42.42.5(pid=23815): stderr: | 20221213194212450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194212450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194212450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194212451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194212451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194212451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194212451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:13.991202 run osmo-stp_10.42.42.5(pid=23815): stdout: | (launched: 2022-12-13_19:42:12.261414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:14.123606 run osmo-stp_10.42.42.5(pid=23815): stderr: | 20221213194212450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194212450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194212450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194212451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194212451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194212451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194212451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:14.281059 run patchelf(pid=23818): Terminating (SIGINT) 19:42:14.462095 run patchelf(pid=23818): Terminated: ok {rc=0} 19:42:14.592381 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23815): Process ended prematurely: osmo-stp_10.42.42.5(pid=23815) [trial-2393↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] [trial-2393↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 19:42:14.602528 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:42:14.631064 run osmo-hlr_10.42.42.2(pid=23812): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23812)] 19:42:14.682216 run osmo-hlr_10.42.42.2(pid=23812): stdout: | (launched: 2022-12-13_19:42:11.257711) 19:42:14.733978 run osmo-hlr_10.42.42.2(pid=23812): stderr: | 20221213194211452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194211452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194211452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194211452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194211452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194211452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194211465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194211473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194211473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194211473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:14.786153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Terminating (SIGTERM) 19:42:14.827750 run iperf3-srv_10.42.42.10(pid=23806): Terminating (SIGTERM) 19:42:14.869594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23807): Terminating (SIGTERM) 19:42:14.911490 run iperf3-srv_10.42.42.10(pid=23808): Terminating (SIGTERM) 19:42:14.953421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Terminating (SIGTERM) 19:42:14.995354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Terminating (SIGTERM) 19:42:15.037098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23817): Terminating (SIGTERM) 19:42:15.078896 --- ParallelTerminationStrategy: PID 23805 died... 19:42:15.099208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23805): Terminated: ok {rc=0} 19:42:15.145213 --- ParallelTerminationStrategy: PID 23806 died... 19:42:15.164782 run iperf3-srv_10.42.42.10(pid=23806): Terminated {rc=256} 19:42:15.210524 --- ParallelTerminationStrategy: PID 23807 died... 19:42:15.230062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23807): Terminated: ok {rc=0} 19:42:15.275400 --- ParallelTerminationStrategy: PID 23808 died... 19:42:15.294866 run iperf3-srv_10.42.42.10(pid=23808): Terminated {rc=256} 19:42:15.340445 --- ParallelTerminationStrategy: PID 23811 died... 19:42:15.360012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23811): Terminated: ok {rc=0} 19:42:15.405619 --- ParallelTerminationStrategy: PID 23814 died... 19:42:15.425165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23814): Terminated: ok {rc=0} 19:42:15.470548 --- ParallelTerminationStrategy: PID 23817 died... 19:42:15.490154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23817): Terminated: ok {rc=0} 19:42:15.576325 bus /gobi_0: Setting Powered False 19:42:16.673803 bus /gobi_0: Setting Powered False 19:42:17.787914 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 19:42:18.936623 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:18.948782 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:42:18.989811 tst iperf3.py: using LAC 35835 19:42:19.117590 tst iperf3.py: using RAC 135 19:42:19.236016 tst iperf3.py: using CellId 35835 19:42:19.353386 tst iperf3.py: using BVCI 35836 19:42:19.461875 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.472639 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.483331 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.493888 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.504864 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.515927 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.527226 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.538381 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:19.549697 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:19.672438 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:19.889755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:20.212870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Launched 19:42:20.492332 run iperf3-srv_10.42.42.10(pid=23820): Launched 19:42:20.613001 tst iperf3.py:8: start network... 19:42:20.829770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:21.329061 run create_hlr_db(pid=23821): Launched 19:42:21.453967 bus /gobi_6: Setting Powered False 19:42:22.517955 run create_hlr_db(pid=23821): Terminated: ok {rc=0} 19:42:22.948025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Launched 19:42:23.247786 run osmo-hlr_10.42.42.2(pid=23824): Launched 19:42:23.362842 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:23.891078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Launched 19:42:24.191314 run osmo-stp_10.42.42.5(pid=23827): Launched 19:42:24.303520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:24.819840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23829): Launched 19:42:24.933981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:25.189079 run patchelf(pid=23830): Launched 19:42:25.355612 run osmo-stp_10.42.42.5(pid=23827): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] 19:42:25.481773 run osmo-stp_10.42.42.5(pid=23827): stdout: | (launched: 2022-12-13_19:42:24.135073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:25.609971 run osmo-stp_10.42.42.5(pid=23827): stderr: | 20221213194224302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194224302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194224302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194224302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194224303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194224303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194224303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:25.738217 run osmo-stp_10.42.42.5(pid=23827): stdout: | (launched: 2022-12-13_19:42:24.135073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:25.860938 run osmo-stp_10.42.42.5(pid=23827): stderr: | 20221213194224302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194224302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194224302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194224302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194224303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194224303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194224303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:26.006624 run patchelf(pid=23830): Terminating (SIGINT) 19:42:26.174984 run patchelf(pid=23830): Terminated: ok {rc=0} 19:42:26.296309 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23827): Process ended prematurely: osmo-stp_10.42.42.5(pid=23827) [trial-2393↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] [trial-2393↪gprs:nanobts+band-1900↪iperf3.py:8] 19:42:26.305818 tst iperf3.py:8: Test FAILED (7.4 sec) 19:42:26.332619 run osmo-hlr_10.42.42.2(pid=23824): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23824)] 19:42:26.380528 run osmo-hlr_10.42.42.2(pid=23824): stdout: | (launched: 2022-12-13_19:42:23.192666) 19:42:26.429682 run osmo-hlr_10.42.42.2(pid=23824): stderr: | 20221213194223365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194223366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194223366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194223366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194223366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194223366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194223378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194223388 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194223388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194223388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:26.479232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Terminating (SIGTERM) 19:42:26.518934 run iperf3-srv_10.42.42.10(pid=23820): Terminating (SIGTERM) 19:42:26.558290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Terminating (SIGTERM) 19:42:26.598264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Terminating (SIGTERM) 19:42:26.637705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23829): Terminating (SIGTERM) 19:42:26.677504 --- ParallelTerminationStrategy: PID 23819 died... 19:42:26.696591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23819): Terminated: ok {rc=0} 19:42:26.740525 --- ParallelTerminationStrategy: PID 23820 died... 19:42:26.759070 run iperf3-srv_10.42.42.10(pid=23820): Terminated {rc=256} 19:42:26.802676 --- ParallelTerminationStrategy: PID 23823 died... 19:42:26.821248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23823): Terminated: ok {rc=0} 19:42:26.865267 --- ParallelTerminationStrategy: PID 23826 died... 19:42:26.883736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23826): Terminated: ok {rc=0} 19:42:26.927669 --- ParallelTerminationStrategy: PID 23829 died... 19:42:26.946282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23829): Terminated: ok {rc=0} 19:42:27.031677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 19:42:28.176311 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.187818 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:42:28.230667 tst iperf3m4.py: using LAC 35836 19:42:28.347713 tst iperf3m4.py: using RAC 136 19:42:28.464058 tst iperf3m4.py: using CellId 35836 19:42:28.578553 tst iperf3m4.py: using BVCI 35837 19:42:28.687571 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.698348 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.708882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.719388 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.729870 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.740265 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.750850 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.761248 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:28.771806 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:28.890752 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:29.008222 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:29.127547 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:29.244572 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:42:29.462351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:29.788269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23831): Launched 19:42:30.069493 run iperf3-srv_10.42.42.10(pid=23832): Launched 19:42:30.191143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:42:30.407093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:30.729700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23833): Launched 19:42:31.049745 run iperf3-srv_10.42.42.10(pid=23834): Launched 19:42:31.174543 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:42:31.382505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:31.698118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23835): Launched 19:42:31.986359 run iperf3-srv_10.42.42.10(pid=23836): Launched 19:42:32.111920 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:42:32.315107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:42:32.617487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23837): Launched 19:42:32.878112 run iperf3-srv_10.42.42.10(pid=23838): Launched 19:42:32.990630 tst iperf3m4.py:8: start network... 19:42:33.191242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:33.656309 run create_hlr_db(pid=23839): Launched 19:42:33.778706 bus /gobi_6: Setting Powered False 19:42:34.838921 run create_hlr_db(pid=23839): Terminated: ok {rc=0} 19:42:35.278580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23841): Launched 19:42:35.602371 run osmo-hlr_10.42.42.2(pid=23842): Launched 19:42:35.725941 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:36.283091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23844): Launched 19:42:36.606179 run osmo-stp_10.42.42.5(pid=23845): Launched 19:42:36.729038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:37.284790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23847): Launched 19:42:37.407650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:37.680329 run patchelf(pid=23848): Launched 19:42:37.862368 run osmo-stp_10.42.42.5(pid=23845): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23845)] 19:42:37.999645 run osmo-stp_10.42.42.5(pid=23845): stdout: | (launched: 2022-12-13_19:42:36.546554) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:38.137845 run osmo-stp_10.42.42.5(pid=23845): stderr: | 20221213194236734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194236734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194236735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194236735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194236735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194236735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194236736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:38.276055 run osmo-stp_10.42.42.5(pid=23845): stdout: | (launched: 2022-12-13_19:42:36.546554) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:38.408623 run osmo-stp_10.42.42.5(pid=23845): stderr: | 20221213194236734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194236734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194236735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194236735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194236735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194236735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194236736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:38.565484 run patchelf(pid=23848): Terminating (SIGINT) 19:42:38.746359 run patchelf(pid=23848): Terminated: ok {rc=0} 19:42:38.876579 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23845): Process ended prematurely: osmo-stp_10.42.42.5(pid=23845) [trial-2393↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23845)] [trial-2393↪gprs:nanobts+band-1900↪iperf3m4.py:8] 19:42:38.886805 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:42:38.915346 run osmo-hlr_10.42.42.2(pid=23842): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23842)] 19:42:38.967012 run osmo-hlr_10.42.42.2(pid=23842): stdout: | (launched: 2022-12-13_19:42:35.542712) 19:42:39.018995 run osmo-hlr_10.42.42.2(pid=23842): stderr: | 20221213194235737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194235737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194235738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194235738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194235738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194235738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194235750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194235758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194235758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194235758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:39.071236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23831): Terminating (SIGTERM) 19:42:39.113130 run iperf3-srv_10.42.42.10(pid=23832): Terminating (SIGTERM) 19:42:39.154935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23833): Terminating (SIGTERM) 19:42:39.197009 run iperf3-srv_10.42.42.10(pid=23834): Terminating (SIGTERM) 19:42:39.238723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23835): Terminating (SIGTERM) 19:42:39.280579 run iperf3-srv_10.42.42.10(pid=23836): Terminating (SIGTERM) 19:42:39.322297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23837): Terminating (SIGTERM) 19:42:39.363982 run iperf3-srv_10.42.42.10(pid=23838): Terminating (SIGTERM) 19:42:39.405914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23841): Terminating (SIGTERM) 19:42:39.447565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23844): Terminating (SIGTERM) 19:42:39.489293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23847): Terminating (SIGTERM) 19:42:39.531260 --- ParallelTerminationStrategy: PID 23831 died... 19:42:39.551226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23831): Terminated: ok {rc=0} 19:42:39.597939 --- ParallelTerminationStrategy: PID 23832 died... 19:42:39.617577 run iperf3-srv_10.42.42.10(pid=23832): Terminated {rc=256} 19:42:39.663621 --- ParallelTerminationStrategy: PID 23833 died... 19:42:39.683283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23833): Terminated: ok {rc=0} 19:42:39.729437 --- ParallelTerminationStrategy: PID 23834 died... 19:42:39.749034 run iperf3-srv_10.42.42.10(pid=23834): Terminated {rc=256} 19:42:39.794899 --- ParallelTerminationStrategy: PID 23835 died... 19:42:39.814513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23835): Terminated: ok {rc=0} 19:42:39.860543 --- ParallelTerminationStrategy: PID 23836 died... 19:42:39.880367 run iperf3-srv_10.42.42.10(pid=23836): Terminated {rc=256} 19:42:39.926129 --- ParallelTerminationStrategy: PID 23837 died... 19:42:39.945825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23837): Terminated: ok {rc=0} 19:42:39.992104 --- ParallelTerminationStrategy: PID 23838 died... 19:42:40.011850 run iperf3-srv_10.42.42.10(pid=23838): Terminated {rc=256} 19:42:40.057802 --- ParallelTerminationStrategy: PID 23841 died... 19:42:40.077467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23841): Terminated: ok {rc=0} 19:42:40.123451 --- ParallelTerminationStrategy: PID 23844 died... 19:42:40.143158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23844): Terminated: ok {rc=0} 19:42:40.189180 --- ParallelTerminationStrategy: PID 23847 died... 19:42:40.209095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23847): Terminated: ok {rc=0} 19:42:40.296711 bus /gobi_4: Setting Powered False 19:42:41.396073 bus /gobi_4: Setting Powered False 19:42:42.513119 bus /gobi_1: Setting Powered False 19:42:43.612146 bus /gobi_1: Setting Powered False 19:42:44.727103 bus /gobi_0: Setting Powered False 19:42:45.823008 bus /gobi_0: Setting Powered False 19:42:46.934564 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 19:42:48.034088 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.045510 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:42:48.084530 tst ping.py: using LAC 35837 19:42:48.210476 tst ping.py: using RAC 137 19:42:48.336498 tst ping.py: using CellId 35837 19:42:48.462373 tst ping.py: using BVCI 35838 19:42:48.578803 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.590687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.602147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.613456 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.625055 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.636601 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.648250 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:48.659938 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:48.775140 tst ping.py:19: start network... 19:42:48.971760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:49.430238 run create_hlr_db(pid=23849): Launched 19:42:49.542178 bus /gobi_6: Setting Powered False 19:42:50.601561 run create_hlr_db(pid=23849): Terminated: ok {rc=0} 19:42:51.034000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Launched 19:42:51.352163 run osmo-hlr_10.42.42.2(pid=23852): Launched 19:42:51.473348 run osmo-stp_10.42.42.5: Starting osmo-stp 19:42:52.023988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Launched 19:42:52.342523 run osmo-stp_10.42.42.5(pid=23855): Launched 19:42:52.465223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:42:53.012428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23857): Launched 19:42:53.133519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:42:53.401469 run patchelf(pid=23858): Launched 19:42:53.578248 run osmo-stp_10.42.42.5(pid=23855): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] 19:42:53.712490 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-13_19:42:52.284257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:53.848058 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221213194252471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194252471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194252471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194252471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194252472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194252472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194252472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:53.983693 run osmo-stp_10.42.42.5(pid=23855): stdout: | (launched: 2022-12-13_19:42:52.284257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:42:54.114907 run osmo-stp_10.42.42.5(pid=23855): stderr: | 20221213194252471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194252471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194252471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194252471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194252472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194252472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194252472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:42:54.268734 run patchelf(pid=23858): Terminating (SIGINT) 19:42:54.446073 run patchelf(pid=23858): Terminated: ok {rc=0} 19:42:54.573919 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2393↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] [trial-2393↪gprs:nanobts+band-1900↪ping.py:22] 19:42:54.583416 tst ping.py:22: Test FAILED (6.5 sec) 19:42:54.611344 run osmo-hlr_10.42.42.2(pid=23852): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23852)] 19:42:54.662568 run osmo-hlr_10.42.42.2(pid=23852): stdout: | (launched: 2022-12-13_19:42:51.294186) 19:42:54.714759 run osmo-hlr_10.42.42.2(pid=23852): stderr: | 20221213194251487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194251487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194251487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194251487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194251487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194251487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194251500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194251508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194251508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194251508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:42:54.766969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminating (SIGTERM) 19:42:54.808462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminating (SIGTERM) 19:42:54.850632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23857): Terminating (SIGTERM) 19:42:54.892643 --- ParallelTerminationStrategy: PID 23851 died... 19:42:54.913349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23851): Terminated: ok {rc=0} 19:42:54.960164 --- ParallelTerminationStrategy: PID 23854 died... 19:42:54.980730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23854): Terminated: ok {rc=0} 19:42:55.027606 --- ParallelTerminationStrategy: PID 23857 died... 19:42:55.047331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23857): Terminated: ok {rc=0} 19:42:55.135331 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 19:42:56.222539 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.234707 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 19:42:56.280038 tst ping_idle_ping.py: using LAC 35838 19:42:56.395673 tst ping_idle_ping.py: using RAC 138 19:42:56.509533 tst ping_idle_ping.py: using CellId 35838 19:42:56.633410 tst ping_idle_ping.py: using BVCI 35839 19:42:56.740782 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.751811 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.762828 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.773782 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.784840 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.796194 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.807251 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 19:42:56.818463 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 19:42:56.935566 tst ping_idle_ping.py:24: start network... 19:42:57.149675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:42:57.644631 run create_hlr_db(pid=23859): Launched 19:42:57.768380 bus /gobi_6: Setting Powered False 19:42:58.832286 run create_hlr_db(pid=23859): Terminated: ok {rc=0} 19:42:59.256846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23861): Launched 19:42:59.556038 run osmo-hlr_10.42.42.2(pid=23862): Launched 19:42:59.672581 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:00.181920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23864): Launched 19:43:00.478101 run osmo-stp_10.42.42.5(pid=23865): Launched 19:43:00.591329 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:01.134614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23867): Launched 19:43:01.304103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:01.566051 run patchelf(pid=23868): Launched 19:43:01.754016 run osmo-stp_10.42.42.5(pid=23865): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23865)] 19:43:01.885364 run osmo-stp_10.42.42.5(pid=23865): stdout: | (launched: 2022-12-13_19:43:00.423325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:02.016662 run osmo-stp_10.42.42.5(pid=23865): stderr: | 20221213194300589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194300589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194300590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194300590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194300591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194300591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194300591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:02.147074 run osmo-stp_10.42.42.5(pid=23865): stdout: | (launched: 2022-12-13_19:43:00.423325) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:02.271936 run osmo-stp_10.42.42.5(pid=23865): stderr: | 20221213194300589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194300589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194300590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194300590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194300591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194300591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194300591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:02.416525 run patchelf(pid=23868): Terminating (SIGINT) 19:43:02.583173 run patchelf(pid=23868): Terminated: ok {rc=0} 19:43:02.703835 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23865): Process ended prematurely: osmo-stp_10.42.42.5(pid=23865) [trial-2393↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23865)] [trial-2393↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 19:43:02.713106 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:43:02.740130 run osmo-hlr_10.42.42.2(pid=23862): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23862)] 19:43:02.788454 run osmo-hlr_10.42.42.2(pid=23862): stdout: | (launched: 2022-12-13_19:42:59.501409) 19:43:02.838089 run osmo-hlr_10.42.42.2(pid=23862): stderr: | 20221213194259673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194259673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194259673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194259673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194259673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194259673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194259686 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194259694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194259694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194259694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:02.887990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23861): Terminating (SIGTERM) 19:43:02.928056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23864): Terminating (SIGTERM) 19:43:02.968128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23867): Terminating (SIGTERM) 19:43:03.008834 --- ParallelTerminationStrategy: PID 23861 died... 19:43:03.028143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23861): Terminated: ok {rc=0} 19:43:03.072192 --- ParallelTerminationStrategy: PID 23864 died... 19:43:03.091010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23864): Terminated: ok {rc=0} 19:43:03.134919 --- ParallelTerminationStrategy: PID 23867 died... 19:43:03.153839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23867): Terminated: ok {rc=0} 19:43:03.239258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 19:43:04.534145 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:43:04.540621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:43:04.564692 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:43:04.603486 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:43:04.690553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:43:04.714015 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:43:04.751975 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:43:05.348231 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:43:05.396196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.407320 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:43:05.447930 tst cs_paging_gprs_active.py: using LAC 35839 19:43:05.566561 tst cs_paging_gprs_active.py: using RAC 139 19:43:05.683685 tst cs_paging_gprs_active.py: using CellId 35839 19:43:05.800746 tst cs_paging_gprs_active.py: using BVCI 35840 19:43:05.908756 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.919793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.930517 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.941155 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.951802 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.962541 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.973573 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.984096 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:05.994983 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:06.113448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:06.233520 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:43:06.452560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:06.777373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Launched 19:43:07.059018 run iperf3-srv_10.42.42.10(pid=23874): Launched 19:43:07.180184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:43:07.399196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:07.723818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Launched 19:43:08.004743 run iperf3-srv_10.42.42.10(pid=23876): Launched 19:43:08.126569 tst cs_paging_gprs_active.py:38: start network... 19:43:08.345598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:08.846789 run create_hlr_db(pid=23877): Launched 19:43:08.970520 bus /gobi_6: Setting Powered False 19:43:10.035855 run create_hlr_db(pid=23877): Terminated: ok {rc=0} 19:43:10.466329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Launched 19:43:10.766561 run osmo-hlr_10.42.42.2(pid=23880): Launched 19:43:10.880496 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:11.398484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Launched 19:43:11.697413 run osmo-stp_10.42.42.5(pid=23883): Launched 19:43:11.812157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:12.331778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23885): Launched 19:43:12.445522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:12.698557 run patchelf(pid=23886): Launched 19:43:12.864857 run osmo-stp_10.42.42.5(pid=23883): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] 19:43:12.991622 run osmo-stp_10.42.42.5(pid=23883): stdout: | (launched: 2022-12-13_19:43:11.642322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:13.120084 run osmo-stp_10.42.42.5(pid=23883): stderr: | 20221213194311811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194311811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194311811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194311811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194311812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194311812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194311812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:13.248417 run osmo-stp_10.42.42.5(pid=23883): stdout: | (launched: 2022-12-13_19:43:11.642322) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:13.371822 run osmo-stp_10.42.42.5(pid=23883): stderr: | 20221213194311811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194311811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194311811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194311811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194311812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194311812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194311812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:13.517522 run patchelf(pid=23886): Terminating (SIGINT) 19:43:13.685564 run patchelf(pid=23886): Terminated: ok {rc=0} 19:43:13.807023 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23883): Process ended prematurely: osmo-stp_10.42.42.5(pid=23883) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:43:13.816357 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 19:43:13.843303 run osmo-hlr_10.42.42.2(pid=23880): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23880)] 19:43:13.890871 run osmo-hlr_10.42.42.2(pid=23880): stdout: | (launched: 2022-12-13_19:43:10.711329) 19:43:13.939971 run osmo-hlr_10.42.42.2(pid=23880): stderr: | 20221213194310883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194310883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194310883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194310883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194310883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194310883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194310895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194310906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194310906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194310906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:13.989798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Terminating (SIGTERM) 19:43:14.029770 run iperf3-srv_10.42.42.10(pid=23874): Terminating (SIGTERM) 19:43:14.069414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Terminating (SIGTERM) 19:43:14.109199 run iperf3-srv_10.42.42.10(pid=23876): Terminating (SIGTERM) 19:43:14.148691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Terminating (SIGTERM) 19:43:14.188296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Terminating (SIGTERM) 19:43:14.227821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23885): Terminating (SIGTERM) 19:43:14.267775 --- ParallelTerminationStrategy: PID 23873 died... 19:43:14.286884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23873): Terminated: ok {rc=0} 19:43:14.330755 --- ParallelTerminationStrategy: PID 23874 died... 19:43:14.349190 run iperf3-srv_10.42.42.10(pid=23874): Terminated {rc=256} 19:43:14.392663 --- ParallelTerminationStrategy: PID 23875 died... 19:43:14.411282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23875): Terminated: ok {rc=0} 19:43:14.454710 --- ParallelTerminationStrategy: PID 23876 died... 19:43:14.473205 run iperf3-srv_10.42.42.10(pid=23876): Terminated {rc=256} 19:43:14.516640 --- ParallelTerminationStrategy: PID 23879 died... 19:43:14.535160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23879): Terminated: ok {rc=0} 19:43:14.578683 --- ParallelTerminationStrategy: PID 23882 died... 19:43:14.597673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23882): Terminated: ok {rc=0} 19:43:14.641294 --- ParallelTerminationStrategy: PID 23885 died... 19:43:14.659920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23885): Terminated: ok {rc=0} 19:43:14.742305 bus /gobi_0: Setting Powered False 19:43:15.854138 bus /gobi_0: Setting Powered False 19:43:16.996000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:43:18.149857 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.161356 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:43:18.203673 tst iperf3.py: using LAC 35840 19:43:18.320189 tst iperf3.py: using RAC 140 19:43:18.436661 tst iperf3.py: using CellId 35840 19:43:18.556590 tst iperf3.py: using BVCI 35841 19:43:18.666449 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.677493 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.688246 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.699021 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.709750 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.720383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.731257 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.742401 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:18.753236 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:18.871362 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:43:19.089868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:19.413292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23887): Launched 19:43:19.694335 run iperf3-srv_10.42.42.10(pid=23888): Launched 19:43:19.815362 tst iperf3.py:8: start network... 19:43:20.033758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:20.533181 run create_hlr_db(pid=23889): Launched 19:43:20.655694 bus /gobi_6: Setting Powered False 19:43:21.719141 run create_hlr_db(pid=23889): Terminated: ok {rc=0} 19:43:22.167339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Launched 19:43:22.490559 run osmo-hlr_10.42.42.2(pid=23892): Launched 19:43:22.613681 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:23.169910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Launched 19:43:23.493144 run osmo-stp_10.42.42.5(pid=23895): Launched 19:43:23.616047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:24.172865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Launched 19:43:24.296085 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:24.568795 run patchelf(pid=23898): Launched 19:43:24.747150 run osmo-stp_10.42.42.5(pid=23895): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] 19:43:24.883906 run osmo-stp_10.42.42.5(pid=23895): stdout: | (launched: 2022-12-13_19:43:23.433665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:25.022906 run osmo-stp_10.42.42.5(pid=23895): stderr: | 20221213194323624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194323624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194323624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194323625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194323625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194323625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194323625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:25.161199 run osmo-stp_10.42.42.5(pid=23895): stdout: | (launched: 2022-12-13_19:43:23.433665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:25.293487 run osmo-stp_10.42.42.5(pid=23895): stderr: | 20221213194323624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194323624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194323624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194323625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194323625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194323625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194323625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:25.450786 run patchelf(pid=23898): Terminating (SIGINT) 19:43:25.631588 run patchelf(pid=23898): Terminated: ok {rc=0} 19:43:25.761994 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23895): Process ended prematurely: osmo-stp_10.42.42.5(pid=23895) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 19:43:25.772228 tst iperf3.py:8: Test FAILED (7.7 sec) 19:43:25.800879 run osmo-hlr_10.42.42.2(pid=23892): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23892)] 19:43:25.852334 run osmo-hlr_10.42.42.2(pid=23892): stdout: | (launched: 2022-12-13_19:43:22.431529) 19:43:25.904350 run osmo-hlr_10.42.42.2(pid=23892): stderr: | 20221213194322625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194322625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194322626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194322626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194322626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194322626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194322638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194322647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194322647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194322647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:25.956860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23887): Terminating (SIGTERM) 19:43:25.998881 run iperf3-srv_10.42.42.10(pid=23888): Terminating (SIGTERM) 19:43:26.040735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Terminating (SIGTERM) 19:43:26.082608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Terminating (SIGTERM) 19:43:26.124361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Terminating (SIGTERM) 19:43:26.166466 --- ParallelTerminationStrategy: PID 23887 died... 19:43:26.186445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23887): Terminated: ok {rc=0} 19:43:26.233391 --- ParallelTerminationStrategy: PID 23888 died... 19:43:26.253234 run iperf3-srv_10.42.42.10(pid=23888): Terminated {rc=256} 19:43:26.299318 --- ParallelTerminationStrategy: PID 23891 died... 19:43:26.319077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23891): Terminated: ok {rc=0} 19:43:26.365445 --- ParallelTerminationStrategy: PID 23894 died... 19:43:26.385287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23894): Terminated: ok {rc=0} 19:43:26.431384 --- ParallelTerminationStrategy: PID 23897 died... 19:43:26.451113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23897): Terminated: ok {rc=0} 19:43:26.538927 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:43:27.685442 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:27.697128 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:43:27.739415 tst iperf3m4.py: using LAC 35841 19:43:27.865785 tst iperf3m4.py: using RAC 141 19:43:27.994642 tst iperf3m4.py: using CellId 35841 19:43:28.120022 tst iperf3m4.py: using BVCI 35842 19:43:28.236085 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.247650 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.259025 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.270284 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.281785 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.293246 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.305047 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.316509 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:28.328196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:28.449683 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:28.568762 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:28.687759 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:28.805044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:43:29.006856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:29.308841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Launched 19:43:29.571617 run iperf3-srv_10.42.42.10(pid=23900): Launched 19:43:29.685928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:43:29.887137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:30.188368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23901): Launched 19:43:30.449832 run iperf3-srv_10.42.42.10(pid=23902): Launched 19:43:30.561859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:43:30.761581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:31.098957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23903): Launched 19:43:31.407138 run iperf3-srv_10.42.42.10(pid=23904): Launched 19:43:31.537197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:43:31.742468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:43:32.051006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23905): Launched 19:43:32.317673 run iperf3-srv_10.42.42.10(pid=23906): Launched 19:43:32.430245 tst iperf3m4.py:8: start network... 19:43:32.630164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:33.095572 run create_hlr_db(pid=23907): Launched 19:43:33.219987 bus /gobi_6: Setting Powered False 19:43:34.279764 run create_hlr_db(pid=23907): Terminated: ok {rc=0} 19:43:34.699484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23909): Launched 19:43:35.002475 run osmo-hlr_10.42.42.2(pid=23910): Launched 19:43:35.115884 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:35.632835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23912): Launched 19:43:35.933399 run osmo-stp_10.42.42.5(pid=23913): Launched 19:43:36.046360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:36.561163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23915): Launched 19:43:36.674951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:36.929312 run patchelf(pid=23916): Launched 19:43:37.095900 run osmo-stp_10.42.42.5(pid=23913): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23913)] 19:43:37.222903 run osmo-stp_10.42.42.5(pid=23913): stdout: | (launched: 2022-12-13_19:43:35.877862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:37.350992 run osmo-stp_10.42.42.5(pid=23913): stderr: | 20221213194336045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194336045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194336045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194336046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194336046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194336046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194336046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:37.479270 run osmo-stp_10.42.42.5(pid=23913): stdout: | (launched: 2022-12-13_19:43:35.877862) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:37.603261 run osmo-stp_10.42.42.5(pid=23913): stderr: | 20221213194336045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194336045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194336045 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194336046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194336046 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194336046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194336046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:37.748815 run patchelf(pid=23916): Terminating (SIGINT) 19:43:37.917286 run patchelf(pid=23916): Terminated: ok {rc=0} 19:43:38.038937 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23913): Process ended prematurely: osmo-stp_10.42.42.5(pid=23913) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23913)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 19:43:38.048269 tst iperf3m4.py:8: Test FAILED (10.4 sec) 19:43:38.075574 run osmo-hlr_10.42.42.2(pid=23910): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23910)] 19:43:38.122902 run osmo-hlr_10.42.42.2(pid=23910): stdout: | (launched: 2022-12-13_19:43:34.944624) 19:43:38.171781 run osmo-hlr_10.42.42.2(pid=23910): stderr: | 20221213194335119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194335119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194335119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194335119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194335119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194335119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194335131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194335141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194335141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194335141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:38.221266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Terminating (SIGTERM) 19:43:38.260720 run iperf3-srv_10.42.42.10(pid=23900): Terminating (SIGTERM) 19:43:38.300052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23901): Terminating (SIGTERM) 19:43:38.339360 run iperf3-srv_10.42.42.10(pid=23902): Terminating (SIGTERM) 19:43:38.378691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23903): Terminating (SIGTERM) 19:43:38.418613 run iperf3-srv_10.42.42.10(pid=23904): Terminating (SIGTERM) 19:43:38.457833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23905): Terminating (SIGTERM) 19:43:38.497211 run iperf3-srv_10.42.42.10(pid=23906): Terminating (SIGTERM) 19:43:38.536309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23909): Terminating (SIGTERM) 19:43:38.575606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23912): Terminating (SIGTERM) 19:43:38.614793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23915): Terminating (SIGTERM) 19:43:38.654368 --- ParallelTerminationStrategy: PID 23899 died... 19:43:38.673752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Terminated: ok {rc=0} 19:43:38.717714 --- ParallelTerminationStrategy: PID 23900 died... 19:43:38.736374 run iperf3-srv_10.42.42.10(pid=23900): Terminated {rc=256} 19:43:38.779820 --- ParallelTerminationStrategy: PID 23901 died... 19:43:38.798443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23901): Terminated: ok {rc=0} 19:43:38.841958 --- ParallelTerminationStrategy: PID 23902 died... 19:43:38.860502 run iperf3-srv_10.42.42.10(pid=23902): Terminated {rc=256} 19:43:38.904335 --- ParallelTerminationStrategy: PID 23903 died... 19:43:38.922921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23903): Terminated: ok {rc=0} 19:43:38.966198 --- ParallelTerminationStrategy: PID 23904 died... 19:43:38.984629 run iperf3-srv_10.42.42.10(pid=23904): Terminated {rc=256} 19:43:39.027964 --- ParallelTerminationStrategy: PID 23905 died... 19:43:39.046686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23905): Terminated: ok {rc=0} 19:43:39.090014 --- ParallelTerminationStrategy: PID 23906 died... 19:43:39.108596 run iperf3-srv_10.42.42.10(pid=23906): Terminated {rc=256} 19:43:39.151863 --- ParallelTerminationStrategy: PID 23909 died... 19:43:39.170438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23909): Terminated: ok {rc=0} 19:43:39.213856 --- ParallelTerminationStrategy: PID 23912 died... 19:43:39.232431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23912): Terminated: ok {rc=0} 19:43:39.275757 --- ParallelTerminationStrategy: PID 23915 died... 19:43:39.294456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23915): Terminated: ok {rc=0} 19:43:39.379341 bus /gobi_4: Setting Powered False 19:43:40.478032 bus /gobi_4: Setting Powered False 19:43:41.591286 bus /gobi_1: Setting Powered False 19:43:42.689499 bus /gobi_1: Setting Powered False 19:43:43.803630 bus /gobi_0: Setting Powered False 19:43:44.902682 bus /gobi_0: Setting Powered False 19:43:46.022313 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 19:43:47.122613 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.134653 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:43:47.177807 tst ping.py: using LAC 35842 19:43:47.295630 tst ping.py: using RAC 142 19:43:47.412807 tst ping.py: using CellId 35842 19:43:47.527172 tst ping.py: using BVCI 35843 19:43:47.633632 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.644888 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.656127 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.667008 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.677877 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.688462 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.699394 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:47.710150 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:47.826343 tst ping.py:19: start network... 19:43:48.041119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:48.530070 run create_hlr_db(pid=23917): Launched 19:43:48.652525 bus /gobi_6: Setting Powered False 19:43:49.715266 run create_hlr_db(pid=23917): Terminated: ok {rc=0} 19:43:50.155992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23919): Launched 19:43:50.472152 run osmo-hlr_10.42.42.2(pid=23920): Launched 19:43:50.593231 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:51.144716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23922): Launched 19:43:51.462133 run osmo-stp_10.42.42.5(pid=23923): Launched 19:43:51.583074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:43:52.130700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23925): Launched 19:43:52.253258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:43:52.521379 run patchelf(pid=23926): Launched 19:43:52.696456 run osmo-stp_10.42.42.5(pid=23923): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23923)] 19:43:52.830557 run osmo-stp_10.42.42.5(pid=23923): stdout: | (launched: 2022-12-13_19:43:51.403725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:52.966144 run osmo-stp_10.42.42.5(pid=23923): stderr: | 20221213194351591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194351591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194351591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194351592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194351592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194351592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194351592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:53.102432 run osmo-stp_10.42.42.5(pid=23923): stdout: | (launched: 2022-12-13_19:43:51.403725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:43:53.233113 run osmo-stp_10.42.42.5(pid=23923): stderr: | 20221213194351591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194351591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194351591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194351592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194351592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194351592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194351592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:43:53.387224 run patchelf(pid=23926): Terminating (SIGINT) 19:43:53.564583 run patchelf(pid=23926): Terminated: ok {rc=0} 19:43:53.692617 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23923): Process ended prematurely: osmo-stp_10.42.42.5(pid=23923) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23923)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 19:43:53.702356 tst ping.py:22: Test FAILED (6.6 sec) 19:43:53.730414 run osmo-hlr_10.42.42.2(pid=23920): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23920)] 19:43:53.780831 run osmo-hlr_10.42.42.2(pid=23920): stdout: | (launched: 2022-12-13_19:43:50.414329) 19:43:53.832869 run osmo-hlr_10.42.42.2(pid=23920): stderr: | 20221213194350606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194350607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194350607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194350607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194350607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194350607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194350619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194350627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194350627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194350627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:43:53.885342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23919): Terminating (SIGTERM) 19:43:53.926833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23922): Terminating (SIGTERM) 19:43:53.968623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23925): Terminating (SIGTERM) 19:43:54.010976 --- ParallelTerminationStrategy: PID 23919 died... 19:43:54.031224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23919): Terminated: ok {rc=0} 19:43:54.077881 --- ParallelTerminationStrategy: PID 23922 died... 19:43:54.098039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23922): Terminated: ok {rc=0} 19:43:54.144368 --- ParallelTerminationStrategy: PID 23925 died... 19:43:54.164197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23925): Terminated: ok {rc=0} 19:43:54.252356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:43:55.339223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.351815 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:43:55.395015 tst ping_idle_ping.py: using LAC 35843 19:43:55.523330 tst ping_idle_ping.py: using RAC 143 19:43:55.647072 tst ping_idle_ping.py: using CellId 35843 19:43:55.769612 tst ping_idle_ping.py: using BVCI 35844 19:43:55.877796 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.889170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.900266 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.911252 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.922487 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.933739 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.945300 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:43:55.956559 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:43:56.075154 tst ping_idle_ping.py:24: start network... 19:43:56.289216 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:43:56.790303 run create_hlr_db(pid=23927): Launched 19:43:56.912159 bus /gobi_6: Setting Powered False 19:43:57.975708 run create_hlr_db(pid=23927): Terminated: ok {rc=0} 19:43:58.420217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Launched 19:43:58.738292 run osmo-hlr_10.42.42.2(pid=23930): Launched 19:43:58.861028 run osmo-stp_10.42.42.5: Starting osmo-stp 19:43:59.410421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Launched 19:43:59.729247 run osmo-stp_10.42.42.5(pid=23933): Launched 19:43:59.852013 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:00.399119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23935): Launched 19:44:00.520180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:00.788703 run patchelf(pid=23936): Launched 19:44:00.986015 run osmo-stp_10.42.42.5(pid=23933): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] 19:44:01.123813 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-13_19:43:59.671403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:01.263145 run osmo-stp_10.42.42.5(pid=23933): stderr: | 20221213194359859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194359859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194359859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194359859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194359860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194359860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194359860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:01.402290 run osmo-stp_10.42.42.5(pid=23933): stdout: | (launched: 2022-12-13_19:43:59.671403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:01.535093 run osmo-stp_10.42.42.5(pid=23933): stderr: | 20221213194359859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194359859 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194359859 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194359859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194359860 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194359860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194359860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:01.692469 run patchelf(pid=23936): Terminating (SIGINT) 19:44:01.875215 run patchelf(pid=23936): Terminated: ok {rc=0} 19:44:02.008220 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 19:44:02.018677 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 19:44:02.048921 run osmo-hlr_10.42.42.2(pid=23930): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23930)] 19:44:02.101550 run osmo-hlr_10.42.42.2(pid=23930): stdout: | (launched: 2022-12-13_19:43:58.680063) 19:44:02.155418 run osmo-hlr_10.42.42.2(pid=23930): stderr: | 20221213194358872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194358872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194358872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194358872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194358873 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194358873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194358885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194358893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194358894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194358894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:02.207580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminating (SIGTERM) 19:44:02.249001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminating (SIGTERM) 19:44:02.290772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23935): Terminating (SIGTERM) 19:44:02.332789 --- ParallelTerminationStrategy: PID 23929 died... 19:44:02.353187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23929): Terminated: ok {rc=0} 19:44:02.399718 --- ParallelTerminationStrategy: PID 23932 died... 19:44:02.419500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23932): Terminated: ok {rc=0} 19:44:02.465458 --- ParallelTerminationStrategy: PID 23935 died... 19:44:02.485461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23935): Terminated: ok {rc=0} 19:44:02.571933 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:44:03.872308 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:44:03.879696 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:44:03.904266 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:44:03.944410 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:44:04.034638 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:44:04.059457 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:44:04.099645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:44:04.698167 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:44:04.750130 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:04.761643 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:44:04.826514 tst cs_paging_gprs_active.py: using LAC 35844 19:44:04.951617 tst cs_paging_gprs_active.py: using RAC 144 19:44:05.076514 tst cs_paging_gprs_active.py: using CellId 35844 19:44:05.200676 tst cs_paging_gprs_active.py: using BVCI 35845 19:44:05.317455 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.329079 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.340380 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.351741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.363381 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.375003 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.386685 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.398652 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:05.410602 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:05.526918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:05.646216 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:44:05.866304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:06.191426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23941): Launched 19:44:06.473671 run iperf3-srv_10.42.42.10(pid=23942): Launched 19:44:06.593924 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:44:06.811901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:07.135134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23943): Launched 19:44:07.417744 run iperf3-srv_10.42.42.10(pid=23944): Launched 19:44:07.539851 tst cs_paging_gprs_active.py:38: start network... 19:44:07.757735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:08.258243 run create_hlr_db(pid=23945): Launched 19:44:08.382977 bus /gobi_6: Setting Powered False 19:44:09.443379 run create_hlr_db(pid=23945): Terminated: ok {rc=0} 19:44:09.892634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23947): Launched 19:44:10.216666 run osmo-hlr_10.42.42.2(pid=23948): Launched 19:44:10.340150 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:10.898889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23950): Launched 19:44:11.221672 run osmo-stp_10.42.42.5(pid=23951): Launched 19:44:11.346918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:11.907685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23953): Launched 19:44:12.031430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:12.285929 run patchelf(pid=23954): Launched 19:44:12.454335 run osmo-stp_10.42.42.5(pid=23951): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23951)] 19:44:12.581906 run osmo-stp_10.42.42.5(pid=23951): stdout: | (launched: 2022-12-13_19:44:11.162385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:12.711182 run osmo-stp_10.42.42.5(pid=23951): stderr: | 20221213194411350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194411350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194411350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194411351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194411351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194411351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194411351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:12.840224 run osmo-stp_10.42.42.5(pid=23951): stdout: | (launched: 2022-12-13_19:44:11.162385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:12.963489 run osmo-stp_10.42.42.5(pid=23951): stderr: | 20221213194411350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194411350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194411350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194411351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194411351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194411351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194411351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:13.109979 run patchelf(pid=23954): Terminating (SIGINT) 19:44:13.278764 run patchelf(pid=23954): Terminated: ok {rc=0} 19:44:13.400427 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23951): Process ended prematurely: osmo-stp_10.42.42.5(pid=23951) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23951)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:44:13.409843 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 19:44:13.436682 run osmo-hlr_10.42.42.2(pid=23948): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23948)] 19:44:13.484476 run osmo-hlr_10.42.42.2(pid=23948): stdout: | (launched: 2022-12-13_19:44:10.157244) 19:44:13.533799 run osmo-hlr_10.42.42.2(pid=23948): stderr: | 20221213194410349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194410349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194410349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194410349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194410349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194410349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194410362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194410371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194410371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194410371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:13.583710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23941): Terminating (SIGTERM) 19:44:13.623951 run iperf3-srv_10.42.42.10(pid=23942): Terminating (SIGTERM) 19:44:13.663896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23943): Terminating (SIGTERM) 19:44:13.703753 run iperf3-srv_10.42.42.10(pid=23944): Terminating (SIGTERM) 19:44:13.743566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23947): Terminating (SIGTERM) 19:44:13.783549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23950): Terminating (SIGTERM) 19:44:13.823435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23953): Terminating (SIGTERM) 19:44:13.864114 --- ParallelTerminationStrategy: PID 23941 died... 19:44:13.883608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23941): Terminated: ok {rc=0} 19:44:13.927702 --- ParallelTerminationStrategy: PID 23942 died... 19:44:13.946714 run iperf3-srv_10.42.42.10(pid=23942): Terminated {rc=256} 19:44:13.990508 --- ParallelTerminationStrategy: PID 23943 died... 19:44:14.009213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23943): Terminated: ok {rc=0} 19:44:14.053056 --- ParallelTerminationStrategy: PID 23944 died... 19:44:14.071793 run iperf3-srv_10.42.42.10(pid=23944): Terminated {rc=256} 19:44:14.115473 --- ParallelTerminationStrategy: PID 23947 died... 19:44:14.134447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23947): Terminated: ok {rc=0} 19:44:14.178394 --- ParallelTerminationStrategy: PID 23950 died... 19:44:14.197366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23950): Terminated: ok {rc=0} 19:44:14.241218 --- ParallelTerminationStrategy: PID 23953 died... 19:44:14.260041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23953): Terminated: ok {rc=0} 19:44:14.343889 bus /gobi_0: Setting Powered False 19:44:15.440858 bus /gobi_0: Setting Powered False 19:44:16.552876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:44:17.696877 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:17.708609 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:44:17.771809 tst iperf3.py: using LAC 35845 19:44:17.892091 tst iperf3.py: using RAC 145 19:44:18.009576 tst iperf3.py: using CellId 35845 19:44:18.127617 tst iperf3.py: using BVCI 35846 19:44:18.236102 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.247234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.258041 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.268770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.279797 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.290814 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.301908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.312743 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:18.324147 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:18.438878 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:44:18.641641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:18.944351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23955): Launched 19:44:19.206695 run iperf3-srv_10.42.42.10(pid=23956): Launched 19:44:19.320806 tst iperf3.py:8: start network... 19:44:19.521964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:19.988110 run create_hlr_db(pid=23957): Launched 19:44:20.112859 bus /gobi_6: Setting Powered False 19:44:21.177346 run create_hlr_db(pid=23957): Terminated: ok {rc=0} 19:44:21.608419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23959): Launched 19:44:21.910452 run osmo-hlr_10.42.42.2(pid=23960): Launched 19:44:22.024300 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:22.554685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23962): Launched 19:44:22.854810 run osmo-stp_10.42.42.5(pid=23963): Launched 19:44:22.970711 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:23.487254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23965): Launched 19:44:23.601956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:23.854950 run patchelf(pid=23966): Launched 19:44:24.022062 run osmo-stp_10.42.42.5(pid=23963): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23963)] 19:44:24.149280 run osmo-stp_10.42.42.5(pid=23963): stdout: | (launched: 2022-12-13_19:44:22.799374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:24.277602 run osmo-stp_10.42.42.5(pid=23963): stderr: | 20221213194422965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194422965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194422966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194422966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194422967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194422967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194422967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:24.406369 run osmo-stp_10.42.42.5(pid=23963): stdout: | (launched: 2022-12-13_19:44:22.799374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:24.529537 run osmo-stp_10.42.42.5(pid=23963): stderr: | 20221213194422965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194422965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194422966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194422966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194422967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194422967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194422967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:24.675548 run patchelf(pid=23966): Terminating (SIGINT) 19:44:24.843982 run patchelf(pid=23966): Terminated: ok {rc=0} 19:44:24.965830 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23963): Process ended prematurely: osmo-stp_10.42.42.5(pid=23963) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23963)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 19:44:24.975241 tst iperf3.py:8: Test FAILED (7.3 sec) 19:44:25.002230 run osmo-hlr_10.42.42.2(pid=23960): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23960)] 19:44:25.050439 run osmo-hlr_10.42.42.2(pid=23960): stdout: | (launched: 2022-12-13_19:44:21.854417) 19:44:25.100108 run osmo-hlr_10.42.42.2(pid=23960): stderr: | 20221213194422026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194422026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194422026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194422026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194422026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194422026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194422037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194422045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194422046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194422046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:25.150052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23955): Terminating (SIGTERM) 19:44:25.190085 run iperf3-srv_10.42.42.10(pid=23956): Terminating (SIGTERM) 19:44:25.230145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23959): Terminating (SIGTERM) 19:44:25.270062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23962): Terminating (SIGTERM) 19:44:25.310142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23965): Terminating (SIGTERM) 19:44:25.350348 --- ParallelTerminationStrategy: PID 23955 died... 19:44:25.369405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23955): Terminated: ok {rc=0} 19:44:25.413334 --- ParallelTerminationStrategy: PID 23956 died... 19:44:25.432092 run iperf3-srv_10.42.42.10(pid=23956): Terminated {rc=256} 19:44:25.476112 --- ParallelTerminationStrategy: PID 23959 died... 19:44:25.495072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23959): Terminated: ok {rc=0} 19:44:25.539103 --- ParallelTerminationStrategy: PID 23962 died... 19:44:25.558085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23962): Terminated: ok {rc=0} 19:44:25.601974 --- ParallelTerminationStrategy: PID 23965 died... 19:44:25.620805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23965): Terminated: ok {rc=0} 19:44:25.704400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:44:26.853961 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:26.866079 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:44:26.926732 tst iperf3m4.py: using LAC 35846 19:44:27.050266 tst iperf3m4.py: using RAC 146 19:44:27.166220 tst iperf3m4.py: using CellId 35846 19:44:27.283209 tst iperf3m4.py: using BVCI 35847 19:44:27.391756 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.403104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.414134 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.425138 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.436128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.447304 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.458623 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.469737 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:27.480831 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:27.596454 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:27.717271 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:27.836763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:27.957682 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:44:28.176780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:28.501751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Launched 19:44:28.783041 run iperf3-srv_10.42.42.10(pid=23969): Launched 19:44:28.904446 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:44:29.123397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:29.447935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23970): Launched 19:44:29.728326 run iperf3-srv_10.42.42.10(pid=23971): Launched 19:44:29.849468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:44:30.067938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:30.391426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23972): Launched 19:44:30.673215 run iperf3-srv_10.42.42.10(pid=23973): Launched 19:44:30.794076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:44:31.029244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:44:31.401771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23974): Launched 19:44:31.683667 run iperf3-srv_10.42.42.10(pid=23975): Launched 19:44:31.815373 tst iperf3m4.py:8: start network... 19:44:32.022362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:32.495932 run create_hlr_db(pid=23976): Launched 19:44:32.619235 bus /gobi_6: Setting Powered False 19:44:33.679292 run create_hlr_db(pid=23976): Terminated: ok {rc=0} 19:44:34.099785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Launched 19:44:34.399940 run osmo-hlr_10.42.42.2(pid=23979): Launched 19:44:34.513483 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:35.032525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Launched 19:44:35.333713 run osmo-stp_10.42.42.5(pid=23982): Launched 19:44:35.446683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:35.963249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23984): Launched 19:44:36.078289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:36.331529 run patchelf(pid=23985): Launched 19:44:36.498135 run osmo-stp_10.42.42.5(pid=23982): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] 19:44:36.625307 run osmo-stp_10.42.42.5(pid=23982): stdout: | (launched: 2022-12-13_19:44:35.278358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:36.753551 run osmo-stp_10.42.42.5(pid=23982): stderr: | 20221213194435447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194435447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194435448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194435448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194435449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194435449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194435449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:36.882094 run osmo-stp_10.42.42.5(pid=23982): stdout: | (launched: 2022-12-13_19:44:35.278358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:37.005144 run osmo-stp_10.42.42.5(pid=23982): stderr: | 20221213194435447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194435447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194435448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194435448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194435449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194435449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194435449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:37.151232 run patchelf(pid=23985): Terminating (SIGINT) 19:44:37.319325 run patchelf(pid=23985): Terminated: ok {rc=0} 19:44:37.440756 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23982): Process ended prematurely: osmo-stp_10.42.42.5(pid=23982) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:44:37.450378 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:44:37.477761 run osmo-hlr_10.42.42.2(pid=23979): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23979)] 19:44:37.525306 run osmo-hlr_10.42.42.2(pid=23979): stdout: | (launched: 2022-12-13_19:44:34.344564) 19:44:37.574332 run osmo-hlr_10.42.42.2(pid=23979): stderr: | 20221213194434519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194434519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194434519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194434519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194434519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194434519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194434532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194434541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194434541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194434541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:37.623787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Terminating (SIGTERM) 19:44:37.663637 run iperf3-srv_10.42.42.10(pid=23969): Terminating (SIGTERM) 19:44:37.703307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23970): Terminating (SIGTERM) 19:44:37.743173 run iperf3-srv_10.42.42.10(pid=23971): Terminating (SIGTERM) 19:44:37.782376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23972): Terminating (SIGTERM) 19:44:37.821670 run iperf3-srv_10.42.42.10(pid=23973): Terminating (SIGTERM) 19:44:37.861063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23974): Terminating (SIGTERM) 19:44:37.900249 run iperf3-srv_10.42.42.10(pid=23975): Terminating (SIGTERM) 19:44:37.939371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Terminating (SIGTERM) 19:44:37.978768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Terminating (SIGTERM) 19:44:38.018162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23984): Terminating (SIGTERM) 19:44:38.058461 --- ParallelTerminationStrategy: PID 23968 died... 19:44:38.077575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23968): Terminated: ok {rc=0} 19:44:38.121187 --- ParallelTerminationStrategy: PID 23969 died... 19:44:38.139864 run iperf3-srv_10.42.42.10(pid=23969): Terminated {rc=256} 19:44:38.183457 --- ParallelTerminationStrategy: PID 23970 died... 19:44:38.202237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23970): Terminated: ok {rc=0} 19:44:38.245874 --- ParallelTerminationStrategy: PID 23971 died... 19:44:38.264507 run iperf3-srv_10.42.42.10(pid=23971): Terminated {rc=256} 19:44:38.307861 --- ParallelTerminationStrategy: PID 23972 died... 19:44:38.326605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23972): Terminated: ok {rc=0} 19:44:38.370065 --- ParallelTerminationStrategy: PID 23973 died... 19:44:38.388801 run iperf3-srv_10.42.42.10(pid=23973): Terminated {rc=256} 19:44:38.432178 --- ParallelTerminationStrategy: PID 23974 died... 19:44:38.450729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23974): Terminated: ok {rc=0} 19:44:38.494451 --- ParallelTerminationStrategy: PID 23975 died... 19:44:38.513115 run iperf3-srv_10.42.42.10(pid=23975): Terminated {rc=256} 19:44:38.556589 --- ParallelTerminationStrategy: PID 23978 died... 19:44:38.575331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Terminated: ok {rc=0} 19:44:38.618855 --- ParallelTerminationStrategy: PID 23981 died... 19:44:38.637556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Terminated: ok {rc=0} 19:44:38.681281 --- ParallelTerminationStrategy: PID 23984 died... 19:44:38.699956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23984): Terminated: ok {rc=0} 19:44:38.784694 bus /gobi_4: Setting Powered False 19:44:39.884324 bus /gobi_4: Setting Powered False 19:44:40.998737 bus /gobi_1: Setting Powered False 19:44:42.097559 bus /gobi_1: Setting Powered False 19:44:43.212619 bus /gobi_0: Setting Powered False 19:44:44.309056 bus /gobi_0: Setting Powered False 19:44:45.424233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:44:46.528326 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:46.541622 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:44:46.609165 tst ping.py: using LAC 35847 19:44:46.751386 tst ping.py: using RAC 147 19:44:46.879365 tst ping.py: using CellId 35847 19:44:47.029413 tst ping.py: using BVCI 35848 19:44:47.139334 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.151112 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.162653 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.174314 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.186104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.197727 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.209476 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:47.221103 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:47.336257 tst ping.py:19: start network... 19:44:47.551055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:48.044370 run create_hlr_db(pid=23986): Launched 19:44:48.165415 bus /gobi_6: Setting Powered False 19:44:49.228585 run create_hlr_db(pid=23986): Terminated: ok {rc=0} 19:44:49.653220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23988): Launched 19:44:49.950178 run osmo-hlr_10.42.42.2(pid=23989): Launched 19:44:50.063135 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:50.580116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23991): Launched 19:44:50.874435 run osmo-stp_10.42.42.5(pid=23992): Launched 19:44:50.987578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:51.495240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23994): Launched 19:44:51.608862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:51.857338 run patchelf(pid=23995): Launched 19:44:52.020503 run osmo-stp_10.42.42.5(pid=23992): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23992)] 19:44:52.145487 run osmo-stp_10.42.42.5(pid=23992): stdout: | (launched: 2022-12-13_19:44:50.819816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:52.271875 run osmo-stp_10.42.42.5(pid=23992): stderr: | 20221213194450986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194450986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194450986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194450987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194450987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194450987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194450987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:52.397884 run osmo-stp_10.42.42.5(pid=23992): stdout: | (launched: 2022-12-13_19:44:50.819816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:44:52.518957 run osmo-stp_10.42.42.5(pid=23992): stderr: | 20221213194450986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194450986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194450986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194450987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194450987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194450987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194450987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:44:52.662282 run patchelf(pid=23995): Terminating (SIGINT) 19:44:52.827868 run patchelf(pid=23995): Terminated: ok {rc=0} 19:44:52.947045 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23992): Process ended prematurely: osmo-stp_10.42.42.5(pid=23992) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23992)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 19:44:52.955976 tst ping.py:22: Test FAILED (6.4 sec) 19:44:52.982345 run osmo-hlr_10.42.42.2(pid=23989): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23989)] 19:44:53.029521 run osmo-hlr_10.42.42.2(pid=23989): stdout: | (launched: 2022-12-13_19:44:49.895461) 19:44:53.078272 run osmo-hlr_10.42.42.2(pid=23989): stderr: | 20221213194450068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194450068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194450068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194450068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194450068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194450068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194450080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194450090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194450091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194450091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:44:53.127381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23988): Terminating (SIGTERM) 19:44:53.166508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23991): Terminating (SIGTERM) 19:44:53.205707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23994): Terminating (SIGTERM) 19:44:53.245436 --- ParallelTerminationStrategy: PID 23988 died... 19:44:53.264383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23988): Terminated: ok {rc=0} 19:44:53.308254 --- ParallelTerminationStrategy: PID 23991 died... 19:44:53.326822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23991): Terminated: ok {rc=0} 19:44:53.370096 --- ParallelTerminationStrategy: PID 23994 died... 19:44:53.388575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23994): Terminated: ok {rc=0} 19:44:53.473742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:44:54.561054 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:54.573741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:44:54.637951 tst ping_idle_ping.py: using LAC 35848 19:44:54.752448 tst ping_idle_ping.py: using RAC 148 19:44:54.866832 tst ping_idle_ping.py: using CellId 35848 19:44:54.980401 tst ping_idle_ping.py: using BVCI 35849 19:44:55.086747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.097852 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.108686 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.119605 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.130297 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.141077 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.151959 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:44:55.162787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:44:55.275790 tst ping_idle_ping.py:24: start network... 19:44:55.473326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:44:55.933314 run create_hlr_db(pid=23996): Launched 19:44:56.053461 bus /gobi_6: Setting Powered False 19:44:57.112814 run create_hlr_db(pid=23996): Terminated: ok {rc=0} 19:44:57.547837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Launched 19:44:57.866612 run osmo-hlr_10.42.42.2(pid=23999): Launched 19:44:57.987844 run osmo-stp_10.42.42.5: Starting osmo-stp 19:44:58.535015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Launched 19:44:58.853769 run osmo-stp_10.42.42.5(pid=24002): Launched 19:44:58.974352 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:44:59.520653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24004): Launched 19:44:59.644179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:44:59.912448 run patchelf(pid=24005): Launched 19:45:00.088872 run osmo-stp_10.42.42.5(pid=24002): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] 19:45:00.223875 run osmo-stp_10.42.42.5(pid=24002): stdout: | (launched: 2022-12-13_19:44:58.795722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:00.360475 run osmo-stp_10.42.42.5(pid=24002): stderr: | 20221213194458981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194458981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194458981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194458982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194458982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194458982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194458982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:00.496610 run osmo-stp_10.42.42.5(pid=24002): stdout: | (launched: 2022-12-13_19:44:58.795722) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:00.627473 run osmo-stp_10.42.42.5(pid=24002): stderr: | 20221213194458981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194458981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194458981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194458982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194458982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194458982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194458982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:00.782089 run patchelf(pid=24005): Terminating (SIGINT) 19:45:00.983829 run patchelf(pid=24005): Terminated: ok {rc=0} 19:45:01.113924 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24002): Process ended prematurely: osmo-stp_10.42.42.5(pid=24002) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:45:01.123476 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 19:45:01.151148 run osmo-hlr_10.42.42.2(pid=23999): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23999)] 19:45:01.202218 run osmo-hlr_10.42.42.2(pid=23999): stdout: | (launched: 2022-12-13_19:44:57.808342) 19:45:01.252397 run osmo-hlr_10.42.42.2(pid=23999): stderr: | 20221213194458001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194458001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194458001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194458001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194458001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194458001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194458014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194458022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194458022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194458023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:01.303333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Terminating (SIGTERM) 19:45:01.344652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Terminating (SIGTERM) 19:45:01.387910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24004): Terminating (SIGTERM) 19:45:01.432788 --- ParallelTerminationStrategy: PID 23998 died... 19:45:01.453225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23998): Terminated: ok {rc=0} 19:45:01.499818 --- ParallelTerminationStrategy: PID 24001 died... 19:45:01.519311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24001): Terminated: ok {rc=0} 19:45:01.564737 --- ParallelTerminationStrategy: PID 24004 died... 19:45:01.584869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24004): Terminated: ok {rc=0} 19:45:01.675199 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 19:45:02.977082 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:02.985117 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:45:03.009621 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:45:03.046281 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:45:03.103562 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:45:03.128400 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:45:03.164096 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:45:03.725444 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:45:03.730731 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:03.742880 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:45:03.804924 tst switch_tch_pdch.py: using LAC 35849 19:45:03.930195 tst switch_tch_pdch.py: using RAC 149 19:45:04.053967 tst switch_tch_pdch.py: using CellId 35849 19:45:04.177716 tst switch_tch_pdch.py: using BVCI 35850 19:45:04.285593 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.297376 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.309056 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.320476 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.332093 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.344107 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.355942 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:45:04.367431 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:04.481657 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:45:04.599881 tst switch_tch_pdch.py:51: start network... 19:45:04.813378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:05.306467 run create_hlr_db(pid=24012): Launched 19:45:05.428377 bus /gobi_6: Setting Powered False 19:45:06.491403 run create_hlr_db(pid=24012): Terminated: ok {rc=0} 19:45:06.915215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24014): Launched 19:45:07.211930 run osmo-hlr_10.42.42.2(pid=24015): Launched 19:45:07.323830 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:07.837927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24017): Launched 19:45:08.132660 run osmo-stp_10.42.42.5(pid=24018): Launched 19:45:08.243781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:45:08.753362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24020): Launched 19:45:08.865800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:45:09.114342 run patchelf(pid=24021): Launched 19:45:09.277548 run osmo-stp_10.42.42.5(pid=24018): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24018)] 19:45:09.402037 run osmo-stp_10.42.42.5(pid=24018): stdout: | (launched: 2022-12-13_19:45:08.077652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:09.528034 run osmo-stp_10.42.42.5(pid=24018): stderr: | 20221213194508245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194508245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194508245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194508246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194508246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194508246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194508246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:09.653969 run osmo-stp_10.42.42.5(pid=24018): stdout: | (launched: 2022-12-13_19:45:08.077652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:09.774638 run osmo-stp_10.42.42.5(pid=24018): stderr: | 20221213194508245 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194508245 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194508245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194508246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194508246 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194508246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194508246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:09.917620 run patchelf(pid=24021): Terminating (SIGINT) 19:45:10.082398 run patchelf(pid=24021): Terminated: ok {rc=0} 19:45:10.201506 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24018): Process ended prematurely: osmo-stp_10.42.42.5(pid=24018) [trial-2393↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24018)] [trial-2393↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:45:10.210312 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 19:45:10.236513 run osmo-hlr_10.42.42.2(pid=24015): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24015)] 19:45:10.284390 run osmo-hlr_10.42.42.2(pid=24015): stdout: | (launched: 2022-12-13_19:45:07.157218) 19:45:10.333743 run osmo-hlr_10.42.42.2(pid=24015): stderr: | 20221213194507329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194507330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194507330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194507330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194507330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194507330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194507342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194507351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194507351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194507351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:10.383557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24014): Terminating (SIGTERM) 19:45:10.423317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24017): Terminating (SIGTERM) 19:45:10.462854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24020): Terminating (SIGTERM) 19:45:10.502683 --- ParallelTerminationStrategy: PID 24014 died... 19:45:10.521602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24014): Terminated: ok {rc=0} 19:45:10.565271 --- ParallelTerminationStrategy: PID 24017 died... 19:45:10.584053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24017): Terminated: ok {rc=0} 19:45:10.627399 --- ParallelTerminationStrategy: PID 24020 died... 19:45:10.645822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24020): Terminated: ok {rc=0} 19:45:10.730568 bus /gobi_0: Setting Powered False 19:45:11.827988 bus /gobi_0: Setting Powered False 19:45:12.942276 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 sms:nanobts+band-900 --------------------------------------------------------------------- 19:45:14.186157 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:14.190937 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:45:14.223673 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:45:14.250403 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 19:45:14.305706 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:45:14.338125 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:45:14.364568 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 19:45:14.906935 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 19:45:14.912020 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:14.922891 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 19:45:14.968013 tst mo_mt_sms.py: using LAC 35850 19:45:15.085480 tst mo_mt_sms.py: using RAC 150 19:45:15.199449 tst mo_mt_sms.py: using CellId 35850 19:45:15.313067 tst mo_mt_sms.py: using BVCI 35851 19:45:15.430211 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:15.441625 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:15.452789 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:15.464034 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:15.475306 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:15.486778 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 19:45:15.599721 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 19:45:15.717488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:16.249039 run create_hlr_db(pid=24025): Launched 19:45:16.388661 bus /gobi_6: Setting Powered False 19:45:17.447920 run create_hlr_db(pid=24025): Terminated: ok {rc=0} 19:45:17.881325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Launched 19:45:18.200246 run osmo-hlr_10.42.42.2(pid=24028): Launched 19:45:18.321330 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:18.868436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Launched 19:45:19.185685 run osmo-stp_10.42.42.5(pid=24031): Launched 19:45:19.306249 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:19.879193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Launched 19:45:20.198752 run osmo-msc_10.42.42.6(pid=24034): Launched 19:45:20.377315 run osmo-stp_10.42.42.5(pid=24031): ERR: Terminated: ERROR {rc=1} [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] 19:45:20.511589 run osmo-stp_10.42.42.5(pid=24031): stdout: | (launched: 2022-12-13_19:45:19.127673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:20.646729 run osmo-stp_10.42.42.5(pid=24031): stderr: | 20221213194519314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194519314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194519315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194519315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194519316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194519316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194519316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:20.780081 run osmo-stp_10.42.42.5(pid=24031): stdout: | (launched: 2022-12-13_19:45:19.127673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:20.907588 run osmo-stp_10.42.42.5(pid=24031): stderr: | 20221213194519314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194519314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194519315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194519315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194519316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194519316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194519316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:21.060158 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24031): Process ended prematurely: osmo-stp_10.42.42.5(pid=24031) [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py:16] 19:45:21.069350 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 19:45:21.096920 run osmo-hlr_10.42.42.2(pid=24028): ERR: Terminated: ERROR {rc=237} [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24028)] 19:45:21.147675 run osmo-hlr_10.42.42.2(pid=24028): stdout: | (launched: 2022-12-13_19:45:18.142541) 19:45:21.199461 run osmo-hlr_10.42.42.2(pid=24028): stderr: | 20221213194518334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194518334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194518334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194518335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194518335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194518335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194518346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194518354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194518355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194518355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:21.271794 run osmo-msc_10.42.42.6(pid=24034): ERR: Terminated: ERROR {rc=2} [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24034)] 19:45:21.321877 run osmo-msc_10.42.42.6(pid=24034): stdout: | (launched: 2022-12-13_19:45:20.140610) 19:45:21.373725 run osmo-msc_10.42.42.6(pid=24034): stderr: | 20221213194520458 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194520458 DLGLOBAL DEBUG validating counter group 0x7f7bd1110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194520458 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194520459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194520459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194520459 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194520461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194520461 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194520461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194520461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:21.425992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Terminating (SIGTERM) 19:45:21.467377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Terminating (SIGTERM) 19:45:21.509513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Terminating (SIGTERM) 19:45:21.551773 --- ParallelTerminationStrategy: PID 24027 died... 19:45:21.572287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24027): Terminated: ok {rc=0} 19:45:21.619172 --- ParallelTerminationStrategy: PID 24030 died... 19:45:21.639043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24030): Terminated: ok {rc=0} 19:45:21.685738 --- ParallelTerminationStrategy: PID 24033 died... 19:45:21.705748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24033): Terminated: ok {rc=0} 19:45:21.793875 bus /sierra_3: Setting Powered False 19:45:22.891702 bus /sierra_3: Setting Powered False 19:45:24.011020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 19:45:25.243664 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:25.249833 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:45:25.283919 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 19:45:25.291429 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 19:45:25.327175 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:45:25.360332 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 19:45:25.367800 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 19:45:25.888442 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 19:45:25.893850 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 19:45:25.905392 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 19:45:25.954517 tst assert_extension.py: using LAC 35851 19:45:26.070607 tst assert_extension.py: using RAC 151 19:45:26.186832 tst assert_extension.py: using CellId 35851 19:45:26.302114 tst assert_extension.py: using BVCI 35852 19:45:26.407813 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 19:45:26.525139 tst assert_extension.py:10: start nitb and bts... 19:45:26.738635 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:45:27.384848 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24039): Launched 19:45:27.702252 run osmo-nitb_10.42.42.2(pid=24040): Launched 19:45:27.879311 run osmo-nitb_10.42.42.2(pid=24040): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24040)] 19:45:28.020926 run osmo-nitb_10.42.42.2(pid=24040): stdout: | (launched: 2022-12-13_19:45:27.644402) 19:45:28.164873 run osmo-nitb_10.42.42.2(pid=24040): stderr: | (launched: 2022-12-13_19:45:27.691602) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:45:28.308383 run osmo-nitb_10.42.42.2(pid=24040): stdout: | (launched: 2022-12-13_19:45:27.644402) 19:45:28.446852 run osmo-nitb_10.42.42.2(pid=24040): stderr: | (launched: 2022-12-13_19:45:27.691602) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24040): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24040) [trial-2393↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24040)] 19:45:28.823311 tst osmo-nitb_10.42.42.2(pid=24040): stdout: | (launched: 2022-12-13_19:45:27.644402) 19:45:28.952341 tst osmo-nitb_10.42.42.2(pid=24040): stderr: | (launched: 2022-12-13_19:45:27.691602) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:45:29.104379 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24040): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24040) [trial-2393↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24040)] [trial-2393↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 19:45:29.113414 tst assert_extension.py:12: Test FAILED (3.2 sec) 19:45:29.120364 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24039): Terminating (SIGTERM) 19:45:29.332259 --- ParallelTerminationStrategy: PID 24039 died... 19:45:29.353663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24039): Terminated: ok {rc=0} 19:45:29.442503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 ussd:nanobts+band-900 --------------------------------------------------------------------- 19:45:30.619039 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:30.624221 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:45:30.658173 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:45:30.686002 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 19:45:30.724655 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:45:30.757759 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:45:30.784364 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 19:45:31.318888 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 19:45:31.324938 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.336356 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 19:45:31.382823 tst assert_extension.py: using LAC 35852 19:45:31.501147 tst assert_extension.py: using RAC 152 19:45:31.623492 tst assert_extension.py: using CellId 35852 19:45:31.748836 tst assert_extension.py: using BVCI 35853 19:45:31.869139 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.881400 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.893580 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.906788 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.920222 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:45:31.933497 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 19:45:32.055750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:32.560838 run create_hlr_db(pid=24046): Launched 19:45:32.683496 bus /sierra_2: Setting Powered False 19:45:33.745921 run create_hlr_db(pid=24046): Terminated: ok {rc=0} 19:45:34.167943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24048): Launched 19:45:34.462122 run osmo-hlr_10.42.42.2(pid=24049): Launched 19:45:34.574966 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:35.084653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24051): Launched 19:45:35.379441 run osmo-stp_10.42.42.5(pid=24052): Launched 19:45:35.491030 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:36.021232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24054): Launched 19:45:36.315115 run osmo-msc_10.42.42.6(pid=24055): Launched 19:45:36.478797 run osmo-stp_10.42.42.5(pid=24052): ERR: Terminated: ERROR {rc=1} [trial-2393↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24052)] 19:45:36.603521 run osmo-stp_10.42.42.5(pid=24052): stdout: | (launched: 2022-12-13_19:45:35.324579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:36.727755 run osmo-stp_10.42.42.5(pid=24052): stderr: | 20221213194535491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194535492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194535492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194535492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194535493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194535493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194535493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:36.850650 run osmo-stp_10.42.42.5(pid=24052): stdout: | (launched: 2022-12-13_19:45:35.324579) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:36.968249 run osmo-stp_10.42.42.5(pid=24052): stderr: | 20221213194535491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194535492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194535492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194535492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194535493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194535493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194535493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:37.109154 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24052): Process ended prematurely: osmo-stp_10.42.42.5(pid=24052) [trial-2393↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24052)] [trial-2393↪ussd:nanobts+band-900↪assert_extension.py:17] 19:45:37.117471 tst assert_extension.py:17: Test FAILED (5.8 sec) 19:45:37.143480 run osmo-hlr_10.42.42.2(pid=24049): ERR: Terminated: ERROR {rc=237} [trial-2393↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24049)] 19:45:37.191204 run osmo-hlr_10.42.42.2(pid=24049): stdout: | (launched: 2022-12-13_19:45:34.407598) 19:45:37.240567 run osmo-hlr_10.42.42.2(pid=24049): stderr: | 20221213194534578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194534578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194534578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194534578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194534578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194534578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194534592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194534602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194534603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194534603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:37.309364 run osmo-msc_10.42.42.6(pid=24055): ERR: Terminated: ERROR {rc=2} [trial-2393↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24055)] 19:45:37.356796 run osmo-msc_10.42.42.6(pid=24055): stdout: | (launched: 2022-12-13_19:45:36.260496) 19:45:37.405718 run osmo-msc_10.42.42.6(pid=24055): stderr: | 20221213194536530 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194536531 DLGLOBAL DEBUG validating counter group 0x7f951ec29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194536531 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194536531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194536531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194536531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194536533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194536533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194536534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194536534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:37.455006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24048): Terminating (SIGTERM) 19:45:37.494628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24051): Terminating (SIGTERM) 19:45:37.534381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24054): Terminating (SIGTERM) 19:45:37.574624 --- ParallelTerminationStrategy: PID 24048 died... 19:45:37.593897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24048): Terminated: ok {rc=0} 19:45:37.638036 --- ParallelTerminationStrategy: PID 24051 died... 19:45:37.656649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24051): Terminated: ok {rc=0} 19:45:37.700534 --- ParallelTerminationStrategy: PID 24054 died... 19:45:37.719046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24054): Terminated: ok {rc=0} 19:45:37.803903 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 19:45:39.018380 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:45:39.026270 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 19:45:39.060087 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 19:45:39.088173 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 19:45:39.141650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 19:45:39.175101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 19:45:39.202890 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 19:45:39.756294 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 19:45:39.808943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:39.820705 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:45:39.889430 tst mo_mt_call.py: using LAC 35853 19:45:40.007838 tst mo_mt_call.py: using RAC 153 19:45:40.127459 tst mo_mt_call.py: using CellId 35853 19:45:40.247403 tst mo_mt_call.py: using BVCI 35854 19:45:40.357491 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:40.368711 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:40.379784 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:40.390748 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:40.402473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:40.413660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:40.533560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:40.654069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:41.153428 run create_hlr_db(pid=24060): Launched 19:45:41.275485 bus /sierra_2: Setting Powered False 19:45:42.339240 run create_hlr_db(pid=24060): Terminated: ok {rc=0} 19:45:42.768902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24062): Launched 19:45:43.092412 run osmo-hlr_10.42.42.2(pid=24063): Launched 19:45:43.215456 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:43.771422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24065): Launched 19:45:44.094319 run osmo-stp_10.42.42.5(pid=24066): Launched 19:45:44.217285 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:44.799334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Launched 19:45:45.122375 run osmo-msc_10.42.42.6(pid=24070): Launched 19:45:45.301448 run osmo-stp_10.42.42.5(pid=24066): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24066)] 19:45:45.437443 run osmo-stp_10.42.42.5(pid=24066): stdout: | (launched: 2022-12-13_19:45:44.035092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:45.573394 run osmo-stp_10.42.42.5(pid=24066): stderr: | 20221213194544222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194544223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194544223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194544223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194544224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194544224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194544224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:45.708725 run osmo-stp_10.42.42.5(pid=24066): stdout: | (launched: 2022-12-13_19:45:44.035092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:45.842997 run osmo-stp_10.42.42.5(pid=24066): stderr: | 20221213194544222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194544223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194544223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194544223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194544224 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194544224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194544224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:46.009524 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24066): Process ended prematurely: osmo-stp_10.42.42.5(pid=24066) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24066)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 19:45:46.020127 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:45:46.050209 run osmo-hlr_10.42.42.2(pid=24063): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24063)] 19:45:46.103651 run osmo-hlr_10.42.42.2(pid=24063): stdout: | (launched: 2022-12-13_19:45:43.032808) 19:45:46.157694 run osmo-hlr_10.42.42.2(pid=24063): stderr: | 20221213194543228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194543228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194543228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194543229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194543229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194543229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194543241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194543250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194543250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194543250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:46.232761 run osmo-msc_10.42.42.6(pid=24070): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24070)] 19:45:46.285815 run osmo-msc_10.42.42.6(pid=24070): stdout: | (launched: 2022-12-13_19:45:45.063561) 19:45:46.339788 run osmo-msc_10.42.42.6(pid=24070): stderr: | 20221213194545379 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194545379 DLGLOBAL DEBUG validating counter group 0x7f7127a87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194545379 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194545379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194545380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194545380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194545382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194545382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194545382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194545382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:46.394499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24062): Terminating (SIGTERM) 19:45:46.437660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24065): Terminating (SIGTERM) 19:45:46.482947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Terminating (SIGTERM) 19:45:46.527928 --- ParallelTerminationStrategy: PID 24062 died... 19:45:46.549755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24062): Terminated: ok {rc=0} 19:45:46.600206 --- ParallelTerminationStrategy: PID 24065 died... 19:45:46.620746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24065): Terminated: ok {rc=0} 19:45:46.670097 --- ParallelTerminationStrategy: PID 24069 died... 19:45:46.690652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24069): Terminated: ok {rc=0} 19:45:46.782347 bus /sierra_3: Setting Powered False 19:45:47.881372 bus /sierra_3: Setting Powered False 19:45:48.999790 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 19:45:50.143804 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.155581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 19:45:50.222495 tst mo_mt_call_osmux.py: using LAC 35854 19:45:50.339384 tst mo_mt_call_osmux.py: using RAC 154 19:45:50.460213 tst mo_mt_call_osmux.py: using CellId 35854 19:45:50.577762 tst mo_mt_call_osmux.py: using BVCI 35855 19:45:50.686647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.697953 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.708940 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.720004 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.731109 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 19:45:50.742064 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:50.861265 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 19:45:50.977729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:45:51.441413 run create_hlr_db(pid=24072): Launched 19:45:51.562897 bus /sierra_2: Setting Powered False 19:45:52.623424 run create_hlr_db(pid=24072): Terminated: ok {rc=0} 19:45:53.041050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Launched 19:45:53.341626 run osmo-hlr_10.42.42.2(pid=24075): Launched 19:45:53.454551 run osmo-stp_10.42.42.5: Starting osmo-stp 19:45:53.968346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Launched 19:45:54.268818 run osmo-stp_10.42.42.5(pid=24078): Launched 19:45:54.382886 run osmo-msc_10.42.42.6: Starting osmo-msc 19:45:54.925273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Launched 19:45:55.225244 run osmo-msc_10.42.42.6(pid=24081): Launched 19:45:55.392557 run osmo-stp_10.42.42.5(pid=24078): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] 19:45:55.519254 run osmo-stp_10.42.42.5(pid=24078): stdout: | (launched: 2022-12-13_19:45:54.212825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:55.645894 run osmo-stp_10.42.42.5(pid=24078): stderr: | 20221213194554378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194554378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194554378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194554379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194554379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194554379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194554379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:55.770825 run osmo-stp_10.42.42.5(pid=24078): stdout: | (launched: 2022-12-13_19:45:54.212825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:45:55.890559 run osmo-stp_10.42.42.5(pid=24078): stderr: | 20221213194554378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194554378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194554378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194554379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194554379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194554379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194554379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:45:56.033956 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24078): Process ended prematurely: osmo-stp_10.42.42.5(pid=24078) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 19:45:56.042596 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 19:45:56.068581 run osmo-hlr_10.42.42.2(pid=24075): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24075)] 19:45:56.116103 run osmo-hlr_10.42.42.2(pid=24075): stdout: | (launched: 2022-12-13_19:45:53.286145) 19:45:56.165178 run osmo-hlr_10.42.42.2(pid=24075): stderr: | 20221213194553459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194553459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194553459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194553459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194553459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194553459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194553472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194553482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194553483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194553483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:45:56.233784 run osmo-msc_10.42.42.6(pid=24081): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24081)] 19:45:56.280899 run osmo-msc_10.42.42.6(pid=24081): stdout: | (launched: 2022-12-13_19:45:55.169721) 19:45:56.329640 run osmo-msc_10.42.42.6(pid=24081): stderr: | 20221213194555437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194555437 DLGLOBAL DEBUG validating counter group 0x7f3296cb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194555438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194555438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194555438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194555438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194555440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194555440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194555440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194555440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:45:56.379013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Terminating (SIGTERM) 19:45:56.418452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Terminating (SIGTERM) 19:45:56.457722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Terminating (SIGTERM) 19:45:56.497240 --- ParallelTerminationStrategy: PID 24074 died... 19:45:56.516245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24074): Terminated: ok {rc=0} 19:45:56.559972 --- ParallelTerminationStrategy: PID 24077 died... 19:45:56.578564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24077): Terminated: ok {rc=0} 19:45:56.622155 --- ParallelTerminationStrategy: PID 24080 died... 19:45:56.640787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24080): Terminated: ok {rc=0} 19:45:56.726800 bus /sierra_3: Setting Powered False 19:45:57.826623 bus /sierra_3: Setting Powered False 19:45:58.945320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 19:46:00.202201 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:00.210538 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 19:46:00.244540 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 19:46:00.272347 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 19:46:00.325502 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 19:46:00.358644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 19:46:00.386147 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 19:46:00.949404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 19:46:01.006076 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.018354 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:46:01.090284 tst mo_mt_call.py: using LAC 35855 19:46:01.259596 tst mo_mt_call.py: using RAC 155 19:46:01.387598 tst mo_mt_call.py: using CellId 35855 19:46:01.520345 tst mo_mt_call.py: using BVCI 35856 19:46:01.633554 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.645924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.658535 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.673281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.686607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:01.699677 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:46:01.820142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:46:01.941606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:02.425774 run create_hlr_db(pid=24086): Launched 19:46:02.548169 bus /sierra_2: Setting Powered False 19:46:03.608529 run create_hlr_db(pid=24086): Terminated: ok {rc=0} 19:46:04.048697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Launched 19:46:04.372719 run osmo-hlr_10.42.42.2(pid=24089): Launched 19:46:04.495503 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:05.053792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Launched 19:46:05.377572 run osmo-stp_10.42.42.5(pid=24092): Launched 19:46:05.499350 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:06.081393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Launched 19:46:06.403482 run osmo-msc_10.42.42.6(pid=24095): Launched 19:46:06.583088 run osmo-stp_10.42.42.5(pid=24092): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] 19:46:06.718630 run osmo-stp_10.42.42.5(pid=24092): stdout: | (launched: 2022-12-13_19:46:05.318502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:06.854586 run osmo-stp_10.42.42.5(pid=24092): stderr: | 20221213194605508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194605508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194605508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194605509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194605509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194605509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194605509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:06.989581 run osmo-stp_10.42.42.5(pid=24092): stdout: | (launched: 2022-12-13_19:46:05.318502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:07.119574 run osmo-stp_10.42.42.5(pid=24092): stderr: | 20221213194605508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194605508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194605508 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194605509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194605509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194605509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194605509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:07.274324 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24092): Process ended prematurely: osmo-stp_10.42.42.5(pid=24092) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 19:46:07.283776 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:46:07.311627 run osmo-hlr_10.42.42.2(pid=24089): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24089)] 19:46:07.362609 run osmo-hlr_10.42.42.2(pid=24089): stdout: | (launched: 2022-12-13_19:46:04.313945) 19:46:07.414525 run osmo-hlr_10.42.42.2(pid=24089): stderr: | 20221213194604509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194604509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194604509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194604509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194604509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194604510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194604522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194604530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194604530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194604531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:07.487010 run osmo-msc_10.42.42.6(pid=24095): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24095)] 19:46:07.537272 run osmo-msc_10.42.42.6(pid=24095): stdout: | (launched: 2022-12-13_19:46:06.344846) 19:46:07.589061 run osmo-msc_10.42.42.6(pid=24095): stderr: | 20221213194606662 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194606663 DLGLOBAL DEBUG validating counter group 0x7fc628213c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194606663 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194606663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194606663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194606663 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194606665 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194606665 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194606665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194606666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:07.641231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Terminating (SIGTERM) 19:46:07.683034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Terminating (SIGTERM) 19:46:07.725214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Terminating (SIGTERM) 19:46:07.767535 --- ParallelTerminationStrategy: PID 24088 died... 19:46:07.787939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24088): Terminated: ok {rc=0} 19:46:07.834671 --- ParallelTerminationStrategy: PID 24091 died... 19:46:07.854510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24091): Terminated: ok {rc=0} 19:46:07.901060 --- ParallelTerminationStrategy: PID 24094 died... 19:46:07.921174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24094): Terminated: ok {rc=0} 19:46:08.008841 bus /sierra_3: Setting Powered False 19:46:09.105032 bus /sierra_3: Setting Powered False 19:46:10.219753 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 19:46:11.370621 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.382843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 19:46:11.451907 tst mo_mt_call_osmux.py: using LAC 35856 19:46:11.577644 tst mo_mt_call_osmux.py: using RAC 156 19:46:11.705984 tst mo_mt_call_osmux.py: using CellId 35856 19:46:11.825146 tst mo_mt_call_osmux.py: using BVCI 35857 19:46:11.934386 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.945794 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.957167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.968301 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.980113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 19:46:11.991875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:46:12.107946 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 19:46:12.227901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:12.729056 run create_hlr_db(pid=24097): Launched 19:46:12.854104 bus /sierra_2: Setting Powered False 19:46:13.918660 run create_hlr_db(pid=24097): Terminated: ok {rc=0} 19:46:14.350198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Launched 19:46:14.650825 run osmo-hlr_10.42.42.2(pid=24100): Launched 19:46:14.768234 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:15.302137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Launched 19:46:15.602571 run osmo-stp_10.42.42.5(pid=24103): Launched 19:46:15.718306 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:16.276421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Launched 19:46:16.593793 run osmo-msc_10.42.42.6(pid=24106): Launched 19:46:16.892028 run osmo-stp_10.42.42.5(pid=24103): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] 19:46:17.175418 run osmo-stp_10.42.42.5(pid=24103): stdout: | (launched: 2022-12-13_19:46:15.546725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:17.383774 run osmo-stp_10.42.42.5(pid=24103): stderr: | 20221213194615713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194615713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194615713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194615714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194615714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194615714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194615714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:17.519445 run osmo-stp_10.42.42.5(pid=24103): stdout: | (launched: 2022-12-13_19:46:15.546725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:17.649765 run osmo-stp_10.42.42.5(pid=24103): stderr: | 20221213194615713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194615713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194615713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194615714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194615714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194615714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194615714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:17.805549 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24103): Process ended prematurely: osmo-stp_10.42.42.5(pid=24103) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 19:46:17.815431 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 19:46:17.843420 run osmo-hlr_10.42.42.2(pid=24100): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24100)] 19:46:17.894588 run osmo-hlr_10.42.42.2(pid=24100): stdout: | (launched: 2022-12-13_19:46:14.595414) 19:46:17.946671 run osmo-hlr_10.42.42.2(pid=24100): stderr: | 20221213194614767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194614767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194614767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194614767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194614767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194614768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194614780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194614788 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194614788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194614789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:18.019459 run osmo-msc_10.42.42.6(pid=24106): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24106)] 19:46:18.070334 run osmo-msc_10.42.42.6(pid=24106): stdout: | (launched: 2022-12-13_19:46:16.537491) 19:46:18.122609 run osmo-msc_10.42.42.6(pid=24106): stderr: | 20221213194617056 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194617056 DLGLOBAL DEBUG validating counter group 0x7f3eec251c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194617056 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194617056 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194617057 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194617057 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194617058 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194617059 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194617059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194617059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:18.174980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Terminating (SIGTERM) 19:46:18.216734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Terminating (SIGTERM) 19:46:18.259009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Terminating (SIGTERM) 19:46:18.301550 --- ParallelTerminationStrategy: PID 24099 died... 19:46:18.322221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24099): Terminated: ok {rc=0} 19:46:18.369260 --- ParallelTerminationStrategy: PID 24102 died... 19:46:18.389355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24102): Terminated: ok {rc=0} 19:46:18.436148 --- ParallelTerminationStrategy: PID 24105 died... 19:46:18.456099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24105): Terminated: ok {rc=0} 19:46:18.544320 bus /sierra_3: Setting Powered False 19:46:19.642371 bus /sierra_3: Setting Powered False 19:46:20.755897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 19:46:22.008644 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:22.016815 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 19:46:22.051317 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 19:46:22.079221 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 19:46:22.132607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 19:46:22.166228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 19:46:22.194202 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 19:46:22.746998 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 19:46:22.799134 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:22.811268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:46:22.880308 tst mo_mt_call.py: using LAC 35857 19:46:23.008499 tst mo_mt_call.py: using RAC 157 19:46:23.127730 tst mo_mt_call.py: using CellId 35857 19:46:23.247056 tst mo_mt_call.py: using BVCI 35858 19:46:23.356690 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:23.368108 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:23.379390 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:23.390461 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:23.401571 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:23.412565 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:23.526385 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:23.647296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:24.115460 run create_hlr_db(pid=24111): Launched 19:46:24.237490 bus /sierra_2: Setting Powered False 19:46:25.297946 run create_hlr_db(pid=24111): Terminated: ok {rc=0} 19:46:25.737525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Launched 19:46:26.061872 run osmo-hlr_10.42.42.2(pid=24114): Launched 19:46:26.184670 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:26.741081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Launched 19:46:27.065961 run osmo-stp_10.42.42.5(pid=24117): Launched 19:46:27.191348 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:27.774378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Launched 19:46:28.099345 run osmo-msc_10.42.42.6(pid=24120): Launched 19:46:28.281258 run osmo-stp_10.42.42.5(pid=24117): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] 19:46:28.417623 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-13_19:46:27.007192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:28.554404 run osmo-stp_10.42.42.5(pid=24117): stderr: | 20221213194627194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194627194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194627194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194627195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194627195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194627195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194627195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:28.689539 run osmo-stp_10.42.42.5(pid=24117): stdout: | (launched: 2022-12-13_19:46:27.007192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:28.819019 run osmo-stp_10.42.42.5(pid=24117): stderr: | 20221213194627194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194627194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194627194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194627195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194627195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194627195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194627195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:28.974454 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 19:46:28.983837 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 19:46:29.011755 run osmo-hlr_10.42.42.2(pid=24114): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24114)] 19:46:29.063754 run osmo-hlr_10.42.42.2(pid=24114): stdout: | (launched: 2022-12-13_19:46:26.002378) 19:46:29.116143 run osmo-hlr_10.42.42.2(pid=24114): stderr: | 20221213194626196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194626196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194626196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194626196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194626196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194626196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194626210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194626218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194626218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194626219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:29.188666 run osmo-msc_10.42.42.6(pid=24120): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24120)] 19:46:29.239370 run osmo-msc_10.42.42.6(pid=24120): stdout: | (launched: 2022-12-13_19:46:28.039830) 19:46:29.291160 run osmo-msc_10.42.42.6(pid=24120): stderr: | 20221213194628357 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194628357 DLGLOBAL DEBUG validating counter group 0x7f7d54e00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194628357 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194628357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194628357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194628358 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194628359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194628360 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194628360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194628360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:29.343504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminating (SIGTERM) 19:46:29.384821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminating (SIGTERM) 19:46:29.426823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminating (SIGTERM) 19:46:29.468799 --- ParallelTerminationStrategy: PID 24113 died... 19:46:29.489089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24113): Terminated: ok {rc=0} 19:46:29.535161 --- ParallelTerminationStrategy: PID 24116 died... 19:46:29.554898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24116): Terminated: ok {rc=0} 19:46:29.600895 --- ParallelTerminationStrategy: PID 24119 died... 19:46:29.620546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24119): Terminated: ok {rc=0} 19:46:29.708010 bus /sierra_3: Setting Powered False 19:46:30.806563 bus /sierra_3: Setting Powered False 19:46:31.932704 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 19:46:33.076250 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.088180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 19:46:33.155242 tst mo_mt_call_osmux.py: using LAC 35858 19:46:33.272540 tst mo_mt_call_osmux.py: using RAC 158 19:46:33.390987 tst mo_mt_call_osmux.py: using CellId 35858 19:46:33.510738 tst mo_mt_call_osmux.py: using BVCI 35859 19:46:33.621481 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.632805 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.643932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.654929 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.666085 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 19:46:33.677147 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:33.795290 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 19:46:33.918893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:34.421598 run create_hlr_db(pid=24122): Launched 19:46:34.545203 bus /sierra_2: Setting Powered False 19:46:35.609198 run create_hlr_db(pid=24122): Terminated: ok {rc=0} 19:46:36.040605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Launched 19:46:36.341341 run osmo-hlr_10.42.42.2(pid=24125): Launched 19:46:36.456172 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:36.973867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Launched 19:46:37.274463 run osmo-stp_10.42.42.5(pid=24128): Launched 19:46:37.388277 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:37.929882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Launched 19:46:38.230208 run osmo-msc_10.42.42.6(pid=24131): Launched 19:46:38.398217 run osmo-stp_10.42.42.5(pid=24128): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] 19:46:38.525216 run osmo-stp_10.42.42.5(pid=24128): stdout: | (launched: 2022-12-13_19:46:37.219092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:38.651815 run osmo-stp_10.42.42.5(pid=24128): stderr: | 20221213194637385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194637385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194637385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194637386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194637386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194637386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194637386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:38.776822 run osmo-stp_10.42.42.5(pid=24128): stdout: | (launched: 2022-12-13_19:46:37.219092) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:38.896667 run osmo-stp_10.42.42.5(pid=24128): stderr: | 20221213194637385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194637385 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194637385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194637386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194637386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194637386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194637386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:39.040849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24128): Process ended prematurely: osmo-stp_10.42.42.5(pid=24128) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 19:46:39.049805 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:46:39.075859 run osmo-hlr_10.42.42.2(pid=24125): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24125)] 19:46:39.123228 run osmo-hlr_10.42.42.2(pid=24125): stdout: | (launched: 2022-12-13_19:46:36.285786) 19:46:39.172156 run osmo-hlr_10.42.42.2(pid=24125): stderr: | 20221213194636457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194636457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194636457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194636457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194636457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194636457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194636469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194636477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194636477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194636477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:39.240686 run osmo-msc_10.42.42.6(pid=24131): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24131)] 19:46:39.287928 run osmo-msc_10.42.42.6(pid=24131): stdout: | (launched: 2022-12-13_19:46:38.174478) 19:46:39.336322 run osmo-msc_10.42.42.6(pid=24131): stderr: | 20221213194638442 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194638442 DLGLOBAL DEBUG validating counter group 0x7f86928d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194638442 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194638443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194638443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194638443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194638445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194638445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194638445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194638445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:39.385130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Terminating (SIGTERM) 19:46:39.424313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Terminating (SIGTERM) 19:46:39.463414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Terminating (SIGTERM) 19:46:39.502887 --- ParallelTerminationStrategy: PID 24124 died... 19:46:39.521744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24124): Terminated: ok {rc=0} 19:46:39.565144 --- ParallelTerminationStrategy: PID 24127 died... 19:46:39.583493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24127): Terminated: ok {rc=0} 19:46:39.626899 --- ParallelTerminationStrategy: PID 24130 died... 19:46:39.645424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24130): Terminated: ok {rc=0} 19:46:39.727764 bus /sierra_3: Setting Powered False 19:46:40.822710 bus /sierra_3: Setting Powered False 19:46:41.936362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 19:46:43.189950 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:46:43.197837 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 19:46:43.231181 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 19:46:43.259549 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 19:46:43.313854 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 19:46:43.347683 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 19:46:43.375297 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 19:46:43.926559 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 19:46:43.978502 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:43.990357 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:46:44.058697 tst mo_mt_call.py: using LAC 35859 19:46:44.184146 tst mo_mt_call.py: using RAC 159 19:46:44.314722 tst mo_mt_call.py: using CellId 35859 19:46:44.442538 tst mo_mt_call.py: using BVCI 35860 19:46:44.559736 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:44.571506 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:44.583078 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:44.594602 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:44.606610 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:44.618498 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:44.734073 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:44.854235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:45.354437 run create_hlr_db(pid=24136): Launched 19:46:45.479180 bus /sierra_2: Setting Powered False 19:46:46.550559 run create_hlr_db(pid=24136): Terminated: ok {rc=0} 19:46:47.097872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Launched 19:46:47.434713 run osmo-hlr_10.42.42.2(pid=24139): Launched 19:46:47.561376 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:48.119370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Launched 19:46:48.424801 run osmo-stp_10.42.42.5(pid=24142): Launched 19:46:48.538919 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:49.082184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Launched 19:46:49.383485 run osmo-msc_10.42.42.6(pid=24145): Launched 19:46:49.552350 run osmo-stp_10.42.42.5(pid=24142): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] 19:46:49.679339 run osmo-stp_10.42.42.5(pid=24142): stdout: | (launched: 2022-12-13_19:46:48.369171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:49.806029 run osmo-stp_10.42.42.5(pid=24142): stderr: | 20221213194648536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194648537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194648537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194648537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194648538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194648538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194648538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:49.931072 run osmo-stp_10.42.42.5(pid=24142): stdout: | (launched: 2022-12-13_19:46:48.369171) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:50.051368 run osmo-stp_10.42.42.5(pid=24142): stderr: | 20221213194648536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194648537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194648537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194648537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194648538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194648538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194648538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:46:50.194863 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24142): Process ended prematurely: osmo-stp_10.42.42.5(pid=24142) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 19:46:50.203722 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:46:50.230075 run osmo-hlr_10.42.42.2(pid=24139): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24139)] 19:46:50.277576 run osmo-hlr_10.42.42.2(pid=24139): stdout: | (launched: 2022-12-13_19:46:47.375832) 19:46:50.326700 run osmo-hlr_10.42.42.2(pid=24139): stderr: | 20221213194647568 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194647568 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194647568 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194647568 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194647568 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194647568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194647583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194647593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194647593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194647594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:46:50.395084 run osmo-msc_10.42.42.6(pid=24145): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24145)] 19:46:50.442101 run osmo-msc_10.42.42.6(pid=24145): stdout: | (launched: 2022-12-13_19:46:49.327988) 19:46:50.490667 run osmo-msc_10.42.42.6(pid=24145): stderr: | 20221213194649597 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194649598 DLGLOBAL DEBUG validating counter group 0x7f1f5a65ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194649598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194649598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194649598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194649599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194649601 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194649601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194649601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194649602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:46:50.539559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Terminating (SIGTERM) 19:46:50.578963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Terminating (SIGTERM) 19:46:50.618265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Terminating (SIGTERM) 19:46:50.657910 --- ParallelTerminationStrategy: PID 24138 died... 19:46:50.677062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24138): Terminated: ok {rc=0} 19:46:50.720763 --- ParallelTerminationStrategy: PID 24141 died... 19:46:50.739517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24141): Terminated: ok {rc=0} 19:46:50.783568 --- ParallelTerminationStrategy: PID 24144 died... 19:46:50.802163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24144): Terminated: ok {rc=0} 19:46:50.884696 bus /sierra_3: Setting Powered False 19:46:51.982268 bus /sierra_3: Setting Powered False 19:46:53.097756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 19:46:54.240534 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.252452 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 19:46:54.322109 tst mo_mt_call_osmux.py: using LAC 35860 19:46:54.439562 tst mo_mt_call_osmux.py: using RAC 160 19:46:54.555026 tst mo_mt_call_osmux.py: using CellId 35860 19:46:54.672490 tst mo_mt_call_osmux.py: using BVCI 35861 19:46:54.780790 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.792113 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.803095 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.814124 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.825267 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 19:46:54.836198 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:54.955190 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 19:46:55.075446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:46:55.577344 run create_hlr_db(pid=24147): Launched 19:46:55.703429 bus /sierra_2: Setting Powered False 19:46:56.766699 run create_hlr_db(pid=24147): Terminated: ok {rc=0} 19:46:57.198088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Launched 19:46:57.499001 run osmo-hlr_10.42.42.2(pid=24150): Launched 19:46:57.612839 run osmo-stp_10.42.42.5: Starting osmo-stp 19:46:58.142601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Launched 19:46:58.443358 run osmo-stp_10.42.42.5(pid=24153): Launched 19:46:58.558739 run osmo-msc_10.42.42.6: Starting osmo-msc 19:46:59.101602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Launched 19:46:59.403198 run osmo-msc_10.42.42.6(pid=24156): Launched 19:46:59.585742 run osmo-stp_10.42.42.5(pid=24153): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] 19:46:59.724868 run osmo-stp_10.42.42.5(pid=24153): stdout: | (launched: 2022-12-13_19:46:58.387703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:46:59.867214 run osmo-stp_10.42.42.5(pid=24153): stderr: | 20221213194658553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194658553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194658553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194658554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194658554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194658554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194658554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:00.002506 run osmo-stp_10.42.42.5(pid=24153): stdout: | (launched: 2022-12-13_19:46:58.387703) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:00.133048 run osmo-stp_10.42.42.5(pid=24153): stderr: | 20221213194658553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194658553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194658553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194658554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194658554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194658554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194658554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:00.288214 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24153): Process ended prematurely: osmo-stp_10.42.42.5(pid=24153) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 19:47:00.298044 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 19:47:00.325832 run osmo-hlr_10.42.42.2(pid=24150): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24150)] 19:47:00.377199 run osmo-hlr_10.42.42.2(pid=24150): stdout: | (launched: 2022-12-13_19:46:57.442925) 19:47:00.429482 run osmo-hlr_10.42.42.2(pid=24150): stderr: | 20221213194657617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194657617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194657617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194657618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194657618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194657618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194657630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194657638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194657639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194657639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:00.502226 run osmo-msc_10.42.42.6(pid=24156): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24156)] 19:47:00.552397 run osmo-msc_10.42.42.6(pid=24156): stdout: | (launched: 2022-12-13_19:46:59.346506) 19:47:00.604477 run osmo-msc_10.42.42.6(pid=24156): stderr: | 20221213194659658 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194659658 DLGLOBAL DEBUG validating counter group 0x7f20a9526c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194659658 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194659658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194659658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194659658 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194659660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194659660 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194659660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194659661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:00.656865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Terminating (SIGTERM) 19:47:00.698729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Terminating (SIGTERM) 19:47:00.740926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Terminating (SIGTERM) 19:47:00.783439 --- ParallelTerminationStrategy: PID 24149 died... 19:47:00.804165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Terminated: ok {rc=0} 19:47:00.864901 --- ParallelTerminationStrategy: PID 24152 died... 19:47:00.890186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Terminated: ok {rc=0} 19:47:00.939751 --- ParallelTerminationStrategy: PID 24155 died... 19:47:00.960096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Terminated: ok {rc=0} 19:47:01.049124 bus /sierra_3: Setting Powered False 19:47:02.153932 bus /sierra_3: Setting Powered False 19:47:03.271229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 19:47:04.520315 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:04.527635 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:47:04.559751 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 19:47:04.586824 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:47:04.639894 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:47:04.673800 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 19:47:04.702060 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:47:05.254262 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 19:47:05.307069 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.319218 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:47:05.388783 tst mo_mt_call.py: using LAC 35861 19:47:05.517925 tst mo_mt_call.py: using RAC 161 19:47:05.644129 tst mo_mt_call.py: using CellId 35861 19:47:05.768375 tst mo_mt_call.py: using BVCI 35862 19:47:05.886858 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.898818 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.910592 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.922357 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.934751 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:05.946930 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:06.063637 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:06.186232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:06.687241 run create_hlr_db(pid=24162): Launched 19:47:06.812006 bus /sierra_2: Setting Powered False 19:47:07.875550 run create_hlr_db(pid=24162): Terminated: ok {rc=0} 19:47:08.307030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Launched 19:47:08.608230 run osmo-hlr_10.42.42.2(pid=24165): Launched 19:47:08.723190 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:09.241489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Launched 19:47:09.542296 run osmo-stp_10.42.42.5(pid=24168): Launched 19:47:09.656190 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:10.200387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Launched 19:47:10.499716 run osmo-msc_10.42.42.6(pid=24171): Launched 19:47:10.667251 run osmo-stp_10.42.42.5(pid=24168): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] 19:47:10.794226 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-13_19:47:09.486290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:10.921814 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221213194709654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194709655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194709655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194709655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194709656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194709656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194709656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:11.046571 run osmo-stp_10.42.42.5(pid=24168): stdout: | (launched: 2022-12-13_19:47:09.486290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:11.166755 run osmo-stp_10.42.42.5(pid=24168): stderr: | 20221213194709654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194709655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194709655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194709655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194709656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194709656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194709656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:11.310453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 19:47:11.319325 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 19:47:11.345464 run osmo-hlr_10.42.42.2(pid=24165): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24165)] 19:47:11.393150 run osmo-hlr_10.42.42.2(pid=24165): stdout: | (launched: 2022-12-13_19:47:08.552651) 19:47:11.442421 run osmo-hlr_10.42.42.2(pid=24165): stderr: | 20221213194708724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194708725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194708725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194708725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194708725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194708725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194708761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194708771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194708771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194708771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:11.511351 run osmo-msc_10.42.42.6(pid=24171): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24171)] 19:47:11.558725 run osmo-msc_10.42.42.6(pid=24171): stdout: | (launched: 2022-12-13_19:47:10.444301) 19:47:11.607773 run osmo-msc_10.42.42.6(pid=24171): stderr: | 20221213194710714 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194710715 DLGLOBAL DEBUG validating counter group 0x7f8eb9dd2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194710715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194710715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194710715 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194710715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194710717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194710717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194710718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194710718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:11.657214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminating (SIGTERM) 19:47:11.697156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminating (SIGTERM) 19:47:11.737327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Terminating (SIGTERM) 19:47:11.777736 --- ParallelTerminationStrategy: PID 24164 died... 19:47:11.796828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24164): Terminated: ok {rc=0} 19:47:11.840858 --- ParallelTerminationStrategy: PID 24167 died... 19:47:11.859592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24167): Terminated: ok {rc=0} 19:47:11.903498 --- ParallelTerminationStrategy: PID 24170 died... 19:47:11.922136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24170): Terminated: ok {rc=0} 19:47:12.007587 bus /sierra_3: Setting Powered False 19:47:13.107308 bus /sierra_3: Setting Powered False 19:47:14.221213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 19:47:15.366579 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.378500 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:47:15.445913 tst mo_mt_call_osmux.py: using LAC 35862 19:47:15.565127 tst mo_mt_call_osmux.py: using RAC 162 19:47:15.682709 tst mo_mt_call_osmux.py: using CellId 35862 19:47:15.801784 tst mo_mt_call_osmux.py: using BVCI 35863 19:47:15.925110 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.937207 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.949113 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.961433 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.974060 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 19:47:15.986620 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:16.106298 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:47:16.244352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:16.751181 run create_hlr_db(pid=24173): Launched 19:47:16.913451 bus /sierra_2: Setting Powered False 19:47:17.977206 run create_hlr_db(pid=24173): Terminated: ok {rc=0} 19:47:18.479339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Launched 19:47:18.778951 run osmo-hlr_10.42.42.2(pid=24176): Launched 19:47:18.892500 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:19.411015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Launched 19:47:19.710780 run osmo-stp_10.42.42.5(pid=24179): Launched 19:47:19.824041 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:20.365684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24181): Launched 19:47:20.664595 run osmo-msc_10.42.42.6(pid=24182): Launched 19:47:20.833683 run osmo-stp_10.42.42.5(pid=24179): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] 19:47:20.961443 run osmo-stp_10.42.42.5(pid=24179): stdout: | (launched: 2022-12-13_19:47:19.655736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:21.087995 run osmo-stp_10.42.42.5(pid=24179): stderr: | 20221213194719823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194719823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194719823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194719824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194719824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194719824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194719824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:21.213149 run osmo-stp_10.42.42.5(pid=24179): stdout: | (launched: 2022-12-13_19:47:19.655736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:21.333338 run osmo-stp_10.42.42.5(pid=24179): stderr: | 20221213194719823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194719823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194719823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194719824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194719824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194719824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194719824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:21.476862 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24179): Process ended prematurely: osmo-stp_10.42.42.5(pid=24179) [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 19:47:21.485778 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 19:47:21.511982 run osmo-hlr_10.42.42.2(pid=24176): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24176)] 19:47:21.559100 run osmo-hlr_10.42.42.2(pid=24176): stdout: | (launched: 2022-12-13_19:47:18.723594) 19:47:21.607911 run osmo-hlr_10.42.42.2(pid=24176): stderr: | 20221213194718897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194718897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194718897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194718897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194718897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194718897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194718914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194718925 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194718926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194718926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:21.676535 run osmo-msc_10.42.42.6(pid=24182): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24182)] 19:47:21.723683 run osmo-msc_10.42.42.6(pid=24182): stdout: | (launched: 2022-12-13_19:47:20.609333) 19:47:21.772314 run osmo-msc_10.42.42.6(pid=24182): stderr: | 20221213194720878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194720878 DLGLOBAL DEBUG validating counter group 0x7f2f5d3b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194720879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194720879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194720879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194720879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194720881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194720881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194720881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194720881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:21.821516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Terminating (SIGTERM) 19:47:21.860553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Terminating (SIGTERM) 19:47:21.899603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24181): Terminating (SIGTERM) 19:47:21.939656 --- ParallelTerminationStrategy: PID 24175 died... 19:47:21.958659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24175): Terminated: ok {rc=0} 19:47:22.002225 --- ParallelTerminationStrategy: PID 24178 died... 19:47:22.020597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24178): Terminated: ok {rc=0} 19:47:22.064631 --- ParallelTerminationStrategy: PID 24181 died... 19:47:22.083298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24181): Terminated: ok {rc=0} 19:47:22.167426 bus /sierra_3: Setting Powered False 19:47:23.265187 bus /sierra_3: Setting Powered False 19:47:24.376092 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:47:25.620712 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:25.627471 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:47:25.659616 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 19:47:25.686822 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 19:47:25.740002 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:47:25.773713 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 19:47:25.801868 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 19:47:26.353230 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 19:47:26.401514 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.413216 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:47:26.472485 tst mo_mt_call.py: using LAC 35863 19:47:26.596687 tst mo_mt_call.py: using RAC 163 19:47:26.714905 tst mo_mt_call.py: using CellId 35863 19:47:26.832565 tst mo_mt_call.py: using BVCI 35864 19:47:26.941187 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.952623 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.963844 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.974920 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.986176 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:26.997442 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:27.116784 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:27.233899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:27.700883 run create_hlr_db(pid=24187): Launched 19:47:27.823769 bus /sierra_2: Setting Powered False 19:47:28.885037 run create_hlr_db(pid=24187): Terminated: ok {rc=0} 19:47:29.305115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24189): Launched 19:47:29.605572 run osmo-hlr_10.42.42.2(pid=24190): Launched 19:47:29.718536 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:30.250496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24192): Launched 19:47:30.550449 run osmo-stp_10.42.42.5(pid=24193): Launched 19:47:30.663531 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:31.228230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24195): Launched 19:47:31.569950 run osmo-msc_10.42.42.6(pid=24196): Launched 19:47:31.829297 run osmo-stp_10.42.42.5(pid=24193): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24193)] 19:47:32.102864 run osmo-stp_10.42.42.5(pid=24193): stdout: | (launched: 2022-12-13_19:47:30.495200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:32.252769 run osmo-stp_10.42.42.5(pid=24193): stderr: | 20221213194730663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194730663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194730663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194730663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194730664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194730664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194730664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:32.390216 run osmo-stp_10.42.42.5(pid=24193): stdout: | (launched: 2022-12-13_19:47:30.495200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:32.519923 run osmo-stp_10.42.42.5(pid=24193): stderr: | 20221213194730663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194730663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194730663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194730663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194730664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194730664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194730664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:32.675618 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24193): Process ended prematurely: osmo-stp_10.42.42.5(pid=24193) [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24193)] [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 19:47:32.685430 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 19:47:32.713599 run osmo-hlr_10.42.42.2(pid=24190): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24190)] 19:47:32.764877 run osmo-hlr_10.42.42.2(pid=24190): stdout: | (launched: 2022-12-13_19:47:29.550128) 19:47:32.817268 run osmo-hlr_10.42.42.2(pid=24190): stderr: | 20221213194729724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194729724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194729724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194729724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194729724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194729724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194729737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194729746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194729746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194729746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:32.889789 run osmo-msc_10.42.42.6(pid=24196): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24196)] 19:47:32.940009 run osmo-msc_10.42.42.6(pid=24196): stdout: | (launched: 2022-12-13_19:47:31.510177) 19:47:32.992325 run osmo-msc_10.42.42.6(pid=24196): stderr: | 20221213194732067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194732068 DLGLOBAL DEBUG validating counter group 0x7f24ac9a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194732068 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194732068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194732068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194732068 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194732070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194732070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194732071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194732071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:33.044691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24189): Terminating (SIGTERM) 19:47:33.086556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24192): Terminating (SIGTERM) 19:47:33.129639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24195): Terminating (SIGTERM) 19:47:33.172410 --- ParallelTerminationStrategy: PID 24189 died... 19:47:33.193179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24189): Terminated: ok {rc=0} 19:47:33.240424 --- ParallelTerminationStrategy: PID 24192 died... 19:47:33.261199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24192): Terminated: ok {rc=0} 19:47:33.307581 --- ParallelTerminationStrategy: PID 24195 died... 19:47:33.327663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24195): Terminated: ok {rc=0} 19:47:33.415622 bus /sierra_3: Setting Powered False 19:47:34.514286 bus /sierra_3: Setting Powered False 19:47:35.631775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 19:47:36.776854 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:36.788779 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:47:36.839363 tst mo_mt_call_osmux.py: using LAC 35864 19:47:36.959320 tst mo_mt_call_osmux.py: using RAC 164 19:47:37.079144 tst mo_mt_call_osmux.py: using CellId 35864 19:47:37.198945 tst mo_mt_call_osmux.py: using BVCI 35865 19:47:37.307526 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:37.318995 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:37.330354 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:37.341541 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:37.352860 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 19:47:37.364046 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:37.478640 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 19:47:37.599536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:38.102025 run create_hlr_db(pid=24198): Launched 19:47:38.226807 bus /sierra_2: Setting Powered False 19:47:39.290966 run create_hlr_db(pid=24198): Terminated: ok {rc=0} 19:47:39.723477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24200): Launched 19:47:40.025297 run osmo-hlr_10.42.42.2(pid=24201): Launched 19:47:40.139620 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:40.656389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24203): Launched 19:47:40.957694 run osmo-stp_10.42.42.5(pid=24204): Launched 19:47:41.072019 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:41.615763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24206): Launched 19:47:41.916933 run osmo-msc_10.42.42.6(pid=24207): Launched 19:47:42.084437 run osmo-stp_10.42.42.5(pid=24204): ERR: Terminated: ERROR {rc=1} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24204)] 19:47:42.211628 run osmo-stp_10.42.42.5(pid=24204): stdout: | (launched: 2022-12-13_19:47:40.902030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:42.338831 run osmo-stp_10.42.42.5(pid=24204): stderr: | 20221213194741070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194741070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194741070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194741071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194741071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194741071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194741071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:42.463887 run osmo-stp_10.42.42.5(pid=24204): stdout: | (launched: 2022-12-13_19:47:40.902030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:42.583968 run osmo-stp_10.42.42.5(pid=24204): stderr: | 20221213194741070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194741070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194741070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194741071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194741071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194741071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194741071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:42.727527 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24204): Process ended prematurely: osmo-stp_10.42.42.5(pid=24204) [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24204)] [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 19:47:42.736548 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 19:47:42.763083 run osmo-hlr_10.42.42.2(pid=24201): ERR: Terminated: ERROR {rc=237} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24201)] 19:47:42.810645 run osmo-hlr_10.42.42.2(pid=24201): stdout: | (launched: 2022-12-13_19:47:39.969800) 19:47:42.860229 run osmo-hlr_10.42.42.2(pid=24201): stderr: | 20221213194740141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194740142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194740142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194740142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194740142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194740142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194740154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194740162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194740162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194740162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:42.929282 run osmo-msc_10.42.42.6(pid=24207): ERR: Terminated: ERROR {rc=2} [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24207)] 19:47:42.976594 run osmo-msc_10.42.42.6(pid=24207): stdout: | (launched: 2022-12-13_19:47:41.861196) 19:47:43.025627 run osmo-msc_10.42.42.6(pid=24207): stderr: | 20221213194742130 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194742130 DLGLOBAL DEBUG validating counter group 0x7f04f460ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194742130 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194742130 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194742131 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194742131 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194742132 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194742133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194742133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194742133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:43.074988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24200): Terminating (SIGTERM) 19:47:43.114521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24203): Terminating (SIGTERM) 19:47:43.154002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24206): Terminating (SIGTERM) 19:47:43.193496 --- ParallelTerminationStrategy: PID 24200 died... 19:47:43.212311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24200): Terminated: ok {rc=0} 19:47:43.256504 --- ParallelTerminationStrategy: PID 24203 died... 19:47:43.275361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24203): Terminated: ok {rc=0} 19:47:43.319297 --- ParallelTerminationStrategy: PID 24206 died... 19:47:43.338119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24206): Terminated: ok {rc=0} 19:47:43.423904 bus /sierra_3: Setting Powered False 19:47:44.521384 bus /sierra_3: Setting Powered False 19:47:45.633713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 emergency:nanobts+band-900 --------------------------------------------------------------------- 19:47:46.900660 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:47:46.909482 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:47:46.949137 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 19:47:46.982242 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 19:47:47.070598 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:47:47.104032 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 19:47:47.136887 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 19:47:47.714986 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2393 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 19:47:47.720183 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:47.731089 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:47.778528 tst emergency_mo_mt_call.py: using LAC 35865 19:47:47.902604 tst emergency_mo_mt_call.py: using RAC 165 19:47:48.025174 tst emergency_mo_mt_call.py: using CellId 35865 19:47:48.147879 tst emergency_mo_mt_call.py: using BVCI 35866 19:47:48.262684 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:48.274028 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:48.285083 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:48.296170 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:48.307520 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:48.318882 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:48.433345 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:48.548448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:49.006614 run create_hlr_db(pid=24212): Launched 19:47:49.127884 bus /sierra_2: Setting Powered False 19:47:50.186498 run create_hlr_db(pid=24212): Terminated: ok {rc=0} 19:47:50.621334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24214): Launched 19:47:50.942035 run osmo-hlr_10.42.42.2(pid=24215): Launched 19:47:51.063986 run osmo-stp_10.42.42.5: Starting osmo-stp 19:47:51.614027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24217): Launched 19:47:51.931765 run osmo-stp_10.42.42.5(pid=24218): Launched 19:47:52.062266 tst emergency_mo_mt_call.py: using MSISDN 8296 19:47:52.229524 run osmo-msc_10.42.42.6: Starting osmo-msc 19:47:52.802435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24220): Launched 19:47:53.119831 run osmo-msc_10.42.42.6(pid=24221): Launched 19:47:53.297168 run osmo-stp_10.42.42.5(pid=24218): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24218)] 19:47:53.432108 run osmo-stp_10.42.42.5(pid=24218): stdout: | (launched: 2022-12-13_19:47:51.873591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:53.567419 run osmo-stp_10.42.42.5(pid=24218): stderr: | 20221213194752062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194752062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194752062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194752063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194752063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194752063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194752064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:53.701065 run osmo-stp_10.42.42.5(pid=24218): stdout: | (launched: 2022-12-13_19:47:51.873591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:47:53.828117 run osmo-stp_10.42.42.5(pid=24218): stderr: | 20221213194752062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194752062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194752062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194752063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194752063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194752063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194752064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:47:53.980173 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24218): Process ended prematurely: osmo-stp_10.42.42.5(pid=24218) [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24218)] [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 19:47:53.989266 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 19:47:54.016417 run osmo-hlr_10.42.42.2(pid=24215): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24215)] 19:47:54.067695 run osmo-hlr_10.42.42.2(pid=24215): stdout: | (launched: 2022-12-13_19:47:50.883272) 19:47:54.120047 run osmo-hlr_10.42.42.2(pid=24215): stderr: | 20221213194751078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194751078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194751078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194751078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194751078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194751078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194751091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194751101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194751102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194751102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:47:54.192497 run osmo-msc_10.42.42.6(pid=24221): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24221)] 19:47:54.242344 run osmo-msc_10.42.42.6(pid=24221): stdout: | (launched: 2022-12-13_19:47:53.061139) 19:47:54.294271 run osmo-msc_10.42.42.6(pid=24221): stderr: | 20221213194753379 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194753379 DLGLOBAL DEBUG validating counter group 0x7f919d7c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194753379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194753379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194753379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194753379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194753381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194753382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194753382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194753382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:47:54.346553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24214): Terminating (SIGTERM) 19:47:54.388027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24217): Terminating (SIGTERM) 19:47:54.429838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24220): Terminating (SIGTERM) 19:47:54.471738 --- ParallelTerminationStrategy: PID 24214 died... 19:47:54.492215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24214): Terminated: ok {rc=0} 19:47:54.538431 --- ParallelTerminationStrategy: PID 24217 died... 19:47:54.558186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24217): Terminated: ok {rc=0} 19:47:54.604121 --- ParallelTerminationStrategy: PID 24220 died... 19:47:54.623767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24220): Terminated: ok {rc=0} 19:47:54.711047 bus /sierra_3: Setting Powered False 19:47:55.809292 bus /sierra_3: Setting Powered False 19:47:56.924790 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 19:47:58.010903 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.022909 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 19:47:58.075063 tst emergency_preemptive_call.py: using LAC 35866 19:47:58.201302 tst emergency_preemptive_call.py: using RAC 166 19:47:58.327027 tst emergency_preemptive_call.py: using CellId 35866 19:47:58.450764 tst emergency_preemptive_call.py: using BVCI 35867 19:47:58.566899 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.578342 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.589560 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.600457 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.611920 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 19:47:58.623353 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:58.737983 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:58.856909 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:58.975001 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 19:47:59.087100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:47:59.546870 run create_hlr_db(pid=24223): Launched 19:47:59.669667 bus /sierra_2: Setting Powered False 19:48:00.729655 run create_hlr_db(pid=24223): Terminated: ok {rc=0} 19:48:01.166182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24225): Launched 19:48:01.545369 run osmo-hlr_10.42.42.2(pid=24226): Launched 19:48:01.676753 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:02.292538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24228): Launched 19:48:02.602943 run osmo-stp_10.42.42.5(pid=24229): Launched 19:48:02.724212 tst emergency_preemptive_call.py: using MSISDN 8297 19:48:02.873636 run osmo-msc_10.42.42.6: Starting osmo-msc 19:48:03.403893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24231): Launched 19:48:03.700130 run osmo-msc_10.42.42.6(pid=24232): Launched 19:48:03.864942 run osmo-stp_10.42.42.5(pid=24229): ERR: Terminated: ERROR {rc=1} [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24229)] 19:48:03.989582 run osmo-stp_10.42.42.5(pid=24229): stdout: | (launched: 2022-12-13_19:48:02.548160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:04.114759 run osmo-stp_10.42.42.5(pid=24229): stderr: | 20221213194802714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194802714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194802714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194802715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194802715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194802715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194802715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:04.238119 run osmo-stp_10.42.42.5(pid=24229): stdout: | (launched: 2022-12-13_19:48:02.548160) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:04.355700 run osmo-stp_10.42.42.5(pid=24229): stderr: | 20221213194802714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194802714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194802714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194802715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194802715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194802715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194802715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:04.496790 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24229): Process ended prematurely: osmo-stp_10.42.42.5(pid=24229) [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24229)] [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 19:48:04.505349 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 19:48:04.531584 run osmo-hlr_10.42.42.2(pid=24226): ERR: Terminated: ERROR {rc=237} [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24226)] 19:48:04.579844 run osmo-hlr_10.42.42.2(pid=24226): stdout: | (launched: 2022-12-13_19:48:01.488478) 19:48:04.629242 run osmo-hlr_10.42.42.2(pid=24226): stderr: | 20221213194801864 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194801870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194801870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194801870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194801870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194801870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194801892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194801910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194801911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194801911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:04.698288 run osmo-msc_10.42.42.6(pid=24232): ERR: Terminated: ERROR {rc=2} [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24232)] 19:48:04.745734 run osmo-msc_10.42.42.6(pid=24232): stdout: | (launched: 2022-12-13_19:48:03.644528) 19:48:04.794990 run osmo-msc_10.42.42.6(pid=24232): stderr: | 20221213194803914 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213194803914 DLGLOBAL DEBUG validating counter group 0x7feeb8317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213194803915 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213194803915 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213194803915 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213194803915 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213194803917 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213194803917 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213194803917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213194803917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:48:04.844440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24225): Terminating (SIGTERM) 19:48:04.883913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24228): Terminating (SIGTERM) 19:48:04.923683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24231): Terminating (SIGTERM) 19:48:04.963760 --- ParallelTerminationStrategy: PID 24225 died... 19:48:04.983103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24225): Terminated: ok {rc=0} 19:48:05.027287 --- ParallelTerminationStrategy: PID 24228 died... 19:48:05.046184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24228): Terminated: ok {rc=0} 19:48:05.090035 --- ParallelTerminationStrategy: PID 24231 died... 19:48:05.108913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24231): Terminated: ok {rc=0} 19:48:05.193898 bus /sierra_9: Setting Powered False 19:48:06.293921 bus /sierra_9: Setting Powered False 19:48:07.413454 bus /sierra_8: Setting Powered False 19:48:08.511737 bus /sierra_8: Setting Powered False 19:48:09.625781 bus /sierra_3: Setting Powered False 19:48:10.723792 bus /sierra_3: Setting Powered False 19:48:11.838315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900 --------------------------------------------------------------------- 19:48:13.118259 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:48:13.124240 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 19:48:13.158070 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 19:48:13.198599 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 19:48:13.289308 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 19:48:13.323487 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 19:48:13.363720 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 19:48:13.954674 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 19:48:14.007653 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.018935 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:48:14.067487 tst cs_paging_gprs_active.py: using LAC 35867 19:48:14.187560 tst cs_paging_gprs_active.py: using RAC 167 19:48:14.306941 tst cs_paging_gprs_active.py: using CellId 35867 19:48:14.435720 tst cs_paging_gprs_active.py: using BVCI 35868 19:48:14.553285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.564603 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.575675 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.586788 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.598106 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.609493 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.620885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.632179 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:14.643685 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:14.760409 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:14.881817 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:48:15.101183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:15.426588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24237): Launched 19:48:15.710386 run iperf3-srv_10.42.42.10(pid=24238): Launched 19:48:15.839722 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:48:16.084907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:16.406593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24239): Launched 19:48:16.681580 run iperf3-srv_10.42.42.10(pid=24240): Launched 19:48:16.818763 tst cs_paging_gprs_active.py:38: start network... 19:48:17.043232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:17.550403 run create_hlr_db(pid=24241): Launched 19:48:17.675072 bus /sierra_2: Setting Powered False 19:48:18.738865 run create_hlr_db(pid=24241): Terminated: ok {rc=0} 19:48:19.169662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24243): Launched 19:48:19.470340 run osmo-hlr_10.42.42.2(pid=24244): Launched 19:48:19.585475 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:20.104796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24246): Launched 19:48:20.405774 run osmo-stp_10.42.42.5(pid=24247): Launched 19:48:20.519960 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:21.040126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24249): Launched 19:48:21.155516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:21.411295 run patchelf(pid=24250): Launched 19:48:21.579982 run osmo-stp_10.42.42.5(pid=24247): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24247)] 19:48:21.707735 run osmo-stp_10.42.42.5(pid=24247): stdout: | (launched: 2022-12-13_19:48:20.350286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:21.837642 run osmo-stp_10.42.42.5(pid=24247): stderr: | 20221213194820516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194820516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194820516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194820517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194820517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194820517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194820517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:21.967119 run osmo-stp_10.42.42.5(pid=24247): stdout: | (launched: 2022-12-13_19:48:20.350286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:22.090435 run osmo-stp_10.42.42.5(pid=24247): stderr: | 20221213194820516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194820516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194820516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194820517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194820517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194820517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194820517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:22.236626 run patchelf(pid=24250): Terminating (SIGINT) 19:48:22.405975 run patchelf(pid=24250): Terminated: ok {rc=0} 19:48:22.527749 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24247): Process ended prematurely: osmo-stp_10.42.42.5(pid=24247) [trial-2393↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24247)] [trial-2393↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 19:48:22.537252 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:48:22.564111 run osmo-hlr_10.42.42.2(pid=24244): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24244)] 19:48:22.611248 run osmo-hlr_10.42.42.2(pid=24244): stdout: | (launched: 2022-12-13_19:48:19.415123) 19:48:22.659998 run osmo-hlr_10.42.42.2(pid=24244): stderr: | 20221213194819586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194819586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194819586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194819586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194819587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194819587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194819599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194819608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194819608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194819608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:22.709299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24237): Terminating (SIGTERM) 19:48:22.748855 run iperf3-srv_10.42.42.10(pid=24238): Terminating (SIGTERM) 19:48:22.788215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24239): Terminating (SIGTERM) 19:48:22.827819 run iperf3-srv_10.42.42.10(pid=24240): Terminating (SIGTERM) 19:48:22.867048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24243): Terminating (SIGTERM) 19:48:22.906606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24246): Terminating (SIGTERM) 19:48:22.946010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24249): Terminating (SIGTERM) 19:48:22.985860 --- ParallelTerminationStrategy: PID 24237 died... 19:48:23.005123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24237): Terminated: ok {rc=0} 19:48:23.048802 --- ParallelTerminationStrategy: PID 24238 died... 19:48:23.067964 run iperf3-srv_10.42.42.10(pid=24238): Terminated {rc=256} 19:48:23.111694 --- ParallelTerminationStrategy: PID 24239 died... 19:48:23.130419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24239): Terminated: ok {rc=0} 19:48:23.173867 --- ParallelTerminationStrategy: PID 24240 died... 19:48:23.193636 run iperf3-srv_10.42.42.10(pid=24240): Terminated {rc=256} 19:48:23.237139 --- ParallelTerminationStrategy: PID 24243 died... 19:48:23.255729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24243): Terminated: ok {rc=0} 19:48:23.299161 --- ParallelTerminationStrategy: PID 24246 died... 19:48:23.317934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24246): Terminated: ok {rc=0} 19:48:23.361485 --- ParallelTerminationStrategy: PID 24249 died... 19:48:23.380040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24249): Terminated: ok {rc=0} 19:48:23.465403 bus /gobi_0: Setting Powered False 19:48:24.563664 bus /gobi_0: Setting Powered False 19:48:25.679650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 19:48:26.824551 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:26.836026 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:48:26.886272 tst iperf3.py: using LAC 35868 19:48:27.003854 tst iperf3.py: using RAC 168 19:48:27.122344 tst iperf3.py: using CellId 35868 19:48:27.242095 tst iperf3.py: using BVCI 35869 19:48:27.352581 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.363541 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.374334 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.385100 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.395583 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.406201 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.416937 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.427615 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:27.438438 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:27.551356 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:48:27.754748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:28.059484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24251): Launched 19:48:28.322072 run iperf3-srv_10.42.42.10(pid=24252): Launched 19:48:28.436408 tst iperf3.py:8: start network... 19:48:28.637226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:29.103715 run create_hlr_db(pid=24253): Launched 19:48:29.225521 bus /gobi_6: Setting Powered False 19:48:30.285899 run create_hlr_db(pid=24253): Terminated: ok {rc=0} 19:48:30.727990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24255): Launched 19:48:31.061055 run osmo-hlr_10.42.42.2(pid=24256): Launched 19:48:31.304109 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:31.973788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24258): Launched 19:48:32.317843 run osmo-stp_10.42.42.5(pid=24259): Launched 19:48:32.443809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:33.001671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24261): Launched 19:48:33.125234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:33.398124 run patchelf(pid=24262): Launched 19:48:33.578613 run osmo-stp_10.42.42.5(pid=24259): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24259)] 19:48:33.715506 run osmo-stp_10.42.42.5(pid=24259): stdout: | (launched: 2022-12-13_19:48:32.257874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:33.854361 run osmo-stp_10.42.42.5(pid=24259): stderr: | 20221213194832445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194832445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194832446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194832446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194832447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194832447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194832447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:33.992771 run osmo-stp_10.42.42.5(pid=24259): stdout: | (launched: 2022-12-13_19:48:32.257874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:34.125813 run osmo-stp_10.42.42.5(pid=24259): stderr: | 20221213194832445 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194832445 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194832446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194832446 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194832447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194832447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194832447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:34.283630 run patchelf(pid=24262): Terminating (SIGINT) 19:48:34.464540 run patchelf(pid=24262): Terminated: ok {rc=0} 19:48:34.595325 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24259): Process ended prematurely: osmo-stp_10.42.42.5(pid=24259) [trial-2393↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24259)] [trial-2393↪gprs:nanobts+band-900↪iperf3.py:8] 19:48:34.605561 tst iperf3.py:8: Test FAILED (7.8 sec) 19:48:34.633903 run osmo-hlr_10.42.42.2(pid=24256): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24256)] 19:48:34.684670 run osmo-hlr_10.42.42.2(pid=24256): stdout: | (launched: 2022-12-13_19:48:31.000240) 19:48:34.736433 run osmo-hlr_10.42.42.2(pid=24256): stderr: | 20221213194831240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194831240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194831240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194831240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194831240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194831240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194831284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194831293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194831293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194831293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:34.788479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24251): Terminating (SIGTERM) 19:48:34.830295 run iperf3-srv_10.42.42.10(pid=24252): Terminating (SIGTERM) 19:48:34.872160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24255): Terminating (SIGTERM) 19:48:34.914266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24258): Terminating (SIGTERM) 19:48:34.956214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24261): Terminating (SIGTERM) 19:48:34.998496 --- ParallelTerminationStrategy: PID 24251 died... 19:48:35.018925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24251): Terminated: ok {rc=0} 19:48:35.065214 --- ParallelTerminationStrategy: PID 24252 died... 19:48:35.084858 run iperf3-srv_10.42.42.10(pid=24252): Terminated {rc=256} 19:48:35.131124 --- ParallelTerminationStrategy: PID 24255 died... 19:48:35.150890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24255): Terminated: ok {rc=0} 19:48:35.196893 --- ParallelTerminationStrategy: PID 24258 died... 19:48:35.216684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24258): Terminated: ok {rc=0} 19:48:35.262682 --- ParallelTerminationStrategy: PID 24261 died... 19:48:35.282500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24261): Terminated: ok {rc=0} 19:48:35.369934 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 19:48:36.515676 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:36.527015 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:48:36.574635 tst iperf3m4.py: using LAC 35869 19:48:36.695671 tst iperf3m4.py: using RAC 169 19:48:36.812670 tst iperf3m4.py: using CellId 35869 19:48:36.934223 tst iperf3m4.py: using BVCI 35870 19:48:37.044392 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.055272 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.065932 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.076486 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.087029 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.097759 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.108423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.118995 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:37.129696 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:37.243938 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:37.366006 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:37.481523 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:37.600336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:48:37.803183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:38.107571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24263): Launched 19:48:38.369832 run iperf3-srv_10.42.42.10(pid=24264): Launched 19:48:38.482386 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:48:38.683003 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:38.985692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24265): Launched 19:48:39.247783 run iperf3-srv_10.42.42.10(pid=24266): Launched 19:48:39.360664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:48:39.561816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:39.864488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24267): Launched 19:48:40.128277 run iperf3-srv_10.42.42.10(pid=24268): Launched 19:48:40.240874 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:48:40.442153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:48:40.744038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24269): Launched 19:48:41.006317 run iperf3-srv_10.42.42.10(pid=24270): Launched 19:48:41.120420 tst iperf3m4.py:8: start network... 19:48:41.321866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:41.790356 run create_hlr_db(pid=24271): Launched 19:48:41.913218 bus /gobi_6: Setting Powered False 19:48:42.973557 run create_hlr_db(pid=24271): Terminated: ok {rc=0} 19:48:43.416116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Launched 19:48:43.741589 run osmo-hlr_10.42.42.2(pid=24274): Launched 19:48:43.866169 run osmo-stp_10.42.42.5: Starting osmo-stp 19:48:44.429630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Launched 19:48:44.754518 run osmo-stp_10.42.42.5(pid=24277): Launched 19:48:44.879218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:48:45.438030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Launched 19:48:45.561871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:48:45.840931 run patchelf(pid=24280): Launched 19:48:46.029751 run osmo-stp_10.42.42.5(pid=24277): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] 19:48:46.160556 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-13_19:48:44.695000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:46.293847 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221213194844883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194844883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194844884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194844884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194844885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194844885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194844885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:46.426769 run osmo-stp_10.42.42.5(pid=24277): stdout: | (launched: 2022-12-13_19:48:44.695000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:48:46.553412 run osmo-stp_10.42.42.5(pid=24277): stderr: | 20221213194844883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194844883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194844884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194844884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194844885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194844885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194844885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:48:46.706364 run patchelf(pid=24280): Terminating (SIGINT) 19:48:46.880732 run patchelf(pid=24280): Terminated: ok {rc=0} 19:48:47.007649 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2393↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] [trial-2393↪gprs:nanobts+band-900↪iperf3m4.py:8] 19:48:47.019234 tst iperf3m4.py:8: Test FAILED (10.5 sec) 19:48:47.048165 run osmo-hlr_10.42.42.2(pid=24274): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24274)] 19:48:47.097311 run osmo-hlr_10.42.42.2(pid=24274): stdout: | (launched: 2022-12-13_19:48:43.682066) 19:48:47.147610 run osmo-hlr_10.42.42.2(pid=24274): stderr: | 20221213194843876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194843876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194843876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194843876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194843876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194843876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194843888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194843897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194843897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194843897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:48:47.197981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24263): Terminating (SIGTERM) 19:48:47.239431 run iperf3-srv_10.42.42.10(pid=24264): Terminating (SIGTERM) 19:48:47.279733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24265): Terminating (SIGTERM) 19:48:47.319837 run iperf3-srv_10.42.42.10(pid=24266): Terminating (SIGTERM) 19:48:47.359220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24267): Terminating (SIGTERM) 19:48:47.398589 run iperf3-srv_10.42.42.10(pid=24268): Terminating (SIGTERM) 19:48:47.438890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24269): Terminating (SIGTERM) 19:48:47.478175 run iperf3-srv_10.42.42.10(pid=24270): Terminating (SIGTERM) 19:48:47.518075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminating (SIGTERM) 19:48:47.557620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminating (SIGTERM) 19:48:47.597723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Terminating (SIGTERM) 19:48:47.638069 --- ParallelTerminationStrategy: PID 24263 died... 19:48:47.657200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24263): Terminated: ok {rc=0} 19:48:47.701213 --- ParallelTerminationStrategy: PID 24264 died... 19:48:47.719808 run iperf3-srv_10.42.42.10(pid=24264): Terminated {rc=256} 19:48:47.763492 --- ParallelTerminationStrategy: PID 24265 died... 19:48:47.782100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24265): Terminated: ok {rc=0} 19:48:47.825750 --- ParallelTerminationStrategy: PID 24266 died... 19:48:47.844260 run iperf3-srv_10.42.42.10(pid=24266): Terminated {rc=256} 19:48:47.887678 --- ParallelTerminationStrategy: PID 24267 died... 19:48:47.906356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24267): Terminated: ok {rc=0} 19:48:47.949813 --- ParallelTerminationStrategy: PID 24268 died... 19:48:47.968327 run iperf3-srv_10.42.42.10(pid=24268): Terminated {rc=256} 19:48:48.012174 --- ParallelTerminationStrategy: PID 24269 died... 19:48:48.031027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24269): Terminated: ok {rc=0} 19:48:48.075122 --- ParallelTerminationStrategy: PID 24270 died... 19:48:48.093820 run iperf3-srv_10.42.42.10(pid=24270): Terminated {rc=256} 19:48:48.137426 --- ParallelTerminationStrategy: PID 24273 died... 19:48:48.155828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24273): Terminated: ok {rc=0} 19:48:48.199795 --- ParallelTerminationStrategy: PID 24276 died... 19:48:48.218514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24276): Terminated: ok {rc=0} 19:48:48.262361 --- ParallelTerminationStrategy: PID 24279 died... 19:48:48.281224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24279): Terminated: ok {rc=0} 19:48:48.366958 bus /gobi_4: Setting Powered False 19:48:49.465412 bus /gobi_4: Setting Powered False 19:48:50.580001 bus /gobi_1: Setting Powered False 19:48:51.677844 bus /gobi_1: Setting Powered False 19:48:52.791779 bus /gobi_0: Setting Powered False 19:48:53.890154 bus /gobi_0: Setting Powered False 19:48:55.002478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900 ping.py ---------------------------------------------- 19:48:56.102443 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.113858 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:48:56.163689 tst ping.py: using LAC 35870 19:48:56.279703 tst ping.py: using RAC 170 19:48:56.393636 tst ping.py: using CellId 35870 19:48:56.508444 tst ping.py: using BVCI 35871 19:48:56.615482 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.626376 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.636920 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.647475 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.658060 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.668518 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.679261 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:48:56.689870 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:48:56.806072 tst ping.py:19: start network... 19:48:57.020774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:48:57.514764 run create_hlr_db(pid=24281): Launched 19:48:57.637472 bus /gobi_6: Setting Powered False 19:48:58.700715 run create_hlr_db(pid=24281): Terminated: ok {rc=0} 19:48:59.143836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24283): Launched 19:48:59.461541 run osmo-hlr_10.42.42.2(pid=24284): Launched 19:48:59.583180 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:00.137431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24286): Launched 19:49:00.455124 run osmo-stp_10.42.42.5(pid=24287): Launched 19:49:00.576685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:01.151444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24289): Launched 19:49:01.299176 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:01.558240 run patchelf(pid=24290): Launched 19:49:01.743724 run osmo-stp_10.42.42.5(pid=24287): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24287)] 19:49:01.872516 run osmo-stp_10.42.42.5(pid=24287): stdout: | (launched: 2022-12-13_19:49:00.396823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:02.003612 run osmo-stp_10.42.42.5(pid=24287): stderr: | 20221213194900583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194900583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194900583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194900584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194900584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194900584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194900585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:02.135006 run osmo-stp_10.42.42.5(pid=24287): stdout: | (launched: 2022-12-13_19:49:00.396823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:02.258682 run osmo-stp_10.42.42.5(pid=24287): stderr: | 20221213194900583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194900583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194900583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194900584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194900584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194900584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194900585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:02.402778 run patchelf(pid=24290): Terminating (SIGINT) 19:49:02.569382 run patchelf(pid=24290): Terminated: ok {rc=0} 19:49:02.689852 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24287): Process ended prematurely: osmo-stp_10.42.42.5(pid=24287) [trial-2393↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24287)] [trial-2393↪gprs:nanobts+band-900↪ping.py:22] 19:49:02.698666 tst ping.py:22: Test FAILED (6.6 sec) 19:49:02.725436 run osmo-hlr_10.42.42.2(pid=24284): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24284)] 19:49:02.773139 run osmo-hlr_10.42.42.2(pid=24284): stdout: | (launched: 2022-12-13_19:48:59.403091) 19:49:02.822202 run osmo-hlr_10.42.42.2(pid=24284): stderr: | 20221213194859596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194859596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194859597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194859597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194859597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194859597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194859608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194859618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194859618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194859618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:02.871587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24283): Terminating (SIGTERM) 19:49:02.911197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24286): Terminating (SIGTERM) 19:49:02.950804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24289): Terminating (SIGTERM) 19:49:02.990949 --- ParallelTerminationStrategy: PID 24283 died... 19:49:03.010217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24283): Terminated: ok {rc=0} 19:49:03.054238 --- ParallelTerminationStrategy: PID 24286 died... 19:49:03.072763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24286): Terminated: ok {rc=0} 19:49:03.116754 --- ParallelTerminationStrategy: PID 24289 died... 19:49:03.135414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24289): Terminated: ok {rc=0} 19:49:03.220765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 19:49:04.307408 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.319166 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 19:49:04.369266 tst ping_idle_ping.py: using LAC 35871 19:49:04.495929 tst ping_idle_ping.py: using RAC 171 19:49:04.620680 tst ping_idle_ping.py: using CellId 35871 19:49:04.746683 tst ping_idle_ping.py: using BVCI 35872 19:49:04.864626 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.875936 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.887085 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.898152 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.910193 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.922102 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.934131 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 19:49:04.946117 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 19:49:05.067418 tst ping_idle_ping.py:24: start network... 19:49:05.267339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:05.732698 run create_hlr_db(pid=24291): Launched 19:49:05.859038 bus /gobi_6: Setting Powered False 19:49:06.922011 run create_hlr_db(pid=24291): Terminated: ok {rc=0} 19:49:07.349037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Launched 19:49:07.670082 run osmo-hlr_10.42.42.2(pid=24294): Launched 19:49:07.794567 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:08.309708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Launched 19:49:08.607440 run osmo-stp_10.42.42.5(pid=24297): Launched 19:49:08.721480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:09.233417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24299): Launched 19:49:09.346146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:09.595809 run patchelf(pid=24300): Launched 19:49:09.759503 run osmo-stp_10.42.42.5(pid=24297): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] 19:49:09.884664 run osmo-stp_10.42.42.5(pid=24297): stdout: | (launched: 2022-12-13_19:49:08.551937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:10.011416 run osmo-stp_10.42.42.5(pid=24297): stderr: | 20221213194908719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194908719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194908719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194908720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194908720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194908720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194908720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:10.138272 run osmo-stp_10.42.42.5(pid=24297): stdout: | (launched: 2022-12-13_19:49:08.551937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:10.260304 run osmo-stp_10.42.42.5(pid=24297): stderr: | 20221213194908719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194908719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194908719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194908720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194908720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194908720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194908720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:10.403948 run patchelf(pid=24300): Terminating (SIGINT) 19:49:10.570941 run patchelf(pid=24300): Terminated: ok {rc=0} 19:49:10.690953 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24297): Process ended prematurely: osmo-stp_10.42.42.5(pid=24297) [trial-2393↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] [trial-2393↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 19:49:10.699572 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:49:10.726135 run osmo-hlr_10.42.42.2(pid=24294): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24294)] 19:49:10.773552 run osmo-hlr_10.42.42.2(pid=24294): stdout: | (launched: 2022-12-13_19:49:07.611260) 19:49:10.822354 run osmo-hlr_10.42.42.2(pid=24294): stderr: | 20221213194907807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194907807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194907807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194907807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194907807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194907807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194907820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194907828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194907828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194907828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:10.871669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Terminating (SIGTERM) 19:49:10.911171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Terminating (SIGTERM) 19:49:10.951075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24299): Terminating (SIGTERM) 19:49:10.991935 --- ParallelTerminationStrategy: PID 24293 died... 19:49:11.011016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24293): Terminated: ok {rc=0} 19:49:11.054819 --- ParallelTerminationStrategy: PID 24296 died... 19:49:11.073372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24296): Terminated: ok {rc=0} 19:49:11.116817 --- ParallelTerminationStrategy: PID 24299 died... 19:49:11.135779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24299): Terminated: ok {rc=0} 19:49:11.217849 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 19:49:12.513948 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:49:12.519818 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 19:49:12.551706 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 19:49:12.590817 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 19:49:12.680212 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 19:49:12.712300 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 19:49:12.750989 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 19:49:13.355174 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 19:49:13.409214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:13.420749 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:13.471118 tst cs_paging_gprs_active.py: using LAC 35872 19:49:13.602792 tst cs_paging_gprs_active.py: using RAC 172 19:49:13.728880 tst cs_paging_gprs_active.py: using CellId 35872 19:49:13.853758 tst cs_paging_gprs_active.py: using BVCI 35873 19:49:13.975951 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:13.987548 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:13.998741 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.010039 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.022105 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.033935 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.045802 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.057448 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:14.069359 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:14.185286 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:14.306395 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:49:14.526757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:14.851851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24306): Launched 19:49:15.133504 run iperf3-srv_10.42.42.10(pid=24307): Launched 19:49:15.254903 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:49:15.473582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:15.797394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24308): Launched 19:49:16.102325 run iperf3-srv_10.42.42.10(pid=24309): Launched 19:49:16.233595 tst cs_paging_gprs_active.py:38: start network... 19:49:16.443118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:16.933087 run create_hlr_db(pid=24310): Launched 19:49:17.093542 bus /gobi_6: Setting Powered False 19:49:18.154364 run create_hlr_db(pid=24310): Terminated: ok {rc=0} 19:49:18.581191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24312): Launched 19:49:18.886946 run osmo-hlr_10.42.42.2(pid=24313): Launched 19:49:19.002425 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:19.543632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24315): Launched 19:49:19.848598 run osmo-stp_10.42.42.5(pid=24316): Launched 19:49:19.964064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:20.490715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24318): Launched 19:49:20.606580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:20.865452 run patchelf(pid=24319): Launched 19:49:21.034655 run osmo-stp_10.42.42.5(pid=24316): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24316)] 19:49:21.163571 run osmo-stp_10.42.42.5(pid=24316): stdout: | (launched: 2022-12-13_19:49:19.792027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:21.294049 run osmo-stp_10.42.42.5(pid=24316): stderr: | 20221213194919960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194919960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194919960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194919961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194919961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194919961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194919961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:21.424249 run osmo-stp_10.42.42.5(pid=24316): stdout: | (launched: 2022-12-13_19:49:19.792027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:21.549110 run osmo-stp_10.42.42.5(pid=24316): stderr: | 20221213194919960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194919960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194919960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194919961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194919961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194919961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194919961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:21.696676 run patchelf(pid=24319): Terminating (SIGINT) 19:49:21.867886 run patchelf(pid=24319): Terminated: ok {rc=0} 19:49:21.990905 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24316): Process ended prematurely: osmo-stp_10.42.42.5(pid=24316) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24316)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 19:49:22.000280 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:49:22.027590 run osmo-hlr_10.42.42.2(pid=24313): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24313)] 19:49:22.075706 run osmo-hlr_10.42.42.2(pid=24313): stdout: | (launched: 2022-12-13_19:49:18.830296) 19:49:22.124814 run osmo-hlr_10.42.42.2(pid=24313): stderr: | 20221213194919004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194919004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194919004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194919004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194919005 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194919005 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194919018 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194919027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194919027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194919027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:22.174630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24306): Terminating (SIGTERM) 19:49:22.214602 run iperf3-srv_10.42.42.10(pid=24307): Terminating (SIGTERM) 19:49:22.254320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24308): Terminating (SIGTERM) 19:49:22.294573 run iperf3-srv_10.42.42.10(pid=24309): Terminating (SIGTERM) 19:49:22.334449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24312): Terminating (SIGTERM) 19:49:22.374649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24315): Terminating (SIGTERM) 19:49:22.414369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24318): Terminating (SIGTERM) 19:49:22.454779 --- ParallelTerminationStrategy: PID 24306 died... 19:49:22.473876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24306): Terminated: ok {rc=0} 19:49:22.517933 --- ParallelTerminationStrategy: PID 24307 died... 19:49:22.536407 run iperf3-srv_10.42.42.10(pid=24307): Terminated {rc=256} 19:49:22.580342 --- ParallelTerminationStrategy: PID 24308 died... 19:49:22.599215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24308): Terminated: ok {rc=0} 19:49:22.642878 --- ParallelTerminationStrategy: PID 24309 died... 19:49:22.661472 run iperf3-srv_10.42.42.10(pid=24309): Terminated {rc=256} 19:49:22.704942 --- ParallelTerminationStrategy: PID 24312 died... 19:49:22.723635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24312): Terminated: ok {rc=0} 19:49:22.767323 --- ParallelTerminationStrategy: PID 24315 died... 19:49:22.785955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24315): Terminated: ok {rc=0} 19:49:22.829731 --- ParallelTerminationStrategy: PID 24318 died... 19:49:22.848301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24318): Terminated: ok {rc=0} 19:49:22.933259 bus /gobi_0: Setting Powered False 19:49:24.032738 bus /gobi_0: Setting Powered False 19:49:25.147756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 19:49:26.292621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.304054 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:26.355506 tst iperf3.py: using LAC 35873 19:49:26.472652 tst iperf3.py: using RAC 173 19:49:26.589989 tst iperf3.py: using CellId 35873 19:49:26.707288 tst iperf3.py: using BVCI 35874 19:49:26.815562 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.826582 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.837291 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.847954 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.858618 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.869206 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.880001 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.890588 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:26.901445 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:27.019867 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:27.238524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:27.563443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Launched 19:49:27.844145 run iperf3-srv_10.42.42.10(pid=24321): Launched 19:49:27.965106 tst iperf3.py:8: start network... 19:49:28.184014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:28.684789 run create_hlr_db(pid=24322): Launched 19:49:28.810934 bus /gobi_6: Setting Powered False 19:49:29.871200 run create_hlr_db(pid=24322): Terminated: ok {rc=0} 19:49:30.310357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24324): Launched 19:49:30.633050 run osmo-hlr_10.42.42.2(pid=24325): Launched 19:49:30.756697 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:31.384493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24327): Launched 19:49:31.704676 run osmo-stp_10.42.42.5(pid=24328): Launched 19:49:31.959492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:32.544319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24330): Launched 19:49:32.658728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:32.913419 run patchelf(pid=24331): Launched 19:49:33.079564 run osmo-stp_10.42.42.5(pid=24328): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24328)] 19:49:33.207405 run osmo-stp_10.42.42.5(pid=24328): stdout: | (launched: 2022-12-13_19:49:31.643376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:33.335774 run osmo-stp_10.42.42.5(pid=24328): stderr: | 20221213194931847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194931847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194931848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194931848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194931849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194931849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194931849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:33.465354 run osmo-stp_10.42.42.5(pid=24328): stdout: | (launched: 2022-12-13_19:49:31.643376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:33.588472 run osmo-stp_10.42.42.5(pid=24328): stderr: | 20221213194931847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194931847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194931848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194931848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194931849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194931849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194931849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:33.734261 run patchelf(pid=24331): Terminating (SIGINT) 19:49:33.902287 run patchelf(pid=24331): Terminated: ok {rc=0} 19:49:34.023344 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24328): Process ended prematurely: osmo-stp_10.42.42.5(pid=24328) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24328)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 19:49:34.032899 tst iperf3.py:8: Test FAILED (7.8 sec) 19:49:34.060001 run osmo-hlr_10.42.42.2(pid=24325): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24325)] 19:49:34.107840 run osmo-hlr_10.42.42.2(pid=24325): stdout: | (launched: 2022-12-13_19:49:30.574015) 19:49:34.157178 run osmo-hlr_10.42.42.2(pid=24325): stderr: | 20221213194930767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194930767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194930767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194930767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194930767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194930767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194930780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194930789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194930789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194930789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:34.206953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Terminating (SIGTERM) 19:49:34.246982 run iperf3-srv_10.42.42.10(pid=24321): Terminating (SIGTERM) 19:49:34.286629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24324): Terminating (SIGTERM) 19:49:34.326503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24327): Terminating (SIGTERM) 19:49:34.366269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24330): Terminating (SIGTERM) 19:49:34.406876 --- ParallelTerminationStrategy: PID 24320 died... 19:49:34.426156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Terminated: ok {rc=0} 19:49:34.470707 --- ParallelTerminationStrategy: PID 24321 died... 19:49:34.489405 run iperf3-srv_10.42.42.10(pid=24321): Terminated {rc=256} 19:49:34.532930 --- ParallelTerminationStrategy: PID 24324 died... 19:49:34.551886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24324): Terminated: ok {rc=0} 19:49:34.595375 --- ParallelTerminationStrategy: PID 24327 died... 19:49:34.614160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24327): Terminated: ok {rc=0} 19:49:34.657792 --- ParallelTerminationStrategy: PID 24330 died... 19:49:34.676476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24330): Terminated: ok {rc=0} 19:49:34.761457 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 19:49:35.907050 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:35.918648 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:35.967728 tst iperf3m4.py: using LAC 35874 19:49:36.087018 tst iperf3m4.py: using RAC 174 19:49:36.204814 tst iperf3m4.py: using CellId 35874 19:49:36.322583 tst iperf3m4.py: using BVCI 35875 19:49:36.433679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.444659 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.455471 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.466184 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.476730 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.487391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.498262 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.508898 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:36.519621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:36.634445 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:36.755312 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:36.871402 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:36.992505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:49:37.211397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:37.536824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24332): Launched 19:49:37.819281 run iperf3-srv_10.42.42.10(pid=24333): Launched 19:49:37.940625 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:49:38.158956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:38.486122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24334): Launched 19:49:38.769716 run iperf3-srv_10.42.42.10(pid=24335): Launched 19:49:38.891534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:49:39.108786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:39.433938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24336): Launched 19:49:39.715299 run iperf3-srv_10.42.42.10(pid=24337): Launched 19:49:39.836432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:49:40.055911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:49:40.382225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24338): Launched 19:49:40.663241 run iperf3-srv_10.42.42.10(pid=24339): Launched 19:49:40.783706 tst iperf3m4.py:8: start network... 19:49:41.000485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:41.499796 run create_hlr_db(pid=24340): Launched 19:49:41.621707 bus /gobi_6: Setting Powered False 19:49:42.685627 run create_hlr_db(pid=24340): Terminated: ok {rc=0} 19:49:43.115665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Launched 19:49:43.416691 run osmo-hlr_10.42.42.2(pid=24343): Launched 19:49:43.530334 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:44.050644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Launched 19:49:44.352290 run osmo-stp_10.42.42.5(pid=24346): Launched 19:49:44.466777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:49:44.987946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24348): Launched 19:49:45.102055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:49:45.356284 run patchelf(pid=24349): Launched 19:49:45.523170 run osmo-stp_10.42.42.5(pid=24346): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] 19:49:45.649895 run osmo-stp_10.42.42.5(pid=24346): stdout: | (launched: 2022-12-13_19:49:44.295908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:45.777699 run osmo-stp_10.42.42.5(pid=24346): stderr: | 20221213194944464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194944464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194944465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194944465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194944466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194944466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194944466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:45.917662 run osmo-stp_10.42.42.5(pid=24346): stdout: | (launched: 2022-12-13_19:49:44.295908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:49:46.056501 run osmo-stp_10.42.42.5(pid=24346): stderr: | 20221213194944464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213194944464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213194944465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213194944465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213194944466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213194944466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213194944466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:49:46.221338 run patchelf(pid=24349): Terminating (SIGINT) 19:49:46.417230 run patchelf(pid=24349): Terminated: ok {rc=0} 19:49:46.557679 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24346): Process ended prematurely: osmo-stp_10.42.42.5(pid=24346) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 19:49:46.569338 tst iperf3m4.py:8: Test FAILED (10.7 sec) 19:49:46.599973 run osmo-hlr_10.42.42.2(pid=24343): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24343)] 19:49:46.656349 run osmo-hlr_10.42.42.2(pid=24343): stdout: | (launched: 2022-12-13_19:49:43.359963) 19:49:46.712171 run osmo-hlr_10.42.42.2(pid=24343): stderr: | 20221213194943534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194943534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194943534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194943534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194943534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194943534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194943547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194943556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194943556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194943556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:49:46.767448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24332): Terminating (SIGTERM) 19:49:46.812593 run iperf3-srv_10.42.42.10(pid=24333): Terminating (SIGTERM) 19:49:46.860297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24334): Terminating (SIGTERM) 19:49:46.905890 run iperf3-srv_10.42.42.10(pid=24335): Terminating (SIGTERM) 19:49:46.951720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24336): Terminating (SIGTERM) 19:49:46.997262 run iperf3-srv_10.42.42.10(pid=24337): Terminating (SIGTERM) 19:49:47.042441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24338): Terminating (SIGTERM) 19:49:47.088413 run iperf3-srv_10.42.42.10(pid=24339): Terminating (SIGTERM) 19:49:47.132366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Terminating (SIGTERM) 19:49:47.177343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Terminating (SIGTERM) 19:49:47.222701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24348): Terminating (SIGTERM) 19:49:47.266114 --- ParallelTerminationStrategy: PID 24332 died... 19:49:47.286347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24332): Terminated: ok {rc=0} 19:49:47.334026 --- ParallelTerminationStrategy: PID 24333 died... 19:49:47.354395 run iperf3-srv_10.42.42.10(pid=24333): Terminated {rc=256} 19:49:47.401428 --- ParallelTerminationStrategy: PID 24334 died... 19:49:47.421857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24334): Terminated: ok {rc=0} 19:49:47.468622 --- ParallelTerminationStrategy: PID 24335 died... 19:49:47.489097 run iperf3-srv_10.42.42.10(pid=24335): Terminated {rc=256} 19:49:47.535929 --- ParallelTerminationStrategy: PID 24336 died... 19:49:47.556378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24336): Terminated: ok {rc=0} 19:49:47.603301 --- ParallelTerminationStrategy: PID 24337 died... 19:49:47.623868 run iperf3-srv_10.42.42.10(pid=24337): Terminated {rc=256} 19:49:47.670753 --- ParallelTerminationStrategy: PID 24338 died... 19:49:47.691273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24338): Terminated: ok {rc=0} 19:49:47.738236 --- ParallelTerminationStrategy: PID 24339 died... 19:49:47.758690 run iperf3-srv_10.42.42.10(pid=24339): Terminated {rc=256} 19:49:47.805397 --- ParallelTerminationStrategy: PID 24342 died... 19:49:47.825727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Terminated: ok {rc=0} 19:49:47.872811 --- ParallelTerminationStrategy: PID 24345 died... 19:49:47.893661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Terminated: ok {rc=0} 19:49:47.940676 --- ParallelTerminationStrategy: PID 24348 died... 19:49:47.961321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24348): Terminated: ok {rc=0} 19:49:48.050812 bus /gobi_4: Setting Powered False 19:49:49.149324 bus /gobi_4: Setting Powered False 19:49:50.265387 bus /gobi_1: Setting Powered False 19:49:51.363241 bus /gobi_1: Setting Powered False 19:49:52.480564 bus /gobi_0: Setting Powered False 19:49:53.579135 bus /gobi_0: Setting Powered False 19:49:54.695465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 19:49:55.797514 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:55.809662 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:49:55.861140 tst ping.py: using LAC 35875 19:49:55.986977 tst ping.py: using RAC 175 19:49:56.112364 tst ping.py: using CellId 35875 19:49:56.238518 tst ping.py: using BVCI 35876 19:49:56.355322 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.366957 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.378403 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.389808 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.401474 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.413062 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.424827 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:49:56.436504 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:49:56.555018 tst ping.py:19: start network... 19:49:56.767065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:49:57.257658 run create_hlr_db(pid=24351): Launched 19:49:57.377628 bus /gobi_6: Setting Powered False 19:49:58.441071 run create_hlr_db(pid=24351): Terminated: ok {rc=0} 19:49:58.882761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24353): Launched 19:49:59.199585 run osmo-hlr_10.42.42.2(pid=24354): Launched 19:49:59.320629 run osmo-stp_10.42.42.5: Starting osmo-stp 19:49:59.872398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24356): Launched 19:50:00.189817 run osmo-stp_10.42.42.5(pid=24357): Launched 19:50:00.310598 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:00.861629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24359): Launched 19:50:00.989225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:01.264408 run patchelf(pid=24363): Launched 19:50:01.448823 run osmo-stp_10.42.42.5(pid=24357): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24357)] 19:50:01.579126 run osmo-stp_10.42.42.5(pid=24357): stdout: | (launched: 2022-12-13_19:50:00.130928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:01.713829 run osmo-stp_10.42.42.5(pid=24357): stderr: | 20221213195000319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195000320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195000320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195000320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195000321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195000321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195000321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:01.846266 run osmo-stp_10.42.42.5(pid=24357): stdout: | (launched: 2022-12-13_19:50:00.130928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:01.971427 run osmo-stp_10.42.42.5(pid=24357): stderr: | 20221213195000319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195000320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195000320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195000320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195000321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195000321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195000321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:02.123250 run patchelf(pid=24363): Terminating (SIGINT) 19:50:02.293333 run patchelf(pid=24363): Terminated: ok {rc=0} 19:50:02.412919 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24357): Process ended prematurely: osmo-stp_10.42.42.5(pid=24357) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24357)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 19:50:02.422151 tst ping.py:22: Test FAILED (6.6 sec) 19:50:02.448731 run osmo-hlr_10.42.42.2(pid=24354): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24354)] 19:50:02.497197 run osmo-hlr_10.42.42.2(pid=24354): stdout: | (launched: 2022-12-13_19:49:59.140519) 19:50:02.546620 run osmo-hlr_10.42.42.2(pid=24354): stderr: | 20221213194959335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213194959335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213194959335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213194959335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213194959335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213194959335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213194959348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213194959356 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213194959356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213194959356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:02.596692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24353): Terminating (SIGTERM) 19:50:02.637368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24356): Terminating (SIGTERM) 19:50:02.677471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24359): Terminating (SIGTERM) 19:50:02.718333 --- ParallelTerminationStrategy: PID 24353 died... 19:50:02.737816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24353): Terminated: ok {rc=0} 19:50:02.781997 --- ParallelTerminationStrategy: PID 24356 died... 19:50:02.801012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24356): Terminated: ok {rc=0} 19:50:02.845432 --- ParallelTerminationStrategy: PID 24359 died... 19:50:02.864439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24359): Terminated: ok {rc=0} 19:50:02.951030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 19:50:04.037689 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.049373 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 19:50:04.098150 tst ping_idle_ping.py: using LAC 35876 19:50:04.225439 tst ping_idle_ping.py: using RAC 176 19:50:04.342484 tst ping_idle_ping.py: using CellId 35876 19:50:04.459578 tst ping_idle_ping.py: using BVCI 35877 19:50:04.566318 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.577608 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.588563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.599352 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.610328 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.621675 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.632993 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 19:50:04.644025 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 19:50:04.757446 tst ping_idle_ping.py:24: start network... 19:50:04.954918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:05.416834 run create_hlr_db(pid=24364): Launched 19:50:05.537935 bus /gobi_6: Setting Powered False 19:50:06.597710 run create_hlr_db(pid=24364): Terminated: ok {rc=0} 19:50:07.034652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Launched 19:50:07.353459 run osmo-hlr_10.42.42.2(pid=24367): Launched 19:50:07.474888 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:08.023091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Launched 19:50:08.342519 run osmo-stp_10.42.42.5(pid=24370): Launched 19:50:08.463213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:09.012625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24372): Launched 19:50:09.133633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:09.402889 run patchelf(pid=24373): Launched 19:50:09.579163 run osmo-stp_10.42.42.5(pid=24370): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] 19:50:09.713944 run osmo-stp_10.42.42.5(pid=24370): stdout: | (launched: 2022-12-13_19:50:08.283806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:09.850235 run osmo-stp_10.42.42.5(pid=24370): stderr: | 20221213195008471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195008471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195008471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195008472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195008472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195008472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195008472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:09.986459 run osmo-stp_10.42.42.5(pid=24370): stdout: | (launched: 2022-12-13_19:50:08.283806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:10.117305 run osmo-stp_10.42.42.5(pid=24370): stderr: | 20221213195008471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195008471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195008471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195008472 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195008472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195008472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195008472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:10.272765 run patchelf(pid=24373): Terminating (SIGINT) 19:50:10.451346 run patchelf(pid=24373): Terminated: ok {rc=0} 19:50:10.579434 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24370): Process ended prematurely: osmo-stp_10.42.42.5(pid=24370) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 19:50:10.588860 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 19:50:10.616881 run osmo-hlr_10.42.42.2(pid=24367): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24367)] 19:50:10.667885 run osmo-hlr_10.42.42.2(pid=24367): stdout: | (launched: 2022-12-13_19:50:07.294637) 19:50:10.719556 run osmo-hlr_10.42.42.2(pid=24367): stderr: | 20221213195007489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195007490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195007490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195007490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195007490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195007490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195007502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195007510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195007511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195007511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:10.771507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminating (SIGTERM) 19:50:10.813083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Terminating (SIGTERM) 19:50:10.855161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24372): Terminating (SIGTERM) 19:50:10.897840 --- ParallelTerminationStrategy: PID 24366 died... 19:50:10.918384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminated: ok {rc=0} 19:50:10.964802 --- ParallelTerminationStrategy: PID 24369 died... 19:50:10.984871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24369): Terminated: ok {rc=0} 19:50:11.030978 --- ParallelTerminationStrategy: PID 24372 died... 19:50:11.050867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24372): Terminated: ok {rc=0} 19:50:11.137857 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 19:50:12.444325 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:50:12.451748 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 19:50:12.485703 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 19:50:12.525777 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 19:50:12.615093 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 19:50:12.648598 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 19:50:12.688730 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 19:50:13.286772 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 19:50:13.339035 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.350516 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:13.418617 tst cs_paging_gprs_active.py: using LAC 35877 19:50:13.544523 tst cs_paging_gprs_active.py: using RAC 177 19:50:13.670490 tst cs_paging_gprs_active.py: using CellId 35877 19:50:13.788646 tst cs_paging_gprs_active.py: using BVCI 35878 19:50:13.898672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.909679 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.920423 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.931248 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.942091 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.952771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.963630 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.974374 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:13.985307 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:14.103840 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:14.225656 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:50:14.444857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:14.769853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24378): Launched 19:50:15.049708 run iperf3-srv_10.42.42.10(pid=24379): Launched 19:50:15.169883 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:50:15.386811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:15.708664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Launched 19:50:16.001083 run iperf3-srv_10.42.42.10(pid=24381): Launched 19:50:16.133281 tst cs_paging_gprs_active.py:38: start network... 19:50:16.355624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:16.865813 run create_hlr_db(pid=24382): Launched 19:50:17.024318 bus /gobi_6: Setting Powered False 19:50:18.088517 run create_hlr_db(pid=24382): Terminated: ok {rc=0} 19:50:18.519059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24384): Launched 19:50:18.821673 run osmo-hlr_10.42.42.2(pid=24385): Launched 19:50:18.934741 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:19.467492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24387): Launched 19:50:19.767016 run osmo-stp_10.42.42.5(pid=24388): Launched 19:50:19.880481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:20.397096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24390): Launched 19:50:20.511252 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:20.766096 run patchelf(pid=24391): Launched 19:50:20.933091 run osmo-stp_10.42.42.5(pid=24388): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24388)] 19:50:21.059793 run osmo-stp_10.42.42.5(pid=24388): stdout: | (launched: 2022-12-13_19:50:19.711534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:21.188338 run osmo-stp_10.42.42.5(pid=24388): stderr: | 20221213195019877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195019877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195019878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195019878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195019878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195019879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195019879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:21.317247 run osmo-stp_10.42.42.5(pid=24388): stdout: | (launched: 2022-12-13_19:50:19.711534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:21.439967 run osmo-stp_10.42.42.5(pid=24388): stderr: | 20221213195019877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195019877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195019878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195019878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195019878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195019879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195019879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:21.585577 run patchelf(pid=24391): Terminating (SIGINT) 19:50:21.753941 run patchelf(pid=24391): Terminated: ok {rc=0} 19:50:21.875069 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24388): Process ended prematurely: osmo-stp_10.42.42.5(pid=24388) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24388)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 19:50:21.884744 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 19:50:21.911822 run osmo-hlr_10.42.42.2(pid=24385): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24385)] 19:50:21.959695 run osmo-hlr_10.42.42.2(pid=24385): stdout: | (launched: 2022-12-13_19:50:18.765087) 19:50:22.009136 run osmo-hlr_10.42.42.2(pid=24385): stderr: | 20221213195018937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195018937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195018937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195018937 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195018937 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195018937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195018950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195018959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195018959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195018959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:22.058662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24378): Terminating (SIGTERM) 19:50:22.098313 run iperf3-srv_10.42.42.10(pid=24379): Terminating (SIGTERM) 19:50:22.137689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Terminating (SIGTERM) 19:50:22.177297 run iperf3-srv_10.42.42.10(pid=24381): Terminating (SIGTERM) 19:50:22.218646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24384): Terminating (SIGTERM) 19:50:22.259008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24387): Terminating (SIGTERM) 19:50:22.298633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24390): Terminating (SIGTERM) 19:50:22.338345 --- ParallelTerminationStrategy: PID 24378 died... 19:50:22.357424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24378): Terminated: ok {rc=0} 19:50:22.400779 --- ParallelTerminationStrategy: PID 24379 died... 19:50:22.419259 run iperf3-srv_10.42.42.10(pid=24379): Terminated {rc=256} 19:50:22.462534 --- ParallelTerminationStrategy: PID 24380 died... 19:50:22.480916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24380): Terminated: ok {rc=0} 19:50:22.524159 --- ParallelTerminationStrategy: PID 24381 died... 19:50:22.542595 run iperf3-srv_10.42.42.10(pid=24381): Terminated {rc=256} 19:50:22.585935 --- ParallelTerminationStrategy: PID 24384 died... 19:50:22.604382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24384): Terminated: ok {rc=0} 19:50:22.647806 --- ParallelTerminationStrategy: PID 24387 died... 19:50:22.666387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24387): Terminated: ok {rc=0} 19:50:22.709669 --- ParallelTerminationStrategy: PID 24390 died... 19:50:22.728122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24390): Terminated: ok {rc=0} 19:50:22.812919 bus /gobi_0: Setting Powered False 19:50:23.913738 bus /gobi_0: Setting Powered False 19:50:25.030582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 19:50:26.175500 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.187015 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:26.259424 tst iperf3.py: using LAC 35878 19:50:26.376941 tst iperf3.py: using RAC 178 19:50:26.492418 tst iperf3.py: using CellId 35878 19:50:26.612748 tst iperf3.py: using BVCI 35879 19:50:26.722619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.733621 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.744230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.754893 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.765615 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.776300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.787123 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.798117 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:26.809108 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:26.922603 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:27.124142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:27.427436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24392): Launched 19:50:27.690484 run iperf3-srv_10.42.42.10(pid=24393): Launched 19:50:27.802307 tst iperf3.py:8: start network... 19:50:28.002278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:28.467414 run create_hlr_db(pid=24394): Launched 19:50:28.589230 bus /gobi_6: Setting Powered False 19:50:29.649183 run create_hlr_db(pid=24394): Terminated: ok {rc=0} 19:50:30.069717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24396): Launched 19:50:30.371478 run osmo-hlr_10.42.42.2(pid=24397): Launched 19:50:30.485418 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:31.021904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24399): Launched 19:50:31.337360 run osmo-stp_10.42.42.5(pid=24400): Launched 19:50:31.576395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:32.238441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24402): Launched 19:50:32.352269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:32.606111 run patchelf(pid=24403): Launched 19:50:32.771602 run osmo-stp_10.42.42.5(pid=24400): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24400)] 19:50:32.898947 run osmo-stp_10.42.42.5(pid=24400): stdout: | (launched: 2022-12-13_19:50:31.279446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:33.026797 run osmo-stp_10.42.42.5(pid=24400): stderr: | 20221213195031593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195031593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195031594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195031594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195031594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195031595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195031595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:33.154681 run osmo-stp_10.42.42.5(pid=24400): stdout: | (launched: 2022-12-13_19:50:31.279446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:33.277116 run osmo-stp_10.42.42.5(pid=24400): stderr: | 20221213195031593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195031593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195031594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195031594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195031594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195031595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195031595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:33.422210 run patchelf(pid=24403): Terminating (SIGINT) 19:50:33.590196 run patchelf(pid=24403): Terminated: ok {rc=0} 19:50:33.711504 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24400): Process ended prematurely: osmo-stp_10.42.42.5(pid=24400) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24400)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 19:50:33.720749 tst iperf3.py:8: Test FAILED (7.6 sec) 19:50:33.747696 run osmo-hlr_10.42.42.2(pid=24397): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24397)] 19:50:33.794996 run osmo-hlr_10.42.42.2(pid=24397): stdout: | (launched: 2022-12-13_19:50:30.315451) 19:50:33.844127 run osmo-hlr_10.42.42.2(pid=24397): stderr: | 20221213195030488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195030488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195030488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195030488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195030488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195030488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195030500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195030510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195030510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195030510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:33.893592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24392): Terminating (SIGTERM) 19:50:33.933165 run iperf3-srv_10.42.42.10(pid=24393): Terminating (SIGTERM) 19:50:33.972555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24396): Terminating (SIGTERM) 19:50:34.011989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24399): Terminating (SIGTERM) 19:50:34.051384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24402): Terminating (SIGTERM) 19:50:34.091245 --- ParallelTerminationStrategy: PID 24392 died... 19:50:34.110322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24392): Terminated: ok {rc=0} 19:50:34.154030 --- ParallelTerminationStrategy: PID 24393 died... 19:50:34.172427 run iperf3-srv_10.42.42.10(pid=24393): Terminated {rc=256} 19:50:34.215870 --- ParallelTerminationStrategy: PID 24396 died... 19:50:34.234431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24396): Terminated: ok {rc=0} 19:50:34.277980 --- ParallelTerminationStrategy: PID 24399 died... 19:50:34.296703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24399): Terminated: ok {rc=0} 19:50:34.340284 --- ParallelTerminationStrategy: PID 24402 died... 19:50:34.358966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24402): Terminated: ok {rc=0} 19:50:34.443990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 19:50:35.588449 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:35.600064 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:35.670213 tst iperf3m4.py: using LAC 35879 19:50:35.787793 tst iperf3m4.py: using RAC 179 19:50:35.903920 tst iperf3m4.py: using CellId 35879 19:50:36.019351 tst iperf3m4.py: using BVCI 35880 19:50:36.136690 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.148329 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.160027 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.171353 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.183015 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.194997 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.206850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.218583 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:36.230376 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:36.350978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:36.472016 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:36.588499 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:36.706871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:50:36.925593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:37.250844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24404): Launched 19:50:37.532410 run iperf3-srv_10.42.42.10(pid=24405): Launched 19:50:37.653512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:50:37.870997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:38.195152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24406): Launched 19:50:38.474887 run iperf3-srv_10.42.42.10(pid=24407): Launched 19:50:38.595525 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:50:38.812755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:39.137449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24408): Launched 19:50:39.417872 run iperf3-srv_10.42.42.10(pid=24409): Launched 19:50:39.538078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:50:39.754157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:50:40.077630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24410): Launched 19:50:40.358113 run iperf3-srv_10.42.42.10(pid=24411): Launched 19:50:40.478628 tst iperf3m4.py:8: start network... 19:50:40.695699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:41.197735 run create_hlr_db(pid=24412): Launched 19:50:41.319614 bus /gobi_6: Setting Powered False 19:50:42.379644 run create_hlr_db(pid=24412): Terminated: ok {rc=0} 19:50:42.808727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Launched 19:50:43.110884 run osmo-hlr_10.42.42.2(pid=24415): Launched 19:50:43.224247 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:43.756686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Launched 19:50:44.057404 run osmo-stp_10.42.42.5(pid=24418): Launched 19:50:44.171715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:50:44.688607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Launched 19:50:44.802519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:50:45.057188 run patchelf(pid=24421): Launched 19:50:45.223476 run osmo-stp_10.42.42.5(pid=24418): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] 19:50:45.349759 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-13_19:50:44.001219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:45.477747 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221213195044168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195044168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195044168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195044169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195044169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195044169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195044169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:45.605569 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-13_19:50:44.001219) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:50:45.727962 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221213195044168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195044168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195044168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195044169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195044169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195044169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195044169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:50:45.873465 run patchelf(pid=24421): Terminating (SIGINT) 19:50:46.044569 run patchelf(pid=24421): Terminated: ok {rc=0} 19:50:46.168750 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 19:50:46.178911 tst iperf3m4.py:8: Test FAILED (10.6 sec) 19:50:46.207400 run osmo-hlr_10.42.42.2(pid=24415): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24415)] 19:50:46.255876 run osmo-hlr_10.42.42.2(pid=24415): stdout: | (launched: 2022-12-13_19:50:43.054646) 19:50:46.306031 run osmo-hlr_10.42.42.2(pid=24415): stderr: | 20221213195043229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195043229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195043229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195043229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195043229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195043229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195043241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195043250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195043250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195043250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:50:46.356720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24404): Terminating (SIGTERM) 19:50:46.398032 run iperf3-srv_10.42.42.10(pid=24405): Terminating (SIGTERM) 19:50:46.441574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24406): Terminating (SIGTERM) 19:50:46.483376 run iperf3-srv_10.42.42.10(pid=24407): Terminating (SIGTERM) 19:50:46.527030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24408): Terminating (SIGTERM) 19:50:46.568396 run iperf3-srv_10.42.42.10(pid=24409): Terminating (SIGTERM) 19:50:46.612476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24410): Terminating (SIGTERM) 19:50:46.653768 run iperf3-srv_10.42.42.10(pid=24411): Terminating (SIGTERM) 19:50:46.697527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminating (SIGTERM) 19:50:46.738456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminating (SIGTERM) 19:50:46.779115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Terminating (SIGTERM) 19:50:46.821598 --- ParallelTerminationStrategy: PID 24404 died... 19:50:46.841205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24404): Terminated: ok {rc=0} 19:50:46.886385 --- ParallelTerminationStrategy: PID 24405 died... 19:50:46.905903 run iperf3-srv_10.42.42.10(pid=24405): Terminated {rc=256} 19:50:46.950440 --- ParallelTerminationStrategy: PID 24406 died... 19:50:46.970330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24406): Terminated: ok {rc=0} 19:50:47.015698 --- ParallelTerminationStrategy: PID 24407 died... 19:50:47.035256 run iperf3-srv_10.42.42.10(pid=24407): Terminated {rc=256} 19:50:47.079739 --- ParallelTerminationStrategy: PID 24408 died... 19:50:47.099103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24408): Terminated: ok {rc=0} 19:50:47.144307 --- ParallelTerminationStrategy: PID 24409 died... 19:50:47.163685 run iperf3-srv_10.42.42.10(pid=24409): Terminated {rc=256} 19:50:47.208212 --- ParallelTerminationStrategy: PID 24410 died... 19:50:47.227360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24410): Terminated: ok {rc=0} 19:50:47.272251 --- ParallelTerminationStrategy: PID 24411 died... 19:50:47.290975 run iperf3-srv_10.42.42.10(pid=24411): Terminated {rc=256} 19:50:47.334283 --- ParallelTerminationStrategy: PID 24414 died... 19:50:47.352892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminated: ok {rc=0} 19:50:47.396406 --- ParallelTerminationStrategy: PID 24417 died... 19:50:47.415149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminated: ok {rc=0} 19:50:47.458847 --- ParallelTerminationStrategy: PID 24420 died... 19:50:47.477768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Terminated: ok {rc=0} 19:50:47.561575 bus /gobi_4: Setting Powered False 19:50:48.661427 bus /gobi_4: Setting Powered False 19:50:49.778890 bus /gobi_1: Setting Powered False 19:50:50.878754 bus /gobi_1: Setting Powered False 19:50:51.996197 bus /gobi_0: Setting Powered False 19:50:53.091212 bus /gobi_0: Setting Powered False 19:50:54.207475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 19:50:55.310317 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.321911 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:50:55.389411 tst ping.py: using LAC 35880 19:50:55.508078 tst ping.py: using RAC 180 19:50:55.628067 tst ping.py: using CellId 35880 19:50:55.742363 tst ping.py: using BVCI 35881 19:50:55.848855 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.859971 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.870817 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.881697 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.892388 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.903264 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.914221 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:50:55.924927 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:50:56.036872 tst ping.py:19: start network... 19:50:56.234360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:50:56.693230 run create_hlr_db(pid=24422): Launched 19:50:56.813507 bus /gobi_6: Setting Powered False 19:50:57.873306 run create_hlr_db(pid=24422): Terminated: ok {rc=0} 19:50:58.288137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24425): Launched 19:50:58.584151 run osmo-hlr_10.42.42.2(pid=24426): Launched 19:50:58.695865 run osmo-stp_10.42.42.5: Starting osmo-stp 19:50:59.207766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24428): Launched 19:50:59.503204 run osmo-stp_10.42.42.5(pid=24429): Launched 19:50:59.615385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:00.127723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24431): Launched 19:51:00.240652 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:00.490942 run patchelf(pid=24432): Launched 19:51:00.654501 run osmo-stp_10.42.42.5(pid=24429): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24429)] 19:51:00.779549 run osmo-stp_10.42.42.5(pid=24429): stdout: | (launched: 2022-12-13_19:50:59.447905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:00.914538 run osmo-stp_10.42.42.5(pid=24429): stderr: | 20221213195059613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195059613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195059613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195059614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195059614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195059614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195059614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:01.044132 run osmo-stp_10.42.42.5(pid=24429): stdout: | (launched: 2022-12-13_19:50:59.447905) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:01.168587 run osmo-stp_10.42.42.5(pid=24429): stderr: | 20221213195059613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195059613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195059613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195059614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195059614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195059614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195059614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:01.314812 run patchelf(pid=24432): Terminating (SIGINT) 19:51:01.484073 run patchelf(pid=24432): Terminated: ok {rc=0} 19:51:01.606217 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24429): Process ended prematurely: osmo-stp_10.42.42.5(pid=24429) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24429)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 19:51:01.616131 tst ping.py:22: Test FAILED (6.3 sec) 19:51:01.644105 run osmo-hlr_10.42.42.2(pid=24426): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24426)] 19:51:01.693055 run osmo-hlr_10.42.42.2(pid=24426): stdout: | (launched: 2022-12-13_19:50:58.528893) 19:51:01.743052 run osmo-hlr_10.42.42.2(pid=24426): stderr: | 20221213195058702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195058702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195058702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195058702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195058702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195058702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195058714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195058723 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195058723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195058723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:01.793620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24425): Terminating (SIGTERM) 19:51:01.834131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24428): Terminating (SIGTERM) 19:51:01.874639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24431): Terminating (SIGTERM) 19:51:01.915597 --- ParallelTerminationStrategy: PID 24425 died... 19:51:01.935385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24425): Terminated: ok {rc=0} 19:51:01.980153 --- ParallelTerminationStrategy: PID 24428 died... 19:51:01.999444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24428): Terminated: ok {rc=0} 19:51:02.044127 --- ParallelTerminationStrategy: PID 24431 died... 19:51:02.063637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24431): Terminated: ok {rc=0} 19:51:02.150911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 19:51:03.240164 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.251815 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 19:51:03.319245 tst ping_idle_ping.py: using LAC 35881 19:51:03.436368 tst ping_idle_ping.py: using RAC 181 19:51:03.554548 tst ping_idle_ping.py: using CellId 35881 19:51:03.673067 tst ping_idle_ping.py: using BVCI 35882 19:51:03.780498 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.791640 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.802573 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.813419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.824194 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.835000 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.845937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 19:51:03.856755 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 19:51:03.975078 tst ping_idle_ping.py:24: start network... 19:51:04.174587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:04.641562 run create_hlr_db(pid=24433): Launched 19:51:04.763329 bus /gobi_6: Setting Powered False 19:51:05.822878 run create_hlr_db(pid=24433): Terminated: ok {rc=0} 19:51:06.239393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Launched 19:51:06.536581 run osmo-hlr_10.42.42.2(pid=24436): Launched 19:51:06.648495 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:07.159169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Launched 19:51:07.455594 run osmo-stp_10.42.42.5(pid=24439): Launched 19:51:07.567691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:08.078340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24441): Launched 19:51:08.191088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:08.442544 run patchelf(pid=24442): Launched 19:51:08.606508 run osmo-stp_10.42.42.5(pid=24439): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] 19:51:08.731909 run osmo-stp_10.42.42.5(pid=24439): stdout: | (launched: 2022-12-13_19:51:07.400406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:08.858785 run osmo-stp_10.42.42.5(pid=24439): stderr: | 20221213195107568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195107568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195107568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195107569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195107569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195107569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195107569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:08.985609 run osmo-stp_10.42.42.5(pid=24439): stdout: | (launched: 2022-12-13_19:51:07.400406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:09.107344 run osmo-stp_10.42.42.5(pid=24439): stderr: | 20221213195107568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195107568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195107568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195107569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195107569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195107569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195107569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:09.252067 run patchelf(pid=24442): Terminating (SIGINT) 19:51:09.418324 run patchelf(pid=24442): Terminated: ok {rc=0} 19:51:09.537883 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24439): Process ended prematurely: osmo-stp_10.42.42.5(pid=24439) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 19:51:09.547261 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 19:51:09.573925 run osmo-hlr_10.42.42.2(pid=24436): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24436)] 19:51:09.621440 run osmo-hlr_10.42.42.2(pid=24436): stdout: | (launched: 2022-12-13_19:51:06.480933) 19:51:09.670735 run osmo-hlr_10.42.42.2(pid=24436): stderr: | 20221213195106654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195106654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195106654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195106654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195106654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195106654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195106667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195106678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195106678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195106678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:09.720146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Terminating (SIGTERM) 19:51:09.759846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Terminating (SIGTERM) 19:51:09.799595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24441): Terminating (SIGTERM) 19:51:09.840295 --- ParallelTerminationStrategy: PID 24435 died... 19:51:09.859488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24435): Terminated: ok {rc=0} 19:51:09.903338 --- ParallelTerminationStrategy: PID 24438 died... 19:51:09.922213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24438): Terminated: ok {rc=0} 19:51:09.965928 --- ParallelTerminationStrategy: PID 24441 died... 19:51:09.984542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24441): Terminated: ok {rc=0} 19:51:10.067747 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 19:51:11.379276 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:51:11.387389 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 19:51:11.418950 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 19:51:11.457735 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 19:51:11.544019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 19:51:11.575949 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 19:51:11.613902 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 19:51:12.215615 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 19:51:12.268634 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.280593 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:51:12.331315 tst cs_paging_gprs_active.py: using LAC 35882 19:51:12.457765 tst cs_paging_gprs_active.py: using RAC 182 19:51:12.582741 tst cs_paging_gprs_active.py: using CellId 35882 19:51:12.706668 tst cs_paging_gprs_active.py: using BVCI 35883 19:51:12.823680 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.835504 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.847430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.859076 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.870968 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.882856 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.894993 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.906875 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:12.919223 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:13.035998 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:13.153511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 19:51:13.371917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:13.694918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24448): Launched 19:51:13.973552 run iperf3-srv_10.42.42.10(pid=24449): Launched 19:51:14.093670 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 19:51:14.310122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:14.632204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24450): Launched 19:51:14.910775 run iperf3-srv_10.42.42.10(pid=24451): Launched 19:51:15.030914 tst cs_paging_gprs_active.py:38: start network... 19:51:15.248316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:15.747269 run create_hlr_db(pid=24452): Launched 19:51:15.880510 bus /gobi_6: Setting Powered False 19:51:16.942195 run create_hlr_db(pid=24452): Terminated: ok {rc=0} 19:51:17.401365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24454): Launched 19:51:17.721397 run osmo-hlr_10.42.42.2(pid=24455): Launched 19:51:17.843698 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:18.396256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24457): Launched 19:51:18.717520 run osmo-stp_10.42.42.5(pid=24458): Launched 19:51:18.840031 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:19.394601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24460): Launched 19:51:19.517515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:19.788453 run patchelf(pid=24461): Launched 19:51:19.966425 run osmo-stp_10.42.42.5(pid=24458): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24458)] 19:51:20.102303 run osmo-stp_10.42.42.5(pid=24458): stdout: | (launched: 2022-12-13_19:51:18.658715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:20.239978 run osmo-stp_10.42.42.5(pid=24458): stderr: | 20221213195118846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195118846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195118846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195118847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195118847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195118847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195118847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:20.377785 run osmo-stp_10.42.42.5(pid=24458): stdout: | (launched: 2022-12-13_19:51:18.658715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:20.509322 run osmo-stp_10.42.42.5(pid=24458): stderr: | 20221213195118846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195118846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195118846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195118847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195118847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195118847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195118847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:20.665265 run patchelf(pid=24461): Terminating (SIGINT) 19:51:20.844628 run patchelf(pid=24461): Terminated: ok {rc=0} 19:51:20.974345 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24458): Process ended prematurely: osmo-stp_10.42.42.5(pid=24458) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24458)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 19:51:20.984376 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 19:51:21.012593 run osmo-hlr_10.42.42.2(pid=24455): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24455)] 19:51:21.063807 run osmo-hlr_10.42.42.2(pid=24455): stdout: | (launched: 2022-12-13_19:51:17.662777) 19:51:21.116070 run osmo-hlr_10.42.42.2(pid=24455): stderr: | 20221213195117856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195117856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195117856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195117856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195117856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195117857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195117869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195117877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195117878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195117878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:21.168459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24448): Terminating (SIGTERM) 19:51:21.210273 run iperf3-srv_10.42.42.10(pid=24449): Terminating (SIGTERM) 19:51:21.253116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24450): Terminating (SIGTERM) 19:51:21.295362 run iperf3-srv_10.42.42.10(pid=24451): Terminating (SIGTERM) 19:51:21.337405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24454): Terminating (SIGTERM) 19:51:21.379446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24457): Terminating (SIGTERM) 19:51:21.421411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24460): Terminating (SIGTERM) 19:51:21.463555 --- ParallelTerminationStrategy: PID 24448 died... 19:51:21.483849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24448): Terminated: ok {rc=0} 19:51:21.530723 --- ParallelTerminationStrategy: PID 24449 died... 19:51:21.550484 run iperf3-srv_10.42.42.10(pid=24449): Terminated {rc=256} 19:51:21.596654 --- ParallelTerminationStrategy: PID 24450 died... 19:51:21.616499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24450): Terminated: ok {rc=0} 19:51:21.662749 --- ParallelTerminationStrategy: PID 24451 died... 19:51:21.682940 run iperf3-srv_10.42.42.10(pid=24451): Terminated {rc=256} 19:51:21.729299 --- ParallelTerminationStrategy: PID 24454 died... 19:51:21.748918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24454): Terminated: ok {rc=0} 19:51:21.794938 --- ParallelTerminationStrategy: PID 24457 died... 19:51:21.814588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24457): Terminated: ok {rc=0} 19:51:21.860710 --- ParallelTerminationStrategy: PID 24460 died... 19:51:21.880572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24460): Terminated: ok {rc=0} 19:51:21.968483 bus /gobi_0: Setting Powered False 19:51:23.067772 bus /gobi_0: Setting Powered False 19:51:24.184789 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 19:51:25.334128 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.346831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:51:25.398516 tst iperf3.py: using LAC 35883 19:51:25.524893 tst iperf3.py: using RAC 183 19:51:25.649712 tst iperf3.py: using CellId 35883 19:51:25.770211 tst iperf3.py: using BVCI 35884 19:51:25.880394 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.892113 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.903496 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.914949 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.926340 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.937567 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.948814 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.959922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:25.971276 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:26.091710 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 19:51:26.307815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:26.628580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24462): Launched 19:51:26.906740 run iperf3-srv_10.42.42.10(pid=24463): Launched 19:51:27.026007 tst iperf3.py:8: start network... 19:51:27.241701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:27.738015 run create_hlr_db(pid=24464): Launched 19:51:27.859902 bus /gobi_6: Setting Powered False 19:51:28.922700 run create_hlr_db(pid=24464): Terminated: ok {rc=0} 19:51:29.369588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24466): Launched 19:51:29.688379 run osmo-hlr_10.42.42.2(pid=24467): Launched 19:51:29.810541 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:30.364663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24469): Launched 19:51:30.685537 run osmo-stp_10.42.42.5(pid=24470): Launched 19:51:30.807024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:31.474390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24472): Launched 19:51:31.605521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:31.870357 run patchelf(pid=24473): Launched 19:51:32.054700 run osmo-stp_10.42.42.5(pid=24470): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24470)] 19:51:32.193731 run osmo-stp_10.42.42.5(pid=24470): stdout: | (launched: 2022-12-13_19:51:30.626678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:32.333982 run osmo-stp_10.42.42.5(pid=24470): stderr: | 20221213195130812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195130812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195130813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195130814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195130814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195130814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195130814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:32.469507 run osmo-stp_10.42.42.5(pid=24470): stdout: | (launched: 2022-12-13_19:51:30.626678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:32.592727 run osmo-stp_10.42.42.5(pid=24470): stderr: | 20221213195130812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195130812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195130813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195130814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195130814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195130814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195130814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:32.738583 run patchelf(pid=24473): Terminating (SIGINT) 19:51:32.906274 run patchelf(pid=24473): Terminated: ok {rc=0} 19:51:33.027337 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24470): Process ended prematurely: osmo-stp_10.42.42.5(pid=24470) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24470)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 19:51:33.037120 tst iperf3.py:8: Test FAILED (7.7 sec) 19:51:33.064205 run osmo-hlr_10.42.42.2(pid=24467): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24467)] 19:51:33.112151 run osmo-hlr_10.42.42.2(pid=24467): stdout: | (launched: 2022-12-13_19:51:29.629792) 19:51:33.161868 run osmo-hlr_10.42.42.2(pid=24467): stderr: | 20221213195129824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195129824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195129824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195129824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195129824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195129824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195129836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195129845 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195129845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195129845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:33.211914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24462): Terminating (SIGTERM) 19:51:33.251574 run iperf3-srv_10.42.42.10(pid=24463): Terminating (SIGTERM) 19:51:33.290990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24466): Terminating (SIGTERM) 19:51:33.331333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24469): Terminating (SIGTERM) 19:51:33.370921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24472): Terminating (SIGTERM) 19:51:33.410553 --- ParallelTerminationStrategy: PID 24462 died... 19:51:33.429650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24462): Terminated: ok {rc=0} 19:51:33.473513 --- ParallelTerminationStrategy: PID 24463 died... 19:51:33.491917 run iperf3-srv_10.42.42.10(pid=24463): Terminated {rc=256} 19:51:33.535737 --- ParallelTerminationStrategy: PID 24466 died... 19:51:33.554474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24466): Terminated: ok {rc=0} 19:51:33.598445 --- ParallelTerminationStrategy: PID 24469 died... 19:51:33.617250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24469): Terminated: ok {rc=0} 19:51:33.661447 --- ParallelTerminationStrategy: PID 24472 died... 19:51:33.680065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24472): Terminated: ok {rc=0} 19:51:33.764136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 19:51:34.913628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:34.926366 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:51:34.981310 tst iperf3m4.py: using LAC 35884 19:51:35.108368 tst iperf3m4.py: using RAC 184 19:51:35.239567 tst iperf3m4.py: using CellId 35884 19:51:35.378557 tst iperf3m4.py: using BVCI 35885 19:51:35.496669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.508613 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.520337 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.532079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.544560 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.557107 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.570039 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.582410 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:35.595112 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:35.715973 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:35.833724 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:35.952283 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:36.071960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 19:51:36.292130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:36.615413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24474): Launched 19:51:36.895318 run iperf3-srv_10.42.42.10(pid=24475): Launched 19:51:37.016017 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 19:51:37.233370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:37.557622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24476): Launched 19:51:37.838135 run iperf3-srv_10.42.42.10(pid=24477): Launched 19:51:37.958328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 19:51:38.175008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:38.499096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24478): Launched 19:51:38.778976 run iperf3-srv_10.42.42.10(pid=24479): Launched 19:51:38.899860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 19:51:39.116283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 19:51:39.441465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24480): Launched 19:51:39.721860 run iperf3-srv_10.42.42.10(pid=24481): Launched 19:51:39.841927 tst iperf3m4.py:8: start network... 19:51:40.058283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:40.558189 run create_hlr_db(pid=24482): Launched 19:51:40.679558 bus /gobi_6: Setting Powered False 19:51:41.742842 run create_hlr_db(pid=24482): Terminated: ok {rc=0} 19:51:42.189458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Launched 19:51:42.511138 run osmo-hlr_10.42.42.2(pid=24485): Launched 19:51:42.633203 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:43.190241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Launched 19:51:43.513679 run osmo-stp_10.42.42.5(pid=24488): Launched 19:51:43.635903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:44.192466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Launched 19:51:44.315779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:51:44.588642 run patchelf(pid=24491): Launched 19:51:44.766654 run osmo-stp_10.42.42.5(pid=24488): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] 19:51:44.903074 run osmo-stp_10.42.42.5(pid=24488): stdout: | (launched: 2022-12-13_19:51:43.454004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:45.041214 run osmo-stp_10.42.42.5(pid=24488): stderr: | 20221213195143644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195143644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195143644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195143645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195143645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195143645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195143645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:45.179222 run osmo-stp_10.42.42.5(pid=24488): stdout: | (launched: 2022-12-13_19:51:43.454004) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:51:45.311877 run osmo-stp_10.42.42.5(pid=24488): stderr: | 20221213195143644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195143644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195143644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195143645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195143645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195143645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195143645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:51:45.468753 run patchelf(pid=24491): Terminating (SIGINT) 19:51:45.648229 run patchelf(pid=24491): Terminated: ok {rc=0} 19:51:45.778282 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24488): Process ended prematurely: osmo-stp_10.42.42.5(pid=24488) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 19:51:45.788520 tst iperf3m4.py:8: Test FAILED (10.9 sec) 19:51:45.817400 run osmo-hlr_10.42.42.2(pid=24485): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24485)] 19:51:45.869212 run osmo-hlr_10.42.42.2(pid=24485): stdout: | (launched: 2022-12-13_19:51:42.451797) 19:51:45.924364 run osmo-hlr_10.42.42.2(pid=24485): stderr: | 20221213195142646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195142646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195142646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195142646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195142646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195142646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195142659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195142667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195142667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195142667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:51:45.979119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24474): Terminating (SIGTERM) 19:51:46.021960 run iperf3-srv_10.42.42.10(pid=24475): Terminating (SIGTERM) 19:51:46.067144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24476): Terminating (SIGTERM) 19:51:46.111405 run iperf3-srv_10.42.42.10(pid=24477): Terminating (SIGTERM) 19:51:46.155197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24478): Terminating (SIGTERM) 19:51:46.199693 run iperf3-srv_10.42.42.10(pid=24479): Terminating (SIGTERM) 19:51:46.245726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24480): Terminating (SIGTERM) 19:51:46.289990 run iperf3-srv_10.42.42.10(pid=24481): Terminating (SIGTERM) 19:51:46.334135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Terminating (SIGTERM) 19:51:46.378102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Terminating (SIGTERM) 19:51:46.421944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Terminating (SIGTERM) 19:51:46.466224 --- ParallelTerminationStrategy: PID 24474 died... 19:51:46.489373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24474): Terminated: ok {rc=0} 19:51:46.537700 --- ParallelTerminationStrategy: PID 24475 died... 19:51:46.558643 run iperf3-srv_10.42.42.10(pid=24475): Terminated {rc=256} 19:51:46.606778 --- ParallelTerminationStrategy: PID 24476 died... 19:51:46.628519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24476): Terminated: ok {rc=0} 19:51:46.677609 --- ParallelTerminationStrategy: PID 24477 died... 19:51:46.698012 run iperf3-srv_10.42.42.10(pid=24477): Terminated {rc=256} 19:51:46.746902 --- ParallelTerminationStrategy: PID 24478 died... 19:51:46.767339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24478): Terminated: ok {rc=0} 19:51:46.816511 --- ParallelTerminationStrategy: PID 24479 died... 19:51:46.837094 run iperf3-srv_10.42.42.10(pid=24479): Terminated {rc=256} 19:51:46.886126 --- ParallelTerminationStrategy: PID 24480 died... 19:51:46.906668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24480): Terminated: ok {rc=0} 19:51:46.954899 --- ParallelTerminationStrategy: PID 24481 died... 19:51:46.975803 run iperf3-srv_10.42.42.10(pid=24481): Terminated {rc=256} 19:51:47.025103 --- ParallelTerminationStrategy: PID 24484 died... 19:51:47.045581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Terminated: ok {rc=0} 19:51:47.094728 --- ParallelTerminationStrategy: PID 24487 died... 19:51:47.115302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Terminated: ok {rc=0} 19:51:47.164277 --- ParallelTerminationStrategy: PID 24490 died... 19:51:47.184809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Terminated: ok {rc=0} 19:51:47.276627 bus /gobi_4: Setting Powered False 19:51:48.377422 bus /gobi_4: Setting Powered False 19:51:49.494171 bus /gobi_1: Setting Powered False 19:51:50.591859 bus /gobi_1: Setting Powered False 19:51:51.707733 bus /gobi_0: Setting Powered False 19:51:52.805913 bus /gobi_0: Setting Powered False 19:51:53.923536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 19:51:55.025905 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.038486 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:51:55.091443 tst ping.py: using LAC 35885 19:51:55.208687 tst ping.py: using RAC 185 19:51:55.324603 tst ping.py: using CellId 35885 19:51:55.441404 tst ping.py: using BVCI 35886 19:51:55.548089 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.559951 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.571257 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.582530 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.593726 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.605055 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.616410 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:51:55.627651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:51:55.745235 tst ping.py:19: start network... 19:51:55.957947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:51:56.450138 run create_hlr_db(pid=24492): Launched 19:51:56.571462 bus /gobi_6: Setting Powered False 19:51:57.633629 run create_hlr_db(pid=24492): Terminated: ok {rc=0} 19:51:58.056805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Launched 19:51:58.352465 run osmo-hlr_10.42.42.2(pid=24495): Launched 19:51:58.464546 run osmo-stp_10.42.42.5: Starting osmo-stp 19:51:58.987126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Launched 19:51:59.281353 run osmo-stp_10.42.42.5(pid=24498): Launched 19:51:59.393303 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:51:59.902612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Launched 19:52:00.014914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:00.265046 run patchelf(pid=24501): Launched 19:52:00.427604 run osmo-stp_10.42.42.5(pid=24498): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] 19:52:00.552198 run osmo-stp_10.42.42.5(pid=24498): stdout: | (launched: 2022-12-13_19:51:59.226777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:00.678403 run osmo-stp_10.42.42.5(pid=24498): stderr: | 20221213195159392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195159393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195159393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195159393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195159394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195159394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195159394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:00.804593 run osmo-stp_10.42.42.5(pid=24498): stdout: | (launched: 2022-12-13_19:51:59.226777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:00.946429 run osmo-stp_10.42.42.5(pid=24498): stderr: | 20221213195159392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195159393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195159393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195159393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195159394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195159394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195159394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:01.101789 run patchelf(pid=24501): Terminating (SIGINT) 19:52:01.292332 run patchelf(pid=24501): Terminated: ok {rc=0} 19:52:01.425749 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24498): Process ended prematurely: osmo-stp_10.42.42.5(pid=24498) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 19:52:01.436649 tst ping.py:22: Test FAILED (6.4 sec) 19:52:01.466325 run osmo-hlr_10.42.42.2(pid=24495): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24495)] 19:52:01.521209 run osmo-hlr_10.42.42.2(pid=24495): stdout: | (launched: 2022-12-13_19:51:58.297630) 19:52:01.576654 run osmo-hlr_10.42.42.2(pid=24495): stderr: | 20221213195158470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195158470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195158470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195158470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195158470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195158470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195158482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195158491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195158492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195158492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:01.633696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Terminating (SIGTERM) 19:52:01.678207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Terminating (SIGTERM) 19:52:01.729078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Terminating (SIGTERM) 19:52:01.774447 --- ParallelTerminationStrategy: PID 24494 died... 19:52:01.796643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Terminated: ok {rc=0} 19:52:01.848778 --- ParallelTerminationStrategy: PID 24497 died... 19:52:01.869602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Terminated: ok {rc=0} 19:52:01.919652 --- ParallelTerminationStrategy: PID 24500 died... 19:52:01.940639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Terminated: ok {rc=0} 19:52:02.046617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 19:52:03.142575 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.154710 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 19:52:03.206504 tst ping_idle_ping.py: using LAC 35886 19:52:03.324684 tst ping_idle_ping.py: using RAC 186 19:52:03.449703 tst ping_idle_ping.py: using CellId 35886 19:52:03.568028 tst ping_idle_ping.py: using BVCI 35887 19:52:03.684656 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.696752 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.708532 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.720340 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.732426 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.744479 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.756673 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 19:52:03.768843 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 19:52:03.883446 tst ping_idle_ping.py:24: start network... 19:52:04.082559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:04.555424 run create_hlr_db(pid=24502): Launched 19:52:04.677779 bus /gobi_6: Setting Powered False 19:52:05.738442 run create_hlr_db(pid=24502): Terminated: ok {rc=0} 19:52:06.174230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Launched 19:52:06.494191 run osmo-hlr_10.42.42.2(pid=24505): Launched 19:52:06.616345 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:07.168263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Launched 19:52:07.486630 run osmo-stp_10.42.42.5(pid=24508): Launched 19:52:07.602713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:08.116010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24510): Launched 19:52:08.228672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:08.479610 run patchelf(pid=24511): Launched 19:52:08.644084 run osmo-stp_10.42.42.5(pid=24508): ERR: Terminated: ERROR {rc=1} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] 19:52:08.769405 run osmo-stp_10.42.42.5(pid=24508): stdout: | (launched: 2022-12-13_19:52:07.428359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:08.896344 run osmo-stp_10.42.42.5(pid=24508): stderr: | 20221213195207597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195207597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195207597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195207598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195207598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195207598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195207598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:09.023360 run osmo-stp_10.42.42.5(pid=24508): stdout: | (launched: 2022-12-13_19:52:07.428359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:09.144913 run osmo-stp_10.42.42.5(pid=24508): stderr: | 20221213195207597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195207597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195207597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195207598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195207598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195207598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195207598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:09.288856 run patchelf(pid=24511): Terminating (SIGINT) 19:52:09.454612 run patchelf(pid=24511): Terminated: ok {rc=0} 19:52:09.574566 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24508): Process ended prematurely: osmo-stp_10.42.42.5(pid=24508) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 19:52:09.583565 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 19:52:09.610423 run osmo-hlr_10.42.42.2(pid=24505): ERR: Terminated: ERROR {rc=237} [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24505)] 19:52:09.658847 run osmo-hlr_10.42.42.2(pid=24505): stdout: | (launched: 2022-12-13_19:52:06.435702) 19:52:09.708234 run osmo-hlr_10.42.42.2(pid=24505): stderr: | 20221213195206630 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195206630 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195206630 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195206630 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195206630 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195206630 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195206642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195206653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195206653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195206653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:09.757981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Terminating (SIGTERM) 19:52:09.798082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Terminating (SIGTERM) 19:52:09.838014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24510): Terminating (SIGTERM) 19:52:09.878403 --- ParallelTerminationStrategy: PID 24504 died... 19:52:09.897656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Terminated: ok {rc=0} 19:52:09.941804 --- ParallelTerminationStrategy: PID 24507 died... 19:52:09.960634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Terminated: ok {rc=0} 19:52:10.004475 --- ParallelTerminationStrategy: PID 24510 died... 19:52:10.023414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24510): Terminated: ok {rc=0} 19:52:10.109319 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 19:52:11.426419 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:52:11.434323 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 19:52:11.470681 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 19:52:11.506441 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 19:52:11.562038 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 19:52:11.595154 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 19:52:11.630734 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 19:52:12.194613 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2393 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 19:52:12.200250 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.212463 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 19:52:12.282567 tst switch_tch_pdch.py: using LAC 35887 19:52:12.408719 tst switch_tch_pdch.py: using RAC 187 19:52:12.532043 tst switch_tch_pdch.py: using CellId 35887 19:52:12.653216 tst switch_tch_pdch.py: using BVCI 35888 19:52:12.767607 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.779690 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.791600 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.803513 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.815741 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.828099 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.840471 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 19:52:12.852797 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:52:12.970296 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 19:52:13.089860 tst switch_tch_pdch.py:51: start network... 19:52:13.287371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:13.743438 run create_hlr_db(pid=24515): Launched 19:52:13.864412 bus /gobi_6: Setting Powered False 19:52:14.923283 run create_hlr_db(pid=24515): Terminated: ok {rc=0} 19:52:15.333314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24517): Launched 19:52:15.625419 run osmo-hlr_10.42.42.2(pid=24518): Launched 19:52:15.737739 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:16.297101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24520): Launched 19:52:16.679299 run osmo-stp_10.42.42.5(pid=24521): Launched 19:52:17.031011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 19:52:17.634461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24523): Launched 19:52:17.746902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 19:52:17.995295 run patchelf(pid=24524): Launched 19:52:18.158416 run osmo-stp_10.42.42.5(pid=24521): ERR: Terminated: ERROR {rc=1} [trial-2393↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24521)] 19:52:18.283707 run osmo-stp_10.42.42.5(pid=24521): stdout: | (launched: 2022-12-13_19:52:16.608071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:18.410100 run osmo-stp_10.42.42.5(pid=24521): stderr: | 20221213195216926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195216926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195216927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195216927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195216927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195216928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195216928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:18.536346 run osmo-stp_10.42.42.5(pid=24521): stdout: | (launched: 2022-12-13_19:52:16.608071) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:18.657333 run osmo-stp_10.42.42.5(pid=24521): stderr: | 20221213195216926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195216926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195216927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195216927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195216927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195216928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195216928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:18.800830 run patchelf(pid=24524): Terminating (SIGINT) 19:52:18.965706 run patchelf(pid=24524): Terminated: ok {rc=0} 19:52:19.085079 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24521): Process ended prematurely: osmo-stp_10.42.42.5(pid=24521) [trial-2393↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24521)] [trial-2393↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 19:52:19.094022 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 19:52:19.120448 run osmo-hlr_10.42.42.2(pid=24518): ERR: Terminated: ERROR {rc=237} [trial-2393↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24518)] 19:52:19.168156 run osmo-hlr_10.42.42.2(pid=24518): stdout: | (launched: 2022-12-13_19:52:15.571243) 19:52:19.217563 run osmo-hlr_10.42.42.2(pid=24518): stderr: | 20221213195215742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195215742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195215742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195215742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195215742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195215742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195215754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195215762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195215763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195215763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:19.267332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24517): Terminating (SIGTERM) 19:52:19.307287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24520): Terminating (SIGTERM) 19:52:19.346815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24523): Terminating (SIGTERM) 19:52:19.386691 --- ParallelTerminationStrategy: PID 24517 died... 19:52:19.405869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24517): Terminated: ok {rc=0} 19:52:19.449869 --- ParallelTerminationStrategy: PID 24520 died... 19:52:19.468258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24520): Terminated: ok {rc=0} 19:52:19.512072 --- ParallelTerminationStrategy: PID 24523 died... 19:52:19.530776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24523): Terminated: ok {rc=0} 19:52:19.616459 bus /gobi_0: Setting Powered False 19:52:20.715742 bus /gobi_0: Setting Powered False 19:52:21.828345 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2393 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 nitb_smpp --------------------------------------------------------------------- 19:52:23.086183 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:52:23.088941 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 19:52:23.110422 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 19:52:23.117726 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 19:52:23.152815 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 19:52:23.174670 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 19:52:23.181836 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 19:52:23.704050 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2393 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 19:52:23.709577 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:52:23.727935 tst esme_connect_policy_acceptall.py: using MSISDN 8298 19:52:23.868793 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:52:24.469781 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24528): Launched 19:52:24.791333 run osmo-nitb_10.42.42.2(pid=24529): Launched 19:52:24.969039 run osmo-nitb_10.42.42.2(pid=24529): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24529)] 19:52:25.113134 run osmo-nitb_10.42.42.2(pid=24529): stdout: | (launched: 2022-12-13_19:52:24.732664) 19:52:25.258952 run osmo-nitb_10.42.42.2(pid=24529): stderr: | (launched: 2022-12-13_19:52:24.780455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:25.404794 run osmo-nitb_10.42.42.2(pid=24529): stdout: | (launched: 2022-12-13_19:52:24.732664) 19:52:25.544742 run osmo-nitb_10.42.42.2(pid=24529): stderr: | (launched: 2022-12-13_19:52:24.780455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24529) [trial-2393↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24529)] 19:52:25.912773 tst osmo-nitb_10.42.42.2(pid=24529): stdout: | (launched: 2022-12-13_19:52:24.732664) 19:52:26.043531 tst osmo-nitb_10.42.42.2(pid=24529): stderr: | (launched: 2022-12-13_19:52:24.780455) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:26.197971 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=24529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24529) [trial-2393↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24529)] [trial-2393↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 19:52:26.206870 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 19:52:26.213795 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24528): Terminating (SIGTERM) 19:52:26.425262 --- ParallelTerminationStrategy: PID 24528 died... 19:52:26.446546 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24528): Terminated: ok {rc=0} ---------------------------------------------- trial-2393 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 19:52:26.497786 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:52:26.519323 tst esme_connect_policy_closed.py: using MSISDN 8299 19:52:26.649196 tst esme_connect_policy_closed.py: using MSISDN 8300 19:52:26.766210 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:52:27.366713 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24530): Launched 19:52:27.690386 run osmo-nitb_10.42.42.2(pid=24531): Launched 19:52:27.864107 run osmo-nitb_10.42.42.2(pid=24531): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24531)] 19:52:27.997303 run osmo-nitb_10.42.42.2(pid=24531): stdout: | (launched: 2022-12-13_19:52:27.630808) 19:52:28.131769 run osmo-nitb_10.42.42.2(pid=24531): stderr: | (launched: 2022-12-13_19:52:27.678903) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:28.266618 run osmo-nitb_10.42.42.2(pid=24531): stdout: | (launched: 2022-12-13_19:52:27.630808) 19:52:28.395818 run osmo-nitb_10.42.42.2(pid=24531): stderr: | (launched: 2022-12-13_19:52:27.678903) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:28.550107 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=24531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24531) [trial-2393↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24531)] [trial-2393↪nitb_smpp↪esme_connect_policy_closed.py:24] 19:52:28.559171 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 19:52:28.565934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24530): Terminating (SIGTERM) 19:52:28.776624 --- ParallelTerminationStrategy: PID 24530 died... 19:52:28.797779 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24530): Terminated: ok {rc=0} ---------------------------------------------- trial-2393 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 19:52:28.849078 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:52:28.860746 tst nitb_smpp: Using 1 x bts (candidates: 1) 19:52:28.900423 tst esme_ms_sms_storeforward.py: using LAC 35888 19:52:29.028906 tst esme_ms_sms_storeforward.py: using RAC 188 19:52:29.153519 tst esme_ms_sms_storeforward.py: using CellId 35888 19:52:29.274750 tst esme_ms_sms_storeforward.py: using BVCI 35889 19:52:29.385582 tst nitb_smpp: Using 1 x modem (candidates: 1) 19:52:29.513032 tst esme_ms_sms_storeforward.py: using MSISDN 8301 19:52:29.629836 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 19:52:29.847380 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:52:30.505798 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Launched 19:52:30.835485 run osmo-nitb_10.42.42.2(pid=24533): Launched 19:52:31.030656 run osmo-nitb_10.42.42.2(pid=24533): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] 19:52:31.166971 run osmo-nitb_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-13_19:52:30.770739) 19:52:31.305433 run osmo-nitb_10.42.42.2(pid=24533): stderr: | (launched: 2022-12-13_19:52:30.818999) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:31.443559 run osmo-nitb_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-13_19:52:30.770739) 19:52:31.575902 run osmo-nitb_10.42.42.2(pid=24533): stderr: | (launched: 2022-12-13_19:52:30.818999) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:31.733775 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=24533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24533) [trial-2393↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] [trial-2393↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 19:52:31.743318 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 19:52:31.750817 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Terminating (SIGTERM) 19:52:31.962821 --- ParallelTerminationStrategy: PID 24532 died... 19:52:31.983031 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24532): Terminated: ok {rc=0} 19:52:32.077860 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 19:52:33.175104 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 19:52:33.186755 tst nitb_smpp: Using 1 x bts (candidates: 1) 19:52:33.226440 tst esme_ms_sms_transaction.py: using LAC 35889 19:52:33.354270 tst esme_ms_sms_transaction.py: using RAC 189 19:52:33.479302 tst esme_ms_sms_transaction.py: using CellId 35889 19:52:33.605263 tst esme_ms_sms_transaction.py: using BVCI 35890 19:52:33.724613 tst nitb_smpp: Using 1 x modem (candidates: 1) 19:52:33.852757 tst esme_ms_sms_transaction.py: using MSISDN 8302 19:52:33.969853 tst esme_ms_sms_transaction.py:18: start nitb and bts... 19:52:34.187681 run osmo-nitb_10.42.42.2: Starting osmo-nitb 19:52:34.840925 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24534): Launched 19:52:35.163410 run osmo-nitb_10.42.42.2(pid=24535): Launched 19:52:35.342418 run osmo-nitb_10.42.42.2(pid=24535): ERR: Terminated: ERROR {rc=2} [trial-2393↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24535)] 19:52:35.486639 run osmo-nitb_10.42.42.2(pid=24535): stdout: | (launched: 2022-12-13_19:52:35.104429) 19:52:35.632579 run osmo-nitb_10.42.42.2(pid=24535): stderr: | (launched: 2022-12-13_19:52:35.152468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:35.778527 run osmo-nitb_10.42.42.2(pid=24535): stdout: | (launched: 2022-12-13_19:52:35.104429) 19:52:35.919457 run osmo-nitb_10.42.42.2(pid=24535): stderr: | (launched: 2022-12-13_19:52:35.152468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24535): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24535) [trial-2393↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24535)] 19:52:36.285851 tst osmo-nitb_10.42.42.2(pid=24535): stdout: | (launched: 2022-12-13_19:52:35.104429) 19:52:36.416523 tst osmo-nitb_10.42.42.2(pid=24535): stderr: | (launched: 2022-12-13_19:52:35.152468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 19:52:36.571199 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=24535): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24535) [trial-2393↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24535)] [trial-2393↪nitb_smpp↪esme_ms_sms_transaction.py:21] 19:52:36.580268 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 19:52:36.587186 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24534): Terminating (SIGTERM) 19:52:36.798828 --- ParallelTerminationStrategy: PID 24534 died... 19:52:36.820533 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24534): Terminated: ok {rc=0} 19:52:36.910007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 smpp --------------------------------------------------------------------- 19:52:38.077200 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:52:38.080431 tst smpp: Verifying 1 x bts (candidates: 11) 19:52:38.101363 tst smpp: Verifying 6 x ip_address (candidates: 9) 19:52:38.129265 tst smpp: Verifying 1 x modem (candidates: 12) 19:52:38.169111 tst smpp: Reserving 1 x bts (candidates: 11) 19:52:38.190228 tst smpp: Reserving 6 x ip_address (candidates: 9) 19:52:38.216416 tst smpp: Reserving 1 x modem (candidates: 12) 19:52:38.739052 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 19:52:38.743805 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:38.754295 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:38.764573 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:38.774807 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:38.793417 tst esme_connect_policy_acceptall.py: using MSISDN 8303 19:52:38.903646 run osmo-stp_10.42.42.4: Starting osmo-stp 19:52:39.417654 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24540): Launched 19:52:39.717503 run osmo-stp_10.42.42.4(pid=24541): Launched 19:52:39.831165 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:40.298749 run create_hlr_db(pid=24542): Launched 19:52:40.422450 bus /sierra_2: Setting Powered False 19:52:41.483470 run create_hlr_db(pid=24542): Terminated: ok {rc=0} 19:52:41.928459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Launched 19:52:42.255727 run osmo-hlr_10.42.42.2(pid=24545): Launched 19:52:42.381280 run osmo-msc_10.42.42.5: Starting osmo-msc 19:52:42.975513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Launched 19:52:43.305193 run osmo-msc_10.42.42.5(pid=24548): Launched 19:52:43.487511 run osmo-hlr_10.42.42.2(pid=24545): ERR: Terminated: ERROR {rc=237} [trial-2393↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24545)] 19:52:43.626007 run osmo-hlr_10.42.42.2(pid=24545): stdout: | (launched: 2022-12-13_19:52:42.195731) 19:52:43.767929 run osmo-hlr_10.42.42.2(pid=24545): stderr: | 20221213195242390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195242390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195242403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195242415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195242415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195242415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:43.904813 run osmo-hlr_10.42.42.2(pid=24545): stdout: | (launched: 2022-12-13_19:52:42.195731) 19:52:44.035914 run osmo-hlr_10.42.42.2(pid=24545): stderr: | 20221213195242390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195242390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195242390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195242403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195242415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195242415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195242415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:44.192776 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=24545): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24545) [trial-2393↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24545)] [trial-2393↪smpp↪esme_connect_policy_acceptall.py:23] 19:52:44.202115 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.5 sec) 19:52:44.229766 run osmo-msc_10.42.42.5(pid=24548): ERR: Terminated: ERROR {rc=9} [trial-2393↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=24548)] 19:52:44.282442 run osmo-msc_10.42.42.5(pid=24548): stdout: | (launched: 2022-12-13_19:52:43.244045) 19:52:44.335402 run osmo-msc_10.42.42.5(pid=24548): stderr: | 20221213195243608 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213195243608 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213195243608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195243608 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213195243608 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213195243608 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213195243608 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213195243609 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213195243609 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 19:52:44.388591 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24540): Terminating (SIGTERM) 19:52:44.431281 run osmo-stp_10.42.42.4(pid=24541): Terminating (SIGTERM) 19:52:44.474636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Terminating (SIGTERM) 19:52:44.518846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Terminating (SIGTERM) 19:52:44.564263 --- ParallelTerminationStrategy: PID 24540 died... 19:52:44.585425 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24540): Terminated: ok {rc=0} 19:52:44.634236 --- ParallelTerminationStrategy: PID 24541 died... 19:52:44.654404 run osmo-stp_10.42.42.4(pid=24541): Terminated: ok {rc=0} 19:52:44.700926 --- ParallelTerminationStrategy: PID 24544 died... 19:52:44.721416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Terminated: ok {rc=0} 19:52:44.768049 --- ParallelTerminationStrategy: PID 24547 died... 19:52:44.788323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Terminated: ok {rc=0} ---------------------------------------------- trial-2393 smpp esme_connect_policy_closed.py ---------------------------------------------- 19:52:44.841040 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:44.853078 tst smpp: Using 1 x bts (candidates: 1) 19:52:44.890582 tst esme_connect_policy_closed.py: using LAC 35890 19:52:45.019682 tst esme_connect_policy_closed.py: using RAC 190 19:52:45.146810 tst esme_connect_policy_closed.py: using CellId 35890 19:52:45.274906 tst esme_connect_policy_closed.py: using BVCI 35891 19:52:45.395411 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:45.406716 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:45.417862 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:45.437729 tst esme_connect_policy_closed.py: using MSISDN 8304 19:52:45.559252 tst esme_connect_policy_closed.py: using MSISDN 8305 19:52:45.669490 run osmo-stp_10.42.42.4: Starting osmo-stp 19:52:46.225315 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24551): Launched 19:52:46.566304 run osmo-stp_10.42.42.4(pid=24552): Launched 19:52:46.686359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:47.252718 run create_hlr_db(pid=24553): Launched 19:52:48.452739 run create_hlr_db(pid=24553): Terminated: ok {rc=0} 19:52:48.775228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24555): Launched 19:52:49.080403 run osmo-hlr_10.42.42.2(pid=24556): Launched 19:52:49.196164 run osmo-msc_10.42.42.5: Starting osmo-msc 19:52:49.755710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24558): Launched 19:52:50.063807 run osmo-msc_10.42.42.5(pid=24559): Launched 19:52:50.234592 run osmo-hlr_10.42.42.2(pid=24556): ERR: Terminated: ERROR {rc=237} [trial-2393↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24556)] 19:52:50.366116 run osmo-hlr_10.42.42.2(pid=24556): stdout: | (launched: 2022-12-13_19:52:49.023809) 19:52:50.495819 run osmo-hlr_10.42.42.2(pid=24556): stderr: | 20221213195249200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195249201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195249201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195249213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195249223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195249223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195249223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:50.623398 run osmo-hlr_10.42.42.2(pid=24556): stdout: | (launched: 2022-12-13_19:52:49.023809) 19:52:50.745795 run osmo-hlr_10.42.42.2(pid=24556): stderr: | 20221213195249200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195249200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195249201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195249201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195249213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195249223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195249223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195249223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:50.892049 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=24556): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24556) [trial-2393↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24556)] [trial-2393↪smpp↪esme_connect_policy_closed.py:31] 19:52:50.900530 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 19:52:50.926371 run osmo-msc_10.42.42.5(pid=24559): ERR: Terminated: ERROR {rc=9} [trial-2393↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=24559)] 19:52:50.974528 run osmo-msc_10.42.42.5(pid=24559): stdout: | (launched: 2022-12-13_19:52:50.007198) 19:52:51.024207 run osmo-msc_10.42.42.5(pid=24559): stderr: | 20221213195250326 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221213195250327 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221213195250327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195250327 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221213195250327 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221213195250327 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221213195250327 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221213195250327 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221213195250327 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 19:52:51.074065 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24551): Terminating (SIGTERM) 19:52:51.113583 run osmo-stp_10.42.42.4(pid=24552): Terminating (SIGTERM) 19:52:51.153153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24555): Terminating (SIGTERM) 19:52:51.193800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24558): Terminating (SIGTERM) 19:52:51.234302 --- ParallelTerminationStrategy: PID 24551 died... 19:52:51.253497 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24551): Terminated: ok {rc=0} 19:52:51.297819 --- ParallelTerminationStrategy: PID 24552 died... 19:52:51.316410 run osmo-stp_10.42.42.4(pid=24552): Terminated: ok {rc=0} 19:52:51.360212 --- ParallelTerminationStrategy: PID 24555 died... 19:52:51.378980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24555): Terminated: ok {rc=0} 19:52:51.422871 --- ParallelTerminationStrategy: PID 24558 died... 19:52:51.441647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24558): Terminated: ok {rc=0} ---------------------------------------------- trial-2393 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 19:52:51.490152 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:51.501352 tst smpp: Using 1 x bts (candidates: 1) 19:52:51.536825 tst esme_ms_sms_storeforward.py: using LAC 35891 19:52:51.657715 tst esme_ms_sms_storeforward.py: using RAC 191 19:52:51.777452 tst esme_ms_sms_storeforward.py: using CellId 35891 19:52:51.903062 tst esme_ms_sms_storeforward.py: using BVCI 35892 19:52:52.016191 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:52.027081 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:52.037728 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:52.048284 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:52.058947 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:52.069564 tst smpp: Using 1 x modem (candidates: 1) 19:52:52.202166 tst esme_ms_sms_storeforward.py: using MSISDN 8306 19:52:52.323489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:52:52.830513 run create_hlr_db(pid=24562): Launched 19:52:54.015439 run create_hlr_db(pid=24562): Terminated: ok {rc=0} 19:52:54.361636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24564): Launched 19:52:54.688718 run osmo-hlr_10.42.42.2(pid=24565): Launched 19:52:54.814994 run osmo-stp_10.42.42.5: Starting osmo-stp 19:52:55.386117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24567): Launched 19:52:55.715654 run osmo-stp_10.42.42.5(pid=24568): Launched 19:52:55.841160 run osmo-msc_10.42.42.6: Starting osmo-msc 19:52:56.434226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24570): Launched 19:52:56.762356 run osmo-msc_10.42.42.6(pid=24571): Launched 19:52:56.946220 run osmo-stp_10.42.42.5(pid=24568): ERR: Terminated: ERROR {rc=1} [trial-2393↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24568)] 19:52:57.084245 run osmo-stp_10.42.42.5(pid=24568): stdout: | (launched: 2022-12-13_19:52:55.655137) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:57.223635 run osmo-stp_10.42.42.5(pid=24568): stderr: | 20221213195255847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195255847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195255847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195255848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195255848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195255848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195255848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:57.361972 run osmo-stp_10.42.42.5(pid=24568): stdout: | (launched: 2022-12-13_19:52:55.655137) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:52:57.493978 run osmo-stp_10.42.42.5(pid=24568): stderr: | 20221213195255847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195255847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195255847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195255848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195255848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195255848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195255848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:52:57.651436 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=24568): Process ended prematurely: osmo-stp_10.42.42.5(pid=24568) [trial-2393↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24568)] [trial-2393↪smpp↪esme_ms_sms_storeforward.py:30] 19:52:57.660557 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 19:52:57.688136 run osmo-hlr_10.42.42.2(pid=24565): ERR: Terminated: ERROR {rc=237} [trial-2393↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24565)] 19:52:57.739456 run osmo-hlr_10.42.42.2(pid=24565): stdout: | (launched: 2022-12-13_19:52:54.628528) 19:52:57.791789 run osmo-hlr_10.42.42.2(pid=24565): stderr: | 20221213195254827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195254827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195254827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195254827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195254827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195254827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195254840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195254849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195254849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195254849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:52:57.864443 run osmo-msc_10.42.42.6(pid=24571): ERR: Terminated: ERROR {rc=2} [trial-2393↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24571)] 19:52:57.914984 run osmo-msc_10.42.42.6(pid=24571): stdout: | (launched: 2022-12-13_19:52:56.702251) 19:52:57.967034 run osmo-msc_10.42.42.6(pid=24571): stderr: | 20221213195257024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195257024 DLGLOBAL DEBUG validating counter group 0x7f533fc3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195257024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195257024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195257024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195257025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195257027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195257027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195257027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195257027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:52:58.019927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24564): Terminating (SIGTERM) 19:52:58.062031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24567): Terminating (SIGTERM) 19:52:58.104202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24570): Terminating (SIGTERM) 19:52:58.146734 --- ParallelTerminationStrategy: PID 24564 died... 19:52:58.167321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24564): Terminated: ok {rc=0} 19:52:58.214119 --- ParallelTerminationStrategy: PID 24567 died... 19:52:58.234206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24567): Terminated: ok {rc=0} 19:52:58.281206 --- ParallelTerminationStrategy: PID 24570 died... 19:52:58.301280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24570): Terminated: ok {rc=0} 19:52:58.389996 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 smpp esme_ms_sms_transaction.py ---------------------------------------------- 19:52:59.478271 tst smpp: Using 1 x ip_address (candidates: 6) 19:52:59.490758 tst smpp: Using 1 x bts (candidates: 1) 19:52:59.529066 tst esme_ms_sms_transaction.py: using LAC 35892 19:52:59.657989 tst esme_ms_sms_transaction.py: using RAC 192 19:52:59.779685 tst esme_ms_sms_transaction.py: using CellId 35892 19:52:59.901308 tst esme_ms_sms_transaction.py: using BVCI 35893 19:53:00.013265 tst smpp: Using 1 x ip_address (candidates: 6) 19:53:00.023948 tst smpp: Using 1 x ip_address (candidates: 6) 19:53:00.034763 tst smpp: Using 1 x ip_address (candidates: 6) 19:53:00.045131 tst smpp: Using 1 x ip_address (candidates: 6) 19:53:00.055885 tst smpp: Using 1 x ip_address (candidates: 6) 19:53:00.066712 tst smpp: Using 1 x modem (candidates: 1) 19:53:00.198588 tst esme_ms_sms_transaction.py: using MSISDN 8307 19:53:00.319696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:00.834251 run create_hlr_db(pid=24573): Launched 19:53:01.016553 bus /sierra_2: Setting Powered False 19:53:02.094271 run create_hlr_db(pid=24573): Terminated: ok {rc=0} 19:53:02.578960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24575): Launched 19:53:02.907274 run osmo-hlr_10.42.42.2(pid=24576): Launched 19:53:03.031783 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:03.597784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24578): Launched 19:53:03.923483 run osmo-stp_10.42.42.5(pid=24579): Launched 19:53:04.050277 run osmo-msc_10.42.42.6: Starting osmo-msc 19:53:04.644177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24581): Launched 19:53:04.975222 run osmo-msc_10.42.42.6(pid=24582): Launched 19:53:05.159307 run osmo-stp_10.42.42.5(pid=24579): ERR: Terminated: ERROR {rc=1} [trial-2393↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24579)] 19:53:05.299079 run osmo-stp_10.42.42.5(pid=24579): stdout: | (launched: 2022-12-13_19:53:03.863434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:05.438919 run osmo-stp_10.42.42.5(pid=24579): stderr: | 20221213195304053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195304053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195304053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195304054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195304054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195304054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195304054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:05.576536 run osmo-stp_10.42.42.5(pid=24579): stdout: | (launched: 2022-12-13_19:53:03.863434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:05.708117 run osmo-stp_10.42.42.5(pid=24579): stderr: | 20221213195304053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195304053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195304053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195304054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195304054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195304054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195304054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:05.865238 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=24579): Process ended prematurely: osmo-stp_10.42.42.5(pid=24579) [trial-2393↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24579)] [trial-2393↪smpp↪esme_ms_sms_transaction.py:28] 19:53:05.874422 tst esme_ms_sms_transaction.py:28: Test FAILED (6.4 sec) 19:53:05.902062 run osmo-hlr_10.42.42.2(pid=24576): ERR: Terminated: ERROR {rc=237} [trial-2393↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24576)] 19:53:05.953791 run osmo-hlr_10.42.42.2(pid=24576): stdout: | (launched: 2022-12-13_19:53:02.846828) 19:53:06.006523 run osmo-hlr_10.42.42.2(pid=24576): stderr: | 20221213195303045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195303045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195303045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195303045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195303045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195303045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195303059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195303068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195303068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195303068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:06.079679 run osmo-msc_10.42.42.6(pid=24582): ERR: Terminated: ERROR {rc=2} [trial-2393↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24582)] 19:53:06.130647 run osmo-msc_10.42.42.6(pid=24582): stdout: | (launched: 2022-12-13_19:53:04.915075) 19:53:06.183265 run osmo-msc_10.42.42.6(pid=24582): stderr: | 20221213195305238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195305238 DLGLOBAL DEBUG validating counter group 0x7fc9f775fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195305238 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195305238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195305239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195305239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195305241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195305241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195305241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195305241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:53:06.236067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24575): Terminating (SIGTERM) 19:53:06.278677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24578): Terminating (SIGTERM) 19:53:06.321460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24581): Terminating (SIGTERM) 19:53:06.363824 --- ParallelTerminationStrategy: PID 24575 died... 19:53:06.384091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24575): Terminated: ok {rc=0} 19:53:06.430472 --- ParallelTerminationStrategy: PID 24578 died... 19:53:06.450480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24578): Terminated: ok {rc=0} 19:53:06.497141 --- ParallelTerminationStrategy: PID 24581 died... 19:53:06.517177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24581): Terminated: ok {rc=0} 19:53:06.605592 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 encryption --------------------------------------------------------------------- 19:53:07.800371 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:53:07.803465 tst encryption: Verifying 1 x bts (candidates: 11) 19:53:07.825292 tst encryption: Verifying 6 x ip_address (candidates: 9) 19:53:07.853848 tst encryption: Verifying 1 x modem (candidates: 12) 19:53:07.891435 tst encryption: Reserving 1 x bts (candidates: 11) 19:53:07.913210 tst encryption: Reserving 6 x ip_address (candidates: 9) 19:53:07.940110 tst encryption: Reserving 1 x modem (candidates: 12) 19:53:08.473198 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2393 encryption register_a5_0_authopt.py ---------------------------------------------- 19:53:08.529358 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:08.540517 tst encryption: Using 1 x bts (candidates: 1) 19:53:08.577034 tst register_a5_0_authopt.py: using LAC 35893 19:53:08.701544 tst register_a5_0_authopt.py: using RAC 193 19:53:08.832326 tst register_a5_0_authopt.py: using CellId 35893 19:53:08.960569 tst register_a5_0_authopt.py: using BVCI 35894 19:53:09.082489 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:09.093583 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:09.104498 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:09.115398 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:09.126745 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:09.137977 tst encryption: Using 1 x modem (candidates: 1) 19:53:09.254721 tst register_a5_0_authopt.py:8: start network... 19:53:09.465718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:09.947969 run create_hlr_db(pid=24587): Launched 19:53:10.074978 bus /sierra_2: Setting Powered False 19:53:11.137028 run create_hlr_db(pid=24587): Terminated: ok {rc=0} 19:53:11.591715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24589): Launched 19:53:11.926149 run osmo-hlr_10.42.42.2(pid=24590): Launched 19:53:12.054088 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:12.628196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24592): Launched 19:53:12.959582 run osmo-stp_10.42.42.5(pid=24593): Launched 19:53:13.087530 run osmo-msc_10.42.42.6: Starting osmo-msc 19:53:13.685685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24595): Launched 19:53:14.017275 run osmo-msc_10.42.42.6(pid=24596): Launched 19:53:14.202092 run osmo-stp_10.42.42.5(pid=24593): ERR: Terminated: ERROR {rc=1} [trial-2393↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24593)] 19:53:14.340934 run osmo-stp_10.42.42.5(pid=24593): stdout: | (launched: 2022-12-13_19:53:12.898844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:14.479959 run osmo-stp_10.42.42.5(pid=24593): stderr: | 20221213195313091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195313091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195313092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195313092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195313093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195313093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195313093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:14.617818 run osmo-stp_10.42.42.5(pid=24593): stdout: | (launched: 2022-12-13_19:53:12.898844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:14.750327 run osmo-stp_10.42.42.5(pid=24593): stderr: | 20221213195313091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195313091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195313092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195313092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195313093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195313093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195313093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:14.908845 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24593): Process ended prematurely: osmo-stp_10.42.42.5(pid=24593) [trial-2393↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24593)] [trial-2393↪encryption↪register_a5_0_authopt.py:8] 19:53:14.918515 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 19:53:14.945918 run osmo-hlr_10.42.42.2(pid=24590): ERR: Terminated: ERROR {rc=237} [trial-2393↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24590)] 19:53:14.996869 run osmo-hlr_10.42.42.2(pid=24590): stdout: | (launched: 2022-12-13_19:53:11.865357) 19:53:15.048880 run osmo-hlr_10.42.42.2(pid=24590): stderr: | 20221213195312064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195312064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195312064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195312064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195312064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195312064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195312076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195312085 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195312085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195312085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:15.121532 run osmo-msc_10.42.42.6(pid=24596): ERR: Terminated: ERROR {rc=2} [trial-2393↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24596)] 19:53:15.171573 run osmo-msc_10.42.42.6(pid=24596): stdout: | (launched: 2022-12-13_19:53:13.956941) 19:53:15.223728 run osmo-msc_10.42.42.6(pid=24596): stderr: | 20221213195314281 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195314282 DLGLOBAL DEBUG validating counter group 0x7f9637ec0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195314282 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195314282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195314282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195314282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195314284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195314284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195314284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195314284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:53:15.275918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24589): Terminating (SIGTERM) 19:53:15.317922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24592): Terminating (SIGTERM) 19:53:15.359791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24595): Terminating (SIGTERM) 19:53:15.401982 --- ParallelTerminationStrategy: PID 24589 died... 19:53:15.422361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24589): Terminated: ok {rc=0} 19:53:15.469434 --- ParallelTerminationStrategy: PID 24592 died... 19:53:15.489260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24592): Terminated: ok {rc=0} 19:53:15.535483 --- ParallelTerminationStrategy: PID 24595 died... 19:53:15.555307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24595): Terminated: ok {rc=0} 19:53:15.642587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 encryption register_a5_0_authreq.py ---------------------------------------------- 19:53:16.799872 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:16.812430 tst encryption: Using 1 x bts (candidates: 1) 19:53:16.851468 tst register_a5_0_authreq.py: using LAC 35894 19:53:16.983929 tst register_a5_0_authreq.py: using RAC 194 19:53:17.139600 tst register_a5_0_authreq.py: using CellId 35894 19:53:17.276299 tst register_a5_0_authreq.py: using BVCI 35895 19:53:17.389787 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:17.400409 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:17.411128 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:17.421715 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:17.432734 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:17.443847 tst encryption: Using 1 x modem (candidates: 1) 19:53:17.561368 tst register_a5_0_authreq.py:8: start network... 19:53:17.770230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:18.250993 run create_hlr_db(pid=24598): Launched 19:53:18.378164 bus /sierra_2: Setting Powered False 19:53:19.439355 run create_hlr_db(pid=24598): Terminated: ok {rc=0} 19:53:19.873181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24600): Launched 19:53:20.185481 run osmo-hlr_10.42.42.2(pid=24601): Launched 19:53:20.306003 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:20.839589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24603): Launched 19:53:21.150327 run osmo-stp_10.42.42.5(pid=24604): Launched 19:53:21.267827 run osmo-msc_10.42.42.6: Starting osmo-msc 19:53:21.826446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24606): Launched 19:53:22.137173 run osmo-msc_10.42.42.6(pid=24607): Launched 19:53:22.311017 run osmo-stp_10.42.42.5(pid=24604): ERR: Terminated: ERROR {rc=1} [trial-2393↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24604)] 19:53:22.441843 run osmo-stp_10.42.42.5(pid=24604): stdout: | (launched: 2022-12-13_19:53:21.093190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:22.572363 run osmo-stp_10.42.42.5(pid=24604): stderr: | 20221213195321265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195321265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195321265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195321266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195321266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195321266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195321266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:22.701373 run osmo-stp_10.42.42.5(pid=24604): stdout: | (launched: 2022-12-13_19:53:21.093190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:22.825452 run osmo-stp_10.42.42.5(pid=24604): stderr: | 20221213195321265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195321265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195321265 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195321266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195321266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195321266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195321266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:22.973881 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24604): Process ended prematurely: osmo-stp_10.42.42.5(pid=24604) [trial-2393↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24604)] [trial-2393↪encryption↪register_a5_0_authreq.py:8] 19:53:22.982895 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 19:53:23.009306 run osmo-hlr_10.42.42.2(pid=24601): ERR: Terminated: ERROR {rc=237} [trial-2393↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24601)] 19:53:23.057673 run osmo-hlr_10.42.42.2(pid=24601): stdout: | (launched: 2022-12-13_19:53:20.127471) 19:53:23.107212 run osmo-hlr_10.42.42.2(pid=24601): stderr: | 20221213195320307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195320307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195320307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195320307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195320307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195320307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195320319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195320327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195320328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195320328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:23.176409 run osmo-msc_10.42.42.6(pid=24607): ERR: Terminated: ERROR {rc=2} [trial-2393↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24607)] 19:53:23.224207 run osmo-msc_10.42.42.6(pid=24607): stdout: | (launched: 2022-12-13_19:53:22.079425) 19:53:23.273644 run osmo-msc_10.42.42.6(pid=24607): stderr: | 20221213195322355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195322355 DLGLOBAL DEBUG validating counter group 0x7fda1a102c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195322355 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195322355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195322355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195322356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195322357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195322358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195322358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195322358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:53:23.323255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24600): Terminating (SIGTERM) 19:53:23.363054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24603): Terminating (SIGTERM) 19:53:23.403382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24606): Terminating (SIGTERM) 19:53:23.443991 --- ParallelTerminationStrategy: PID 24600 died... 19:53:23.463346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24600): Terminated: ok {rc=0} 19:53:23.507688 --- ParallelTerminationStrategy: PID 24603 died... 19:53:23.526485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24603): Terminated: ok {rc=0} 19:53:23.570477 --- ParallelTerminationStrategy: PID 24606 died... 19:53:23.589348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24606): Terminated: ok {rc=0} 19:53:23.675431 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 encryption register_a5_1_authreq.py ---------------------------------------------- 19:53:24.828693 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:24.840758 tst encryption: Using 1 x bts (candidates: 1) 19:53:24.882325 tst register_a5_1_authreq.py: using LAC 35895 19:53:25.026794 tst register_a5_1_authreq.py: using RAC 195 19:53:25.158643 tst register_a5_1_authreq.py: using CellId 35895 19:53:25.288524 tst register_a5_1_authreq.py: using BVCI 35896 19:53:25.411126 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:25.422530 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:25.433825 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:25.444780 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:25.456095 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:25.467316 tst encryption: Using 1 x modem (candidates: 1) 19:53:25.583024 tst register_a5_1_authreq.py:8: start network... 19:53:25.792656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:26.275196 run create_hlr_db(pid=24609): Launched 19:53:26.403957 bus /sierra_2: Setting Powered False 19:53:27.466067 run create_hlr_db(pid=24609): Terminated: ok {rc=0} 19:53:27.919435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Launched 19:53:28.254317 run osmo-hlr_10.42.42.2(pid=24612): Launched 19:53:28.383946 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:28.957293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Launched 19:53:29.290041 run osmo-stp_10.42.42.5(pid=24615): Launched 19:53:29.418803 run osmo-msc_10.42.42.6: Starting osmo-msc 19:53:30.016543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Launched 19:53:30.351801 run osmo-msc_10.42.42.6(pid=24618): Launched 19:53:30.538663 run osmo-stp_10.42.42.5(pid=24615): ERR: Terminated: ERROR {rc=1} [trial-2393↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] 19:53:30.678524 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-13_19:53:29.228574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:30.818843 run osmo-stp_10.42.42.5(pid=24615): stderr: | 20221213195329421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195329422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195329422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195329422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195329423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195329423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195329423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:31.015009 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-13_19:53:29.228574) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:31.152175 run osmo-stp_10.42.42.5(pid=24615): stderr: | 20221213195329421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195329422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195329422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195329422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195329423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195329423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195329423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:31.316158 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2393↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] [trial-2393↪encryption↪register_a5_1_authreq.py:8] 19:53:31.327082 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 19:53:31.356427 run osmo-hlr_10.42.42.2(pid=24612): ERR: Terminated: ERROR {rc=237} [trial-2393↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24612)] 19:53:31.411631 run osmo-hlr_10.42.42.2(pid=24612): stdout: | (launched: 2022-12-13_19:53:28.193519) 19:53:31.466691 run osmo-hlr_10.42.42.2(pid=24612): stderr: | 20221213195328390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195328390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195328390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195328390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195328390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195328390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195328402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195328411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195328411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195328411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:31.543144 run osmo-msc_10.42.42.6(pid=24618): ERR: Terminated: ERROR {rc=2} [trial-2393↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24618)] 19:53:31.596708 run osmo-msc_10.42.42.6(pid=24618): stdout: | (launched: 2022-12-13_19:53:30.290504) 19:53:31.650253 run osmo-msc_10.42.42.6(pid=24618): stderr: | 20221213195330614 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195330614 DLGLOBAL DEBUG validating counter group 0x7ff97231ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195330614 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195330614 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195330614 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195330614 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195330616 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195330616 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195330616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195330617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:53:31.707025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminating (SIGTERM) 19:53:31.750503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminating (SIGTERM) 19:53:31.795841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Terminating (SIGTERM) 19:53:31.842220 --- ParallelTerminationStrategy: PID 24611 died... 19:53:31.864119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminated: ok {rc=0} 19:53:31.914538 --- ParallelTerminationStrategy: PID 24614 died... 19:53:31.935389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminated: ok {rc=0} 19:53:31.985360 --- ParallelTerminationStrategy: PID 24617 died... 19:53:32.006033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Terminated: ok {rc=0} 19:53:32.098905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2393 encryption register_a5_3_authreq.py ---------------------------------------------- 19:53:33.254594 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.266721 tst encryption: Using 1 x bts (candidates: 1) 19:53:33.305837 tst register_a5_3_authreq.py: using LAC 35896 19:53:33.429579 tst register_a5_3_authreq.py: using RAC 196 19:53:33.552818 tst register_a5_3_authreq.py: using CellId 35896 19:53:33.676476 tst register_a5_3_authreq.py: using BVCI 35897 19:53:33.790610 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.801575 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.812245 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.822679 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.833125 tst encryption: Using 1 x ip_address (candidates: 6) 19:53:33.843475 tst encryption: Using 1 x modem (candidates: 1) 19:53:33.974508 tst register_a5_3_authreq.py:8: start network... 19:53:34.201411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:53:34.718838 run create_hlr_db(pid=24620): Launched 19:53:34.848094 bus /sierra_2: Setting Powered False 19:53:35.913673 run create_hlr_db(pid=24620): Terminated: ok {rc=0} 19:53:36.377573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Launched 19:53:36.712197 run osmo-hlr_10.42.42.2(pid=24623): Launched 19:53:36.839428 run osmo-stp_10.42.42.5: Starting osmo-stp 19:53:37.410286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Launched 19:53:37.743724 run osmo-stp_10.42.42.5(pid=24626): Launched 19:53:37.871097 run osmo-msc_10.42.42.6: Starting osmo-msc 19:53:38.471903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Launched 19:53:38.805166 run osmo-msc_10.42.42.6(pid=24629): Launched 19:53:38.990651 run osmo-stp_10.42.42.5(pid=24626): ERR: Terminated: ERROR {rc=1} [trial-2393↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] 19:53:39.131709 run osmo-stp_10.42.42.5(pid=24626): stdout: | (launched: 2022-12-13_19:53:37.683155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:39.272724 run osmo-stp_10.42.42.5(pid=24626): stderr: | 20221213195337876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195337877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195337877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195337877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195337878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195337878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195337878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:39.412638 run osmo-stp_10.42.42.5(pid=24626): stdout: | (launched: 2022-12-13_19:53:37.683155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:53:39.546293 run osmo-stp_10.42.42.5(pid=24626): stderr: | 20221213195337876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195337877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195337877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195337877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195337878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195337878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195337878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:53:39.705999 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24626): Process ended prematurely: osmo-stp_10.42.42.5(pid=24626) [trial-2393↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] [trial-2393↪encryption↪register_a5_3_authreq.py:8] 19:53:39.715764 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 19:53:39.743513 run osmo-hlr_10.42.42.2(pid=24623): ERR: Terminated: ERROR {rc=237} [trial-2393↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24623)] 19:53:39.795379 run osmo-hlr_10.42.42.2(pid=24623): stdout: | (launched: 2022-12-13_19:53:36.651709) 19:53:39.847851 run osmo-hlr_10.42.42.2(pid=24623): stderr: | 20221213195336851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195336851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195336851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195336851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195336851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195336851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195336863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195336872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195336872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195336872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:53:39.920555 run osmo-msc_10.42.42.6(pid=24629): ERR: Terminated: ERROR {rc=2} [trial-2393↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24629)] 19:53:39.971031 run osmo-msc_10.42.42.6(pid=24629): stdout: | (launched: 2022-12-13_19:53:38.744370) 19:53:40.023701 run osmo-msc_10.42.42.6(pid=24629): stderr: | 20221213195339065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195339065 DLGLOBAL DEBUG validating counter group 0x7fc2a6d73c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195339066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195339066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195339066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195339066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195339068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195339068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195339068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195339068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:53:40.076334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Terminating (SIGTERM) 19:53:40.118454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Terminating (SIGTERM) 19:53:40.161094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Terminating (SIGTERM) 19:53:40.204064 --- ParallelTerminationStrategy: PID 24622 died... 19:53:40.224698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Terminated: ok {rc=0} 19:53:40.271849 --- ParallelTerminationStrategy: PID 24625 died... 19:53:40.292186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Terminated: ok {rc=0} 19:53:40.339101 --- ParallelTerminationStrategy: PID 24628 died... 19:53:40.359231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Terminated: ok {rc=0} 19:53:40.448768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 19:53:41.659529 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:53:41.664919 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 19:53:41.684431 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 19:53:41.715686 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 19:53:41.749466 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 19:53:41.768435 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 19:53:41.795375 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 19:53:42.299777 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 19:53:42.305287 tst handover.py:11: TEST_CONFIG: {} 19:53:42.512711 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:53:42.528870 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:53:42.552055 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:53:42.603660 tst handover.py: using MSISDN 8308 19:53:42.718564 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8308', subscriber_id=0} 19:53:42.827347 run srsepc_10.42.42.118: Starting srsepc 19:53:44.678910 run rm-remote-dir(pid=24634): Launched 19:53:44.805417 bus /sierra_2: Setting Powered False 19:53:45.907888 run rm-remote-dir(pid=24634): Terminated: ok {rc=0} 19:53:46.368199 run mk-remote-dir(pid=24635): Launched 19:53:47.642873 run mk-remote-dir(pid=24635): Terminated: ok {rc=0} 19:53:47.933364 run scp-inst-to-remote(pid=24636): Launched 19:53:50.117872 run scp-inst-to-remote(pid=24636): Terminated: ok {rc=0} 19:53:50.480183 run rm-remote-dir(pid=24638): Launched 19:53:51.671911 run rm-remote-dir(pid=24638): Terminated: ok {rc=0} 19:53:52.035214 run mk-remote-dir(pid=24639): Launched 19:53:53.230190 run mk-remote-dir(pid=24639): Terminated: ok {rc=0} 19:53:53.540733 run scp-cfg-to-remote(pid=24640): Launched 19:53:54.730101 run scp-cfg-to-remote(pid=24640): Terminated: ok {rc=0} 19:53:55.037127 run scp-db-to-remote(pid=24642): Launched 19:53:56.227477 run scp-db-to-remote(pid=24642): Terminated: ok {rc=0} 19:53:56.370175 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:53:56.704585 run patchelf(pid=24644): Launched 19:53:57.893824 run patchelf(pid=24644): Terminated: ok {rc=0} 19:53:58.035696 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:53:58.370627 run setcap-netadm(pid=24645): Launched 19:53:59.560907 run setcap-netadm(pid=24645): Terminated: ok {rc=0} 19:53:59.910941 run srsepc(pid=24646): Launched 19:54:00.035653 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:01.288942 run rm-remote-dir(pid=24674): Launched 19:54:01.647663 run srsepc(pid=24646): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24646)] 19:54:01.825348 run srsepc(pid=24646): stdout: | (launched: 2022-12-13_19:53:59.849989) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:02.005453 run srsepc(pid=24646): stderr: | (launched: 2022-12-13_19:53:59.899403) | Connection to 10.42.42.116 closed. 19:54:02.182746 run srsepc(pid=24646): stdout: | (launched: 2022-12-13_19:53:59.849989) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:02.359591 run srsepc(pid=24646): stderr: | (launched: 2022-12-13_19:53:59.899403) | Connection to 10.42.42.116 closed. 19:54:02.569331 run rm-remote-dir(pid=24674): Terminating (SIGINT) 19:54:02.820159 run rm-remote-dir(pid=24674): Terminated: ok {rc=0} 19:54:03.008494 tst handover.py:37: ERR: Error: srsepc(pid=24646): Process ended prematurely: srsepc(pid=24646) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24646)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 19:54:03.026983 tst handover.py:37: Test FAILED (20.7 sec) 19:54:03.145195 run scp-back-log(pid=24744): Launched 19:54:04.290998 run scp-back-log(pid=24744): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24744)] 19:54:04.359131 run scp-back-log(pid=24744): stdout: | (launched: 2022-12-13_19:54:03.100119) 19:54:04.429145 run scp-back-log(pid=24744): stderr: | (launched: 2022-12-13_19:54:03.131504) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:04.505872 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24744): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24744)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 19:54:04.557703 tst iperf3_bidir.py:13: Number of physical ue: 1 19:54:04.789697 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:54:04.834849 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 19:54:05.064076 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:54:05.081935 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:54:05.120198 tst iperf3_bidir.py: using MSISDN 8309 19:54:05.248869 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8309', subscriber_id=0} 19:54:05.369679 run srsepc_10.42.42.118: Starting srsepc 19:54:06.068254 run rm-remote-dir(pid=24920): Launched 19:54:07.298198 run rm-remote-dir(pid=24920): Terminated: ok {rc=0} 19:54:07.669712 run mk-remote-dir(pid=24923): Launched 19:54:08.888353 run mk-remote-dir(pid=24923): Terminated: ok {rc=0} 19:54:09.209696 run scp-inst-to-remote(pid=24924): Launched 19:54:11.476290 run scp-inst-to-remote(pid=24924): Terminated: ok {rc=0} 19:54:11.854518 run rm-remote-dir(pid=24926): Launched 19:54:13.074896 run rm-remote-dir(pid=24926): Terminated: ok {rc=0} 19:54:13.453730 run mk-remote-dir(pid=24927): Launched 19:54:14.716612 run mk-remote-dir(pid=24927): Terminated: ok {rc=0} 19:54:15.089574 run scp-cfg-to-remote(pid=24928): Launched 19:54:16.352230 run scp-cfg-to-remote(pid=24928): Terminated: ok {rc=0} 19:54:16.724125 run scp-db-to-remote(pid=24930): Launched 19:54:18.049441 run scp-db-to-remote(pid=24930): Terminated: ok {rc=0} 19:54:18.198194 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:18.550103 run patchelf(pid=24932): Launched 19:54:19.782976 run patchelf(pid=24932): Terminated: ok {rc=0} 19:54:19.932670 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:54:20.284691 run setcap-netadm(pid=24933): Launched 19:54:21.507506 run setcap-netadm(pid=24933): Terminated: ok {rc=0} 19:54:21.878437 run srsepc(pid=24934): Launched 19:54:22.037185 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:23.269778 run rm-remote-dir(pid=24935): Launched 19:54:23.572749 run srsepc(pid=24934): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24934)] 19:54:23.724853 run srsepc(pid=24934): stdout: | (launched: 2022-12-13_19:54:21.815002) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:23.868414 run srsepc(pid=24934): stderr: | (launched: 2022-12-13_19:54:21.867408) | Connection to 10.42.42.116 closed. 19:54:24.010338 run srsepc(pid=24934): stdout: | (launched: 2022-12-13_19:54:21.815002) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:24.148075 run srsepc(pid=24934): stderr: | (launched: 2022-12-13_19:54:21.867408) | Connection to 10.42.42.116 closed. 19:54:24.311075 run rm-remote-dir(pid=24935): Terminating (SIGINT) 19:54:24.499636 run rm-remote-dir(pid=24935): Terminated: ok {rc=0} 19:54:24.637993 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=24934): Process ended prematurely: srsepc(pid=24934) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24934)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 19:54:24.650216 tst iperf3_bidir.py:42: Test FAILED (20.1 sec) 19:54:24.735709 run scp-back-log(pid=24936): Launched 19:54:25.814115 run scp-back-log(pid=24936): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24936)] 19:54:25.875799 run scp-back-log(pid=24936): stdout: | (launched: 2022-12-13_19:54:24.704222) 19:54:25.939053 run scp-back-log(pid=24936): stderr: | (launched: 2022-12-13_19:54:24.724322) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:26.010139 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24936): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24936)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 19:54:26.056450 tst iperf3_dl.py:13: Number of physical ue: 1 19:54:26.267632 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:54:26.316153 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 19:54:26.523562 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:54:26.539491 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:54:26.571873 tst iperf3_dl.py: using MSISDN 8310 19:54:26.695039 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8310', subscriber_id=0} 19:54:26.813556 run srsepc_10.42.42.118: Starting srsepc 19:54:27.497978 run rm-remote-dir(pid=24938): Launched 19:54:28.692808 run rm-remote-dir(pid=24938): Terminated: ok {rc=0} 19:54:29.058683 run mk-remote-dir(pid=24939): Launched 19:54:30.252106 run mk-remote-dir(pid=24939): Terminated: ok {rc=0} 19:54:30.563827 run scp-inst-to-remote(pid=24940): Launched 19:54:32.758182 run scp-inst-to-remote(pid=24940): Terminated: ok {rc=0} 19:54:33.122857 run rm-remote-dir(pid=24942): Launched 19:54:34.316643 run rm-remote-dir(pid=24942): Terminated: ok {rc=0} 19:54:34.682233 run mk-remote-dir(pid=24943): Launched 19:54:35.876556 run mk-remote-dir(pid=24943): Terminated: ok {rc=0} 19:54:36.187658 run scp-cfg-to-remote(pid=24944): Launched 19:54:37.381104 run scp-cfg-to-remote(pid=24944): Terminated: ok {rc=0} 19:54:37.690882 run scp-db-to-remote(pid=24946): Launched 19:54:38.882402 run scp-db-to-remote(pid=24946): Terminated: ok {rc=0} 19:54:39.025674 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:39.362520 run patchelf(pid=24948): Launched 19:54:40.556145 run patchelf(pid=24948): Terminated: ok {rc=0} 19:54:40.699037 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:54:41.036209 run setcap-netadm(pid=24949): Launched 19:54:42.229143 run setcap-netadm(pid=24949): Terminated: ok {rc=0} 19:54:42.582548 run srsepc(pid=24950): Launched 19:54:42.706922 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:54:43.913547 run rm-remote-dir(pid=24951): Launched 19:54:44.106003 run srsepc(pid=24950): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24950)] 19:54:44.251791 run srsepc(pid=24950): stdout: | (launched: 2022-12-13_19:54:42.520679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:44.399351 run srsepc(pid=24950): stderr: | (launched: 2022-12-13_19:54:42.570489) | Connection to 10.42.42.116 closed. 19:54:44.546359 run srsepc(pid=24950): stdout: | (launched: 2022-12-13_19:54:42.520679) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:54:44.687109 run srsepc(pid=24950): stderr: | (launched: 2022-12-13_19:54:42.570489) | Connection to 10.42.42.116 closed. 19:54:44.854435 run rm-remote-dir(pid=24951): Terminating (SIGINT) 19:54:45.047144 run rm-remote-dir(pid=24951): Terminated: ok {rc=0} 19:54:45.186406 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=24950): Process ended prematurely: srsepc(pid=24950) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24950)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 19:54:45.197477 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 19:54:45.280434 run scp-back-log(pid=24952): Launched 19:54:46.362384 run scp-back-log(pid=24952): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24952)] 19:54:46.431023 run scp-back-log(pid=24952): stdout: | (launched: 2022-12-13_19:54:45.247485) 19:54:46.499677 run scp-back-log(pid=24952): stderr: | (launched: 2022-12-13_19:54:45.268553) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:54:46.576603 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24952): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24952)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 19:54:46.628158 tst iperf3_ul.py:13: Number of physical ue: 1 19:54:46.862120 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:54:46.907283 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 19:54:47.135313 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:54:47.153131 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:54:47.188402 tst iperf3_ul.py: using MSISDN 8311 19:54:47.312332 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8311', subscriber_id=0} 19:54:47.430631 run srsepc_10.42.42.118: Starting srsepc 19:54:48.117979 run rm-remote-dir(pid=24954): Launched 19:54:49.313137 run rm-remote-dir(pid=24954): Terminated: ok {rc=0} 19:54:49.680346 run mk-remote-dir(pid=24955): Launched 19:54:50.874641 run mk-remote-dir(pid=24955): Terminated: ok {rc=0} 19:54:51.188080 run scp-inst-to-remote(pid=24956): Launched 19:54:53.381080 run scp-inst-to-remote(pid=24956): Terminated: ok {rc=0} 19:54:53.746925 run rm-remote-dir(pid=24958): Launched 19:54:54.941273 run rm-remote-dir(pid=24958): Terminated: ok {rc=0} 19:54:55.308341 run mk-remote-dir(pid=24959): Launched 19:54:56.505503 run mk-remote-dir(pid=24959): Terminated: ok {rc=0} 19:54:56.818589 run scp-cfg-to-remote(pid=24960): Launched 19:54:58.010203 run scp-cfg-to-remote(pid=24960): Terminated: ok {rc=0} 19:54:58.322139 run scp-db-to-remote(pid=24962): Launched 19:54:59.517482 run scp-db-to-remote(pid=24962): Terminated: ok {rc=0} 19:54:59.661342 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:54:59.999669 run patchelf(pid=24964): Launched 19:55:01.191449 run patchelf(pid=24964): Terminated: ok {rc=0} 19:55:01.339575 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:55:01.686898 run setcap-netadm(pid=24968): Launched 19:55:02.978977 run setcap-netadm(pid=24968): Terminated: ok {rc=0} 19:55:03.334380 run srsepc(pid=24969): Launched 19:55:03.460129 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:55:04.663180 run rm-remote-dir(pid=24970): Launched 19:55:04.853855 run srsepc(pid=24969): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24969)] 19:55:05.000274 run srsepc(pid=24969): stdout: | (launched: 2022-12-13_19:55:03.272181) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:05.148046 run srsepc(pid=24969): stderr: | (launched: 2022-12-13_19:55:03.322653) | Connection to 10.42.42.116 closed. 19:55:05.295075 run srsepc(pid=24969): stdout: | (launched: 2022-12-13_19:55:03.272181) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:05.436494 run srsepc(pid=24969): stderr: | (launched: 2022-12-13_19:55:03.322653) | Connection to 10.42.42.116 closed. 19:55:05.603594 run rm-remote-dir(pid=24970): Terminating (SIGINT) 19:55:05.796474 run rm-remote-dir(pid=24970): Terminated: ok {rc=0} 19:55:05.936522 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=24969): Process ended prematurely: srsepc(pid=24969) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24969)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 19:55:05.947615 tst iperf3_ul.py:42: Test FAILED (19.3 sec) 19:55:06.030380 run scp-back-log(pid=24971): Launched 19:55:07.112543 run scp-back-log(pid=24971): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24971)] 19:55:07.177899 run scp-back-log(pid=24971): stdout: | (launched: 2022-12-13_19:55:05.997470) 19:55:07.244440 run scp-back-log(pid=24971): stderr: | (launched: 2022-12-13_19:55:06.018252) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:55:07.319533 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24971): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24971)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 19:55:07.368600 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:55:07.386854 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:55:07.411581 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:55:07.462394 tst ping.py: using MSISDN 8312 19:55:07.588484 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8312', subscriber_id=0} 19:55:07.707616 run srsepc_10.42.42.118: Starting srsepc 19:55:08.396117 run rm-remote-dir(pid=24973): Launched 19:55:09.591992 run rm-remote-dir(pid=24973): Terminated: ok {rc=0} 19:55:09.958273 run mk-remote-dir(pid=24974): Launched 19:55:11.151110 run mk-remote-dir(pid=24974): Terminated: ok {rc=0} 19:55:11.463327 run scp-inst-to-remote(pid=24975): Launched 19:55:13.655672 run scp-inst-to-remote(pid=24975): Terminated: ok {rc=0} 19:55:14.019963 run rm-remote-dir(pid=24977): Launched 19:55:15.213156 run rm-remote-dir(pid=24977): Terminated: ok {rc=0} 19:55:15.579870 run mk-remote-dir(pid=24978): Launched 19:55:16.788243 run mk-remote-dir(pid=24978): Terminated: ok {rc=0} 19:55:17.140256 run scp-cfg-to-remote(pid=24979): Launched 19:55:18.379931 run scp-cfg-to-remote(pid=24979): Terminated: ok {rc=0} 19:55:18.692274 run scp-db-to-remote(pid=24981): Launched 19:55:19.884148 run scp-db-to-remote(pid=24981): Terminated: ok {rc=0} 19:55:20.027002 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:55:20.364358 run patchelf(pid=24983): Launched 19:55:21.555011 run patchelf(pid=24983): Terminated: ok {rc=0} 19:55:21.697589 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:55:22.034213 run setcap-netadm(pid=24984): Launched 19:55:23.226225 run setcap-netadm(pid=24984): Terminated: ok {rc=0} 19:55:23.579235 run srsepc(pid=24985): Launched 19:55:23.705298 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:55:24.849130 run rm-remote-dir(pid=24986): Launched 19:55:25.030459 run srsepc(pid=24985): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24985)] 19:55:25.169502 run srsepc(pid=24985): stdout: | (launched: 2022-12-13_19:55:23.517605) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:25.308199 run srsepc(pid=24985): stderr: | (launched: 2022-12-13_19:55:23.567403) | Connection to 10.42.42.116 closed. 19:55:25.446693 run srsepc(pid=24985): stdout: | (launched: 2022-12-13_19:55:23.517605) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:25.578995 run srsepc(pid=24985): stderr: | (launched: 2022-12-13_19:55:23.567403) | Connection to 10.42.42.116 closed. 19:55:25.735398 run rm-remote-dir(pid=24986): Terminating (SIGINT) 19:55:25.917180 run rm-remote-dir(pid=24986): Terminated: ok {rc=0} 19:55:26.048656 tst ping.py:16: ERR: Error: srsepc(pid=24985): Process ended prematurely: srsepc(pid=24985) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24985)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 19:55:26.059006 tst ping.py:16: Test FAILED (18.7 sec) 19:55:26.137781 run scp-back-log(pid=24987): Launched 19:55:27.215382 run scp-back-log(pid=24987): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24987)] 19:55:27.276603 run scp-back-log(pid=24987): stdout: | (launched: 2022-12-13_19:55:26.106257) 19:55:27.339252 run scp-back-log(pid=24987): stderr: | (launched: 2022-12-13_19:55:26.126382) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:55:27.409889 tst srsepc_10.42.42.118: Error('scp-back-log(pid=24987): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=24987)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 19:55:27.455999 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:55:27.472877 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:55:27.496053 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:55:27.550994 tst rrc_idle_mo_ping.py: using MSISDN 8313 19:55:27.668012 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8313', subscriber_id=0} 19:55:27.777511 run srsepc_10.42.42.118: Starting srsepc 19:55:28.416164 run rm-remote-dir(pid=24989): Launched 19:55:29.600101 run rm-remote-dir(pid=24989): Terminated: ok {rc=0} 19:55:29.942911 run mk-remote-dir(pid=24990): Launched 19:55:31.141903 run mk-remote-dir(pid=24990): Terminated: ok {rc=0} 19:55:31.485075 run scp-inst-to-remote(pid=24991): Launched 19:55:33.758987 run scp-inst-to-remote(pid=24991): Terminated: ok {rc=0} 19:55:34.100709 run rm-remote-dir(pid=24993): Launched 19:55:35.284461 run rm-remote-dir(pid=24993): Terminated: ok {rc=0} 19:55:35.628416 run mk-remote-dir(pid=24994): Launched 19:55:36.812436 run mk-remote-dir(pid=24994): Terminated: ok {rc=0} 19:55:37.105725 run scp-cfg-to-remote(pid=24995): Launched 19:55:38.286583 run scp-cfg-to-remote(pid=24995): Terminated: ok {rc=0} 19:55:38.576758 run scp-db-to-remote(pid=24997): Launched 19:55:39.758232 run scp-db-to-remote(pid=24997): Terminated: ok {rc=0} 19:55:39.891918 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:55:40.207704 run patchelf(pid=24999): Launched 19:55:41.388781 run patchelf(pid=24999): Terminated: ok {rc=0} 19:55:41.522860 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:55:41.838586 run setcap-netadm(pid=25000): Launched 19:55:43.019433 run setcap-netadm(pid=25000): Terminated: ok {rc=0} 19:55:43.350821 run srsepc(pid=25001): Launched 19:55:43.468628 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:55:44.598905 run rm-remote-dir(pid=25002): Launched 19:55:44.779603 run srsepc(pid=25001): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25001)] 19:55:44.918963 run srsepc(pid=25001): stdout: | (launched: 2022-12-13_19:55:43.291831) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:45.056597 run srsepc(pid=25001): stderr: | (launched: 2022-12-13_19:55:43.338653) | Connection to 10.42.42.116 closed. 19:55:45.194498 run srsepc(pid=25001): stdout: | (launched: 2022-12-13_19:55:43.291831) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:55:45.325984 run srsepc(pid=25001): stderr: | (launched: 2022-12-13_19:55:43.338653) | Connection to 10.42.42.116 closed. 19:55:45.482241 run rm-remote-dir(pid=25002): Terminating (SIGINT) 19:55:45.663659 run rm-remote-dir(pid=25002): Terminated: ok {rc=0} 19:55:45.794585 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=25001): Process ended prematurely: srsepc(pid=25001) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25001)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 19:55:45.804618 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 19:55:45.894188 run scp-back-log(pid=25003): Launched 19:55:46.974630 run scp-back-log(pid=25003): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25003)] 19:55:47.046035 run scp-back-log(pid=25003): stdout: | (launched: 2022-12-13_19:55:45.859391) 19:55:47.109862 run scp-back-log(pid=25003): stderr: | (launched: 2022-12-13_19:55:45.880680) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:55:47.182597 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25003): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25003)]') ---------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 19:55:47.230001 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 19:55:47.249410 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 19:55:47.277670 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 19:55:47.330103 tst rrc_idle_mt_ping.py: using MSISDN 8314 19:55:47.456743 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8314', subscriber_id=0} 19:55:47.576216 run srsepc_10.42.42.118: Starting srsepc 19:55:48.262914 run rm-remote-dir(pid=25005): Launched 19:55:49.458327 run rm-remote-dir(pid=25005): Terminated: ok {rc=0} 19:55:49.824836 run mk-remote-dir(pid=25006): Launched 19:55:51.019270 run mk-remote-dir(pid=25006): Terminated: ok {rc=0} 19:55:51.332022 run scp-inst-to-remote(pid=25007): Launched 19:55:53.523299 run scp-inst-to-remote(pid=25007): Terminated: ok {rc=0} 19:55:53.865753 run rm-remote-dir(pid=25012): Launched 19:55:55.050711 run rm-remote-dir(pid=25012): Terminated: ok {rc=0} 19:55:55.394624 run mk-remote-dir(pid=25013): Launched 19:55:56.579845 run mk-remote-dir(pid=25013): Terminated: ok {rc=0} 19:55:56.871678 run scp-cfg-to-remote(pid=25014): Launched 19:55:58.051909 run scp-cfg-to-remote(pid=25014): Terminated: ok {rc=0} 19:55:58.342827 run scp-db-to-remote(pid=25016): Launched 19:55:59.526404 run scp-db-to-remote(pid=25016): Terminated: ok {rc=0} 19:55:59.659947 run srsepc_10.42.42.118: Setting RPATH for srsepc 19:55:59.975738 run patchelf(pid=25018): Launched 19:56:01.171382 run patchelf(pid=25018): Terminated: ok {rc=0} 19:56:01.321733 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 19:56:01.671644 run setcap-netadm(pid=25019): Launched 19:56:02.957490 run setcap-netadm(pid=25019): Terminated: ok {rc=0} 19:56:03.311112 run srsepc(pid=25020): Launched 19:56:03.437342 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 19:56:04.643428 run rm-remote-dir(pid=25021): Launched 19:56:04.834400 run srsepc(pid=25020): ERR: Terminated: ERROR {rc=127} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25020)] 19:56:04.980077 run srsepc(pid=25020): stdout: | (launched: 2022-12-13_19:56:03.249319) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:56:05.127021 run srsepc(pid=25020): stderr: | (launched: 2022-12-13_19:56:03.299297) | Connection to 10.42.42.116 closed. 19:56:05.273840 run srsepc(pid=25020): stdout: | (launched: 2022-12-13_19:56:03.249319) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 19:56:05.415590 run srsepc(pid=25020): stderr: | (launched: 2022-12-13_19:56:03.299297) | Connection to 10.42.42.116 closed. 19:56:05.582908 run rm-remote-dir(pid=25021): Terminating (SIGINT) 19:56:05.775073 run rm-remote-dir(pid=25021): Terminated: ok {rc=0} 19:56:05.914582 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=25020): Process ended prematurely: srsepc(pid=25020) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25020)] [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 19:56:05.925423 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 19:56:06.008353 run scp-back-log(pid=25023): Launched 19:56:07.092038 run scp-back-log(pid=25023): ERR: Terminated: ERROR {rc=1} [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25023)] 19:56:07.157390 run scp-back-log(pid=25023): stdout: | (launched: 2022-12-13_19:56:05.975437) 19:56:07.223974 run scp-back-log(pid=25023): stderr: | (launched: 2022-12-13_19:56:05.996514) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 19:56:07.298606 tst srsepc_10.42.42.118: Error('scp-back-log(pid=25023): launch_sync(): local process exited with status 1 [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=25023)]') --------------------------------------------------------------------- trial-2393 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 19:56:07.434091 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:07.439717 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 19:56:07.484774 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 19:56:07.513032 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 19:56:07.567845 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 19:56:07.613391 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 19:56:07.641275 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 19:56:08.191519 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 19:56:08.197500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:08.209102 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 19:56:08.249903 tst handover.py: using LAC 35897 19:56:08.382259 tst handover.py: using RAC 197 19:56:08.513456 tst handover.py: using CellId 35897 19:56:08.644716 tst handover.py: using BVCI 35898 19:56:08.764923 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 19:56:08.801429 tst handover.py: using LAC 35898 19:56:08.923703 tst handover.py: using RAC 198 19:56:09.045871 tst handover.py: using CellId 35898 19:56:09.168391 tst handover.py: using BVCI 35899 19:56:09.281464 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:09.292528 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:09.303216 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:09.313971 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:09.325981 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 19:56:09.336748 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 19:56:09.459331 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 19:56:09.576161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:10.056562 run create_hlr_db(pid=25029): Launched 19:56:11.228474 run create_hlr_db(pid=25029): Terminated: ok {rc=0} 19:56:11.554372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Launched 19:56:11.862054 run osmo-hlr_10.42.42.2(pid=25032): Launched 19:56:11.979200 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:12.523831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Launched 19:56:12.856485 run osmo-stp_10.42.42.5(pid=25035): Launched 19:56:12.984494 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:13.582588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Launched 19:56:13.913803 run osmo-msc_10.42.42.6(pid=25038): Launched 19:56:14.099178 run osmo-stp_10.42.42.5(pid=25035): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] 19:56:14.237918 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-13_19:56:12.795613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:14.378517 run osmo-stp_10.42.42.5(pid=25035): stderr: | 20221213195612986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195612986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195612987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195612987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195612987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195612988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195612988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:14.515892 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-13_19:56:12.795613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:14.647683 run osmo-stp_10.42.42.5(pid=25035): stderr: | 20221213195612986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195612986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195612987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195612987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195612987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195612988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195612988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:14.804702 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 19:56:14.814031 tst handover.py:18: Test FAILED (6.6 sec) 19:56:14.841531 run osmo-hlr_10.42.42.2(pid=25032): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25032)] 19:56:14.892913 run osmo-hlr_10.42.42.2(pid=25032): stdout: | (launched: 2022-12-13_19:56:11.804857) 19:56:14.945238 run osmo-hlr_10.42.42.2(pid=25032): stderr: | 20221213195611981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195611981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195611981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195611981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195611981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195611981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195611996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195612006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195612006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195612006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:15.017937 run osmo-msc_10.42.42.6(pid=25038): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25038)] 19:56:15.068386 run osmo-msc_10.42.42.6(pid=25038): stdout: | (launched: 2022-12-13_19:56:13.853087) 19:56:15.120508 run osmo-msc_10.42.42.6(pid=25038): stderr: | 20221213195614172 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195614172 DLGLOBAL DEBUG validating counter group 0x7ff5f07b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195614172 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195614172 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195614173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195614173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195614175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195614175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195614175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195614175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:15.172822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminating (SIGTERM) 19:56:15.214738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminating (SIGTERM) 19:56:15.257092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminating (SIGTERM) 19:56:15.299775 --- ParallelTerminationStrategy: PID 25031 died... 19:56:15.320190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminated: ok {rc=0} 19:56:15.367632 --- ParallelTerminationStrategy: PID 25034 died... 19:56:15.387600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminated: ok {rc=0} 19:56:15.434195 --- ParallelTerminationStrategy: PID 25037 died... 19:56:15.454196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminated: ok {rc=0} 19:56:15.542610 bus /sierra_3: Setting Powered False 19:56:16.647557 bus /sierra_3: Setting Powered False 19:56:17.771426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 19:56:19.020628 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:19.026100 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 19:56:19.067377 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 19:56:19.095190 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 19:56:19.149122 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 19:56:19.190885 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 19:56:19.218484 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 19:56:19.769100 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 19:56:19.775675 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:19.787537 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 19:56:19.826187 tst handover.py: using LAC 35899 19:56:19.955415 tst handover.py: using RAC 199 19:56:20.086254 tst handover.py: using CellId 35899 19:56:20.215530 tst handover.py: using BVCI 35900 19:56:20.329334 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 19:56:20.364118 tst handover.py: using LAC 35900 19:56:20.485301 tst handover.py: using RAC 200 19:56:20.609126 tst handover.py: using CellId 35900 19:56:20.730223 tst handover.py: using BVCI 35901 19:56:20.841955 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:20.853153 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:20.863913 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:20.874651 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:20.886084 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:56:20.897408 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 19:56:21.017644 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 19:56:21.134624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:21.586491 run create_hlr_db(pid=25043): Launched 19:56:21.705627 bus /sierra_2: Setting Powered False 19:56:22.766631 run create_hlr_db(pid=25043): Terminated: ok {rc=0} 19:56:23.188448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Launched 19:56:23.520669 run osmo-hlr_10.42.42.2(pid=25046): Launched 19:56:23.647253 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:24.186132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Launched 19:56:24.516050 run osmo-stp_10.42.42.5(pid=25049): Launched 19:56:24.642120 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:25.210678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Launched 19:56:25.541969 run osmo-msc_10.42.42.6(pid=25052): Launched 19:56:25.726252 run osmo-stp_10.42.42.5(pid=25049): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] 19:56:25.864407 run osmo-stp_10.42.42.5(pid=25049): stdout: | (launched: 2022-12-13_19:56:24.455380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:26.003432 run osmo-stp_10.42.42.5(pid=25049): stderr: | 20221213195624647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195624647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195624647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195624648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195624648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195624648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195624648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:26.141441 run osmo-stp_10.42.42.5(pid=25049): stdout: | (launched: 2022-12-13_19:56:24.455380) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:26.273198 run osmo-stp_10.42.42.5(pid=25049): stderr: | 20221213195624647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195624647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195624647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195624648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195624648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195624648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195624648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:26.431232 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25049): Process ended prematurely: osmo-stp_10.42.42.5(pid=25049) [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 19:56:26.440265 tst handover.py:18: Test FAILED (6.7 sec) 19:56:26.467486 run osmo-hlr_10.42.42.2(pid=25046): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25046)] 19:56:26.517397 run osmo-hlr_10.42.42.2(pid=25046): stdout: | (launched: 2022-12-13_19:56:23.459877) 19:56:26.568924 run osmo-hlr_10.42.42.2(pid=25046): stderr: | 20221213195623661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195623661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195623661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195623661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195623661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195623661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195623674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195623683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195623683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195623683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:26.641037 run osmo-msc_10.42.42.6(pid=25052): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25052)] 19:56:26.690783 run osmo-msc_10.42.42.6(pid=25052): stdout: | (launched: 2022-12-13_19:56:25.480651) 19:56:26.742578 run osmo-msc_10.42.42.6(pid=25052): stderr: | 20221213195625803 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195625803 DLGLOBAL DEBUG validating counter group 0x7f5131875c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195625803 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195625804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195625804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195625804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195625806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195625806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195625806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195625806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:26.794196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Terminating (SIGTERM) 19:56:26.835814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Terminating (SIGTERM) 19:56:26.877524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Terminating (SIGTERM) 19:56:26.919521 --- ParallelTerminationStrategy: PID 25045 died... 19:56:26.939511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25045): Terminated: ok {rc=0} 19:56:26.985539 --- ParallelTerminationStrategy: PID 25048 died... 19:56:27.005043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25048): Terminated: ok {rc=0} 19:56:27.050732 --- ParallelTerminationStrategy: PID 25051 died... 19:56:27.070280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25051): Terminated: ok {rc=0} 19:56:27.157833 bus /sierra_3: Setting Powered False 19:56:28.256351 bus /sierra_3: Setting Powered False 19:56:29.372892 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 19:56:30.619123 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:30.624284 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:56:30.679248 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:56:30.705931 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:56:30.758580 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:56:30.814528 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:56:30.856611 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:56:31.402216 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 19:56:31.409277 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:31.421956 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:56:31.464636 tst handover.py: using LAC 35901 19:56:31.593688 tst handover.py: using RAC 201 19:56:31.747865 tst handover.py: using CellId 35901 19:56:31.890940 tst handover.py: using BVCI 35902 19:56:32.035990 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:56:32.085518 tst handover.py: using LAC 35902 19:56:32.219610 tst handover.py: using RAC 202 19:56:32.348792 tst handover.py: using CellId 35902 19:56:32.480175 tst handover.py: using BVCI 35903 19:56:32.601215 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:32.612841 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:32.624375 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:32.635931 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:32.647810 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:56:32.659549 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:56:32.776402 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:56:32.896683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:33.380373 run create_hlr_db(pid=25057): Launched 19:56:33.515650 bus /sierra_2: Setting Powered False 19:56:34.580491 run create_hlr_db(pid=25057): Terminated: ok {rc=0} 19:56:35.010932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Launched 19:56:35.343503 run osmo-hlr_10.42.42.2(pid=25060): Launched 19:56:35.469654 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:36.008137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Launched 19:56:36.340009 run osmo-stp_10.42.42.5(pid=25063): Launched 19:56:36.467765 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:37.034207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Launched 19:56:37.366236 run osmo-msc_10.42.42.6(pid=25066): Launched 19:56:37.552618 run osmo-stp_10.42.42.5(pid=25063): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] 19:56:37.691341 run osmo-stp_10.42.42.5(pid=25063): stdout: | (launched: 2022-12-13_19:56:36.279385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:37.831474 run osmo-stp_10.42.42.5(pid=25063): stderr: | 20221213195636470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195636471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195636471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195636471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195636472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195636472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195636472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:37.969565 run osmo-stp_10.42.42.5(pid=25063): stdout: | (launched: 2022-12-13_19:56:36.279385) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:38.101585 run osmo-stp_10.42.42.5(pid=25063): stderr: | 20221213195636470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195636471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195636471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195636471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195636472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195636472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195636472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:38.259332 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25063): Process ended prematurely: osmo-stp_10.42.42.5(pid=25063) [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 19:56:38.268342 tst handover.py:18: Test FAILED (6.9 sec) 19:56:38.295758 run osmo-hlr_10.42.42.2(pid=25060): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25060)] 19:56:38.347895 run osmo-hlr_10.42.42.2(pid=25060): stdout: | (launched: 2022-12-13_19:56:35.282756) 19:56:38.400558 run osmo-hlr_10.42.42.2(pid=25060): stderr: | 20221213195635483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195635483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195635483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195635483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195635483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195635483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195635515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195635525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195635525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195635525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:38.472891 run osmo-msc_10.42.42.6(pid=25066): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25066)] 19:56:38.522875 run osmo-msc_10.42.42.6(pid=25066): stdout: | (launched: 2022-12-13_19:56:37.305108) 19:56:38.574745 run osmo-msc_10.42.42.6(pid=25066): stderr: | 20221213195637627 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195637628 DLGLOBAL DEBUG validating counter group 0x7fa41aedcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195637628 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195637628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195637628 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195637628 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195637630 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195637630 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195637630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195637630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:38.626775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Terminating (SIGTERM) 19:56:38.668714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Terminating (SIGTERM) 19:56:38.710692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Terminating (SIGTERM) 19:56:38.752870 --- ParallelTerminationStrategy: PID 25059 died... 19:56:38.773042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25059): Terminated: ok {rc=0} 19:56:38.819684 --- ParallelTerminationStrategy: PID 25062 died... 19:56:38.839564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25062): Terminated: ok {rc=0} 19:56:38.886314 --- ParallelTerminationStrategy: PID 25065 died... 19:56:38.906354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25065): Terminated: ok {rc=0} 19:56:38.994542 bus /sierra_3: Setting Powered False 19:56:40.094133 bus /sierra_3: Setting Powered False 19:56:41.210108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:56:42.480732 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:42.486632 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:56:42.539130 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:56:42.566975 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:56:42.619569 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:56:42.671305 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:56:42.698879 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:56:43.249959 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:56:43.255421 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:43.266838 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:56:43.306367 tst handover.py: using LAC 35903 19:56:43.428478 tst handover.py: using RAC 203 19:56:43.549447 tst handover.py: using CellId 35903 19:56:43.678450 tst handover.py: using BVCI 35904 19:56:43.799790 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:56:43.845427 tst handover.py: using LAC 35904 19:56:43.964443 tst handover.py: using RAC 204 19:56:44.082872 tst handover.py: using CellId 35904 19:56:44.203050 tst handover.py: using BVCI 35905 19:56:44.316240 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:44.327725 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:44.338915 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:44.349993 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:44.361374 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:56:44.372695 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:56:44.492419 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:56:44.610977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:45.064270 run create_hlr_db(pid=25071): Launched 19:56:45.200814 bus /sierra_2: Setting Powered False 19:56:46.266747 run create_hlr_db(pid=25071): Terminated: ok {rc=0} 19:56:46.709948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Launched 19:56:47.057549 run osmo-hlr_10.42.42.2(pid=25074): Launched 19:56:47.209938 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:47.719685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Launched 19:56:48.029014 run osmo-stp_10.42.42.5(pid=25077): Launched 19:56:48.146959 run osmo-msc_10.42.42.6: Starting osmo-msc 19:56:48.681222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Launched 19:56:48.990248 run osmo-msc_10.42.42.6(pid=25080): Launched 19:56:49.165104 run osmo-stp_10.42.42.5(pid=25077): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] 19:56:49.295653 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-13_19:56:47.971927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:49.426243 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221213195648143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195648144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195648144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195648144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195648145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195648145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195648145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:49.554849 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-13_19:56:47.971927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:56:49.678150 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221213195648143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195648144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195648144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195648144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195648145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195648145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195648145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:56:49.825716 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 19:56:49.834296 tst handover.py:18: Test FAILED (6.6 sec) 19:56:49.860864 run osmo-hlr_10.42.42.2(pid=25074): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25074)] 19:56:49.909460 run osmo-hlr_10.42.42.2(pid=25074): stdout: | (launched: 2022-12-13_19:56:46.995592) 19:56:49.959498 run osmo-hlr_10.42.42.2(pid=25074): stderr: | 20221213195647229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195647229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195647229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195647229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195647229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195647229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195647242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195647251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195647251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195647251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:56:50.028693 run osmo-msc_10.42.42.6(pid=25080): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25080)] 19:56:50.076568 run osmo-msc_10.42.42.6(pid=25080): stdout: | (launched: 2022-12-13_19:56:48.932831) 19:56:50.126407 run osmo-msc_10.42.42.6(pid=25080): stderr: | 20221213195649203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195649204 DLGLOBAL DEBUG validating counter group 0x7f8d76824c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195649204 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195649204 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195649204 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195649204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195649206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195649206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195649207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195649207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:56:50.176685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminating (SIGTERM) 19:56:50.216645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminating (SIGTERM) 19:56:50.257492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminating (SIGTERM) 19:56:50.297827 --- ParallelTerminationStrategy: PID 25073 died... 19:56:50.317268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminated: ok {rc=0} 19:56:50.361344 --- ParallelTerminationStrategy: PID 25076 died... 19:56:50.380186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminated: ok {rc=0} 19:56:50.424377 --- ParallelTerminationStrategy: PID 25079 died... 19:56:50.443310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminated: ok {rc=0} 19:56:50.530692 bus /sierra_3: Setting Powered False 19:56:51.630192 bus /sierra_3: Setting Powered False 19:56:52.745866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:56:54.001456 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:56:54.008034 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:56:54.065260 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:56:54.093336 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:56:54.145550 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:56:54.202099 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:56:54.229790 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:56:54.781547 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:56:54.786710 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:54.798005 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:56:54.837495 tst handover.py: using LAC 35905 19:56:54.969941 tst handover.py: using RAC 205 19:56:55.098499 tst handover.py: using CellId 35905 19:56:55.228327 tst handover.py: using BVCI 35906 19:56:55.348029 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:56:55.398586 tst handover.py: using LAC 35906 19:56:55.525833 tst handover.py: using RAC 206 19:56:55.653122 tst handover.py: using CellId 35906 19:56:55.779771 tst handover.py: using BVCI 35907 19:56:55.901221 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:55.912902 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:55.924451 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:55.935994 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:55.947680 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:56:55.959363 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:56:56.076454 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:56:56.196525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:56:56.680300 run create_hlr_db(pid=25085): Launched 19:56:56.813395 bus /sierra_2: Setting Powered False 19:56:57.874484 run create_hlr_db(pid=25085): Terminated: ok {rc=0} 19:56:58.296787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Launched 19:56:58.628764 run osmo-hlr_10.42.42.2(pid=25088): Launched 19:56:58.755239 run osmo-stp_10.42.42.5: Starting osmo-stp 19:56:59.291764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Launched 19:56:59.623223 run osmo-stp_10.42.42.5(pid=25091): Launched 19:56:59.750022 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:00.316262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Launched 19:57:00.647942 run osmo-msc_10.42.42.6(pid=25094): Launched 19:57:00.831797 run osmo-stp_10.42.42.5(pid=25091): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] 19:57:01.090886 run osmo-stp_10.42.42.5(pid=25091): stdout: | (launched: 2022-12-13_19:56:59.562896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:01.311203 run osmo-stp_10.42.42.5(pid=25091): stderr: | 20221213195659755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195659755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195659756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195659756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195659756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195659756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195659757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:01.452141 run osmo-stp_10.42.42.5(pid=25091): stdout: | (launched: 2022-12-13_19:56:59.562896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:01.587019 run osmo-stp_10.42.42.5(pid=25091): stderr: | 20221213195659755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195659755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195659756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195659756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195659756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195659756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195659757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:01.748357 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25091): Process ended prematurely: osmo-stp_10.42.42.5(pid=25091) [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 19:57:01.758217 tst handover.py:18: Test FAILED (7.0 sec) 19:57:01.787210 run osmo-hlr_10.42.42.2(pid=25088): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25088)] 19:57:01.839810 run osmo-hlr_10.42.42.2(pid=25088): stdout: | (launched: 2022-12-13_19:56:58.567882) 19:57:01.893445 run osmo-hlr_10.42.42.2(pid=25088): stderr: | 20221213195658769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195658769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195658769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195658769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195658769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195658770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195658783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195658794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195658794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195658794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:01.967834 run osmo-msc_10.42.42.6(pid=25094): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25094)] 19:57:02.019737 run osmo-msc_10.42.42.6(pid=25094): stdout: | (launched: 2022-12-13_19:57:00.587385) 19:57:02.073140 run osmo-msc_10.42.42.6(pid=25094): stderr: | 20221213195701010 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195701010 DLGLOBAL DEBUG validating counter group 0x7f5ee2097c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195701010 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195701010 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195701010 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195701011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195701012 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195701013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195701013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195701013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:02.127248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Terminating (SIGTERM) 19:57:02.169688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Terminating (SIGTERM) 19:57:02.214466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Terminating (SIGTERM) 19:57:02.260678 --- ParallelTerminationStrategy: PID 25087 died... 19:57:02.282208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25087): Terminated: ok {rc=0} 19:57:02.327202 --- ParallelTerminationStrategy: PID 25090 died... 19:57:02.346341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25090): Terminated: ok {rc=0} 19:57:02.391407 --- ParallelTerminationStrategy: PID 25093 died... 19:57:02.410275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25093): Terminated: ok {rc=0} 19:57:02.497192 bus /sierra_3: Setting Powered False 19:57:03.597151 bus /sierra_3: Setting Powered False 19:57:04.713195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 19:57:05.980530 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:05.986283 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:57:06.029730 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:57:06.057489 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:57:06.111884 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:57:06.154227 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:57:06.180936 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:57:06.729140 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 19:57:06.734570 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:06.745793 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:57:06.786223 tst handover.py: using LAC 35907 19:57:06.909386 tst handover.py: using RAC 207 19:57:07.031842 tst handover.py: using CellId 35907 19:57:07.157126 tst handover.py: using BVCI 35908 19:57:07.268384 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:57:07.302802 tst handover.py: using LAC 35908 19:57:07.421798 tst handover.py: using RAC 208 19:57:07.542847 tst handover.py: using CellId 35908 19:57:07.663693 tst handover.py: using BVCI 35909 19:57:07.776572 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:07.787668 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:07.798427 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:07.809470 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:07.820751 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:57:07.831980 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:57:07.951560 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:57:08.068514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:08.521563 run create_hlr_db(pid=25099): Launched 19:57:08.638065 bus /sierra_2: Setting Powered False 19:57:09.699152 run create_hlr_db(pid=25099): Terminated: ok {rc=0} 19:57:10.121750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Launched 19:57:10.452824 run osmo-hlr_10.42.42.2(pid=25102): Launched 19:57:10.581033 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:11.120072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Launched 19:57:11.453111 run osmo-stp_10.42.42.5(pid=25105): Launched 19:57:11.579803 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:12.148911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Launched 19:57:12.482230 run osmo-msc_10.42.42.6(pid=25108): Launched 19:57:12.669203 run osmo-stp_10.42.42.5(pid=25105): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] 19:57:12.807980 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-13_19:57:11.391217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:12.946695 run osmo-stp_10.42.42.5(pid=25105): stderr: | 20221213195711583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195711583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195711583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195711584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195711584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195711584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195711584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:13.084874 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-13_19:57:11.391217) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:13.217190 run osmo-stp_10.42.42.5(pid=25105): stderr: | 20221213195711583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195711583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195711583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195711584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195711584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195711584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195711584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:13.375513 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25105): Process ended prematurely: osmo-stp_10.42.42.5(pid=25105) [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 19:57:13.385036 tst handover.py:18: Test FAILED (6.6 sec) 19:57:13.412731 run osmo-hlr_10.42.42.2(pid=25102): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25102)] 19:57:13.463410 run osmo-hlr_10.42.42.2(pid=25102): stdout: | (launched: 2022-12-13_19:57:10.391443) 19:57:13.515532 run osmo-hlr_10.42.42.2(pid=25102): stderr: | 20221213195710591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195710591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195710591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195710591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195710591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195710591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195710604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195710614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195710614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195710614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:13.587891 run osmo-msc_10.42.42.6(pid=25108): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25108)] 19:57:13.638068 run osmo-msc_10.42.42.6(pid=25108): stdout: | (launched: 2022-12-13_19:57:12.420803) 19:57:13.689916 run osmo-msc_10.42.42.6(pid=25108): stderr: | 20221213195712744 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195712744 DLGLOBAL DEBUG validating counter group 0x7f7dbfb0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195712745 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195712745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195712745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195712745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195712747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195712747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195712747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195712747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:13.742273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminating (SIGTERM) 19:57:13.784226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminating (SIGTERM) 19:57:13.826253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminating (SIGTERM) 19:57:13.868583 --- ParallelTerminationStrategy: PID 25101 died... 19:57:13.888782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminated: ok {rc=0} 19:57:13.935556 --- ParallelTerminationStrategy: PID 25104 died... 19:57:13.955420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminated: ok {rc=0} 19:57:14.001950 --- ParallelTerminationStrategy: PID 25107 died... 19:57:14.021900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminated: ok {rc=0} 19:57:14.111317 bus /sierra_3: Setting Powered False 19:57:15.208643 bus /sierra_3: Setting Powered False 19:57:16.328739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 19:57:17.598138 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:17.603787 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:57:17.659710 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:57:17.687606 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:57:17.742998 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:57:17.797187 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:57:17.823835 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:57:18.378448 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 19:57:18.384096 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:18.396001 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:57:18.434984 tst handover.py: using LAC 35909 19:57:18.565387 tst handover.py: using RAC 209 19:57:18.696899 tst handover.py: using CellId 35909 19:57:18.825793 tst handover.py: using BVCI 35910 19:57:18.939369 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:57:18.988061 tst handover.py: using LAC 35910 19:57:19.110533 tst handover.py: using RAC 210 19:57:19.230604 tst handover.py: using CellId 35910 19:57:19.355381 tst handover.py: using BVCI 35911 19:57:19.469180 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:19.480059 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:19.490897 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:19.501772 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:19.512843 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:57:19.523962 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:57:19.645653 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:57:19.763722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:20.218832 run create_hlr_db(pid=25113): Launched 19:57:20.337682 bus /sierra_2: Setting Powered False 19:57:21.398567 run create_hlr_db(pid=25113): Terminated: ok {rc=0} 19:57:21.820741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Launched 19:57:22.153521 run osmo-hlr_10.42.42.2(pid=25116): Launched 19:57:22.280470 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:22.825387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Launched 19:57:23.156462 run osmo-stp_10.42.42.5(pid=25119): Launched 19:57:23.284159 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:23.854033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Launched 19:57:24.184909 run osmo-msc_10.42.42.6(pid=25122): Launched 19:57:24.370394 run osmo-stp_10.42.42.5(pid=25119): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] 19:57:24.510234 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-13_19:57:23.095769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:24.649097 run osmo-stp_10.42.42.5(pid=25119): stderr: | 20221213195723288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195723288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195723288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195723289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195723289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195723289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195723289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:24.786262 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-13_19:57:23.095769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:24.918055 run osmo-stp_10.42.42.5(pid=25119): stderr: | 20221213195723288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195723288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195723288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195723289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195723289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195723289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195723289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:25.075369 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25119): Process ended prematurely: osmo-stp_10.42.42.5(pid=25119) [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 19:57:25.084432 tst handover.py:18: Test FAILED (6.7 sec) 19:57:25.111941 run osmo-hlr_10.42.42.2(pid=25116): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25116)] 19:57:25.162014 run osmo-hlr_10.42.42.2(pid=25116): stdout: | (launched: 2022-12-13_19:57:22.092308) 19:57:25.213747 run osmo-hlr_10.42.42.2(pid=25116): stderr: | 20221213195722292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195722293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195722293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195722293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195722293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195722293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195722306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195722314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195722314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195722314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:25.285792 run osmo-msc_10.42.42.6(pid=25122): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25122)] 19:57:25.335786 run osmo-msc_10.42.42.6(pid=25122): stdout: | (launched: 2022-12-13_19:57:24.123752) 19:57:25.387329 run osmo-msc_10.42.42.6(pid=25122): stderr: | 20221213195724447 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195724447 DLGLOBAL DEBUG validating counter group 0x7f2277c0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195724447 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195724448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195724448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195724448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195724450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195724450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195724450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195724450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:25.439915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminating (SIGTERM) 19:57:25.481454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminating (SIGTERM) 19:57:25.523104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminating (SIGTERM) 19:57:25.565379 --- ParallelTerminationStrategy: PID 25115 died... 19:57:25.585796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminated: ok {rc=0} 19:57:25.632526 --- ParallelTerminationStrategy: PID 25118 died... 19:57:25.652458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminated: ok {rc=0} 19:57:25.698926 --- ParallelTerminationStrategy: PID 25121 died... 19:57:25.718801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminated: ok {rc=0} 19:57:25.807704 bus /sierra_3: Setting Powered False 19:57:26.906425 bus /sierra_3: Setting Powered False 19:57:28.024520 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 19:57:29.290354 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:29.296548 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:57:29.352389 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:57:29.380366 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:57:29.433314 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:57:29.488168 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:57:29.515824 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:57:30.068289 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 19:57:30.074054 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:30.085824 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:57:30.125117 tst handover.py: using LAC 35911 19:57:30.254903 tst handover.py: using RAC 211 19:57:30.386546 tst handover.py: using CellId 35911 19:57:30.518088 tst handover.py: using BVCI 35912 19:57:30.639493 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:57:30.689314 tst handover.py: using LAC 35912 19:57:30.819792 tst handover.py: using RAC 212 19:57:30.983919 tst handover.py: using CellId 35912 19:57:31.154190 tst handover.py: using BVCI 35913 19:57:31.271854 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:31.283991 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:31.295899 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:31.307918 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:31.321273 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:57:31.334264 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:57:31.458173 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:57:31.582676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:32.055471 run create_hlr_db(pid=25127): Launched 19:57:32.211733 bus /sierra_2: Setting Powered False 19:57:33.272858 run create_hlr_db(pid=25127): Terminated: ok {rc=0} 19:57:33.697123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25129): Launched 19:57:34.028844 run osmo-hlr_10.42.42.2(pid=25130): Launched 19:57:34.156417 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:34.700752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25132): Launched 19:57:35.032637 run osmo-stp_10.42.42.5(pid=25133): Launched 19:57:35.158430 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:35.729091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25135): Launched 19:57:36.061972 run osmo-msc_10.42.42.6(pid=25136): Launched 19:57:36.247997 run osmo-stp_10.42.42.5(pid=25133): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25133)] 19:57:36.386844 run osmo-stp_10.42.42.5(pid=25133): stdout: | (launched: 2022-12-13_19:57:34.971472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:36.526377 run osmo-stp_10.42.42.5(pid=25133): stderr: | 20221213195735165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195735165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195735165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195735166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195735166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195735166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195735166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:36.663947 run osmo-stp_10.42.42.5(pid=25133): stdout: | (launched: 2022-12-13_19:57:34.971472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:36.795884 run osmo-stp_10.42.42.5(pid=25133): stderr: | 20221213195735165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195735165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195735165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195735166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195735166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195735166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195735166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:36.953583 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25133): Process ended prematurely: osmo-stp_10.42.42.5(pid=25133) [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25133)] [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 19:57:36.962748 tst handover.py:18: Test FAILED (6.9 sec) 19:57:36.990274 run osmo-hlr_10.42.42.2(pid=25130): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25130)] 19:57:37.041418 run osmo-hlr_10.42.42.2(pid=25130): stdout: | (launched: 2022-12-13_19:57:33.967742) 19:57:37.094012 run osmo-hlr_10.42.42.2(pid=25130): stderr: | 20221213195734167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195734167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195734167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195734168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195734168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195734168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195734179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195734189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195734189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195734189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:37.166277 run osmo-msc_10.42.42.6(pid=25136): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25136)] 19:57:37.216375 run osmo-msc_10.42.42.6(pid=25136): stdout: | (launched: 2022-12-13_19:57:36.000594) 19:57:37.268282 run osmo-msc_10.42.42.6(pid=25136): stderr: | 20221213195736323 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195736323 DLGLOBAL DEBUG validating counter group 0x7fc05ce79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195736323 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195736323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195736323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195736323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195736325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195736325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195736326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195736326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:37.320794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25129): Terminating (SIGTERM) 19:57:37.362721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25132): Terminating (SIGTERM) 19:57:37.405068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25135): Terminating (SIGTERM) 19:57:37.447626 --- ParallelTerminationStrategy: PID 25129 died... 19:57:37.468132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25129): Terminated: ok {rc=0} 19:57:37.514913 --- ParallelTerminationStrategy: PID 25132 died... 19:57:37.534901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25132): Terminated: ok {rc=0} 19:57:37.582543 --- ParallelTerminationStrategy: PID 25135 died... 19:57:37.602680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25135): Terminated: ok {rc=0} 19:57:37.691125 bus /sierra_3: Setting Powered False 19:57:38.791631 bus /sierra_3: Setting Powered False 19:57:39.909479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 19:57:41.174691 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:41.180309 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 19:57:41.218726 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 19:57:41.246720 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 19:57:41.299465 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 19:57:41.337670 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 19:57:41.365338 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 19:57:41.917942 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 19:57:41.923575 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:41.935222 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:57:41.970261 tst handover.py: using LAC 35913 19:57:42.098793 tst handover.py: using RAC 213 19:57:42.228892 tst handover.py: using CellId 35913 19:57:42.359161 tst handover.py: using BVCI 35914 19:57:42.481199 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:57:42.517051 tst handover.py: using LAC 35914 19:57:42.647163 tst handover.py: using RAC 214 19:57:42.769310 tst handover.py: using CellId 35914 19:57:42.889642 tst handover.py: using BVCI 35915 19:57:43.003480 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:43.014626 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:43.025470 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:43.036278 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:43.047286 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:57:43.058384 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:57:43.177859 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:57:43.298650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:43.755142 run create_hlr_db(pid=25141): Launched 19:57:43.873710 bus /sierra_2: Setting Powered False 19:57:44.939374 run create_hlr_db(pid=25141): Terminated: ok {rc=0} 19:57:45.361767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Launched 19:57:45.695318 run osmo-hlr_10.42.42.2(pid=25144): Launched 19:57:45.822879 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:46.459784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Launched 19:57:46.901811 run osmo-stp_10.42.42.5(pid=25147): Launched 19:57:47.262804 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:47.861535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25149): Launched 19:57:48.193699 run osmo-msc_10.42.42.6(pid=25150): Launched 19:57:48.379393 run osmo-stp_10.42.42.5(pid=25147): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] 19:57:48.518565 run osmo-stp_10.42.42.5(pid=25147): stdout: | (launched: 2022-12-13_19:57:46.820501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:48.658352 run osmo-stp_10.42.42.5(pid=25147): stderr: | 20221213195747056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195747056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195747056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195747058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195747058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195747059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195747059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:48.797306 run osmo-stp_10.42.42.5(pid=25147): stdout: | (launched: 2022-12-13_19:57:46.820501) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:57:48.929263 run osmo-stp_10.42.42.5(pid=25147): stderr: | 20221213195747056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195747056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195747056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195747058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195747058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195747059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195747059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:57:49.087400 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25147): Process ended prematurely: osmo-stp_10.42.42.5(pid=25147) [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 19:57:49.096336 tst handover.py:18: Test FAILED (7.2 sec) 19:57:49.123877 run osmo-hlr_10.42.42.2(pid=25144): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25144)] 19:57:49.174346 run osmo-hlr_10.42.42.2(pid=25144): stdout: | (launched: 2022-12-13_19:57:45.634141) 19:57:49.226583 run osmo-hlr_10.42.42.2(pid=25144): stderr: | 20221213195745834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195745834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195745834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195745834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195745834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195745834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195745867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195745886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195745886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195745886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:57:49.299507 run osmo-msc_10.42.42.6(pid=25150): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25150)] 19:57:49.349768 run osmo-msc_10.42.42.6(pid=25150): stdout: | (launched: 2022-12-13_19:57:48.132604) 19:57:49.401778 run osmo-msc_10.42.42.6(pid=25150): stderr: | 20221213195748458 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195748458 DLGLOBAL DEBUG validating counter group 0x7f6d05af4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195748458 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195748458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195748458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195748458 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195748460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195748460 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195748461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195748461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:57:49.454525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Terminating (SIGTERM) 19:57:49.496466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Terminating (SIGTERM) 19:57:49.538549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25149): Terminating (SIGTERM) 19:57:49.580588 --- ParallelTerminationStrategy: PID 25143 died... 19:57:49.600699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Terminated: ok {rc=0} 19:57:49.647008 --- ParallelTerminationStrategy: PID 25146 died... 19:57:49.666551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Terminated: ok {rc=0} 19:57:49.712692 --- ParallelTerminationStrategy: PID 25149 died... 19:57:49.732260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25149): Terminated: ok {rc=0} 19:57:49.820070 bus /sierra_3: Setting Powered False 19:57:50.921552 bus /sierra_3: Setting Powered False 19:57:52.037489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 19:57:53.282523 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:57:53.288743 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:57:53.339906 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:57:53.366623 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:57:53.419899 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:57:53.470848 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:57:53.497445 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:57:54.046856 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 19:57:54.052257 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:54.063283 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:57:54.097233 tst handover.py: using LAC 35915 19:57:54.218870 tst handover.py: using RAC 215 19:57:54.341131 tst handover.py: using CellId 35915 19:57:54.471673 tst handover.py: using BVCI 35916 19:57:54.593666 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:57:54.644101 tst handover.py: using LAC 35916 19:57:54.774823 tst handover.py: using RAC 216 19:57:54.908428 tst handover.py: using CellId 35916 19:57:55.040715 tst handover.py: using BVCI 35917 19:57:55.163136 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:55.174624 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:55.185901 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:55.197131 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:55.209154 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:57:55.221075 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:57:55.340286 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:57:55.461699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:57:55.917490 run create_hlr_db(pid=25155): Launched 19:57:56.035871 bus /sierra_2: Setting Powered False 19:57:57.098045 run create_hlr_db(pid=25155): Terminated: ok {rc=0} 19:57:57.523333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Launched 19:57:57.856428 run osmo-hlr_10.42.42.2(pid=25158): Launched 19:57:57.983355 run osmo-stp_10.42.42.5: Starting osmo-stp 19:57:58.528596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Launched 19:57:58.860767 run osmo-stp_10.42.42.5(pid=25161): Launched 19:57:58.988630 run osmo-msc_10.42.42.6: Starting osmo-msc 19:57:59.557747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25163): Launched 19:57:59.889925 run osmo-msc_10.42.42.6(pid=25164): Launched 19:58:00.073649 run osmo-stp_10.42.42.5(pid=25161): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] 19:58:00.212246 run osmo-stp_10.42.42.5(pid=25161): stdout: | (launched: 2022-12-13_19:57:58.799947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:00.351828 run osmo-stp_10.42.42.5(pid=25161): stderr: | 20221213195758992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195758993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195758993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195758993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195758994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195758994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195758994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:00.490709 run osmo-stp_10.42.42.5(pid=25161): stdout: | (launched: 2022-12-13_19:57:58.799947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:00.622445 run osmo-stp_10.42.42.5(pid=25161): stderr: | 20221213195758992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195758993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195758993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195758993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195758994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195758994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195758994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:00.779778 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25161): Process ended prematurely: osmo-stp_10.42.42.5(pid=25161) [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 19:58:00.788846 tst handover.py:18: Test FAILED (6.7 sec) 19:58:00.816263 run osmo-hlr_10.42.42.2(pid=25158): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25158)] 19:58:00.887938 run osmo-hlr_10.42.42.2(pid=25158): stdout: | (launched: 2022-12-13_19:57:57.795738) 19:58:00.944795 run osmo-hlr_10.42.42.2(pid=25158): stderr: | 20221213195757994 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195757994 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195757994 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195757994 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195757994 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195757994 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195758006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195758015 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195758015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195758015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:01.018833 run osmo-msc_10.42.42.6(pid=25164): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25164)] 19:58:01.096520 run osmo-msc_10.42.42.6(pid=25164): stdout: | (launched: 2022-12-13_19:57:59.828832) 19:58:01.150309 run osmo-msc_10.42.42.6(pid=25164): stderr: | 20221213195800150 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195800150 DLGLOBAL DEBUG validating counter group 0x7fd1898eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195800150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195800150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195800150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195800150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195800152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195800152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195800153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195800153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:01.202876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Terminating (SIGTERM) 19:58:01.245282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Terminating (SIGTERM) 19:58:01.287886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25163): Terminating (SIGTERM) 19:58:01.332574 --- ParallelTerminationStrategy: PID 25157 died... 19:58:01.354273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Terminated: ok {rc=0} 19:58:01.402005 --- ParallelTerminationStrategy: PID 25160 died... 19:58:01.422504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Terminated: ok {rc=0} 19:58:01.469240 --- ParallelTerminationStrategy: PID 25163 died... 19:58:01.489756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25163): Terminated: ok {rc=0} 19:58:01.582660 bus /sierra_3: Setting Powered False 19:58:02.683915 bus /sierra_3: Setting Powered False 19:58:03.799583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:58:05.066618 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:05.072215 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:58:05.120666 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:58:05.148488 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:58:05.202537 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:58:05.251467 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:58:05.279190 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:58:05.833494 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:58:05.839953 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:05.852239 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:05.889907 tst handover.py: using LAC 35917 19:58:06.019127 tst handover.py: using RAC 217 19:58:06.149483 tst handover.py: using CellId 35917 19:58:06.285832 tst handover.py: using BVCI 35918 19:58:06.407391 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:58:06.451779 tst handover.py: using LAC 35918 19:58:06.573243 tst handover.py: using RAC 218 19:58:06.692754 tst handover.py: using CellId 35918 19:58:06.812054 tst handover.py: using BVCI 35919 19:58:06.923833 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:06.935082 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:06.946126 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:06.957129 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:06.968417 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:58:06.979677 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:07.100167 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:58:07.218436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:07.673208 run create_hlr_db(pid=25169): Launched 19:58:07.791137 bus /sierra_2: Setting Powered False 19:58:08.852752 run create_hlr_db(pid=25169): Terminated: ok {rc=0} 19:58:09.258493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Launched 19:58:09.568589 run osmo-hlr_10.42.42.2(pid=25172): Launched 19:58:09.687455 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:10.210372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Launched 19:58:10.522761 run osmo-stp_10.42.42.5(pid=25175): Launched 19:58:10.643137 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:11.176767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Launched 19:58:11.487196 run osmo-msc_10.42.42.6(pid=25178): Launched 19:58:11.661413 run osmo-stp_10.42.42.5(pid=25175): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] 19:58:11.792155 run osmo-stp_10.42.42.5(pid=25175): stdout: | (launched: 2022-12-13_19:58:10.465168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:11.923340 run osmo-stp_10.42.42.5(pid=25175): stderr: | 20221213195810636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195810636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195810636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195810637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195810637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195810637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195810638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:12.052255 run osmo-stp_10.42.42.5(pid=25175): stdout: | (launched: 2022-12-13_19:58:10.465168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:12.176121 run osmo-stp_10.42.42.5(pid=25175): stderr: | 20221213195810636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195810636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195810636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195810637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195810637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195810637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195810638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:12.324387 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25175): Process ended prematurely: osmo-stp_10.42.42.5(pid=25175) [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 19:58:12.332936 tst handover.py:18: Test FAILED (6.5 sec) 19:58:12.359379 run osmo-hlr_10.42.42.2(pid=25172): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25172)] 19:58:12.408315 run osmo-hlr_10.42.42.2(pid=25172): stdout: | (launched: 2022-12-13_19:58:09.511203) 19:58:12.458553 run osmo-hlr_10.42.42.2(pid=25172): stderr: | 20221213195809690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195809690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195809690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195809690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195809690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195809690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195809701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195809710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195809710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195809710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:12.528727 run osmo-msc_10.42.42.6(pid=25178): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25178)] 19:58:12.577301 run osmo-msc_10.42.42.6(pid=25178): stdout: | (launched: 2022-12-13_19:58:11.429778) 19:58:12.627386 run osmo-msc_10.42.42.6(pid=25178): stderr: | 20221213195811701 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195811701 DLGLOBAL DEBUG validating counter group 0x7fe279374c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195811701 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195811701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195811701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195811702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195811703 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195811704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195811704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195811704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:12.678291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Terminating (SIGTERM) 19:58:12.718319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Terminating (SIGTERM) 19:58:12.758918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Terminating (SIGTERM) 19:58:12.799769 --- ParallelTerminationStrategy: PID 25171 died... 19:58:12.819461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25171): Terminated: ok {rc=0} 19:58:12.863772 --- ParallelTerminationStrategy: PID 25174 died... 19:58:12.882672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25174): Terminated: ok {rc=0} 19:58:12.926989 --- ParallelTerminationStrategy: PID 25177 died... 19:58:12.945915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25177): Terminated: ok {rc=0} 19:58:13.032192 bus /sierra_3: Setting Powered False 19:58:14.132061 bus /sierra_3: Setting Powered False 19:58:15.248933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:58:16.502103 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:16.507987 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:58:16.564824 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:58:16.592942 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:58:16.645382 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:58:16.736223 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:58:16.766988 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:58:17.282380 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:58:17.288452 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:17.300277 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:58:17.336078 tst handover.py: using LAC 35919 19:58:17.457131 tst handover.py: using RAC 219 19:58:17.577267 tst handover.py: using CellId 35919 19:58:17.701961 tst handover.py: using BVCI 35920 19:58:17.815874 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:58:17.863310 tst handover.py: using LAC 35920 19:58:17.983680 tst handover.py: using RAC 220 19:58:18.103871 tst handover.py: using CellId 35920 19:58:18.224068 tst handover.py: using BVCI 35921 19:58:18.336668 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:18.347985 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:18.358896 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:18.369756 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:18.381825 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:58:18.394042 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:58:18.511358 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:58:18.627795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:19.081281 run create_hlr_db(pid=25184): Launched 19:58:19.199032 bus /sierra_2: Setting Powered False 19:58:20.260028 run create_hlr_db(pid=25184): Terminated: ok {rc=0} 19:58:20.665293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Launched 19:58:20.973962 run osmo-hlr_10.42.42.2(pid=25187): Launched 19:58:21.092129 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:21.607764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Launched 19:58:21.918310 run osmo-stp_10.42.42.5(pid=25190): Launched 19:58:22.038994 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:22.571603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Launched 19:58:22.882038 run osmo-msc_10.42.42.6(pid=25193): Launched 19:58:23.056658 run osmo-stp_10.42.42.5(pid=25190): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] 19:58:23.186886 run osmo-stp_10.42.42.5(pid=25190): stdout: | (launched: 2022-12-13_19:58:21.860366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:23.316796 run osmo-stp_10.42.42.5(pid=25190): stderr: | 20221213195822031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195822032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195822032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195822032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195822033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195822033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195822033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:23.445368 run osmo-stp_10.42.42.5(pid=25190): stdout: | (launched: 2022-12-13_19:58:21.860366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:23.568157 run osmo-stp_10.42.42.5(pid=25190): stderr: | 20221213195822031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195822032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195822032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195822032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195822033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195822033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195822033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:23.715289 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25190): Process ended prematurely: osmo-stp_10.42.42.5(pid=25190) [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 19:58:23.723547 tst handover.py:18: Test FAILED (6.4 sec) 19:58:23.749567 run osmo-hlr_10.42.42.2(pid=25187): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25187)] 19:58:23.797959 run osmo-hlr_10.42.42.2(pid=25187): stdout: | (launched: 2022-12-13_19:58:20.916814) 19:58:23.847760 run osmo-hlr_10.42.42.2(pid=25187): stderr: | 20221213195821092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195821092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195821092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195821092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195821092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195821092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195821104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195821112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195821112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195821112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:23.916738 run osmo-msc_10.42.42.6(pid=25193): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25193)] 19:58:23.964630 run osmo-msc_10.42.42.6(pid=25193): stdout: | (launched: 2022-12-13_19:58:22.824668) 19:58:24.013938 run osmo-msc_10.42.42.6(pid=25193): stderr: | 20221213195823094 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195823094 DLGLOBAL DEBUG validating counter group 0x7f9fb60a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195823094 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195823095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195823095 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195823095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195823097 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195823097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195823097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195823097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:24.063930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Terminating (SIGTERM) 19:58:24.103665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Terminating (SIGTERM) 19:58:24.143603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Terminating (SIGTERM) 19:58:24.183682 --- ParallelTerminationStrategy: PID 25186 died... 19:58:24.203075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Terminated: ok {rc=0} 19:58:24.247001 --- ParallelTerminationStrategy: PID 25189 died... 19:58:24.265812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Terminated: ok {rc=0} 19:58:24.309592 --- ParallelTerminationStrategy: PID 25192 died... 19:58:24.328262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Terminated: ok {rc=0} 19:58:24.414769 bus /sierra_3: Setting Powered False 19:58:25.514998 bus /sierra_3: Setting Powered False 19:58:26.630478 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 19:58:27.903631 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:27.910351 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:58:27.950299 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:58:27.978221 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:58:28.039511 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:58:28.078676 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:58:28.105633 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:58:28.654478 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 19:58:28.661124 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:28.672056 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:58:28.706290 tst handover.py: using LAC 35921 19:58:28.828543 tst handover.py: using RAC 221 19:58:28.948008 tst handover.py: using CellId 35921 19:58:29.070896 tst handover.py: using BVCI 35922 19:58:29.183030 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:58:29.217062 tst handover.py: using LAC 35922 19:58:29.337102 tst handover.py: using RAC 222 19:58:29.456239 tst handover.py: using CellId 35922 19:58:29.575506 tst handover.py: using BVCI 35923 19:58:29.687450 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:29.698421 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:29.709112 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:29.719798 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:29.730818 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:58:29.741844 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:58:29.862769 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:58:29.983059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:30.470493 run create_hlr_db(pid=25198): Launched 19:58:30.606692 bus /sierra_2: Setting Powered False 19:58:31.670423 run create_hlr_db(pid=25198): Terminated: ok {rc=0} 19:58:32.109601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25200): Launched 19:58:32.452719 run osmo-hlr_10.42.42.2(pid=25201): Launched 19:58:32.582781 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:33.125518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25203): Launched 19:58:33.458295 run osmo-stp_10.42.42.5(pid=25204): Launched 19:58:33.587103 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:34.157425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25206): Launched 19:58:34.490885 run osmo-msc_10.42.42.6(pid=25207): Launched 19:58:34.678589 run osmo-stp_10.42.42.5(pid=25204): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25204)] 19:58:34.818659 run osmo-stp_10.42.42.5(pid=25204): stdout: | (launched: 2022-12-13_19:58:33.397242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:34.959126 run osmo-stp_10.42.42.5(pid=25204): stderr: | 20221213195833588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195833588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195833589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195833589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195833590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195833590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195833590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:35.097581 run osmo-stp_10.42.42.5(pid=25204): stdout: | (launched: 2022-12-13_19:58:33.397242) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:35.229917 run osmo-stp_10.42.42.5(pid=25204): stderr: | 20221213195833588 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195833588 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195833589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195833589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195833590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195833590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195833590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:35.388044 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25204): Process ended prematurely: osmo-stp_10.42.42.5(pid=25204) [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25204)] [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 19:58:35.397191 tst handover.py:18: Test FAILED (6.7 sec) 19:58:35.424854 run osmo-hlr_10.42.42.2(pid=25201): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25201)] 19:58:35.476122 run osmo-hlr_10.42.42.2(pid=25201): stdout: | (launched: 2022-12-13_19:58:32.391403) 19:58:35.527969 run osmo-hlr_10.42.42.2(pid=25201): stderr: | 20221213195832592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195832592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195832592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195832592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195832592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195832592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195832604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195832613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195832613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195832613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:35.600710 run osmo-msc_10.42.42.6(pid=25207): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25207)] 19:58:35.650559 run osmo-msc_10.42.42.6(pid=25207): stdout: | (launched: 2022-12-13_19:58:34.429514) 19:58:35.701954 run osmo-msc_10.42.42.6(pid=25207): stderr: | 20221213195834752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195834752 DLGLOBAL DEBUG validating counter group 0x7f1aabc23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195834752 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195834752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195834752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195834753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195834754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195834755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195834755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195834755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:35.753707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25200): Terminating (SIGTERM) 19:58:35.795300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25203): Terminating (SIGTERM) 19:58:35.837349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25206): Terminating (SIGTERM) 19:58:35.879491 --- ParallelTerminationStrategy: PID 25200 died... 19:58:35.899689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25200): Terminated: ok {rc=0} 19:58:35.946303 --- ParallelTerminationStrategy: PID 25203 died... 19:58:35.966119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25203): Terminated: ok {rc=0} 19:58:36.012219 --- ParallelTerminationStrategy: PID 25206 died... 19:58:36.032037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25206): Terminated: ok {rc=0} 19:58:36.119574 bus /sierra_3: Setting Powered False 19:58:37.219430 bus /sierra_3: Setting Powered False 19:58:38.336115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 19:58:39.581538 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:39.587144 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:58:39.639398 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:58:39.667111 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:58:39.720725 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:58:39.773226 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:58:39.800898 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:58:40.355351 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 19:58:40.360894 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:40.372835 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:58:40.408613 tst handover.py: using LAC 35923 19:58:40.530521 tst handover.py: using RAC 223 19:58:40.653195 tst handover.py: using CellId 35923 19:58:40.775519 tst handover.py: using BVCI 35924 19:58:40.887334 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:58:40.936243 tst handover.py: using LAC 35924 19:58:41.059045 tst handover.py: using RAC 224 19:58:41.181203 tst handover.py: using CellId 35924 19:58:41.307845 tst handover.py: using BVCI 35925 19:58:41.421214 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:41.432067 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:41.442835 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:41.453779 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:41.464795 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:58:41.475877 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:58:41.596423 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:58:41.715332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:42.201493 run create_hlr_db(pid=25213): Launched 19:58:42.336820 bus /sierra_2: Setting Powered False 19:58:43.402010 run create_hlr_db(pid=25213): Terminated: ok {rc=0} 19:58:43.818202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25215): Launched 19:58:44.129718 run osmo-hlr_10.42.42.2(pid=25216): Launched 19:58:44.247858 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:44.756008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25218): Launched 19:58:45.065757 run osmo-stp_10.42.42.5(pid=25219): Launched 19:58:45.184539 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:45.717979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25221): Launched 19:58:46.061872 run osmo-msc_10.42.42.6(pid=25222): Launched 19:58:46.412019 run osmo-stp_10.42.42.5(pid=25219): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25219)] 19:58:46.577600 run osmo-stp_10.42.42.5(pid=25219): stdout: | (launched: 2022-12-13_19:58:45.008512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:46.873152 run osmo-stp_10.42.42.5(pid=25219): stderr: | 20221213195845177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195845177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195845178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195845178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195845178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195845179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195845179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:47.027056 run osmo-stp_10.42.42.5(pid=25219): stdout: | (launched: 2022-12-13_19:58:45.008512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:47.153378 run osmo-stp_10.42.42.5(pid=25219): stderr: | 20221213195845177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195845177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195845178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195845178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195845178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195845179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195845179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:47.304288 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25219): Process ended prematurely: osmo-stp_10.42.42.5(pid=25219) [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25219)] [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 19:58:47.313525 tst handover.py:18: Test FAILED (6.9 sec) 19:58:47.340719 run osmo-hlr_10.42.42.2(pid=25216): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25216)] 19:58:47.391404 run osmo-hlr_10.42.42.2(pid=25216): stdout: | (launched: 2022-12-13_19:58:44.072267) 19:58:47.442902 run osmo-hlr_10.42.42.2(pid=25216): stderr: | 20221213195844251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195844251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195844251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195844251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195844251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195844251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195844264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195844274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195844274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195844274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:47.514836 run osmo-msc_10.42.42.6(pid=25222): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25222)] 19:58:47.563223 run osmo-msc_10.42.42.6(pid=25222): stdout: | (launched: 2022-12-13_19:58:45.995911) 19:58:47.613722 run osmo-msc_10.42.42.6(pid=25222): stderr: | 20221213195846626 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195846626 DLGLOBAL DEBUG validating counter group 0x7fcba7c77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195846627 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195846627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195846627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195846627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195846641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195846641 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195846641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195846641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:47.664204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25215): Terminating (SIGTERM) 19:58:47.704570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25218): Terminating (SIGTERM) 19:58:47.745367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25221): Terminating (SIGTERM) 19:58:47.786184 --- ParallelTerminationStrategy: PID 25215 died... 19:58:47.806047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25215): Terminated: ok {rc=0} 19:58:47.850858 --- ParallelTerminationStrategy: PID 25218 died... 19:58:47.870142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25218): Terminated: ok {rc=0} 19:58:47.914794 --- ParallelTerminationStrategy: PID 25221 died... 19:58:47.933901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25221): Terminated: ok {rc=0} 19:58:48.020637 bus /sierra_3: Setting Powered False 19:58:49.121861 bus /sierra_3: Setting Powered False 19:58:50.238996 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 19:58:51.500180 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:58:51.505826 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:58:51.557621 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:58:51.585822 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:58:51.640816 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:58:51.692782 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:58:51.720587 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:58:52.272168 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 19:58:52.278634 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:52.290793 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:58:52.327765 tst handover.py: using LAC 35925 19:58:52.451703 tst handover.py: using RAC 225 19:58:52.582949 tst handover.py: using CellId 35925 19:58:52.714423 tst handover.py: using BVCI 35926 19:58:52.835872 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:58:52.886347 tst handover.py: using LAC 35926 19:58:53.017299 tst handover.py: using RAC 226 19:58:53.146684 tst handover.py: using CellId 35926 19:58:53.275910 tst handover.py: using BVCI 35927 19:58:53.397129 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:53.408549 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:53.419813 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:53.431079 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:53.442812 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:58:53.454163 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:58:53.571118 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:58:53.690659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:58:54.176245 run create_hlr_db(pid=25227): Launched 19:58:54.311179 bus /sierra_2: Setting Powered False 19:58:55.376747 run create_hlr_db(pid=25227): Terminated: ok {rc=0} 19:58:55.795163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25229): Launched 19:58:56.104737 run osmo-hlr_10.42.42.2(pid=25230): Launched 19:58:56.223568 run osmo-stp_10.42.42.5: Starting osmo-stp 19:58:56.744784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25232): Launched 19:58:57.054650 run osmo-stp_10.42.42.5(pid=25233): Launched 19:58:57.173059 run osmo-msc_10.42.42.6: Starting osmo-msc 19:58:57.707070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25235): Launched 19:58:58.018905 run osmo-msc_10.42.42.6(pid=25236): Launched 19:58:58.193955 run osmo-stp_10.42.42.5(pid=25233): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25233)] 19:58:58.324682 run osmo-stp_10.42.42.5(pid=25233): stdout: | (launched: 2022-12-13_19:58:56.997491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:58.455647 run osmo-stp_10.42.42.5(pid=25233): stderr: | 20221213195857163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195857163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195857163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195857164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195857164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195857164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195857164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:58.584245 run osmo-stp_10.42.42.5(pid=25233): stdout: | (launched: 2022-12-13_19:58:56.997491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:58:58.707630 run osmo-stp_10.42.42.5(pid=25233): stderr: | 20221213195857163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195857163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195857163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195857164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195857164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195857164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195857164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:58:58.854939 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25233): Process ended prematurely: osmo-stp_10.42.42.5(pid=25233) [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25233)] [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 19:58:58.863686 tst handover.py:18: Test FAILED (6.6 sec) 19:58:58.890058 run osmo-hlr_10.42.42.2(pid=25230): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25230)] 19:58:58.938497 run osmo-hlr_10.42.42.2(pid=25230): stdout: | (launched: 2022-12-13_19:58:56.047779) 19:58:58.988116 run osmo-hlr_10.42.42.2(pid=25230): stderr: | 20221213195856224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195856224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195856224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195856224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195856225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195856225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195856237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195856245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195856245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195856245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:58:59.056915 run osmo-msc_10.42.42.6(pid=25236): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25236)] 19:58:59.104766 run osmo-msc_10.42.42.6(pid=25236): stdout: | (launched: 2022-12-13_19:58:57.961385) 19:58:59.154203 run osmo-msc_10.42.42.6(pid=25236): stderr: | 20221213195858232 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195858232 DLGLOBAL DEBUG validating counter group 0x7f1e67fd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195858232 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195858232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195858232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195858232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195858234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195858234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195858235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195858235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:58:59.203529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25229): Terminating (SIGTERM) 19:58:59.243467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25232): Terminating (SIGTERM) 19:58:59.283157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25235): Terminating (SIGTERM) 19:58:59.323745 --- ParallelTerminationStrategy: PID 25229 died... 19:58:59.343389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25229): Terminated: ok {rc=0} 19:58:59.388064 --- ParallelTerminationStrategy: PID 25232 died... 19:58:59.406979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25232): Terminated: ok {rc=0} 19:58:59.451242 --- ParallelTerminationStrategy: PID 25235 died... 19:58:59.470128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25235): Terminated: ok {rc=0} 19:58:59.556316 bus /sierra_3: Setting Powered False 19:59:00.657243 bus /sierra_3: Setting Powered False 19:59:01.788046 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 19:59:03.057094 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:03.062343 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:59:03.112426 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:59:03.139262 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:59:03.191922 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:59:03.244190 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:59:03.272099 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:59:03.817647 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 19:59:03.824871 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:03.836877 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:59:03.873885 tst handover.py: using LAC 35927 19:59:03.995768 tst handover.py: using RAC 227 19:59:04.117358 tst handover.py: using CellId 35927 19:59:04.236505 tst handover.py: using BVCI 35928 19:59:04.348144 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:59:04.395296 tst handover.py: using LAC 35928 19:59:04.514656 tst handover.py: using RAC 228 19:59:04.633374 tst handover.py: using CellId 35928 19:59:04.752393 tst handover.py: using BVCI 35929 19:59:04.863959 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:04.875049 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:04.885914 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:04.896602 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:04.908089 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:59:04.919144 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:59:05.039592 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:59:05.156092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:05.609644 run create_hlr_db(pid=25242): Launched 19:59:05.727343 bus /sierra_2: Setting Powered False 19:59:06.788594 run create_hlr_db(pid=25242): Terminated: ok {rc=0} 19:59:07.213245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25244): Launched 19:59:07.547164 run osmo-hlr_10.42.42.2(pid=25245): Launched 19:59:07.675400 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:08.218804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25247): Launched 19:59:08.551458 run osmo-stp_10.42.42.5(pid=25248): Launched 19:59:08.679380 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:09.252146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25250): Launched 19:59:09.587118 run osmo-msc_10.42.42.6(pid=25251): Launched 19:59:09.772271 run osmo-stp_10.42.42.5(pid=25248): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25248)] 19:59:09.911494 run osmo-stp_10.42.42.5(pid=25248): stdout: | (launched: 2022-12-13_19:59:08.490562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:10.051406 run osmo-stp_10.42.42.5(pid=25248): stderr: | 20221213195908682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195908682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195908682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195908682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195908683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195908683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195908683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:10.190244 run osmo-stp_10.42.42.5(pid=25248): stdout: | (launched: 2022-12-13_19:59:08.490562) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:10.323001 run osmo-stp_10.42.42.5(pid=25248): stderr: | 20221213195908682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195908682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195908682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195908682 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195908683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195908683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195908683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:10.481883 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25248): Process ended prematurely: osmo-stp_10.42.42.5(pid=25248) [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25248)] [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 19:59:10.490861 tst handover.py:18: Test FAILED (6.7 sec) 19:59:10.518570 run osmo-hlr_10.42.42.2(pid=25245): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25245)] 19:59:10.569221 run osmo-hlr_10.42.42.2(pid=25245): stdout: | (launched: 2022-12-13_19:59:07.485891) 19:59:10.621474 run osmo-hlr_10.42.42.2(pid=25245): stderr: | 20221213195907686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195907686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195907686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195907686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195907686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195907686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195907698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195907708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195907708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195907708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:10.694613 run osmo-msc_10.42.42.6(pid=25251): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25251)] 19:59:10.745193 run osmo-msc_10.42.42.6(pid=25251): stdout: | (launched: 2022-12-13_19:59:09.525837) 19:59:10.797362 run osmo-msc_10.42.42.6(pid=25251): stderr: | 20221213195909849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195909849 DLGLOBAL DEBUG validating counter group 0x7fc4ba7a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195909849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195909849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195909849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195909849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195909851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195909851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195909851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195909852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:10.849934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25244): Terminating (SIGTERM) 19:59:10.891909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25247): Terminating (SIGTERM) 19:59:10.934057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25250): Terminating (SIGTERM) 19:59:10.976676 --- ParallelTerminationStrategy: PID 25244 died... 19:59:10.997110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25244): Terminated: ok {rc=0} 19:59:11.043624 --- ParallelTerminationStrategy: PID 25247 died... 19:59:11.063331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25247): Terminated: ok {rc=0} 19:59:11.109996 --- ParallelTerminationStrategy: PID 25250 died... 19:59:11.129960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25250): Terminated: ok {rc=0} 19:59:11.219270 bus /sierra_3: Setting Powered False 19:59:12.319401 bus /sierra_3: Setting Powered False 19:59:13.435804 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:59:14.697440 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:14.703083 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:59:14.749715 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:59:14.777435 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:59:14.831923 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:59:14.877972 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:59:14.905148 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:59:15.454651 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:59:15.460301 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:15.471820 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:59:15.506233 tst handover.py: using LAC 35929 19:59:15.635807 tst handover.py: using RAC 229 19:59:15.765462 tst handover.py: using CellId 35929 19:59:15.912141 tst handover.py: using BVCI 35930 19:59:16.043193 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:59:16.089502 tst handover.py: using LAC 35930 19:59:16.220656 tst handover.py: using RAC 230 19:59:16.353831 tst handover.py: using CellId 35930 19:59:16.484313 tst handover.py: using BVCI 35931 19:59:16.602530 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:16.614860 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:16.626896 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:16.639051 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:16.653063 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:59:16.666983 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:59:16.811091 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:59:16.935026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:17.428920 run create_hlr_db(pid=25256): Launched 19:59:17.566562 bus /sierra_2: Setting Powered False 19:59:18.632012 run create_hlr_db(pid=25256): Terminated: ok {rc=0} 19:59:19.050481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Launched 19:59:19.364154 run osmo-hlr_10.42.42.2(pid=25259): Launched 19:59:19.482714 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:19.998354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Launched 19:59:20.308041 run osmo-stp_10.42.42.5(pid=25262): Launched 19:59:20.427509 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:20.960017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Launched 19:59:21.270707 run osmo-msc_10.42.42.6(pid=25266): Launched 19:59:21.445903 run osmo-stp_10.42.42.5(pid=25262): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] 19:59:21.576590 run osmo-stp_10.42.42.5(pid=25262): stdout: | (launched: 2022-12-13_19:59:20.250820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:21.707800 run osmo-stp_10.42.42.5(pid=25262): stderr: | 20221213195920418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195920418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195920418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195920418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195920419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195920419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195920419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:21.837324 run osmo-stp_10.42.42.5(pid=25262): stdout: | (launched: 2022-12-13_19:59:20.250820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:21.960367 run osmo-stp_10.42.42.5(pid=25262): stderr: | 20221213195920418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195920418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195920418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195920418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195920419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195920419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195920419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:22.107899 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25262): Process ended prematurely: osmo-stp_10.42.42.5(pid=25262) [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 19:59:22.116385 tst handover.py:18: Test FAILED (6.6 sec) 19:59:22.142706 run osmo-hlr_10.42.42.2(pid=25259): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25259)] 19:59:22.192014 run osmo-hlr_10.42.42.2(pid=25259): stdout: | (launched: 2022-12-13_19:59:19.306485) 19:59:22.241943 run osmo-hlr_10.42.42.2(pid=25259): stderr: | 20221213195919483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195919483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195919483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195919483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195919483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195919483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195919495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195919505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195919506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195919506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:22.311475 run osmo-msc_10.42.42.6(pid=25266): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25266)] 19:59:22.359323 run osmo-msc_10.42.42.6(pid=25266): stdout: | (launched: 2022-12-13_19:59:21.212844) 19:59:22.409480 run osmo-msc_10.42.42.6(pid=25266): stderr: | 20221213195921482 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195921482 DLGLOBAL DEBUG validating counter group 0x7f532dc2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195921483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195921483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195921483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195921483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195921485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195921485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195921485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195921485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:22.459021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Terminating (SIGTERM) 19:59:22.499144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Terminating (SIGTERM) 19:59:22.539955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Terminating (SIGTERM) 19:59:22.580512 --- ParallelTerminationStrategy: PID 25258 died... 19:59:22.600259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Terminated: ok {rc=0} 19:59:22.645413 --- ParallelTerminationStrategy: PID 25261 died... 19:59:22.664699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Terminated: ok {rc=0} 19:59:22.709140 --- ParallelTerminationStrategy: PID 25265 died... 19:59:22.728191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Terminated: ok {rc=0} 19:59:22.814558 bus /sierra_3: Setting Powered False 19:59:23.914016 bus /sierra_3: Setting Powered False 19:59:25.029657 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:59:26.281310 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:26.286580 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:59:26.336878 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:59:26.363764 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:59:26.418999 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:59:26.472491 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:59:26.500393 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:59:27.050020 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:59:27.056577 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:27.067915 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:27.101641 tst handover.py: using LAC 35931 19:59:27.235621 tst handover.py: using RAC 231 19:59:27.363922 tst handover.py: using CellId 35931 19:59:27.491722 tst handover.py: using BVCI 35932 19:59:27.611826 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:59:27.661323 tst handover.py: using LAC 35932 19:59:27.789430 tst handover.py: using RAC 232 19:59:27.917452 tst handover.py: using CellId 35932 19:59:28.048359 tst handover.py: using BVCI 35933 19:59:28.169995 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:28.181586 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:28.192838 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:28.204259 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:28.215730 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:59:28.227177 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:28.341265 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:59:28.457160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:28.910444 run create_hlr_db(pid=25271): Launched 19:59:29.031039 bus /sierra_2: Setting Powered False 19:59:30.092888 run create_hlr_db(pid=25271): Terminated: ok {rc=0} 19:59:30.498281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Launched 19:59:30.807118 run osmo-hlr_10.42.42.2(pid=25274): Launched 19:59:31.032653 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:31.695534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Launched 19:59:32.057695 run osmo-stp_10.42.42.5(pid=25277): Launched 19:59:32.240006 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:32.773691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Launched 19:59:33.082565 run osmo-msc_10.42.42.6(pid=25280): Launched 19:59:33.254927 run osmo-stp_10.42.42.5(pid=25277): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] 19:59:33.385757 run osmo-stp_10.42.42.5(pid=25277): stdout: | (launched: 2022-12-13_19:59:31.983820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:33.516210 run osmo-stp_10.42.42.5(pid=25277): stderr: | 20221213195932231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195932231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195932232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195932232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195932233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195932233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195932233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:33.645451 run osmo-stp_10.42.42.5(pid=25277): stdout: | (launched: 2022-12-13_19:59:31.983820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:33.768909 run osmo-stp_10.42.42.5(pid=25277): stderr: | 20221213195932231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195932231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195932232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195932232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195932233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195932233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195932233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:33.916447 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25277): Process ended prematurely: osmo-stp_10.42.42.5(pid=25277) [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 19:59:33.924876 tst handover.py:18: Test FAILED (6.9 sec) 19:59:33.951071 run osmo-hlr_10.42.42.2(pid=25274): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25274)] 19:59:33.999561 run osmo-hlr_10.42.42.2(pid=25274): stdout: | (launched: 2022-12-13_19:59:30.749781) 19:59:34.049297 run osmo-hlr_10.42.42.2(pid=25274): stderr: | 20221213195931017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195931017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195931017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195931017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195931017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195931018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195931062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195931077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195931078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195931078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:34.118915 run osmo-msc_10.42.42.6(pid=25280): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25280)] 19:59:34.166322 run osmo-msc_10.42.42.6(pid=25280): stdout: | (launched: 2022-12-13_19:59:33.025193) 19:59:34.215944 run osmo-msc_10.42.42.6(pid=25280): stderr: | 20221213195933296 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195933296 DLGLOBAL DEBUG validating counter group 0x7f08be96fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195933296 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195933296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195933296 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195933297 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195933298 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195933299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195933299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195933299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:34.266145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Terminating (SIGTERM) 19:59:34.305933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Terminating (SIGTERM) 19:59:34.345931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Terminating (SIGTERM) 19:59:34.386202 --- ParallelTerminationStrategy: PID 25273 died... 19:59:34.405524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Terminated: ok {rc=0} 19:59:34.449804 --- ParallelTerminationStrategy: PID 25276 died... 19:59:34.468703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Terminated: ok {rc=0} 19:59:34.512781 --- ParallelTerminationStrategy: PID 25279 died... 19:59:34.531977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Terminated: ok {rc=0} 19:59:34.617762 bus /sierra_3: Setting Powered False 19:59:35.717321 bus /sierra_3: Setting Powered False 19:59:36.832378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 19:59:38.099843 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:38.105326 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:59:38.143805 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:59:38.171538 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:59:38.224516 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:59:38.262651 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:59:38.290157 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:59:38.842802 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 19:59:38.848145 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:38.859612 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:59:38.894241 tst handover.py: using LAC 35933 19:59:39.029072 tst handover.py: using RAC 233 19:59:39.159438 tst handover.py: using CellId 35933 19:59:39.295672 tst handover.py: using BVCI 35934 19:59:39.416774 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:59:39.451650 tst handover.py: using LAC 35934 19:59:39.580287 tst handover.py: using RAC 234 19:59:39.708229 tst handover.py: using CellId 35934 19:59:39.836017 tst handover.py: using BVCI 35935 19:59:39.958954 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:39.970463 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:39.981689 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:39.992788 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:40.004064 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:59:40.015239 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:59:40.132303 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:59:40.251930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:40.738514 run create_hlr_db(pid=25285): Launched 19:59:40.874017 bus /sierra_2: Setting Powered False 19:59:41.939390 run create_hlr_db(pid=25285): Terminated: ok {rc=0} 19:59:42.354359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Launched 19:59:42.665740 run osmo-hlr_10.42.42.2(pid=25288): Launched 19:59:42.785158 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:43.294812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Launched 19:59:43.604812 run osmo-stp_10.42.42.5(pid=25291): Launched 19:59:43.723610 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:44.254837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25293): Launched 19:59:44.565520 run osmo-msc_10.42.42.6(pid=25294): Launched 19:59:44.738859 run osmo-stp_10.42.42.5(pid=25291): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] 19:59:44.869470 run osmo-stp_10.42.42.5(pid=25291): stdout: | (launched: 2022-12-13_19:59:43.547533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:45.000033 run osmo-stp_10.42.42.5(pid=25291): stderr: | 20221213195943717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195943717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195943717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195943718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195943718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195943718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195943718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:45.128925 run osmo-stp_10.42.42.5(pid=25291): stdout: | (launched: 2022-12-13_19:59:43.547533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:45.253116 run osmo-stp_10.42.42.5(pid=25291): stderr: | 20221213195943717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195943717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195943717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195943718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195943718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195943718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195943718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:45.400798 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25291): Process ended prematurely: osmo-stp_10.42.42.5(pid=25291) [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 19:59:45.409320 tst handover.py:18: Test FAILED (6.6 sec) 19:59:45.435599 run osmo-hlr_10.42.42.2(pid=25288): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25288)] 19:59:45.485789 run osmo-hlr_10.42.42.2(pid=25288): stdout: | (launched: 2022-12-13_19:59:42.608172) 19:59:45.536037 run osmo-hlr_10.42.42.2(pid=25288): stderr: | 20221213195942783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195942783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195942783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195942783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195942783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195942783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195942797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195942807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195942807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195942807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:45.606985 run osmo-msc_10.42.42.6(pid=25294): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25294)] 19:59:45.654669 run osmo-msc_10.42.42.6(pid=25294): stdout: | (launched: 2022-12-13_19:59:44.507957) 19:59:45.704656 run osmo-msc_10.42.42.6(pid=25294): stderr: | 20221213195944778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195944778 DLGLOBAL DEBUG validating counter group 0x7f216585cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195944778 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195944778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195944779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195944779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195944780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195944781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195944781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195944781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:45.754271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Terminating (SIGTERM) 19:59:45.794297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Terminating (SIGTERM) 19:59:45.850830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25293): Terminating (SIGTERM) 19:59:45.904275 --- ParallelTerminationStrategy: PID 25287 died... 19:59:45.925511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25287): Terminated: ok {rc=0} 19:59:45.975373 --- ParallelTerminationStrategy: PID 25290 died... 19:59:45.996807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25290): Terminated: ok {rc=0} 19:59:46.045303 --- ParallelTerminationStrategy: PID 25293 died... 19:59:46.067554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25293): Terminated: ok {rc=0} 19:59:46.160668 bus /sierra_3: Setting Powered False 19:59:47.266608 bus /sierra_3: Setting Powered False 19:59:48.382416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 19:59:49.622330 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:59:49.627862 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:59:49.678616 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:59:49.705209 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:59:49.764534 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:59:49.816274 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:59:49.844221 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:59:50.391160 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 19:59:50.397556 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:50.409060 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:59:50.444136 tst handover.py: using LAC 35935 19:59:50.575807 tst handover.py: using RAC 235 19:59:50.711562 tst handover.py: using CellId 35935 19:59:50.841695 tst handover.py: using BVCI 35936 19:59:50.962144 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:59:51.010803 tst handover.py: using LAC 35936 19:59:51.138872 tst handover.py: using RAC 236 19:59:51.269387 tst handover.py: using CellId 35936 19:59:51.398801 tst handover.py: using BVCI 35937 19:59:51.521809 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:51.533825 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:51.545197 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:51.556519 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:51.567862 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:59:51.579332 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:59:51.695936 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:59:51.817335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:59:52.302660 run create_hlr_db(pid=25300): Launched 19:59:52.438358 bus /sierra_2: Setting Powered False 19:59:53.503664 run create_hlr_db(pid=25300): Terminated: ok {rc=0} 19:59:53.921543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25302): Launched 19:59:54.230546 run osmo-hlr_10.42.42.2(pid=25303): Launched 19:59:54.349585 run osmo-stp_10.42.42.5: Starting osmo-stp 19:59:54.854522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25305): Launched 19:59:55.163434 run osmo-stp_10.42.42.5(pid=25306): Launched 19:59:55.283205 run osmo-msc_10.42.42.6: Starting osmo-msc 19:59:55.815152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25308): Launched 19:59:56.125186 run osmo-msc_10.42.42.6(pid=25309): Launched 19:59:56.298378 run osmo-stp_10.42.42.5(pid=25306): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25306)] 19:59:56.429788 run osmo-stp_10.42.42.5(pid=25306): stdout: | (launched: 2022-12-13_19:59:55.106147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:56.560423 run osmo-stp_10.42.42.5(pid=25306): stderr: | 20221213195955275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195955275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195955275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195955276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195955276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195955276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195955277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:56.689817 run osmo-stp_10.42.42.5(pid=25306): stdout: | (launched: 2022-12-13_19:59:55.106147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:59:56.813511 run osmo-stp_10.42.42.5(pid=25306): stderr: | 20221213195955275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213195955275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213195955275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213195955276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213195955276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213195955276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213195955277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:59:56.961473 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25306): Process ended prematurely: osmo-stp_10.42.42.5(pid=25306) [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25306)] [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 19:59:56.969693 tst handover.py:18: Test FAILED (6.6 sec) 19:59:56.996027 run osmo-hlr_10.42.42.2(pid=25303): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25303)] 19:59:57.045050 run osmo-hlr_10.42.42.2(pid=25303): stdout: | (launched: 2022-12-13_19:59:54.173480) 19:59:57.094828 run osmo-hlr_10.42.42.2(pid=25303): stderr: | 20221213195954348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213195954348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213195954348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213195954348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213195954348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213195954348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213195954360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213195954368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213195954368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213195954368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:59:57.164498 run osmo-msc_10.42.42.6(pid=25309): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25309)] 19:59:57.212370 run osmo-msc_10.42.42.6(pid=25309): stdout: | (launched: 2022-12-13_19:59:56.067687) 19:59:57.262232 run osmo-msc_10.42.42.6(pid=25309): stderr: | 20221213195956338 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213195956338 DLGLOBAL DEBUG validating counter group 0x7f758c8f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213195956338 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213195956338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213195956338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213195956339 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213195956340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213195956341 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213195956341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213195956341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:59:57.312714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25302): Terminating (SIGTERM) 19:59:57.352853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25305): Terminating (SIGTERM) 19:59:57.393297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25308): Terminating (SIGTERM) 19:59:57.434282 --- ParallelTerminationStrategy: PID 25302 died... 19:59:57.453893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25302): Terminated: ok {rc=0} 19:59:57.498175 --- ParallelTerminationStrategy: PID 25305 died... 19:59:57.517273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25305): Terminated: ok {rc=0} 19:59:57.561528 --- ParallelTerminationStrategy: PID 25308 died... 19:59:57.580485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25308): Terminated: ok {rc=0} 19:59:57.667449 bus /sierra_3: Setting Powered False 19:59:58.767693 bus /sierra_3: Setting Powered False 19:59:59.885386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 20:00:01.184432 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:01.190947 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:00:01.247096 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:00:01.277382 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:00:01.333045 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:00:01.397166 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:00:01.430963 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:00:01.964501 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 20:00:01.972996 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:01.996698 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:00:02.047497 tst handover.py: using LAC 35937 20:00:02.193370 tst handover.py: using RAC 237 20:00:02.328061 tst handover.py: using CellId 35937 20:00:02.451649 tst handover.py: using BVCI 35938 20:00:02.565952 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:00:02.613496 tst handover.py: using LAC 35938 20:00:02.740797 tst handover.py: using RAC 238 20:00:02.862247 tst handover.py: using CellId 35938 20:00:02.983773 tst handover.py: using BVCI 35939 20:00:03.096339 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:03.107245 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:03.118231 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:03.128914 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:03.140532 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:00:03.152183 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:00:03.274668 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:00:03.394629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:03.850481 run create_hlr_db(pid=25317): Launched 20:00:03.971677 bus /sierra_2: Setting Powered False 20:00:05.034005 run create_hlr_db(pid=25317): Terminated: ok {rc=0} 20:00:05.444574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Launched 20:00:05.757877 run osmo-hlr_10.42.42.2(pid=25320): Launched 20:00:05.876835 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:06.399379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Launched 20:00:06.712277 run osmo-stp_10.42.42.5(pid=25323): Launched 20:00:06.831086 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:07.367011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25325): Launched 20:00:07.680769 run osmo-msc_10.42.42.6(pid=25326): Launched 20:00:07.854257 run osmo-stp_10.42.42.5(pid=25323): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] 20:00:07.985800 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-13_20:00:06.654698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:08.117369 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221213200006823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200006823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200006824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200006824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200006825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200006825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200006825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:08.246741 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-13_20:00:06.654698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:08.370746 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221213200006823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200006823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200006824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200006824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200006825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200006825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200006825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:08.519681 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 20:00:08.528299 tst handover.py:18: Test FAILED (6.6 sec) 20:00:08.554739 run osmo-hlr_10.42.42.2(pid=25320): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25320)] 20:00:08.603647 run osmo-hlr_10.42.42.2(pid=25320): stdout: | (launched: 2022-12-13_20:00:05.700157) 20:00:08.654209 run osmo-hlr_10.42.42.2(pid=25320): stderr: | 20221213200005874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200005875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200005875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200005875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200005875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200005875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200005887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200005895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200005896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200005896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:08.724385 run osmo-msc_10.42.42.6(pid=25326): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25326)] 20:00:08.772369 run osmo-msc_10.42.42.6(pid=25326): stdout: | (launched: 2022-12-13_20:00:07.623147) 20:00:08.822275 run osmo-msc_10.42.42.6(pid=25326): stderr: | 20221213200007895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200007895 DLGLOBAL DEBUG validating counter group 0x7f859239dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200007895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200007895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200007895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200007895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200007897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200007898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200007898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200007898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:08.872145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminating (SIGTERM) 20:00:08.912419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminating (SIGTERM) 20:00:08.952795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25325): Terminating (SIGTERM) 20:00:08.993758 --- ParallelTerminationStrategy: PID 25319 died... 20:00:09.013630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminated: ok {rc=0} 20:00:09.058477 --- ParallelTerminationStrategy: PID 25322 died... 20:00:09.077794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminated: ok {rc=0} 20:00:09.122460 --- ParallelTerminationStrategy: PID 25325 died... 20:00:09.141682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25325): Terminated: ok {rc=0} 20:00:09.226421 bus /sierra_3: Setting Powered False 20:00:10.326278 bus /sierra_3: Setting Powered False 20:00:11.442755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 20:00:12.702836 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:12.708539 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 20:00:12.769941 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 20:00:12.798101 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 20:00:12.851950 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 20:00:12.913696 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 20:00:12.941238 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 20:00:13.497950 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 20:00:13.503726 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:13.515625 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:00:13.565288 tst handover.py: using LAC 35939 20:00:13.695256 tst handover.py: using RAC 239 20:00:13.826699 tst handover.py: using CellId 35939 20:00:13.956175 tst handover.py: using BVCI 35940 20:00:14.076260 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 20:00:14.123830 tst handover.py: using LAC 35940 20:00:14.255418 tst handover.py: using RAC 240 20:00:14.384885 tst handover.py: using CellId 35940 20:00:14.514657 tst handover.py: using BVCI 35941 20:00:14.637014 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:14.648820 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:14.660349 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:14.672026 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:14.683587 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 20:00:14.695093 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:00:14.813423 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 20:00:14.929987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:15.382888 run create_hlr_db(pid=25331): Launched 20:00:15.503916 bus /sierra_2: Setting Powered False 20:00:16.564374 run create_hlr_db(pid=25331): Terminated: ok {rc=0} 20:00:16.980687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25333): Launched 20:00:17.310210 run osmo-hlr_10.42.42.2(pid=25334): Launched 20:00:17.432475 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:17.952244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25336): Launched 20:00:18.262475 run osmo-stp_10.42.42.5(pid=25337): Launched 20:00:18.382336 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:18.914273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25339): Launched 20:00:19.226789 run osmo-msc_10.42.42.6(pid=25340): Launched 20:00:19.402209 run osmo-stp_10.42.42.5(pid=25337): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25337)] 20:00:19.534093 run osmo-stp_10.42.42.5(pid=25337): stdout: | (launched: 2022-12-13_20:00:18.204399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:19.664855 run osmo-stp_10.42.42.5(pid=25337): stderr: | 20221213200018374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200018374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200018374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200018375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200018375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200018375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200018375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:19.793789 run osmo-stp_10.42.42.5(pid=25337): stdout: | (launched: 2022-12-13_20:00:18.204399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:19.917257 run osmo-stp_10.42.42.5(pid=25337): stderr: | 20221213200018374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200018374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200018374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200018375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200018375 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200018375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200018375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:20.064470 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25337): Process ended prematurely: osmo-stp_10.42.42.5(pid=25337) [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25337)] [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 20:00:20.073068 tst handover.py:18: Test FAILED (6.6 sec) 20:00:20.099408 run osmo-hlr_10.42.42.2(pid=25334): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25334)] 20:00:20.148215 run osmo-hlr_10.42.42.2(pid=25334): stdout: | (launched: 2022-12-13_20:00:17.252174) 20:00:20.197946 run osmo-hlr_10.42.42.2(pid=25334): stderr: | 20221213200017426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200017426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200017426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200017427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200017427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200017427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200017439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200017449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200017449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200017450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:20.268120 run osmo-msc_10.42.42.6(pid=25340): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25340)] 20:00:20.315997 run osmo-msc_10.42.42.6(pid=25340): stdout: | (launched: 2022-12-13_20:00:19.169210) 20:00:20.365984 run osmo-msc_10.42.42.6(pid=25340): stderr: | 20221213200019438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200019438 DLGLOBAL DEBUG validating counter group 0x7faa45d03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200019438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200019439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200019439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200019439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200019441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200019441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200019441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200019441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:20.416567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25333): Terminating (SIGTERM) 20:00:20.456465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25336): Terminating (SIGTERM) 20:00:20.496801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25339): Terminating (SIGTERM) 20:00:20.537364 --- ParallelTerminationStrategy: PID 25333 died... 20:00:20.557134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25333): Terminated: ok {rc=0} 20:00:20.601822 --- ParallelTerminationStrategy: PID 25336 died... 20:00:20.620994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25336): Terminated: ok {rc=0} 20:00:20.665288 --- ParallelTerminationStrategy: PID 25339 died... 20:00:20.684414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25339): Terminated: ok {rc=0} 20:00:20.771020 bus /sierra_3: Setting Powered False 20:00:21.870687 bus /sierra_3: Setting Powered False 20:00:22.986803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:00:24.259179 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:24.264474 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:00:24.329566 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:00:24.356329 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:00:24.409542 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:00:24.476368 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:00:24.504621 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:00:25.056048 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:00:25.061797 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:25.073489 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:00:25.122621 tst handover.py: using LAC 35941 20:00:25.252061 tst handover.py: using RAC 241 20:00:25.381079 tst handover.py: using CellId 35941 20:00:25.508788 tst handover.py: using BVCI 35942 20:00:25.629200 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:00:25.678682 tst handover.py: using LAC 35942 20:00:25.807623 tst handover.py: using RAC 242 20:00:25.928487 tst handover.py: using CellId 35942 20:00:26.047390 tst handover.py: using BVCI 35943 20:00:26.158874 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:26.170009 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:26.180843 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:26.191757 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:26.202965 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:00:26.214148 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:00:26.334315 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:00:26.453917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:26.910270 run create_hlr_db(pid=25345): Launched 20:00:27.030370 bus /sierra_2: Setting Powered False 20:00:28.091964 run create_hlr_db(pid=25345): Terminated: ok {rc=0} 20:00:28.498360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25347): Launched 20:00:28.808399 run osmo-hlr_10.42.42.2(pid=25348): Launched 20:00:28.926445 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:29.434411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25350): Launched 20:00:29.744369 run osmo-stp_10.42.42.5(pid=25351): Launched 20:00:29.861932 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:30.391990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25353): Launched 20:00:30.701645 run osmo-msc_10.42.42.6(pid=25354): Launched 20:00:30.918206 run osmo-stp_10.42.42.5(pid=25351): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25351)] 20:00:31.128081 run osmo-stp_10.42.42.5(pid=25351): stdout: | (launched: 2022-12-13_20:00:29.687014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:31.277415 run osmo-stp_10.42.42.5(pid=25351): stderr: | 20221213200029854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200029854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200029854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200029854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200029855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200029855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200029855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:31.422897 run osmo-stp_10.42.42.5(pid=25351): stdout: | (launched: 2022-12-13_20:00:29.687014) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:31.551939 run osmo-stp_10.42.42.5(pid=25351): stderr: | 20221213200029854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200029854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200029854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200029854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200029855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200029855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200029855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:31.705532 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25351): Process ended prematurely: osmo-stp_10.42.42.5(pid=25351) [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25351)] [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 20:00:31.714988 tst handover.py:18: Test FAILED (6.6 sec) 20:00:31.742623 run osmo-hlr_10.42.42.2(pid=25348): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25348)] 20:00:31.795810 run osmo-hlr_10.42.42.2(pid=25348): stdout: | (launched: 2022-12-13_20:00:28.751042) 20:00:31.848439 run osmo-hlr_10.42.42.2(pid=25348): stderr: | 20221213200028927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200028927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200028927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200028927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200028927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200028927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200028940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200028948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200028948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200028948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:31.921533 run osmo-msc_10.42.42.6(pid=25354): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25354)] 20:00:31.972568 run osmo-msc_10.42.42.6(pid=25354): stdout: | (launched: 2022-12-13_20:00:30.644237) 20:00:32.024774 run osmo-msc_10.42.42.6(pid=25354): stderr: | 20221213200031008 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200031008 DLGLOBAL DEBUG validating counter group 0x7f6a04805c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200031008 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200031008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200031008 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200031009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200031010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200031011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200031011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200031011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:32.077609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25347): Terminating (SIGTERM) 20:00:32.118782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25350): Terminating (SIGTERM) 20:00:32.161104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25353): Terminating (SIGTERM) 20:00:32.203576 --- ParallelTerminationStrategy: PID 25347 died... 20:00:32.224847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25347): Terminated: ok {rc=0} 20:00:32.271473 --- ParallelTerminationStrategy: PID 25350 died... 20:00:32.292398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25350): Terminated: ok {rc=0} 20:00:32.339124 --- ParallelTerminationStrategy: PID 25353 died... 20:00:32.360180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25353): Terminated: ok {rc=0} 20:00:32.447284 bus /sierra_3: Setting Powered False 20:00:33.546380 bus /sierra_3: Setting Powered False 20:00:34.663408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 20:00:35.937884 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:35.944493 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:00:35.997190 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:00:36.025244 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:00:36.079645 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:00:36.133152 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:00:36.160826 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:00:36.710056 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 20:00:36.715467 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:36.727034 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:36.776867 tst handover.py: using LAC 35943 20:00:36.906875 tst handover.py: using RAC 243 20:00:37.038023 tst handover.py: using CellId 35943 20:00:37.168771 tst handover.py: using BVCI 35944 20:00:37.288674 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 20:00:37.324873 tst handover.py: using LAC 35944 20:00:37.453971 tst handover.py: using RAC 244 20:00:37.584912 tst handover.py: using CellId 35944 20:00:37.715990 tst handover.py: using BVCI 35945 20:00:37.837492 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:37.848917 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:37.860225 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:37.871471 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:37.882915 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:00:37.894296 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:38.010625 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 20:00:38.131302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:38.617650 run create_hlr_db(pid=25359): Launched 20:00:38.752036 bus /sierra_2: Setting Powered False 20:00:39.817747 run create_hlr_db(pid=25359): Terminated: ok {rc=0} 20:00:40.249441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25361): Launched 20:00:40.581506 run osmo-hlr_10.42.42.2(pid=25362): Launched 20:00:40.709168 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:41.255164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25364): Launched 20:00:41.587372 run osmo-stp_10.42.42.5(pid=25365): Launched 20:00:41.715838 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:42.288427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25367): Launched 20:00:42.619834 run osmo-msc_10.42.42.6(pid=25368): Launched 20:00:42.805295 run osmo-stp_10.42.42.5(pid=25365): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25365)] 20:00:42.943892 run osmo-stp_10.42.42.5(pid=25365): stdout: | (launched: 2022-12-13_20:00:41.526447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:43.083970 run osmo-stp_10.42.42.5(pid=25365): stderr: | 20221213200041719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200041719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200041720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200041720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200041721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200041721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200041721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:43.222195 run osmo-stp_10.42.42.5(pid=25365): stdout: | (launched: 2022-12-13_20:00:41.526447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:43.354349 run osmo-stp_10.42.42.5(pid=25365): stderr: | 20221213200041719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200041719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200041720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200041720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200041721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200041721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200041721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:43.513095 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25365): Process ended prematurely: osmo-stp_10.42.42.5(pid=25365) [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25365)] [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 20:00:43.522044 tst handover.py:18: Test FAILED (6.8 sec) 20:00:43.549781 run osmo-hlr_10.42.42.2(pid=25362): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25362)] 20:00:43.600151 run osmo-hlr_10.42.42.2(pid=25362): stdout: | (launched: 2022-12-13_20:00:40.520568) 20:00:43.652103 run osmo-hlr_10.42.42.2(pid=25362): stderr: | 20221213200040719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200040720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200040720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200040720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200040720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200040720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200040732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200040741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200040741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200040742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:43.725165 run osmo-msc_10.42.42.6(pid=25368): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25368)] 20:00:43.775307 run osmo-msc_10.42.42.6(pid=25368): stdout: | (launched: 2022-12-13_20:00:42.559020) 20:00:43.826833 run osmo-msc_10.42.42.6(pid=25368): stderr: | 20221213200042881 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200042881 DLGLOBAL DEBUG validating counter group 0x7f35e6b28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200042881 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200042881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200042882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200042882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200042883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200042884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200042884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200042884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:43.878735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25361): Terminating (SIGTERM) 20:00:43.920329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25364): Terminating (SIGTERM) 20:00:43.962207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25367): Terminating (SIGTERM) 20:00:44.004062 --- ParallelTerminationStrategy: PID 25361 died... 20:00:44.024067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25361): Terminated: ok {rc=0} 20:00:44.070543 --- ParallelTerminationStrategy: PID 25364 died... 20:00:44.091609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25364): Terminated: ok {rc=0} 20:00:44.137523 --- ParallelTerminationStrategy: PID 25367 died... 20:00:44.157236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25367): Terminated: ok {rc=0} 20:00:44.245565 bus /sierra_3: Setting Powered False 20:00:45.344581 bus /sierra_3: Setting Powered False 20:00:46.458862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 20:00:47.710536 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:47.715735 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:00:47.779424 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:00:47.806203 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:00:47.862763 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:00:47.926581 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:00:47.953228 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:00:48.498179 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 20:00:48.503612 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:48.514816 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:48.562966 tst handover.py: using LAC 35945 20:00:48.682325 tst handover.py: using RAC 245 20:00:48.811229 tst handover.py: using CellId 35945 20:00:48.939074 tst handover.py: using BVCI 35946 20:00:49.058963 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:00:49.111602 tst handover.py: using LAC 35946 20:00:49.240287 tst handover.py: using RAC 246 20:00:49.370867 tst handover.py: using CellId 35946 20:00:49.499938 tst handover.py: using BVCI 35947 20:00:49.614031 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:49.624854 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:49.635832 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:49.646661 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:49.657879 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:00:49.668840 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:49.794131 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:00:49.914811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:00:50.401293 run create_hlr_db(pid=25373): Launched 20:00:50.535519 bus /sierra_2: Setting Powered False 20:00:51.600730 run create_hlr_db(pid=25373): Terminated: ok {rc=0} 20:00:52.022636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25377): Launched 20:00:52.333555 run osmo-hlr_10.42.42.2(pid=25378): Launched 20:00:52.452358 run osmo-stp_10.42.42.5: Starting osmo-stp 20:00:52.972126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25380): Launched 20:00:53.284673 run osmo-stp_10.42.42.5(pid=25381): Launched 20:00:53.405343 run osmo-msc_10.42.42.6: Starting osmo-msc 20:00:53.942920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25383): Launched 20:00:54.256655 run osmo-msc_10.42.42.6(pid=25384): Launched 20:00:54.432695 run osmo-stp_10.42.42.5(pid=25381): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25381)] 20:00:54.564333 run osmo-stp_10.42.42.5(pid=25381): stdout: | (launched: 2022-12-13_20:00:53.226221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:54.695770 run osmo-stp_10.42.42.5(pid=25381): stderr: | 20221213200053394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200053394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200053395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200053395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200053396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200053396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200053396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:54.825480 run osmo-stp_10.42.42.5(pid=25381): stdout: | (launched: 2022-12-13_20:00:53.226221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:00:54.949892 run osmo-stp_10.42.42.5(pid=25381): stderr: | 20221213200053394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200053394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200053395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200053395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200053396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200053396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200053396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:00:55.098358 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25381): Process ended prematurely: osmo-stp_10.42.42.5(pid=25381) [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25381)] [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 20:00:55.106731 tst handover.py:18: Test FAILED (6.6 sec) 20:00:55.133194 run osmo-hlr_10.42.42.2(pid=25378): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25378)] 20:00:55.182508 run osmo-hlr_10.42.42.2(pid=25378): stdout: | (launched: 2022-12-13_20:00:52.275971) 20:00:55.233341 run osmo-hlr_10.42.42.2(pid=25378): stderr: | 20221213200052451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200052451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200052451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200052452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200052452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200052452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200052463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200052473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200052473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200052473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:00:55.303528 run osmo-msc_10.42.42.6(pid=25384): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25384)] 20:00:55.351966 run osmo-msc_10.42.42.6(pid=25384): stdout: | (launched: 2022-12-13_20:00:54.198910) 20:00:55.402626 run osmo-msc_10.42.42.6(pid=25384): stderr: | 20221213200054469 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200054469 DLGLOBAL DEBUG validating counter group 0x7f20cede0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200054469 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200054469 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200054469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200054470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200054471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200054472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200054472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200054472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:00:55.453441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25377): Terminating (SIGTERM) 20:00:55.493768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25380): Terminating (SIGTERM) 20:00:55.534572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25383): Terminating (SIGTERM) 20:00:55.575202 --- ParallelTerminationStrategy: PID 25377 died... 20:00:55.594842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25377): Terminated: ok {rc=0} 20:00:55.639562 --- ParallelTerminationStrategy: PID 25380 died... 20:00:55.658844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25380): Terminated: ok {rc=0} 20:00:55.703729 --- ParallelTerminationStrategy: PID 25383 died... 20:00:55.723141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25383): Terminated: ok {rc=0} 20:00:55.811097 bus /sierra_3: Setting Powered False 20:00:56.914489 bus /sierra_3: Setting Powered False 20:00:58.035075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 20:00:59.306532 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:00:59.313394 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:00:59.377846 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:00:59.405531 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:00:59.458543 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:00:59.521649 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:00:59.548355 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:01:00.099040 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 20:01:00.104262 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:00.115648 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:00.164227 tst handover.py: using LAC 35947 20:01:00.297138 tst handover.py: using RAC 247 20:01:00.426798 tst handover.py: using CellId 35947 20:01:00.559039 tst handover.py: using BVCI 35948 20:01:00.681335 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:00.730295 tst handover.py: using LAC 35948 20:01:00.859621 tst handover.py: using RAC 248 20:01:01.007366 tst handover.py: using CellId 35948 20:01:01.138140 tst handover.py: using BVCI 35949 20:01:01.278468 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:01.290602 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:01.302730 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:01.314815 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:01.328085 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:01.341125 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:01.467788 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:01.612520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:02.082187 run create_hlr_db(pid=25389): Launched 20:01:02.238233 bus /sierra_2: Setting Powered False 20:01:03.300191 run create_hlr_db(pid=25389): Terminated: ok {rc=0} 20:01:03.706767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Launched 20:01:04.017591 run osmo-hlr_10.42.42.2(pid=25392): Launched 20:01:04.136071 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:04.656441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Launched 20:01:04.966758 run osmo-stp_10.42.42.5(pid=25395): Launched 20:01:05.085379 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:05.617794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Launched 20:01:05.926645 run osmo-msc_10.42.42.6(pid=25398): Launched 20:01:06.099937 run osmo-stp_10.42.42.5(pid=25395): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] 20:01:06.231125 run osmo-stp_10.42.42.5(pid=25395): stdout: | (launched: 2022-12-13_20:01:04.909244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:06.361364 run osmo-stp_10.42.42.5(pid=25395): stderr: | 20221213200105079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200105079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200105080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200105080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200105080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200105081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200105081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:06.489981 run osmo-stp_10.42.42.5(pid=25395): stdout: | (launched: 2022-12-13_20:01:04.909244) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:06.613634 run osmo-stp_10.42.42.5(pid=25395): stderr: | 20221213200105079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200105079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200105080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200105080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200105080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200105081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200105081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:06.760621 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25395): Process ended prematurely: osmo-stp_10.42.42.5(pid=25395) [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 20:01:06.768923 tst handover.py:18: Test FAILED (6.7 sec) 20:01:06.795309 run osmo-hlr_10.42.42.2(pid=25392): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25392)] 20:01:06.844358 run osmo-hlr_10.42.42.2(pid=25392): stdout: | (launched: 2022-12-13_20:01:03.959922) 20:01:06.894766 run osmo-hlr_10.42.42.2(pid=25392): stderr: | 20221213200104135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200104135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200104135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200104135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200104135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200104135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200104147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200104155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200104156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200104156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:06.964481 run osmo-msc_10.42.42.6(pid=25398): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25398)] 20:01:07.012412 run osmo-msc_10.42.42.6(pid=25398): stdout: | (launched: 2022-12-13_20:01:05.869125) 20:01:07.062304 run osmo-msc_10.42.42.6(pid=25398): stderr: | 20221213200106138 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200106138 DLGLOBAL DEBUG validating counter group 0x7ff1f5371c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200106138 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200106138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200106138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200106138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200106140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200106140 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200106141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200106141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:07.112646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Terminating (SIGTERM) 20:01:07.153086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Terminating (SIGTERM) 20:01:07.193873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Terminating (SIGTERM) 20:01:07.234466 --- ParallelTerminationStrategy: PID 25391 died... 20:01:07.254111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Terminated: ok {rc=0} 20:01:07.298768 --- ParallelTerminationStrategy: PID 25394 died... 20:01:07.317996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Terminated: ok {rc=0} 20:01:07.362497 --- ParallelTerminationStrategy: PID 25397 died... 20:01:07.382044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Terminated: ok {rc=0} 20:01:07.470017 bus /sierra_3: Setting Powered False 20:01:08.570250 bus /sierra_3: Setting Powered False 20:01:09.688002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 20:01:10.964124 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:10.970489 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 20:01:11.031486 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 20:01:11.058221 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 20:01:11.112044 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 20:01:11.175491 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 20:01:11.203376 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 20:01:11.755786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 20:01:11.761841 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:11.773953 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:01:11.819553 tst handover.py: using LAC 35949 20:01:11.953827 tst handover.py: using RAC 249 20:01:12.075028 tst handover.py: using CellId 35949 20:01:12.194347 tst handover.py: using BVCI 35950 20:01:12.307828 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 20:01:12.355202 tst handover.py: using LAC 35950 20:01:12.483567 tst handover.py: using RAC 250 20:01:12.611401 tst handover.py: using CellId 35950 20:01:12.738520 tst handover.py: using BVCI 35951 20:01:12.858329 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:12.870118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:12.881747 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:12.893476 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:12.905772 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 20:01:12.917949 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:01:13.037430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 20:01:13.158412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:13.645809 run create_hlr_db(pid=25403): Launched 20:01:13.782545 bus /sierra_2: Setting Powered False 20:01:14.848388 run create_hlr_db(pid=25403): Terminated: ok {rc=0} 20:01:15.281893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Launched 20:01:15.616608 run osmo-hlr_10.42.42.2(pid=25406): Launched 20:01:15.744203 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:16.317620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Launched 20:01:16.651796 run osmo-stp_10.42.42.5(pid=25410): Launched 20:01:16.990833 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:17.625642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25412): Launched 20:01:17.956904 run osmo-msc_10.42.42.6(pid=25413): Launched 20:01:18.143225 run osmo-stp_10.42.42.5(pid=25410): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] 20:01:18.282375 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-13_20:01:16.591547) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:18.421687 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221213200116807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200116807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200116808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200116808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200116809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200116809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200116809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:18.559801 run osmo-stp_10.42.42.5(pid=25410): stdout: | (launched: 2022-12-13_20:01:16.591547) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:18.691696 run osmo-stp_10.42.42.5(pid=25410): stderr: | 20221213200116807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200116807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200116808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200116808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200116809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200116809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200116809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:18.849510 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 20:01:18.858402 tst handover.py:18: Test FAILED (7.1 sec) 20:01:18.885983 run osmo-hlr_10.42.42.2(pid=25406): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25406)] 20:01:18.936423 run osmo-hlr_10.42.42.2(pid=25406): stdout: | (launched: 2022-12-13_20:01:15.555007) 20:01:18.988684 run osmo-hlr_10.42.42.2(pid=25406): stderr: | 20221213200115756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200115756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200115756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200115756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200115756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200115756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200115767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200115776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200115776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200115776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:19.061575 run osmo-msc_10.42.42.6(pid=25413): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25413)] 20:01:19.112134 run osmo-msc_10.42.42.6(pid=25413): stdout: | (launched: 2022-12-13_20:01:17.895678) 20:01:19.163846 run osmo-msc_10.42.42.6(pid=25413): stderr: | 20221213200118216 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200118216 DLGLOBAL DEBUG validating counter group 0x7f25be1bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200118217 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200118217 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200118217 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200118217 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200118219 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200118219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200118219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200118219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:19.216226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Terminating (SIGTERM) 20:01:19.258350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminating (SIGTERM) 20:01:19.300357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25412): Terminating (SIGTERM) 20:01:19.342965 --- ParallelTerminationStrategy: PID 25405 died... 20:01:19.363268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25405): Terminated: ok {rc=0} 20:01:19.409765 --- ParallelTerminationStrategy: PID 25409 died... 20:01:19.429547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25409): Terminated: ok {rc=0} 20:01:19.475567 --- ParallelTerminationStrategy: PID 25412 died... 20:01:19.495313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25412): Terminated: ok {rc=0} 20:01:19.583713 bus /sierra_3: Setting Powered False 20:01:20.682429 bus /sierra_3: Setting Powered False 20:01:21.798126 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 20:01:23.064389 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:23.069685 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:01:23.117416 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:01:23.144021 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:01:23.196977 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:01:23.244477 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:01:23.271134 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:01:23.822008 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 20:01:23.827418 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:23.838762 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:01:23.884256 tst handover.py: using LAC 35951 20:01:24.014427 tst handover.py: using RAC 251 20:01:24.144239 tst handover.py: using CellId 35951 20:01:24.272897 tst handover.py: using BVCI 35952 20:01:24.394571 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 20:01:24.431294 tst handover.py: using LAC 35952 20:01:24.562483 tst handover.py: using RAC 252 20:01:24.693341 tst handover.py: using CellId 35952 20:01:24.825883 tst handover.py: using BVCI 35953 20:01:24.946352 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:24.957988 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:24.969406 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:24.980880 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:24.992504 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:25.003894 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:01:25.120277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 20:01:25.240256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:25.727060 run create_hlr_db(pid=25418): Launched 20:01:25.860349 bus /sierra_2: Setting Powered False 20:01:26.925218 run create_hlr_db(pid=25418): Terminated: ok {rc=0} 20:01:27.356576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Launched 20:01:27.690815 run osmo-hlr_10.42.42.2(pid=25421): Launched 20:01:27.818400 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:28.359787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Launched 20:01:28.693158 run osmo-stp_10.42.42.5(pid=25424): Launched 20:01:28.820022 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:29.389535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25426): Launched 20:01:29.722447 run osmo-msc_10.42.42.6(pid=25427): Launched 20:01:29.908068 run osmo-stp_10.42.42.5(pid=25424): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] 20:01:30.047387 run osmo-stp_10.42.42.5(pid=25424): stdout: | (launched: 2022-12-13_20:01:28.631656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:30.187632 run osmo-stp_10.42.42.5(pid=25424): stderr: | 20221213200128823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200128823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200128823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200128824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200128824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200128824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200128824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:30.325726 run osmo-stp_10.42.42.5(pid=25424): stdout: | (launched: 2022-12-13_20:01:28.631656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:30.457982 run osmo-stp_10.42.42.5(pid=25424): stderr: | 20221213200128823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200128823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200128823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200128824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200128824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200128824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200128824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:30.616429 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25424): Process ended prematurely: osmo-stp_10.42.42.5(pid=25424) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 20:01:30.625627 tst handover.py:18: Test FAILED (6.8 sec) 20:01:30.653362 run osmo-hlr_10.42.42.2(pid=25421): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25421)] 20:01:30.703831 run osmo-hlr_10.42.42.2(pid=25421): stdout: | (launched: 2022-12-13_20:01:27.629812) 20:01:30.755946 run osmo-hlr_10.42.42.2(pid=25421): stderr: | 20221213200127827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200127827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200127827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200127827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200127827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200127827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200127839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200127850 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200127850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200127850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:30.828344 run osmo-msc_10.42.42.6(pid=25427): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25427)] 20:01:30.879391 run osmo-msc_10.42.42.6(pid=25427): stdout: | (launched: 2022-12-13_20:01:29.661433) 20:01:30.932459 run osmo-msc_10.42.42.6(pid=25427): stderr: | 20221213200129981 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200129981 DLGLOBAL DEBUG validating counter group 0x7feb83d9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200129981 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200129981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200129981 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200129981 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200129983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200129983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200129984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200129984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:30.985389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Terminating (SIGTERM) 20:01:31.027929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Terminating (SIGTERM) 20:01:31.070614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25426): Terminating (SIGTERM) 20:01:31.113697 --- ParallelTerminationStrategy: PID 25420 died... 20:01:31.133912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25420): Terminated: ok {rc=0} 20:01:31.181262 --- ParallelTerminationStrategy: PID 25423 died... 20:01:31.201542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25423): Terminated: ok {rc=0} 20:01:31.248455 --- ParallelTerminationStrategy: PID 25426 died... 20:01:31.268835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25426): Terminated: ok {rc=0} 20:01:31.358534 bus /sierra_3: Setting Powered False 20:01:32.456778 bus /sierra_3: Setting Powered False 20:01:33.573125 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 20:01:34.832508 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:34.838356 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:01:34.899505 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:01:34.927108 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:01:34.983168 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:01:35.044233 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:01:35.071045 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:01:35.626803 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 20:01:35.632408 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:35.644231 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:01:35.688814 tst handover.py: using LAC 35953 20:01:35.819467 tst handover.py: using RAC 253 20:01:35.950147 tst handover.py: using CellId 35953 20:01:36.080932 tst handover.py: using BVCI 35954 20:01:36.201737 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:01:36.252757 tst handover.py: using LAC 35954 20:01:36.396054 tst handover.py: using RAC 254 20:01:36.522968 tst handover.py: using CellId 35954 20:01:36.645451 tst handover.py: using BVCI 35955 20:01:36.767086 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:36.778880 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:36.790594 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:36.802190 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:36.813772 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:01:36.825425 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:01:36.943644 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:01:37.065161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:37.552767 run create_hlr_db(pid=25432): Launched 20:01:37.689785 bus /sierra_2: Setting Powered False 20:01:38.755287 run create_hlr_db(pid=25432): Terminated: ok {rc=0} 20:01:39.189878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25434): Launched 20:01:39.524361 run osmo-hlr_10.42.42.2(pid=25435): Launched 20:01:39.653653 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:40.184848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25437): Launched 20:01:40.496317 run osmo-stp_10.42.42.5(pid=25438): Launched 20:01:40.615601 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:41.153199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25440): Launched 20:01:41.465671 run osmo-msc_10.42.42.6(pid=25441): Launched 20:01:41.641941 run osmo-stp_10.42.42.5(pid=25438): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25438)] 20:01:41.774287 run osmo-stp_10.42.42.5(pid=25438): stdout: | (launched: 2022-12-13_20:01:40.438799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:41.905038 run osmo-stp_10.42.42.5(pid=25438): stderr: | 20221213200140607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200140607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200140607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200140607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200140608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200140608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200140608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:42.033881 run osmo-stp_10.42.42.5(pid=25438): stdout: | (launched: 2022-12-13_20:01:40.438799) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:42.157288 run osmo-stp_10.42.42.5(pid=25438): stderr: | 20221213200140607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200140607 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200140607 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200140607 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200140608 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200140608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200140608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:42.304689 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25438): Process ended prematurely: osmo-stp_10.42.42.5(pid=25438) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25438)] [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 20:01:42.313066 tst handover.py:18: Test FAILED (6.7 sec) 20:01:42.339196 run osmo-hlr_10.42.42.2(pid=25435): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25435)] 20:01:42.387162 run osmo-hlr_10.42.42.2(pid=25435): stdout: | (launched: 2022-12-13_20:01:39.462636) 20:01:42.436670 run osmo-hlr_10.42.42.2(pid=25435): stderr: | 20221213200139659 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200139659 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200139659 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200139659 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200139659 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200139659 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200139672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200139682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200139682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200139682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:42.506247 run osmo-msc_10.42.42.6(pid=25441): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25441)] 20:01:42.553756 run osmo-msc_10.42.42.6(pid=25441): stdout: | (launched: 2022-12-13_20:01:41.407848) 20:01:42.602962 run osmo-msc_10.42.42.6(pid=25441): stderr: | 20221213200141680 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200141680 DLGLOBAL DEBUG validating counter group 0x7fc1a7437c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200141680 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200141680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200141680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200141681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200141682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200141683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200141683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200141683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:42.652362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25434): Terminating (SIGTERM) 20:01:42.692193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25437): Terminating (SIGTERM) 20:01:42.731967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25440): Terminating (SIGTERM) 20:01:42.771984 --- ParallelTerminationStrategy: PID 25434 died... 20:01:42.791473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25434): Terminated: ok {rc=0} 20:01:42.835615 --- ParallelTerminationStrategy: PID 25437 died... 20:01:42.854621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25437): Terminated: ok {rc=0} 20:01:42.898737 --- ParallelTerminationStrategy: PID 25440 died... 20:01:42.917680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25440): Terminated: ok {rc=0} 20:01:43.004372 bus /sierra_3: Setting Powered False 20:01:44.104781 bus /sierra_3: Setting Powered False 20:01:45.222671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 20:01:46.507855 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:46.515293 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:01:46.589813 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:01:46.624200 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:01:46.679268 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:01:46.745527 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:01:46.774546 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:01:47.326049 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 20:01:47.331260 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:47.342518 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:47.388296 tst handover.py: using LAC 35955 20:01:47.512857 tst handover.py: using RAC 255 20:01:47.633642 tst handover.py: using CellId 35955 20:01:47.753949 tst handover.py: using BVCI 35956 20:01:47.867526 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:01:47.913488 tst handover.py: using LAC 35956 20:01:48.035636 tst handover.py: using RAC 1 20:01:48.156610 tst handover.py: using CellId 35956 20:01:48.276839 tst handover.py: using BVCI 35957 20:01:48.389114 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:48.400304 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:48.411293 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:48.422339 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:48.433721 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:01:48.445099 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:48.566495 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:01:48.684185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:01:49.140120 run create_hlr_db(pid=25446): Launched 20:01:49.258705 bus /sierra_2: Setting Powered False 20:01:50.320046 run create_hlr_db(pid=25446): Terminated: ok {rc=0} 20:01:50.727406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Launched 20:01:51.040173 run osmo-hlr_10.42.42.2(pid=25449): Launched 20:01:51.158915 run osmo-stp_10.42.42.5: Starting osmo-stp 20:01:51.678125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Launched 20:01:51.989483 run osmo-stp_10.42.42.5(pid=25452): Launched 20:01:52.108180 run osmo-msc_10.42.42.6: Starting osmo-msc 20:01:52.642037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25454): Launched 20:01:52.954448 run osmo-msc_10.42.42.6(pid=25455): Launched 20:01:53.129277 run osmo-stp_10.42.42.5(pid=25452): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] 20:01:53.259637 run osmo-stp_10.42.42.5(pid=25452): stdout: | (launched: 2022-12-13_20:01:51.931419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:53.390102 run osmo-stp_10.42.42.5(pid=25452): stderr: | 20221213200152099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200152099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200152099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200152100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200152100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200152100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200152100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:53.518736 run osmo-stp_10.42.42.5(pid=25452): stdout: | (launched: 2022-12-13_20:01:51.931419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:01:53.641893 run osmo-stp_10.42.42.5(pid=25452): stderr: | 20221213200152099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200152099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200152099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200152100 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200152100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200152100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200152100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:01:53.789462 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25452): Process ended prematurely: osmo-stp_10.42.42.5(pid=25452) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 20:01:53.797866 tst handover.py:18: Test FAILED (6.5 sec) 20:01:53.824445 run osmo-hlr_10.42.42.2(pid=25449): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25449)] 20:01:53.873335 run osmo-hlr_10.42.42.2(pid=25449): stdout: | (launched: 2022-12-13_20:01:50.982597) 20:01:53.923202 run osmo-hlr_10.42.42.2(pid=25449): stderr: | 20221213200151160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200151160 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200151160 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200151160 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200151160 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200151160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200151172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200151180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200151181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200151181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:01:53.993267 run osmo-msc_10.42.42.6(pid=25455): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25455)] 20:01:54.041147 run osmo-msc_10.42.42.6(pid=25455): stdout: | (launched: 2022-12-13_20:01:52.896564) 20:01:54.090943 run osmo-msc_10.42.42.6(pid=25455): stderr: | 20221213200153167 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200153168 DLGLOBAL DEBUG validating counter group 0x7f0b4756cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200153168 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200153168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200153168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200153168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200153170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200153170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200153171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200153171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:01:54.142026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Terminating (SIGTERM) 20:01:54.181809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Terminating (SIGTERM) 20:01:54.221716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25454): Terminating (SIGTERM) 20:01:54.262228 --- ParallelTerminationStrategy: PID 25448 died... 20:01:54.281434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25448): Terminated: ok {rc=0} 20:01:54.326479 --- ParallelTerminationStrategy: PID 25451 died... 20:01:54.345485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25451): Terminated: ok {rc=0} 20:01:54.389736 --- ParallelTerminationStrategy: PID 25454 died... 20:01:54.408838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25454): Terminated: ok {rc=0} 20:01:54.496735 bus /sierra_3: Setting Powered False 20:01:55.597722 bus /sierra_3: Setting Powered False 20:01:56.715134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 20:01:57.982365 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:01:57.987665 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 20:01:58.040228 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 20:01:58.066722 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 20:01:58.120540 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 20:01:58.174374 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 20:01:58.202259 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 20:01:58.753307 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 20:01:58.758761 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:58.770443 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:01:58.822915 tst handover.py: using LAC 35957 20:01:58.953385 tst handover.py: using RAC 2 20:01:59.085167 tst handover.py: using CellId 35957 20:01:59.216641 tst handover.py: using BVCI 35958 20:01:59.336751 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 20:01:59.374347 tst handover.py: using LAC 35958 20:01:59.504887 tst handover.py: using RAC 3 20:01:59.635688 tst handover.py: using CellId 35958 20:01:59.767634 tst handover.py: using BVCI 35959 20:01:59.889520 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:59.901056 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:59.912394 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:59.923742 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:59.935308 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 20:01:59.946893 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:02:00.063242 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 20:02:00.182378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:00.670938 run create_hlr_db(pid=25460): Launched 20:02:00.808031 bus /sierra_2: Setting Powered False 20:02:01.871960 run create_hlr_db(pid=25460): Terminated: ok {rc=0} 20:02:02.313862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25462): Launched 20:02:02.651211 run osmo-hlr_10.42.42.2(pid=25463): Launched 20:02:02.781398 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:03.323484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25465): Launched 20:02:03.658159 run osmo-stp_10.42.42.5(pid=25466): Launched 20:02:03.786065 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:04.355643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25468): Launched 20:02:04.688441 run osmo-msc_10.42.42.6(pid=25469): Launched 20:02:04.874604 run osmo-stp_10.42.42.5(pid=25466): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25466)] 20:02:05.013656 run osmo-stp_10.42.42.5(pid=25466): stdout: | (launched: 2022-12-13_20:02:03.596681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:05.153089 run osmo-stp_10.42.42.5(pid=25466): stderr: | 20221213200203788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200203788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200203788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200203789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200203789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200203789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200203790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:05.291250 run osmo-stp_10.42.42.5(pid=25466): stdout: | (launched: 2022-12-13_20:02:03.596681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:05.423885 run osmo-stp_10.42.42.5(pid=25466): stderr: | 20221213200203788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200203788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200203788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200203789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200203789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200203789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200203790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:05.582787 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25466): Process ended prematurely: osmo-stp_10.42.42.5(pid=25466) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25466)] [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 20:02:05.592079 tst handover.py:18: Test FAILED (6.8 sec) 20:02:05.619903 run osmo-hlr_10.42.42.2(pid=25463): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25463)] 20:02:05.670886 run osmo-hlr_10.42.42.2(pid=25463): stdout: | (launched: 2022-12-13_20:02:02.589836) 20:02:05.723405 run osmo-hlr_10.42.42.2(pid=25463): stderr: | 20221213200202787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200202787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200202787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200202787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200202787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200202787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200202801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200202811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200202812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200202812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:05.795994 run osmo-msc_10.42.42.6(pid=25469): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25469)] 20:02:05.846429 run osmo-msc_10.42.42.6(pid=25469): stdout: | (launched: 2022-12-13_20:02:04.627097) 20:02:05.898465 run osmo-msc_10.42.42.6(pid=25469): stderr: | 20221213200204948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200204948 DLGLOBAL DEBUG validating counter group 0x7f2fa277cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200204949 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200204949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200204949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200204949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200204951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200204951 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200204951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200204951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:05.951036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25462): Terminating (SIGTERM) 20:02:05.993664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25465): Terminating (SIGTERM) 20:02:06.036181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25468): Terminating (SIGTERM) 20:02:06.079318 --- ParallelTerminationStrategy: PID 25462 died... 20:02:06.099997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25462): Terminated: ok {rc=0} 20:02:06.147303 --- ParallelTerminationStrategy: PID 25465 died... 20:02:06.167515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25465): Terminated: ok {rc=0} 20:02:06.214388 --- ParallelTerminationStrategy: PID 25468 died... 20:02:06.234645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25468): Terminated: ok {rc=0} 20:02:06.323646 bus /sierra_3: Setting Powered False 20:02:07.422140 bus /sierra_3: Setting Powered False 20:02:08.535761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 20:02:09.800396 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:09.806269 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:02:09.872837 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:02:09.900742 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:02:09.954378 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:02:10.021973 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:02:10.048856 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:02:10.596633 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 20:02:10.602128 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:10.613450 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:02:10.666152 tst handover.py: using LAC 35959 20:02:10.787448 tst handover.py: using RAC 4 20:02:10.908034 tst handover.py: using CellId 35959 20:02:11.040904 tst handover.py: using BVCI 35960 20:02:11.163222 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:02:11.213020 tst handover.py: using LAC 35960 20:02:11.342403 tst handover.py: using RAC 5 20:02:11.472765 tst handover.py: using CellId 35960 20:02:11.604942 tst handover.py: using BVCI 35961 20:02:11.727067 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:11.738912 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:11.750531 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:11.762233 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:11.774122 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:11.786040 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:02:11.902527 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:02:12.018752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:12.472836 run create_hlr_db(pid=25474): Launched 20:02:12.591941 bus /sierra_2: Setting Powered False 20:02:13.657064 run create_hlr_db(pid=25474): Terminated: ok {rc=0} 20:02:14.073898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Launched 20:02:14.384409 run osmo-hlr_10.42.42.2(pid=25477): Launched 20:02:14.502967 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:15.012393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Launched 20:02:15.323883 run osmo-stp_10.42.42.5(pid=25480): Launched 20:02:15.442429 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:15.999842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25482): Launched 20:02:16.330931 run osmo-msc_10.42.42.6(pid=25483): Launched 20:02:16.795838 run osmo-stp_10.42.42.5(pid=25480): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] 20:02:17.155632 run osmo-stp_10.42.42.5(pid=25480): stdout: | (launched: 2022-12-13_20:02:15.266060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:17.403262 run osmo-stp_10.42.42.5(pid=25480): stderr: | 20221213200215435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200215435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200215435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200215435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200215436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200215436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200215436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:17.543610 run osmo-stp_10.42.42.5(pid=25480): stdout: | (launched: 2022-12-13_20:02:15.266060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:17.676937 run osmo-stp_10.42.42.5(pid=25480): stderr: | 20221213200215435 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200215435 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200215435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200215435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200215436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200215436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200215436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:17.836373 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25480): Process ended prematurely: osmo-stp_10.42.42.5(pid=25480) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 20:02:17.845684 tst handover.py:18: Test FAILED (7.2 sec) 20:02:17.873543 run osmo-hlr_10.42.42.2(pid=25477): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25477)] 20:02:17.925318 run osmo-hlr_10.42.42.2(pid=25477): stdout: | (launched: 2022-12-13_20:02:14.326982) 20:02:17.978249 run osmo-hlr_10.42.42.2(pid=25477): stderr: | 20221213200214504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200214504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200214504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200214504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200214504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200214504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200214515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200214524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200214524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200214525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:18.051545 run osmo-msc_10.42.42.6(pid=25483): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25483)] 20:02:18.102746 run osmo-msc_10.42.42.6(pid=25483): stdout: | (launched: 2022-12-13_20:02:16.271169) 20:02:18.155521 run osmo-msc_10.42.42.6(pid=25483): stderr: | 20221213200217037 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200217037 DLGLOBAL DEBUG validating counter group 0x7f82e2f6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200217037 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200217037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200217038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200217039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200217046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200217047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200217049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200217049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:18.208719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Terminating (SIGTERM) 20:02:18.251186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Terminating (SIGTERM) 20:02:18.293943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25482): Terminating (SIGTERM) 20:02:18.336891 --- ParallelTerminationStrategy: PID 25476 died... 20:02:18.357636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25476): Terminated: ok {rc=0} 20:02:18.404740 --- ParallelTerminationStrategy: PID 25479 died... 20:02:18.425111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25479): Terminated: ok {rc=0} 20:02:18.472514 --- ParallelTerminationStrategy: PID 25482 died... 20:02:18.492692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25482): Terminated: ok {rc=0} 20:02:18.581304 bus /sierra_3: Setting Powered False 20:02:19.681798 bus /sierra_3: Setting Powered False 20:02:20.796932 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 20:02:22.076787 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:22.082142 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:02:22.145628 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:02:22.172213 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:02:22.222823 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:02:22.286787 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:02:22.313485 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:02:22.871947 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 20:02:22.877911 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:22.892478 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:22.945253 tst handover.py: using LAC 35961 20:02:23.066660 tst handover.py: using RAC 6 20:02:23.185661 tst handover.py: using CellId 35961 20:02:23.306890 tst handover.py: using BVCI 35962 20:02:23.420209 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:23.466465 tst handover.py: using LAC 35962 20:02:23.587830 tst handover.py: using RAC 7 20:02:23.707007 tst handover.py: using CellId 35962 20:02:23.827958 tst handover.py: using BVCI 35963 20:02:23.939703 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:23.951050 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:23.962343 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:23.973608 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:23.985502 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:23.997176 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:24.118880 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:24.237173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:24.691659 run create_hlr_db(pid=25488): Launched 20:02:24.809225 bus /sierra_2: Setting Powered False 20:02:25.870640 run create_hlr_db(pid=25488): Terminated: ok {rc=0} 20:02:26.294878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25490): Launched 20:02:26.630405 run osmo-hlr_10.42.42.2(pid=25491): Launched 20:02:26.760817 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:27.307353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25493): Launched 20:02:27.643268 run osmo-stp_10.42.42.5(pid=25494): Launched 20:02:27.773843 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:28.343209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25496): Launched 20:02:28.677444 run osmo-msc_10.42.42.6(pid=25497): Launched 20:02:28.862230 run osmo-stp_10.42.42.5(pid=25494): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25494)] 20:02:29.001746 run osmo-stp_10.42.42.5(pid=25494): stdout: | (launched: 2022-12-13_20:02:27.581634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:29.141449 run osmo-stp_10.42.42.5(pid=25494): stderr: | 20221213200227772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200227772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200227773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200227773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200227774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200227774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200227774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:29.279266 run osmo-stp_10.42.42.5(pid=25494): stdout: | (launched: 2022-12-13_20:02:27.581634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:29.411836 run osmo-stp_10.42.42.5(pid=25494): stderr: | 20221213200227772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200227772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200227773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200227773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200227774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200227774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200227774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:29.570435 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25494): Process ended prematurely: osmo-stp_10.42.42.5(pid=25494) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25494)] [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 20:02:29.579488 tst handover.py:18: Test FAILED (6.7 sec) 20:02:29.607286 run osmo-hlr_10.42.42.2(pid=25491): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25491)] 20:02:29.658124 run osmo-hlr_10.42.42.2(pid=25491): stdout: | (launched: 2022-12-13_20:02:26.568794) 20:02:29.710634 run osmo-hlr_10.42.42.2(pid=25491): stderr: | 20221213200226768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200226768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200226768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200226768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200226768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200226768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200226781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200226791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200226791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200226791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:29.783302 run osmo-msc_10.42.42.6(pid=25497): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25497)] 20:02:29.833737 run osmo-msc_10.42.42.6(pid=25497): stdout: | (launched: 2022-12-13_20:02:28.615859) 20:02:29.885556 run osmo-msc_10.42.42.6(pid=25497): stderr: | 20221213200228938 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200228938 DLGLOBAL DEBUG validating counter group 0x7feb20d3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200228938 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200228938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200228939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200228939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200228941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200228941 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200228941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200228942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:29.937884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25490): Terminating (SIGTERM) 20:02:29.979877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25493): Terminating (SIGTERM) 20:02:30.022069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25496): Terminating (SIGTERM) 20:02:30.064298 --- ParallelTerminationStrategy: PID 25490 died... 20:02:30.084285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25490): Terminated: ok {rc=0} 20:02:30.130903 --- ParallelTerminationStrategy: PID 25493 died... 20:02:30.150641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25493): Terminated: ok {rc=0} 20:02:30.196716 --- ParallelTerminationStrategy: PID 25496 died... 20:02:30.216600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25496): Terminated: ok {rc=0} 20:02:30.305220 bus /sierra_3: Setting Powered False 20:02:31.401196 bus /sierra_3: Setting Powered False 20:02:32.518016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 20:02:33.795327 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:33.800648 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 20:02:33.852409 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 20:02:33.879329 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 20:02:33.929109 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 20:02:33.980107 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 20:02:34.006887 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 20:02:34.562488 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 20:02:34.567876 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:34.579262 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:02:34.613681 tst handover.py: using LAC 35963 20:02:34.733136 tst handover.py: using RAC 8 20:02:34.856447 tst handover.py: using CellId 35963 20:02:34.977413 tst handover.py: using BVCI 35964 20:02:35.089062 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 20:02:35.136046 tst handover.py: using LAC 35964 20:02:35.254524 tst handover.py: using RAC 9 20:02:35.374770 tst handover.py: using CellId 35964 20:02:35.493310 tst handover.py: using BVCI 35965 20:02:35.605133 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:35.616208 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:35.626975 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:35.637720 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:35.648936 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 20:02:35.660268 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:02:35.779703 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 20:02:35.898016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:36.353475 run create_hlr_db(pid=25502): Launched 20:02:36.471778 bus /sierra_2: Setting Powered False 20:02:37.532755 run create_hlr_db(pid=25502): Terminated: ok {rc=0} 20:02:37.959769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25504): Launched 20:02:38.295024 run osmo-hlr_10.42.42.2(pid=25505): Launched 20:02:38.423233 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:38.968032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25507): Launched 20:02:39.301555 run osmo-stp_10.42.42.5(pid=25508): Launched 20:02:39.428442 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:40.000616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25510): Launched 20:02:40.334607 run osmo-msc_10.42.42.6(pid=25511): Launched 20:02:40.520207 run osmo-stp_10.42.42.5(pid=25508): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25508)] 20:02:40.660837 run osmo-stp_10.42.42.5(pid=25508): stdout: | (launched: 2022-12-13_20:02:39.239737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:40.800259 run osmo-stp_10.42.42.5(pid=25508): stderr: | 20221213200239431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200239431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200239431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200239431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200239432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200239432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200239432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:40.938693 run osmo-stp_10.42.42.5(pid=25508): stdout: | (launched: 2022-12-13_20:02:39.239737) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:41.071187 run osmo-stp_10.42.42.5(pid=25508): stderr: | 20221213200239431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200239431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200239431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200239431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200239432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200239432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200239432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:41.229232 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25508): Process ended prematurely: osmo-stp_10.42.42.5(pid=25508) [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25508)] [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 20:02:41.238207 tst handover.py:18: Test FAILED (6.7 sec) 20:02:41.265964 run osmo-hlr_10.42.42.2(pid=25505): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25505)] 20:02:41.316841 run osmo-hlr_10.42.42.2(pid=25505): stdout: | (launched: 2022-12-13_20:02:38.233837) 20:02:41.369697 run osmo-hlr_10.42.42.2(pid=25505): stderr: | 20221213200238430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200238430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200238430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200238430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200238430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200238430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200238445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200238456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200238456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200238456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:41.442961 run osmo-msc_10.42.42.6(pid=25511): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25511)] 20:02:41.493591 run osmo-msc_10.42.42.6(pid=25511): stdout: | (launched: 2022-12-13_20:02:40.273210) 20:02:41.545990 run osmo-msc_10.42.42.6(pid=25511): stderr: | 20221213200240594 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200240594 DLGLOBAL DEBUG validating counter group 0x7fee7e6d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200240595 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200240595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200240595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200240595 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200240597 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200240597 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200240597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200240597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:41.599229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25504): Terminating (SIGTERM) 20:02:41.641682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25507): Terminating (SIGTERM) 20:02:41.684026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25510): Terminating (SIGTERM) 20:02:41.726661 --- ParallelTerminationStrategy: PID 25504 died... 20:02:41.747117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25504): Terminated: ok {rc=0} 20:02:41.794004 --- ParallelTerminationStrategy: PID 25507 died... 20:02:41.813869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25507): Terminated: ok {rc=0} 20:02:41.860911 --- ParallelTerminationStrategy: PID 25510 died... 20:02:41.881326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25510): Terminated: ok {rc=0} 20:02:41.969889 bus /sierra_3: Setting Powered False 20:02:43.071310 bus /sierra_3: Setting Powered False 20:02:44.192069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 20:02:45.446943 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:45.452490 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:02:45.504811 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:02:45.531809 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:02:45.586493 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:02:45.639088 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:02:45.666962 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:02:46.237900 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 20:02:46.246073 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:46.259955 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:46.298240 tst handover.py: using LAC 35965 20:02:46.433148 tst handover.py: using RAC 10 20:02:46.560561 tst handover.py: using CellId 35965 20:02:46.722607 tst handover.py: using BVCI 35966 20:02:46.839027 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:46.889139 tst handover.py: using LAC 35966 20:02:47.039428 tst handover.py: using RAC 11 20:02:47.167376 tst handover.py: using CellId 35966 20:02:47.309906 tst handover.py: using BVCI 35967 20:02:47.431954 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:47.443574 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:47.455005 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:47.466377 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:47.478390 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:47.490095 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:47.607543 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:47.729403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:48.187176 run create_hlr_db(pid=25517): Launched 20:02:48.309501 bus /sierra_2: Setting Powered False 20:02:49.371830 run create_hlr_db(pid=25517): Terminated: ok {rc=0} 20:02:49.779541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25519): Launched 20:02:50.092427 run osmo-hlr_10.42.42.2(pid=25520): Launched 20:02:50.210967 run osmo-stp_10.42.42.5: Starting osmo-stp 20:02:50.722184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25522): Launched 20:02:51.033443 run osmo-stp_10.42.42.5(pid=25523): Launched 20:02:51.151861 run osmo-msc_10.42.42.6: Starting osmo-msc 20:02:51.685536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25525): Launched 20:02:51.996545 run osmo-msc_10.42.42.6(pid=25526): Launched 20:02:52.171738 run osmo-stp_10.42.42.5(pid=25523): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25523)] 20:02:52.303311 run osmo-stp_10.42.42.5(pid=25523): stdout: | (launched: 2022-12-13_20:02:50.975676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:52.434195 run osmo-stp_10.42.42.5(pid=25523): stderr: | 20221213200251143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200251143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200251143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200251144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200251144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200251144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200251144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:52.563603 run osmo-stp_10.42.42.5(pid=25523): stdout: | (launched: 2022-12-13_20:02:50.975676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:02:52.687651 run osmo-stp_10.42.42.5(pid=25523): stderr: | 20221213200251143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200251143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200251143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200251144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200251144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200251144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200251144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:02:52.836447 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25523): Process ended prematurely: osmo-stp_10.42.42.5(pid=25523) [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25523)] [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 20:02:52.844847 tst handover.py:18: Test FAILED (6.6 sec) 20:02:52.871430 run osmo-hlr_10.42.42.2(pid=25520): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25520)] 20:02:52.921185 run osmo-hlr_10.42.42.2(pid=25520): stdout: | (launched: 2022-12-13_20:02:50.034702) 20:02:52.971834 run osmo-hlr_10.42.42.2(pid=25520): stderr: | 20221213200250209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200250209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200250209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200250209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200250209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200250209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200250221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200250229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200250229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200250229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:02:53.042245 run osmo-msc_10.42.42.6(pid=25526): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25526)] 20:02:53.090557 run osmo-msc_10.42.42.6(pid=25526): stdout: | (launched: 2022-12-13_20:02:51.938938) 20:02:53.141107 run osmo-msc_10.42.42.6(pid=25526): stderr: | 20221213200252210 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200252210 DLGLOBAL DEBUG validating counter group 0x7ff7a7d53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200252210 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200252210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200252210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200252210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200252212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200252212 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200252213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200252213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:02:53.191739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25519): Terminating (SIGTERM) 20:02:53.231863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25522): Terminating (SIGTERM) 20:02:53.273107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25525): Terminating (SIGTERM) 20:02:53.314630 --- ParallelTerminationStrategy: PID 25519 died... 20:02:53.334274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25519): Terminated: ok {rc=0} 20:02:53.379182 --- ParallelTerminationStrategy: PID 25522 died... 20:02:53.398403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25522): Terminated: ok {rc=0} 20:02:53.443184 --- ParallelTerminationStrategy: PID 25525 died... 20:02:53.462408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25525): Terminated: ok {rc=0} 20:02:53.547985 bus /sierra_3: Setting Powered False 20:02:54.644060 bus /sierra_3: Setting Powered False 20:02:55.762991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2393 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 20:02:57.016789 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 20:02:57.022237 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 20:02:57.085136 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 20:02:57.112038 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 20:02:57.164653 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 20:02:57.227803 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 20:02:57.254593 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 20:02:57.804803 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2393 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 20:02:57.810399 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:57.821669 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:57.869633 tst handover.py: using LAC 35967 20:02:57.999798 tst handover.py: using RAC 12 20:02:58.129474 tst handover.py: using CellId 35967 20:02:58.259540 tst handover.py: using BVCI 35968 20:02:58.379987 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 20:02:58.428187 tst handover.py: using LAC 35968 20:02:58.549257 tst handover.py: using RAC 13 20:02:58.669259 tst handover.py: using CellId 35968 20:02:58.788894 tst handover.py: using BVCI 35969 20:02:58.901133 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:58.912221 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:58.923363 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:58.934349 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:58.945931 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 20:02:58.957292 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:59.077353 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 20:02:59.198198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 20:02:59.655113 run create_hlr_db(pid=25531): Launched 20:02:59.775946 bus /sierra_2: Setting Powered False 20:03:00.848831 run create_hlr_db(pid=25531): Terminated: ok {rc=0} 20:03:01.339381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25534): Launched 20:03:01.671918 run osmo-hlr_10.42.42.2(pid=25535): Launched 20:03:01.906678 run osmo-stp_10.42.42.5: Starting osmo-stp 20:03:02.597603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25537): Launched 20:03:02.931436 run osmo-stp_10.42.42.5(pid=25538): Launched 20:03:03.059673 run osmo-msc_10.42.42.6: Starting osmo-msc 20:03:03.631078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25540): Launched 20:03:03.964073 run osmo-msc_10.42.42.6(pid=25541): Launched 20:03:04.149552 run osmo-stp_10.42.42.5(pid=25538): ERR: Terminated: ERROR {rc=1} [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25538)] 20:03:04.325364 run osmo-stp_10.42.42.5(pid=25538): stdout: | (launched: 2022-12-13_20:03:02.870199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:04.465137 run osmo-stp_10.42.42.5(pid=25538): stderr: | 20221213200303059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200303059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200303059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200303060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200303060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200303060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200303060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:04.603507 run osmo-stp_10.42.42.5(pid=25538): stdout: | (launched: 2022-12-13_20:03:02.870199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 20:03:04.735770 run osmo-stp_10.42.42.5(pid=25538): stderr: | 20221213200303059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221213200303059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221213200303059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221213200303060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221213200303060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221213200303060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221213200303060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 20:03:04.894301 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=25538): Process ended prematurely: osmo-stp_10.42.42.5(pid=25538) [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25538)] [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 20:03:04.903080 tst handover.py:18: Test FAILED (7.1 sec) 20:03:04.930612 run osmo-hlr_10.42.42.2(pid=25535): ERR: Terminated: ERROR {rc=237} [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25535)] 20:03:04.981388 run osmo-hlr_10.42.42.2(pid=25535): stdout: | (launched: 2022-12-13_20:03:01.612673) 20:03:05.033501 run osmo-hlr_10.42.42.2(pid=25535): stderr: | 20221213200301972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221213200301972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221213200301972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221213200301972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221213200301972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221213200301972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221213200301993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221213200302005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221213200302006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221213200302006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 20:03:05.106145 run osmo-msc_10.42.42.6(pid=25541): ERR: Terminated: ERROR {rc=2} [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25541)] 20:03:05.156560 run osmo-msc_10.42.42.6(pid=25541): stdout: | (launched: 2022-12-13_20:03:03.902526) 20:03:05.208451 run osmo-msc_10.42.42.6(pid=25541): stderr: | 20221213200304222 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221213200304222 DLGLOBAL DEBUG validating counter group 0x7f58b3739c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221213200304223 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221213200304223 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221213200304223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221213200304223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221213200304225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221213200304225 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221213200304225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221213200304225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 20:03:05.260716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25534): Terminating (SIGTERM) 20:03:05.302566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25537): Terminating (SIGTERM) 20:03:05.344556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25540): Terminating (SIGTERM) 20:03:05.386812 --- ParallelTerminationStrategy: PID 25534 died... 20:03:05.406999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25534): Terminated: ok {rc=0} 20:03:05.453373 --- ParallelTerminationStrategy: PID 25537 died... 20:03:05.472787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25537): Terminated: ok {rc=0} 20:03:05.519569 --- ParallelTerminationStrategy: PID 25540 died... 20:03:05.539221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25540): Terminated: ok {rc=0} 20:03:05.627316 bus /sierra_3: Setting Powered False 20:03:06.726494 bus /sierra_3: Setting Powered False 20:03:07.842267 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2393 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 20:03:09.117991 tst trial-2393: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393/run.2022-12-13_18-38-33/trial-2393.xml -------------------------------------------------------------------------------------------- trial-2393 FAIL -------------------------------------------------------------------------------------------- 20:03:11.059555 tst trial-2393: trial-2393: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.2 sec) Error: osmo-nitb_10.42.42.2(pid=18439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18439) [trial-2393↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18439)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.3 sec) Error: osmo-stp_10.42.42.5(pid=18449): Process ended prematurely: osmo-stp_10.42.42.5(pid=18449) [trial-2393↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18449)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=18458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18458) [trial-2393↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18458)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18470): Process ended prematurely: osmo-stp_10.42.42.5(pid=18470) [trial-2393↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18470)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18484): Process ended prematurely: osmo-stp_10.42.42.5(pid=18484) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18484)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18495): Process ended prematurely: osmo-stp_10.42.42.5(pid=18495) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18495)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18509): Process ended prematurely: osmo-stp_10.42.42.5(pid=18509) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18509)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18522): Process ended prematurely: osmo-stp_10.42.42.5(pid=18522) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18522)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18536): Process ended prematurely: osmo-stp_10.42.42.5(pid=18536) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18536)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18547): Process ended prematurely: osmo-stp_10.42.42.5(pid=18547) [trial-2393↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18547)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18561): Process ended prematurely: osmo-stp_10.42.42.5(pid=18561) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18561)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18572): Process ended prematurely: osmo-stp_10.42.42.5(pid=18572) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18572)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18586): Process ended prematurely: osmo-stp_10.42.42.5(pid=18586) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18586)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18597): Process ended prematurely: osmo-stp_10.42.42.5(pid=18597) [trial-2393↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18597)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18611): Process ended prematurely: osmo-stp_10.42.42.5(pid=18611) [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18611)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18622): Process ended prematurely: osmo-stp_10.42.42.5(pid=18622) [trial-2393↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18622)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=18636): Process ended prematurely: osmo-stp_10.42.42.5(pid=18636) [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18636)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=18647): Process ended prematurely: osmo-stp_10.42.42.5(pid=18647) [trial-2393↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18647)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=18661): Process ended prematurely: osmo-stp_10.42.42.5(pid=18661) [trial-2393↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18661)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18672): Process ended prematurely: osmo-stp_10.42.42.5(pid=18672) [trial-2393↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18672)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.7 sec) Error: osmo-stp_10.42.42.5(pid=18691): Process ended prematurely: osmo-stp_10.42.42.5(pid=18691) [trial-2393↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18691)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=18703): Process ended prematurely: osmo-stp_10.42.42.5(pid=18703) [trial-2393↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18703)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=18721): Process ended prematurely: osmo-stp_10.42.42.5(pid=18721) [trial-2393↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18721)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18734): Process ended prematurely: osmo-stp_10.42.42.5(pid=18734) [trial-2393↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18734)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18744): Process ended prematurely: osmo-stp_10.42.42.5(pid=18744) [trial-2393↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18744)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=18763): Process ended prematurely: osmo-stp_10.42.42.5(pid=18763) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18763)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=18775): Process ended prematurely: osmo-stp_10.42.42.5(pid=18775) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18775)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=18796): Process ended prematurely: osmo-stp_10.42.42.5(pid=18796) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18796)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18806): Process ended prematurely: osmo-stp_10.42.42.5(pid=18806) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18806)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18816): Process ended prematurely: osmo-stp_10.42.42.5(pid=18816) [trial-2393↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18816)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=18834): Process ended prematurely: osmo-stp_10.42.42.5(pid=18834) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18834)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=18851): Process ended prematurely: osmo-stp_10.42.42.5(pid=18851) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18851)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=18870): Process ended prematurely: osmo-stp_10.42.42.5(pid=18870) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18870)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18880): Process ended prematurely: osmo-stp_10.42.42.5(pid=18880) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18880)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18890): Process ended prematurely: osmo-stp_10.42.42.5(pid=18890) [trial-2393↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18890)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=18907): Process ended prematurely: osmo-stp_10.42.42.5(pid=18907) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18907)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=18919): Process ended prematurely: osmo-stp_10.42.42.5(pid=18919) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18919)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=18937): Process ended prematurely: osmo-stp_10.42.42.5(pid=18937) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18937)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18947): Process ended prematurely: osmo-stp_10.42.42.5(pid=18947) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18947)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18957): Process ended prematurely: osmo-stp_10.42.42.5(pid=18957) [trial-2393↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18957)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18972): Process ended prematurely: osmo-stp_10.42.42.5(pid=18972) [trial-2393↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18972)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=18985): Process ended prematurely: osmo-stp_10.42.42.5(pid=18985) [trial-2393↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18985)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=18994): Process ended prematurely: osmo-nitb_10.42.42.2(pid=18994) [trial-2393↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=18994)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19004): Process ended prematurely: osmo-stp_10.42.42.5(pid=19004) [trial-2393↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19004)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19013): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19013) [trial-2393↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19013)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19023): Process ended prematurely: osmo-stp_10.42.42.5(pid=19023) [trial-2393↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19023)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19037): Process ended prematurely: osmo-stp_10.42.42.5(pid=19037) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19037)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19048): Process ended prematurely: osmo-stp_10.42.42.5(pid=19048) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19062): Process ended prematurely: osmo-stp_10.42.42.5(pid=19062) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19073): Process ended prematurely: osmo-stp_10.42.42.5(pid=19073) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19073)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2393↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19115): Process ended prematurely: osmo-stp_10.42.42.5(pid=19115) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19115)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19127): Process ended prematurely: osmo-stp_10.42.42.5(pid=19127) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19127)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19145): Process ended prematurely: osmo-stp_10.42.42.5(pid=19145) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19145)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19156): Process ended prematurely: osmo-stp_10.42.42.5(pid=19156) [trial-2393↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19156)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19170): Process ended prematurely: osmo-stp_10.42.42.5(pid=19170) [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19170)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19181): Process ended prematurely: osmo-stp_10.42.42.5(pid=19181) [trial-2393↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19181)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19195): Process ended prematurely: osmo-stp_10.42.42.5(pid=19195) [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19195)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19206): Process ended prematurely: osmo-stp_10.42.42.5(pid=19206) [trial-2393↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19206)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19221): Process ended prematurely: osmo-stp_10.42.42.5(pid=19221) [trial-2393↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19221)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19232): Process ended prematurely: osmo-stp_10.42.42.5(pid=19232) [trial-2393↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19232)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19250): Process ended prematurely: osmo-stp_10.42.42.5(pid=19250) [trial-2393↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19250)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19262): Process ended prematurely: osmo-stp_10.42.42.5(pid=19262) [trial-2393↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19262)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=19280): Process ended prematurely: osmo-stp_10.42.42.5(pid=19280) [trial-2393↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19280)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19290): Process ended prematurely: osmo-stp_10.42.42.5(pid=19290) [trial-2393↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19290)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19300): Process ended prematurely: osmo-stp_10.42.42.5(pid=19300) [trial-2393↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19300)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19317): Process ended prematurely: osmo-stp_10.42.42.5(pid=19317) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19317)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=19329): Process ended prematurely: osmo-stp_10.42.42.5(pid=19329) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19329)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=19361): Process ended prematurely: osmo-stp_10.42.42.5(pid=19361) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19361)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=19631): Process ended prematurely: osmo-stp_10.42.42.5(pid=19631) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19631)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19641): Process ended prematurely: osmo-stp_10.42.42.5(pid=19641) [trial-2393↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19641)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=19658): Process ended prematurely: osmo-stp_10.42.42.5(pid=19658) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19658)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19670): Process ended prematurely: osmo-stp_10.42.42.5(pid=19670) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19670)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=19688): Process ended prematurely: osmo-stp_10.42.42.5(pid=19688) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19688)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19701): Process ended prematurely: osmo-stp_10.42.42.5(pid=19701) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19701)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19711): Process ended prematurely: osmo-stp_10.42.42.5(pid=19711) [trial-2393↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19711)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=19728): Process ended prematurely: osmo-stp_10.42.42.5(pid=19728) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19728)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=19746): Process ended prematurely: osmo-stp_10.42.42.5(pid=19746) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19746)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=19768): Process ended prematurely: osmo-stp_10.42.42.5(pid=19768) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19768)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19780): Process ended prematurely: osmo-stp_10.42.42.5(pid=19780) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19780)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19790): Process ended prematurely: osmo-stp_10.42.42.5(pid=19790) [trial-2393↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19790)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19803): Process ended prematurely: osmo-stp_10.42.42.5(pid=19803) [trial-2393↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19803)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19816): Process ended prematurely: osmo-stp_10.42.42.5(pid=19816) [trial-2393↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19816)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=19824): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19824) [trial-2393↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19824)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19834): Process ended prematurely: osmo-stp_10.42.42.5(pid=19834) [trial-2393↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19834)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=19843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=19843) [trial-2393↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=19843)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=19853): Process ended prematurely: osmo-stp_10.42.42.5(pid=19853) [trial-2393↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19853)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19867): Process ended prematurely: osmo-stp_10.42.42.5(pid=19867) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19867)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19878): Process ended prematurely: osmo-stp_10.42.42.5(pid=19878) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19878)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19892): Process ended prematurely: osmo-stp_10.42.42.5(pid=19892) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19892)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=19903): Process ended prematurely: osmo-stp_10.42.42.5(pid=19903) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19903)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19917): Process ended prematurely: osmo-stp_10.42.42.5(pid=19917) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19917)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=19928): Process ended prematurely: osmo-stp_10.42.42.5(pid=19928) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19928)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19942): Process ended prematurely: osmo-stp_10.42.42.5(pid=19942) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19942)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19953): Process ended prematurely: osmo-stp_10.42.42.5(pid=19953) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19953)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=19967): Process ended prematurely: osmo-stp_10.42.42.5(pid=19967) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19967)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19978): Process ended prematurely: osmo-stp_10.42.42.5(pid=19978) [trial-2393↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19978)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=19992): Process ended prematurely: osmo-stp_10.42.42.5(pid=19992) [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19992)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20004): Process ended prematurely: osmo-stp_10.42.42.5(pid=20004) [trial-2393↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20004)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20019): Process ended prematurely: osmo-stp_10.42.42.5(pid=20019) [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20019)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20030): Process ended prematurely: osmo-stp_10.42.42.5(pid=20030) [trial-2393↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20030)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20044): Process ended prematurely: osmo-stp_10.42.42.5(pid=20044) [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20044)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20058): Process ended prematurely: osmo-stp_10.42.42.5(pid=20058) [trial-2393↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20058)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20073): Process ended prematurely: osmo-stp_10.42.42.5(pid=20073) [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20073)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20084): Process ended prematurely: osmo-stp_10.42.42.5(pid=20084) [trial-2393↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20084)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20099): Process ended prematurely: osmo-stp_10.42.42.5(pid=20099) [trial-2393↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20099)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20110): Process ended prematurely: osmo-stp_10.42.42.5(pid=20110) [trial-2393↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20110)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=20129): Process ended prematurely: osmo-stp_10.42.42.5(pid=20129) [trial-2393↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20129)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=20141): Process ended prematurely: osmo-stp_10.42.42.5(pid=20141) [trial-2393↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20141)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=20159): Process ended prematurely: osmo-stp_10.42.42.5(pid=20159) [trial-2393↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20159)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20169): Process ended prematurely: osmo-stp_10.42.42.5(pid=20169) [trial-2393↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20169)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20179): Process ended prematurely: osmo-stp_10.42.42.5(pid=20179) [trial-2393↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20179)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20196): Process ended prematurely: osmo-stp_10.42.42.5(pid=20196) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20196)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20208): Process ended prematurely: osmo-stp_10.42.42.5(pid=20208) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20208)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=20226): Process ended prematurely: osmo-stp_10.42.42.5(pid=20226) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20226)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20236): Process ended prematurely: osmo-stp_10.42.42.5(pid=20236) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20236)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20246): Process ended prematurely: osmo-stp_10.42.42.5(pid=20246) [trial-2393↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20246)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20279): Process ended prematurely: osmo-stp_10.42.42.5(pid=20279) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20279)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20297): Process ended prematurely: osmo-stp_10.42.42.5(pid=20297) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20297)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20307): Process ended prematurely: osmo-stp_10.42.42.5(pid=20307) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20307)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20317): Process ended prematurely: osmo-stp_10.42.42.5(pid=20317) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20317)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=20334): Process ended prematurely: osmo-stp_10.42.42.5(pid=20334) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20334)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20346): Process ended prematurely: osmo-stp_10.42.42.5(pid=20346) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20364): Process ended prematurely: osmo-stp_10.42.42.5(pid=20364) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20364)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20374): Process ended prematurely: osmo-stp_10.42.42.5(pid=20374) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20374)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20388): Process ended prematurely: osmo-stp_10.42.42.5(pid=20388) [trial-2393↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20388)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20409): Process ended prematurely: osmo-stp_10.42.42.5(pid=20409) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20409)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=20421): Process ended prematurely: osmo-stp_10.42.42.5(pid=20421) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20421)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=20439): Process ended prematurely: osmo-stp_10.42.42.5(pid=20439) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20439)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20449): Process ended prematurely: osmo-stp_10.42.42.5(pid=20449) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20449)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20461): Process ended prematurely: osmo-stp_10.42.42.5(pid=20461) [trial-2393↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20461)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=20474): Process ended prematurely: osmo-stp_10.42.42.5(pid=20474) [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20474)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20488): Process ended prematurely: osmo-stp_10.42.42.5(pid=20488) [trial-2393↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20488)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20496): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20496) [trial-2393↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20496)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20506): Process ended prematurely: osmo-stp_10.42.42.5(pid=20506) [trial-2393↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20506)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20516): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20516) [trial-2393↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20516)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20526): Process ended prematurely: osmo-stp_10.42.42.5(pid=20526) [trial-2393↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20526)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20540): Process ended prematurely: osmo-stp_10.42.42.5(pid=20540) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20540)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20565): Process ended prematurely: osmo-stp_10.42.42.5(pid=20565) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20565)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20576): Process ended prematurely: osmo-stp_10.42.42.5(pid=20576) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20576)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20590): Process ended prematurely: osmo-stp_10.42.42.5(pid=20590) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20590)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20601): Process ended prematurely: osmo-stp_10.42.42.5(pid=20601) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20601)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20615): Process ended prematurely: osmo-stp_10.42.42.5(pid=20615) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20615)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20626): Process ended prematurely: osmo-stp_10.42.42.5(pid=20626) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20640): Process ended prematurely: osmo-stp_10.42.42.5(pid=20640) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20651): Process ended prematurely: osmo-stp_10.42.42.5(pid=20651) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20651)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20668): Process ended prematurely: osmo-stp_10.42.42.5(pid=20668) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20668)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20679): Process ended prematurely: osmo-stp_10.42.42.5(pid=20679) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20679)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=20964): Process ended prematurely: osmo-stp_10.42.42.5(pid=20964) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20964)] FAIL: mo_mt_call_osmux.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=20975): Process ended prematurely: osmo-stp_10.42.42.5(pid=20975) [trial-2393↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20975)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20990): Process ended prematurely: osmo-stp_10.42.42.5(pid=20990) [trial-2393↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20990)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21001): Process ended prematurely: osmo-stp_10.42.42.5(pid=21001) [trial-2393↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21001)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21020): Process ended prematurely: osmo-stp_10.42.42.5(pid=21020) [trial-2393↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21020)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21035): Process ended prematurely: osmo-stp_10.42.42.5(pid=21035) [trial-2393↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21035)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21053): Process ended prematurely: osmo-stp_10.42.42.5(pid=21053) [trial-2393↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21053)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21063): Process ended prematurely: osmo-stp_10.42.42.5(pid=21063) [trial-2393↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21063)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21073): Process ended prematurely: osmo-stp_10.42.42.5(pid=21073) [trial-2393↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21073)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21091): Process ended prematurely: osmo-stp_10.42.42.5(pid=21091) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21091)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21103): Process ended prematurely: osmo-stp_10.42.42.5(pid=21103) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21103)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21121): Process ended prematurely: osmo-stp_10.42.42.5(pid=21121) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21121)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21141): Process ended prematurely: osmo-stp_10.42.42.5(pid=21141) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21141)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21160): Process ended prematurely: osmo-stp_10.42.42.5(pid=21160) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21160)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21172): Process ended prematurely: osmo-stp_10.42.42.5(pid=21172) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21172)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21190): Process ended prematurely: osmo-stp_10.42.42.5(pid=21190) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21190)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21200): Process ended prematurely: osmo-stp_10.42.42.5(pid=21200) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21200)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21210): Process ended prematurely: osmo-stp_10.42.42.5(pid=21210) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21210)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21227): Process ended prematurely: osmo-stp_10.42.42.5(pid=21227) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21227)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=21239): Process ended prematurely: osmo-stp_10.42.42.5(pid=21239) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21239)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21257): Process ended prematurely: osmo-stp_10.42.42.5(pid=21257) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21257)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21277): Process ended prematurely: osmo-stp_10.42.42.5(pid=21277) [trial-2393↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21277)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21290): Process ended prematurely: osmo-stp_10.42.42.5(pid=21290) [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21290)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21305): Process ended prematurely: osmo-stp_10.42.42.5(pid=21305) [trial-2393↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21315): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21315) [trial-2393↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21315)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21325): Process ended prematurely: osmo-stp_10.42.42.5(pid=21325) [trial-2393↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21325)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21335) [trial-2393↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21335)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21345): Process ended prematurely: osmo-stp_10.42.42.5(pid=21345) [trial-2393↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21345)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21359): Process ended prematurely: osmo-stp_10.42.42.5(pid=21359) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21359)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21373): Process ended prematurely: osmo-stp_10.42.42.5(pid=21373) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21387): Process ended prematurely: osmo-stp_10.42.42.5(pid=21387) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21387)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21398): Process ended prematurely: osmo-stp_10.42.42.5(pid=21398) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21398)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21412): Process ended prematurely: osmo-stp_10.42.42.5(pid=21412) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21412)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21423): Process ended prematurely: osmo-stp_10.42.42.5(pid=21423) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21423)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21437): Process ended prematurely: osmo-stp_10.42.42.5(pid=21437) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21437)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21448): Process ended prematurely: osmo-stp_10.42.42.5(pid=21448) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21448)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21463): Process ended prematurely: osmo-stp_10.42.42.5(pid=21463) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21463)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21474): Process ended prematurely: osmo-stp_10.42.42.5(pid=21474) [trial-2393↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21474)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21499): Process ended prematurely: osmo-stp_10.42.42.5(pid=21499) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21499)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21516): Process ended prematurely: osmo-stp_10.42.42.5(pid=21516) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21516)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21527): Process ended prematurely: osmo-stp_10.42.42.5(pid=21527) [trial-2393↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21541): Process ended prematurely: osmo-stp_10.42.42.5(pid=21541) [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21541)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21552): Process ended prematurely: osmo-stp_10.42.42.5(pid=21552) [trial-2393↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21552)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21566): Process ended prematurely: osmo-stp_10.42.42.5(pid=21566) [trial-2393↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21566)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2393↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21597): Process ended prematurely: osmo-stp_10.42.42.5(pid=21597) [trial-2393↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21597)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21609): Process ended prematurely: osmo-stp_10.42.42.5(pid=21609) [trial-2393↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21609)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=21627): Process ended prematurely: osmo-stp_10.42.42.5(pid=21627) [trial-2393↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21627)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21637): Process ended prematurely: osmo-stp_10.42.42.5(pid=21637) [trial-2393↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21637)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21647): Process ended prematurely: osmo-stp_10.42.42.5(pid=21647) [trial-2393↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21647)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21676): Process ended prematurely: osmo-stp_10.42.42.5(pid=21676) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21676)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21694): Process ended prematurely: osmo-stp_10.42.42.5(pid=21694) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21694)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21705): Process ended prematurely: osmo-stp_10.42.42.5(pid=21705) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21705)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21718): Process ended prematurely: osmo-stp_10.42.42.5(pid=21718) [trial-2393↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21718)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21735): Process ended prematurely: osmo-stp_10.42.42.5(pid=21735) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21735)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21747): Process ended prematurely: osmo-stp_10.42.42.5(pid=21747) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21747)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21765): Process ended prematurely: osmo-stp_10.42.42.5(pid=21765) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21765)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21781): Process ended prematurely: osmo-stp_10.42.42.5(pid=21781) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21781)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21791): Process ended prematurely: osmo-stp_10.42.42.5(pid=21791) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21791)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21808): Process ended prematurely: osmo-stp_10.42.42.5(pid=21808) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21808)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21820): Process ended prematurely: osmo-stp_10.42.42.5(pid=21820) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21820)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21838): Process ended prematurely: osmo-stp_10.42.42.5(pid=21838) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21838)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21848): Process ended prematurely: osmo-stp_10.42.42.5(pid=21848) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21848)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21858): Process ended prematurely: osmo-stp_10.42.42.5(pid=21858) [trial-2393↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21858)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=21875): Process ended prematurely: osmo-stp_10.42.42.5(pid=21875) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21875)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21887): Process ended prematurely: osmo-stp_10.42.42.5(pid=21887) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21887)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21905): Process ended prematurely: osmo-stp_10.42.42.5(pid=21905) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21905)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21920): Process ended prematurely: osmo-stp_10.42.42.5(pid=21920) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21920)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21930): Process ended prematurely: osmo-stp_10.42.42.5(pid=21930) [trial-2393↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21930)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21943): Process ended prematurely: osmo-stp_10.42.42.5(pid=21943) [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21943)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21956): Process ended prematurely: osmo-stp_10.42.42.5(pid=21956) [trial-2393↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21956)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21964): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21964) [trial-2393↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21964)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21974): Process ended prematurely: osmo-stp_10.42.42.5(pid=21974) [trial-2393↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21974)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=21983): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21983) [trial-2393↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21983)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21994): Process ended prematurely: osmo-stp_10.42.42.5(pid=21994) [trial-2393↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21994)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22281): Process ended prematurely: osmo-stp_10.42.42.5(pid=22281) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22281)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22292): Process ended prematurely: osmo-stp_10.42.42.5(pid=22292) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22292)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22306): Process ended prematurely: osmo-stp_10.42.42.5(pid=22306) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22306)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22317): Process ended prematurely: osmo-stp_10.42.42.5(pid=22317) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22317)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22332): Process ended prematurely: osmo-stp_10.42.42.5(pid=22332) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22332)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22347): Process ended prematurely: osmo-stp_10.42.42.5(pid=22347) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22347)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22361): Process ended prematurely: osmo-stp_10.42.42.5(pid=22361) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22361)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22372): Process ended prematurely: osmo-stp_10.42.42.5(pid=22372) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22372)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22386): Process ended prematurely: osmo-stp_10.42.42.5(pid=22386) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22386)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22397): Process ended prematurely: osmo-stp_10.42.42.5(pid=22397) [trial-2393↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22397)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22412): Process ended prematurely: osmo-stp_10.42.42.5(pid=22412) [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22412)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22423): Process ended prematurely: osmo-stp_10.42.42.5(pid=22423) [trial-2393↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22423)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22448): Process ended prematurely: osmo-stp_10.42.42.5(pid=22448) [trial-2393↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22448)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22463): Process ended prematurely: osmo-stp_10.42.42.5(pid=22463) [trial-2393↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22463)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22474): Process ended prematurely: osmo-stp_10.42.42.5(pid=22474) [trial-2393↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22474)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22492): Process ended prematurely: osmo-stp_10.42.42.5(pid=22492) [trial-2393↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22492)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22504): Process ended prematurely: osmo-stp_10.42.42.5(pid=22504) [trial-2393↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22504)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22522): Process ended prematurely: osmo-stp_10.42.42.5(pid=22522) [trial-2393↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22522)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22532): Process ended prematurely: osmo-stp_10.42.42.5(pid=22532) [trial-2393↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22532)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22542): Process ended prematurely: osmo-stp_10.42.42.5(pid=22542) [trial-2393↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22542)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22561): Process ended prematurely: osmo-stp_10.42.42.5(pid=22561) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22561)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22573): Process ended prematurely: osmo-stp_10.42.42.5(pid=22573) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22573)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=22591): Process ended prematurely: osmo-stp_10.42.42.5(pid=22591) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22591)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22601): Process ended prematurely: osmo-stp_10.42.42.5(pid=22601) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22601)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22611): Process ended prematurely: osmo-stp_10.42.42.5(pid=22611) [trial-2393↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22611)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22630): Process ended prematurely: osmo-stp_10.42.42.5(pid=22630) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22630)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22660): Process ended prematurely: osmo-stp_10.42.42.5(pid=22660) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22660)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22670): Process ended prematurely: osmo-stp_10.42.42.5(pid=22670) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22670)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22680): Process ended prematurely: osmo-stp_10.42.42.5(pid=22680) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22680)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22703): Process ended prematurely: osmo-stp_10.42.42.5(pid=22703) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22703)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22715): Process ended prematurely: osmo-stp_10.42.42.5(pid=22715) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22715)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22733): Process ended prematurely: osmo-stp_10.42.42.5(pid=22733) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22733)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22744): Process ended prematurely: osmo-stp_10.42.42.5(pid=22744) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22744)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22754): Process ended prematurely: osmo-stp_10.42.42.5(pid=22754) [trial-2393↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22754)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22768): Process ended prematurely: osmo-stp_10.42.42.5(pid=22768) [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22768)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22781): Process ended prematurely: osmo-stp_10.42.42.5(pid=22781) [trial-2393↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22781)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22789): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22789) [trial-2393↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22789)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22799): Process ended prematurely: osmo-stp_10.42.42.5(pid=22799) [trial-2393↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22799)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22808): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22808) [trial-2393↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22808)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=22818): Process ended prematurely: osmo-stp_10.42.42.5(pid=22818) [trial-2393↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22818)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22832): Process ended prematurely: osmo-stp_10.42.42.5(pid=22832) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22832)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22843): Process ended prematurely: osmo-stp_10.42.42.5(pid=22843) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22843)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22857): Process ended prematurely: osmo-stp_10.42.42.5(pid=22857) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22857)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22869): Process ended prematurely: osmo-stp_10.42.42.5(pid=22869) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22883): Process ended prematurely: osmo-stp_10.42.42.5(pid=22883) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22883)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22894): Process ended prematurely: osmo-stp_10.42.42.5(pid=22894) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22894)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22909): Process ended prematurely: osmo-stp_10.42.42.5(pid=22909) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22909)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22920): Process ended prematurely: osmo-stp_10.42.42.5(pid=22920) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22920)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22934): Process ended prematurely: osmo-stp_10.42.42.5(pid=22934) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22934)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22945): Process ended prematurely: osmo-stp_10.42.42.5(pid=22945) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22945)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22960): Process ended prematurely: osmo-stp_10.42.42.5(pid=22960) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22960)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22971): Process ended prematurely: osmo-stp_10.42.42.5(pid=22971) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22985): Process ended prematurely: osmo-stp_10.42.42.5(pid=22985) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22985)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22996): Process ended prematurely: osmo-stp_10.42.42.5(pid=22996) [trial-2393↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22996)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23010): Process ended prematurely: osmo-stp_10.42.42.5(pid=23010) [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23010)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2393↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23043): Process ended prematurely: osmo-stp_10.42.42.5(pid=23043) [trial-2393↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23043)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23055): Process ended prematurely: osmo-stp_10.42.42.5(pid=23055) [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23055)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=23074): Process ended prematurely: osmo-stp_10.42.42.5(pid=23074) [trial-2393↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23074)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23084): Process ended prematurely: osmo-stp_10.42.42.5(pid=23084) [trial-2393↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23084)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23096): Process ended prematurely: osmo-stp_10.42.42.5(pid=23096) [trial-2393↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23096)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23113): Process ended prematurely: osmo-stp_10.42.42.5(pid=23113) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23113)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23125): Process ended prematurely: osmo-stp_10.42.42.5(pid=23125) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23125)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23163): Process ended prematurely: osmo-stp_10.42.42.5(pid=23163) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23163)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23180): Process ended prematurely: osmo-stp_10.42.42.5(pid=23180) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23180)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23192): Process ended prematurely: osmo-stp_10.42.42.5(pid=23192) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23192)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23210): Process ended prematurely: osmo-stp_10.42.42.5(pid=23210) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23210)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23220): Process ended prematurely: osmo-stp_10.42.42.5(pid=23220) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23220)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23230): Process ended prematurely: osmo-stp_10.42.42.5(pid=23230) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23230)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23248): Process ended prematurely: osmo-stp_10.42.42.5(pid=23248) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23260): Process ended prematurely: osmo-stp_10.42.42.5(pid=23260) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23260)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23278): Process ended prematurely: osmo-stp_10.42.42.5(pid=23278) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23278)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23288): Process ended prematurely: osmo-stp_10.42.42.5(pid=23288) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23288)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23298): Process ended prematurely: osmo-stp_10.42.42.5(pid=23298) [trial-2393↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23312): Process ended prematurely: osmo-stp_10.42.42.5(pid=23312) [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23312)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23598): Process ended prematurely: osmo-stp_10.42.42.5(pid=23598) [trial-2393↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23598)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=23606): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23606) [trial-2393↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23606)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23618): Process ended prematurely: osmo-stp_10.42.42.5(pid=23618) [trial-2393↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23618)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23627): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23627) [trial-2393↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23627)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23637): Process ended prematurely: osmo-stp_10.42.42.5(pid=23637) [trial-2393↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23637)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23651): Process ended prematurely: osmo-stp_10.42.42.5(pid=23651) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23651)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23665): Process ended prematurely: osmo-stp_10.42.42.5(pid=23665) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23665)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23679): Process ended prematurely: osmo-stp_10.42.42.5(pid=23679) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23679)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23690): Process ended prematurely: osmo-stp_10.42.42.5(pid=23690) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23690)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23706): Process ended prematurely: osmo-stp_10.42.42.5(pid=23706) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23706)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23717): Process ended prematurely: osmo-stp_10.42.42.5(pid=23717) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23717)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23733): Process ended prematurely: osmo-stp_10.42.42.5(pid=23733) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23733)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23744): Process ended prematurely: osmo-stp_10.42.42.5(pid=23744) [trial-2393↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23744)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23758): Process ended prematurely: osmo-stp_10.42.42.5(pid=23758) [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23758)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23769): Process ended prematurely: osmo-stp_10.42.42.5(pid=23769) [trial-2393↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23769)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23783): Process ended prematurely: osmo-stp_10.42.42.5(pid=23783) [trial-2393↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23783)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23794): Process ended prematurely: osmo-stp_10.42.42.5(pid=23794) [trial-2393↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23794)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23815): Process ended prematurely: osmo-stp_10.42.42.5(pid=23815) [trial-2393↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23815)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=23827): Process ended prematurely: osmo-stp_10.42.42.5(pid=23827) [trial-2393↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23827)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23845): Process ended prematurely: osmo-stp_10.42.42.5(pid=23845) [trial-2393↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23845)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23855): Process ended prematurely: osmo-stp_10.42.42.5(pid=23855) [trial-2393↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23855)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23865): Process ended prematurely: osmo-stp_10.42.42.5(pid=23865) [trial-2393↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23865)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23883): Process ended prematurely: osmo-stp_10.42.42.5(pid=23883) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23883)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23895): Process ended prematurely: osmo-stp_10.42.42.5(pid=23895) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23895)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23913): Process ended prematurely: osmo-stp_10.42.42.5(pid=23913) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23913)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23923): Process ended prematurely: osmo-stp_10.42.42.5(pid=23923) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23923)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23933): Process ended prematurely: osmo-stp_10.42.42.5(pid=23933) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23933)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23951): Process ended prematurely: osmo-stp_10.42.42.5(pid=23951) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23951)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23963): Process ended prematurely: osmo-stp_10.42.42.5(pid=23963) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23963)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=23982): Process ended prematurely: osmo-stp_10.42.42.5(pid=23982) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23992): Process ended prematurely: osmo-stp_10.42.42.5(pid=23992) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23992)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24002): Process ended prematurely: osmo-stp_10.42.42.5(pid=24002) [trial-2393↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24002)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24018): Process ended prematurely: osmo-stp_10.42.42.5(pid=24018) [trial-2393↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24018)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24031): Process ended prematurely: osmo-stp_10.42.42.5(pid=24031) [trial-2393↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24031)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24040): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24040) [trial-2393↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24040)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24052): Process ended prematurely: osmo-stp_10.42.42.5(pid=24052) [trial-2393↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24052)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24066): Process ended prematurely: osmo-stp_10.42.42.5(pid=24066) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24066)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24078): Process ended prematurely: osmo-stp_10.42.42.5(pid=24078) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24078)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24092): Process ended prematurely: osmo-stp_10.42.42.5(pid=24092) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24092)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24103): Process ended prematurely: osmo-stp_10.42.42.5(pid=24103) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24103)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24117): Process ended prematurely: osmo-stp_10.42.42.5(pid=24117) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24117)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24128): Process ended prematurely: osmo-stp_10.42.42.5(pid=24128) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24128)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24142): Process ended prematurely: osmo-stp_10.42.42.5(pid=24142) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24142)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24153): Process ended prematurely: osmo-stp_10.42.42.5(pid=24153) [trial-2393↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24168): Process ended prematurely: osmo-stp_10.42.42.5(pid=24168) [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24168)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24179): Process ended prematurely: osmo-stp_10.42.42.5(pid=24179) [trial-2393↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24179)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24193): Process ended prematurely: osmo-stp_10.42.42.5(pid=24193) [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24193)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24204): Process ended prematurely: osmo-stp_10.42.42.5(pid=24204) [trial-2393↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24204)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24218): Process ended prematurely: osmo-stp_10.42.42.5(pid=24218) [trial-2393↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24218)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24229): Process ended prematurely: osmo-stp_10.42.42.5(pid=24229) [trial-2393↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24229)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24247): Process ended prematurely: osmo-stp_10.42.42.5(pid=24247) [trial-2393↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24247)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24259): Process ended prematurely: osmo-stp_10.42.42.5(pid=24259) [trial-2393↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24259)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=24277): Process ended prematurely: osmo-stp_10.42.42.5(pid=24277) [trial-2393↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24277)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24287): Process ended prematurely: osmo-stp_10.42.42.5(pid=24287) [trial-2393↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24287)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24297): Process ended prematurely: osmo-stp_10.42.42.5(pid=24297) [trial-2393↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24297)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24316): Process ended prematurely: osmo-stp_10.42.42.5(pid=24316) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24316)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24328): Process ended prematurely: osmo-stp_10.42.42.5(pid=24328) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24328)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24346): Process ended prematurely: osmo-stp_10.42.42.5(pid=24346) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24357): Process ended prematurely: osmo-stp_10.42.42.5(pid=24357) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24357)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24370): Process ended prematurely: osmo-stp_10.42.42.5(pid=24370) [trial-2393↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24370)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24388): Process ended prematurely: osmo-stp_10.42.42.5(pid=24388) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24388)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24400): Process ended prematurely: osmo-stp_10.42.42.5(pid=24400) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24400)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24429): Process ended prematurely: osmo-stp_10.42.42.5(pid=24429) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24429)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24439): Process ended prematurely: osmo-stp_10.42.42.5(pid=24439) [trial-2393↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24439)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24458): Process ended prematurely: osmo-stp_10.42.42.5(pid=24458) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24458)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=24470): Process ended prematurely: osmo-stp_10.42.42.5(pid=24470) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24470)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24488): Process ended prematurely: osmo-stp_10.42.42.5(pid=24488) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24498): Process ended prematurely: osmo-stp_10.42.42.5(pid=24498) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24508): Process ended prematurely: osmo-stp_10.42.42.5(pid=24508) [trial-2393↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24521): Process ended prematurely: osmo-stp_10.42.42.5(pid=24521) [trial-2393↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24521)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=24529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24529) [trial-2393↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24529)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=24531): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24531) [trial-2393↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24531)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=24533): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24533) [trial-2393↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24533)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24535): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24535) [trial-2393↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24535)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.5 sec) Error: osmo-hlr_10.42.42.2(pid=24545): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24545) [trial-2393↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24545)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=24556): Process ended prematurely: osmo-hlr_10.42.42.2(pid=24556) [trial-2393↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24556)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24568): Process ended prematurely: osmo-stp_10.42.42.5(pid=24568) [trial-2393↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24568)] FAIL: esme_ms_sms_transaction.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24579): Process ended prematurely: osmo-stp_10.42.42.5(pid=24579) [trial-2393↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24579)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24593): Process ended prematurely: osmo-stp_10.42.42.5(pid=24593) [trial-2393↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24593)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24604): Process ended prematurely: osmo-stp_10.42.42.5(pid=24604) [trial-2393↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24604)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2393↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24626): Process ended prematurely: osmo-stp_10.42.42.5(pid=24626) [trial-2393↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.7 sec) Error: srsepc(pid=24646): Process ended prematurely: srsepc(pid=24646) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24646)] FAIL: iperf3_bidir.py (20.1 sec) Error: srsepc(pid=24934): Process ended prematurely: srsepc(pid=24934) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24934)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=24950): Process ended prematurely: srsepc(pid=24950) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24950)] FAIL: iperf3_ul.py (19.3 sec) Error: srsepc(pid=24969): Process ended prematurely: srsepc(pid=24969) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24969)] FAIL: ping.py (18.7 sec) Error: srsepc(pid=24985): Process ended prematurely: srsepc(pid=24985) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=24985)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=25001): Process ended prematurely: srsepc(pid=25001) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25001)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=25020): Process ended prematurely: srsepc(pid=25020) [trial-2393↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=25020)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2393↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25049): Process ended prematurely: osmo-stp_10.42.42.5(pid=25049) [trial-2393↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25049)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25063): Process ended prematurely: osmo-stp_10.42.42.5(pid=25063) [trial-2393↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25063)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2393↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25091): Process ended prematurely: osmo-stp_10.42.42.5(pid=25091) [trial-2393↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25091)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25105): Process ended prematurely: osmo-stp_10.42.42.5(pid=25105) [trial-2393↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25119): Process ended prematurely: osmo-stp_10.42.42.5(pid=25119) [trial-2393↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25133): Process ended prematurely: osmo-stp_10.42.42.5(pid=25133) [trial-2393↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25133)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=25147): Process ended prematurely: osmo-stp_10.42.42.5(pid=25147) [trial-2393↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25161): Process ended prematurely: osmo-stp_10.42.42.5(pid=25161) [trial-2393↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25175): Process ended prematurely: osmo-stp_10.42.42.5(pid=25175) [trial-2393↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25175)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25190): Process ended prematurely: osmo-stp_10.42.42.5(pid=25190) [trial-2393↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25204): Process ended prematurely: osmo-stp_10.42.42.5(pid=25204) [trial-2393↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25204)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25219): Process ended prematurely: osmo-stp_10.42.42.5(pid=25219) [trial-2393↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25219)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25233): Process ended prematurely: osmo-stp_10.42.42.5(pid=25233) [trial-2393↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25233)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25248): Process ended prematurely: osmo-stp_10.42.42.5(pid=25248) [trial-2393↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25248)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25262): Process ended prematurely: osmo-stp_10.42.42.5(pid=25262) [trial-2393↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25277): Process ended prematurely: osmo-stp_10.42.42.5(pid=25277) [trial-2393↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25291): Process ended prematurely: osmo-stp_10.42.42.5(pid=25291) [trial-2393↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25291)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25306): Process ended prematurely: osmo-stp_10.42.42.5(pid=25306) [trial-2393↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25306)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2393↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25337): Process ended prematurely: osmo-stp_10.42.42.5(pid=25337) [trial-2393↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25337)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25351): Process ended prematurely: osmo-stp_10.42.42.5(pid=25351) [trial-2393↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25351)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25365): Process ended prematurely: osmo-stp_10.42.42.5(pid=25365) [trial-2393↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25365)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25381): Process ended prematurely: osmo-stp_10.42.42.5(pid=25381) [trial-2393↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25381)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25395): Process ended prematurely: osmo-stp_10.42.42.5(pid=25395) [trial-2393↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25410): Process ended prematurely: osmo-stp_10.42.42.5(pid=25410) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25410)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25424): Process ended prematurely: osmo-stp_10.42.42.5(pid=25424) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25424)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25438): Process ended prematurely: osmo-stp_10.42.42.5(pid=25438) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25438)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25452): Process ended prematurely: osmo-stp_10.42.42.5(pid=25452) [trial-2393↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25452)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25466): Process ended prematurely: osmo-stp_10.42.42.5(pid=25466) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25466)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=25480): Process ended prematurely: osmo-stp_10.42.42.5(pid=25480) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25480)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25494): Process ended prematurely: osmo-stp_10.42.42.5(pid=25494) [trial-2393↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25494)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25508): Process ended prematurely: osmo-stp_10.42.42.5(pid=25508) [trial-2393↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25508)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25523): Process ended prematurely: osmo-stp_10.42.42.5(pid=25523) [trial-2393↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25523)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=25538): Process ended prematurely: osmo-stp_10.42.42.5(pid=25538) [trial-2393↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25538)] + rm -rf trial-2393/inst + cd trial-2393 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-13 18:38:21 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393-run.tgz run.2022-12-13_18-38-33 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2393-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17681.tgz osmo-bts-oc2g.build-5537.tgz osmo-bts-sysmo.build-8041.tgz osmo-bts.build-7510.tgz osmo-ggsn.build-6690.tgz osmo-hlr.build-8715.tgz osmo-hnbgw.build-2987.tgz osmo-mgw.build-8960.tgz osmo-msc.build-29307.tgz osmo-nitb.build-12990.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30091.tgz osmo-stp.build-9256.tgz osmo-trx.build-4683.tgz osmocom-bb.build-4710.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE